Lead Data Platform Engineer (OpenSearch)

**Position:**
Lead Data Platform Engineer (OpenSearch)

**Job Description:**

**Role: Lead Data Platform Engineer (AWS | Kafka | OpenSearch)**

**Preferred Location: Ahmedabad, Pune, Indore**

**Years of Experience: 08 – 12 years**

**Notice Period – 0-30 Days (Preferred)**

**Introduction**
Our team builds a data platform that reliably collects, processes, and retrieves large-scale IoT data based on AWS. We are seeking senior engineer who can design unobstructed flow even among billions of data records, push data storage performance to the limit, and technically lead service growth.

**Key Responsibilities**

+ **High-availability data pipeline design:** AWS MSK (Kafka), end-to-end data streaming architecture design and operation using Logstash
+ **Storage optimization and sharding strategies:** Optimizing large-scale search performance through **OpenSearch's index design, sharding, and lifecycle (ISM) manag...