Found Description
We are looking for a Data Engineer (specialized in Databricks) with 3-6 years of experience who can go beyond building pipelines — someone who translates analytics logic into reusable, governed data products.
The role is for a Healthcare consulting MNC, so pharma domain experience will be a huge plus.
Experience: 3-6 years
Location: Gurgaon
Cloud Platform: AWS
Mandatory Requirements
- Strong hands-on experience with Databricks — Workflows, Notebooks, Jobs, Delta Lake. Familiarity with Unity Catalog is a plus.
- Deep expertise in Python and PySpark — beyond basic transformations: complex joins, windowing functions, UDFs, and optimization techniques.
- Proven experience in Apache Spark performance tuning — partitioning, caching, skew handling, query optimization....