Found Description
Responsibilities
- Architect and implement a centralized data platform on Databricks
- Design data models and unified schemas across multiple product lines
- Implement multi-catalog governance strategy using Unity Catalog
- Optimize Delta Lake performance through Z-ordering, compaction, and liquid clustering
- Build declarative ETL pipeline frameworks using Delta Live Tables
- Integrate third-party data sources like ERP systems and external providers
- Implement cost monitoring, data quality frameworks, and self-service patterns
Requirements
- 5-8 years in data engineering or data platform roles
- 3+ years hands-on Databricks experience
- Expertise in Unity Catalog, Delta Lake, and Delta Live Tables
- Proficiency in PySpark and Databricks SQL
- Experience with AWS (S3, IAM, VPC)
- Infrastructure-as-code experience, preferably with Terraform
- Proven track reco...