Found Description
Job Description
ROLE:
We are seeking an experienced Senior Data Engineer to join our data engineering team. In this role, you will design, develop, and optimize large-scale data pipelines and architectures using modern cloud technologies. You will work with cross-functional teams to build robust ETL/ELT solutions, manage data lakes and lakehouses, and ensure high-performance data processing systems that support critical business intelligence and analytics initiatives.
Key Responsibilities
- Design and implement scalable data pipelines using Azure Data Factory and Azure Databricks
- Develop and optimize ETL/ELT processes for large-scale distributed data processing
- Build and maintain data lake and lakehouse architectures on Azure cloud platform
- Write efficient SQL and PySpark code for data transformation and analysis
- Implement Lakeflow Declara...