Data Engineer

Job Description:

• Design, develop, and maintain batch and real-time data pipelines using Apache Spark, PySpark, Databricks, and Azure Data Factory.

• Build and manage scalable data lake and data warehouse solutions using Delta Lake, Parquet, and modern data storage architectures.

• Optimize large-scale data processing workloads through query tuning, partitioning, caching, and performance enhanc...