Found Description
KPI Partners is seeking a skilled and motivated Databricks Engineer to join our dynamic team. As a Databricks Engineer, you will play a crucial role in designing, implementing, and optimizing data solutions using Databricks and Airflow. Your expertise will help drive data analytics initiatives and enhance our data-driven decision-making capabilities.
Key Responsibilities:
- Design and develop scalable data pipelines utilizing Databricks to process and analyze large datasets.
- Implement and manage workflow orchestration using Airflow.
- Collaborate with data scientists, analysts, and other stakeholders to define data requirements and ensure the availability of high-quality data.
- Optimize data workflows and ETL processes for efficiency and performance.
- Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal downtime.
- Maintain documentation related to data architecture and...