Found Description
Join our team as a Data Pipeline Developer focusing on Azure ADF and Databricks. Design cutting-edge data workflows and ensure system performance in a cloud environment.
This position involves crafting, developing, and maintaining robust data pipelines on Azure. Key responsibilities include utilizing Spark SQL for processing and ensuring data quality across Azure SQL integrations. You will troubleshoot and resolve any issues related to pipelines or clusters, closely working with DevOps teams to utilize Azure DevOps, Git, and CI/CD methodologies effectively.
Key Responsibilities: • Develop and maintain data pipelines in Azure using ADF and Databricks • Execute ETL/ELT workflows for data transformation • Monitor and address troubleshooting for pipeline failures • Work with Azure DevOps and CI/CD to enhance operations • Optimize data processing performance for efficiency
Requirements: • Strong experience with Azure Data Factory (ADF) and Databricks • Knowledgeab...
This position involves crafting, developing, and maintaining robust data pipelines on Azure. Key responsibilities include utilizing Spark SQL for processing and ensuring data quality across Azure SQL integrations. You will troubleshoot and resolve any issues related to pipelines or clusters, closely working with DevOps teams to utilize Azure DevOps, Git, and CI/CD methodologies effectively.
Key Responsibilities: • Develop and maintain data pipelines in Azure using ADF and Databricks • Execute ETL/ELT workflows for data transformation • Monitor and address troubleshooting for pipeline failures • Work with Azure DevOps and CI/CD to enhance operations • Optimize data processing performance for efficiency
Requirements: • Strong experience with Azure Data Factory (ADF) and Databricks • Knowledgeab...
Ready to Apply?
Submit your application for Data Pipeline Developer: Azure ADF & Databricks at Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Apply Now