Found Description
Seaspan Corporation is seeking a Databricks Developer with strong expertise in Azure services and data pipelines. This role will implement robust data solutions leveraging Databricks and Apache Spark for enterprise needs.
As a key member of the Data Development team, you will have 5+ years of experience building ETL/ELT pipelines and optimizing data workflows. This position requires proficiency in SQL, Python, and a solid understanding of Delta Lake architecture to streamline data processing initiatives. You will collaborate with various data professionals to ensure high-quality datasets across the organization.
Key Responsibilities:
• Build scalable data pipelines using Databricks
• Develop efficient ETL/ELT processes with ADF and notebooks
• Integrate large datasets into unified analytics-ready outputs
• Optimize data processing techniques in Spark jobs
• Perform data quality checks and validation
Requirements:
• 5+ years in data engineering or big data dev...
As a key member of the Data Development team, you will have 5+ years of experience building ETL/ELT pipelines and optimizing data workflows. This position requires proficiency in SQL, Python, and a solid understanding of Delta Lake architecture to streamline data processing initiatives. You will collaborate with various data professionals to ensure high-quality datasets across the organization.
Key Responsibilities:
• Build scalable data pipelines using Databricks
• Develop efficient ETL/ELT processes with ADF and notebooks
• Integrate large datasets into unified analytics-ready outputs
• Optimize data processing techniques in Spark jobs
• Perform data quality checks and validation
Requirements:
• 5+ years in data engineering or big data dev...
Ready to Apply?
Submit your application for Databricks Developer with Azure Expertise at Atlas Corporation
Apply Now