Found Description
Join Seaspan Corporation as a Senior Databricks Developer, where your expertise in data engineering will shape our analytics capabilities. Implement robust data pipelines on Databricks to support enterprise data needs.
As part of the Data Development team, you will design, maintain, and optimize data pipelines using Apache Spark. This role requires strong collaboration with data scientists and analysts to ensure high-quality datasets for analytics and reporting.
Key Responsibilities:
• Develop and manage scalable data pipelines using Databricks
• Optimize Spark jobs and manage performance with Delta Lake
• Integrate datasets from multiple sources for analytics readiness
• Create and manage ADF pipelines and orchestration workflows
• Ensure adherence to data quality and governance standards
Requirements:
• Over 5 years of experience in big data or data engineering
• Strong expertise in Databricks and Spark technologies
• Experience with Azure Data Lake, ...
As part of the Data Development team, you will design, maintain, and optimize data pipelines using Apache Spark. This role requires strong collaboration with data scientists and analysts to ensure high-quality datasets for analytics and reporting.
Key Responsibilities:
• Develop and manage scalable data pipelines using Databricks
• Optimize Spark jobs and manage performance with Delta Lake
• Integrate datasets from multiple sources for analytics readiness
• Create and manage ADF pipelines and orchestration workflows
• Ensure adherence to data quality and governance standards
Requirements:
• Over 5 years of experience in big data or data engineering
• Strong expertise in Databricks and Spark technologies
• Experience with Azure Data Lake, ...