Found Description
Become a Databricks Data Engineer with Seaspan Corporation, where you'll implement and optimize data pipelines for advanced analytics. Work with Apache Spark and enhance enterprise reporting capabilities.
As a part of the Data Development team, you will design and maintain scalable workflows, leveraging your expertise in SQL, PySpark, and Azure Data Factory. The role requires integrating and transforming diverse datasets into usable formats while ensuring optimal performance on Delta Lake. Partner with Data Analysts and Architects to produce reliable datasets that meet enterprise standards.
Key Responsibilities:
• Design scalable data pipelines using Databricks and SQL
• Develop ETL processes for structured and semi-structured data
• Optimize Spark jobs using partitioning and caching
• Collaborate on data orchestration and quality checks
• Support data governance and comprehensive documentation
Requirements:
• 5+ years in data engineering or big data
• Deg...
As a part of the Data Development team, you will design and maintain scalable workflows, leveraging your expertise in SQL, PySpark, and Azure Data Factory. The role requires integrating and transforming diverse datasets into usable formats while ensuring optimal performance on Delta Lake. Partner with Data Analysts and Architects to produce reliable datasets that meet enterprise standards.
Key Responsibilities:
• Design scalable data pipelines using Databricks and SQL
• Develop ETL processes for structured and semi-structured data
• Optimize Spark jobs using partitioning and caching
• Collaborate on data orchestration and quality checks
• Support data governance and comprehensive documentation
Requirements:
• 5+ years in data engineering or big data
• Deg...
Ready to Apply?
Submit your application for Databricks Data Engineer at Seaspan at Seaspan Corporation
Apply Now