Found Description
Elevate your career with VLink as a Senior Data Engineer specializing in Databricks, Scala, and Spark in Montreal. Focus on migrating complex reporting pipelines to a cloud-based architecture, ensuring data integrity.
This contract role requires you to lead the migration of intricate regulatory reporting systems from a legacy ETL setup to a modern Databricks and Snowflake platform on Azure. Your hands-on expertise in Scala, Spark, and SQL will be vital in designing, testing, and reconciling production pipelines that meet stringent reporting standards.
Key Responsibilities:
• Design and implement regulatory reporting pipelines
• Write production-level Spark applications in Scala
• Optimize SQL scripts for data extraction and analysis
• Execute migrations from legacy systems to modern platforms
• Develop automated data quality and reconciliation tools
Requirements:
• Proven experience with Scala/Spark and Databricks
• Strong SQL expertise and data analysis c...
This contract role requires you to lead the migration of intricate regulatory reporting systems from a legacy ETL setup to a modern Databricks and Snowflake platform on Azure. Your hands-on expertise in Scala, Spark, and SQL will be vital in designing, testing, and reconciling production pipelines that meet stringent reporting standards.
Key Responsibilities:
• Design and implement regulatory reporting pipelines
• Write production-level Spark applications in Scala
• Optimize SQL scripts for data extraction and analysis
• Execute migrations from legacy systems to modern platforms
• Develop automated data quality and reconciliation tools
Requirements:
• Proven experience with Scala/Spark and Databricks
• Strong SQL expertise and data analysis c...