Found Description
Step into a key role as a Senior Data Bricks/Scala/Spark Engineering Specialist with VLink in Montreal, QC. This on-site contract position focuses on transforming data pipelines on a cloud platform.
You will be responsible for migrating complex regulatory reporting pipelines from legacy systems to a modern architecture involving Databricks and Snowflake. Your production experience with Scala, Spark, and SQL is essential as you design, implement, and test the creation of these pipelines. This opportunity also requires a strong background in CI/CD processes and data quality assurance practices.
Key Responsibilities:
• Design and execute regulatory reporting pipelines
• Migrate existing ETL workflows to Azure solutions
• Write Spark applications in production environment
• Validate data integrity through automated checks
• Ensure comprehensive testing is conducted for all phases
Requirements:
• Significant experien...
You will be responsible for migrating complex regulatory reporting pipelines from legacy systems to a modern architecture involving Databricks and Snowflake. Your production experience with Scala, Spark, and SQL is essential as you design, implement, and test the creation of these pipelines. This opportunity also requires a strong background in CI/CD processes and data quality assurance practices.
Key Responsibilities:
• Design and execute regulatory reporting pipelines
• Migrate existing ETL workflows to Azure solutions
• Write Spark applications in production environment
• Validate data integrity through automated checks
• Ensure comprehensive testing is conducted for all phases
Requirements:
• Significant experien...