Found Description
Take on the role of Data Bricks and Spark Expert at VLink, Montreal, QC. This senior position involves transforming complex ETL processes into cloud-based solutions using Databricks and Snowflake.
As a key player in the 12-month contract, you will design, implement, and reconcile production pipelines while ensuring regulatory compliance. Your skills in Spark, SQL, and data quality will be essential to drive this migration forward and meet strict parity requirements.
Key Responsibilities:
• Lead design and reconciliation of production pipelines
• Implement Spark applications and optimize performance
• Write complex SQL scripts to extract important data
• Perform hands-on testing using TDD and BDD methodologies
• Execute large-scale migrations from legacy systems to Azure
Requirements:
• Proven experience with Scala, Databricks, and Spark
• Strong SQL fluency for data analysis
• Familiar with Azure networking and ADLS
• Experience in CI/CD implementati...
As a key player in the 12-month contract, you will design, implement, and reconcile production pipelines while ensuring regulatory compliance. Your skills in Spark, SQL, and data quality will be essential to drive this migration forward and meet strict parity requirements.
Key Responsibilities:
• Lead design and reconciliation of production pipelines
• Implement Spark applications and optimize performance
• Write complex SQL scripts to extract important data
• Perform hands-on testing using TDD and BDD methodologies
• Execute large-scale migrations from legacy systems to Azure
Requirements:
• Proven experience with Scala, Databricks, and Spark
• Strong SQL fluency for data analysis
• Familiar with Azure networking and ADLS
• Experience in CI/CD implementati...