Senior Data Engineer: Databricks & Scala

Elevate your engineering career with VLink as a Senior Data Engineer in Montreal, QC. Focus on migrating data pipelines with Databricks, Scala, and Spark in a hands-on capacity.
This contract role spans 12 months and involves design, implementation, testing, and reconciliation of production pipelines for regulatory reporting. Your expertise in complex SQL, Databricks serverless compute, and performance tuning will directly impact migration efforts in a regulated environment.
Key Responsibilities:
• Design and implement regulatory reporting pipelines
• Migrate ETL processes from legacy systems
• Write and analyze complex SQL scripts
• Utilize Databricks CLI and Unity Catalog
• Perform testing with TDD and BDD methodologies
Requirements:
• Proven Scala/Spark experience in production settings
• Familiarity with Azure, ADLS, and networking basics
• Knowledge of orchestration using Airflow
• Experience in CI/CD practices with Artifactory
• Strong data ...