Senior Data Bricks/Scala/Spark Engineering Specialist - saint-valere (Saint-Valère, Quebec)

Senior Data Bricks/Scala/Spark Engineering SpecialistLocation:Montreal, QC (Onsite)
Employment Type:Contract
Duration:12 Months
Job DescriptionWe’re migrating complex on‑prem regulatory reporting pipelines from a legacy ETL + Autosys + SQL + Teradata stack to a contemporary Databricks + Snowflake platform on Azure. The role is hands‑on: design, implement, test, and reconcile production pipelines feeding regulatory reports under strict parity requirements.
Must‑haveScala / Spark — production experience writing Spark applications in Scala (not just notebooks); comfortable with the DataFrame API, joins, window functions, partitioning, and performance tuning
Databricks — Serverless compute, Unity Catalog, Asset Bundles, Databricks CLI
SQL fluency — comfortable writing, analyzing and extracting requirements from complex SQL scripts
Snowflake — schema design, performance, Spark‑Snowflake connector
Azure — ADLS, networking basics, secrets/identity (EntraID / managed id...