Senior Data Bricks/Scala/Spark Engineering Specialist - joliette

Senior Data Bricks/Scala/Spark Engineering Specialist

Location: Montreal, QC, (Onsite) Employment Type: Contract | Duration: 12 Months We're migrating complex on-prem regulatory reporting pipelines from a legacy ETL + Autosys + SQL + Teradata stack to a modern Databricks + Snowflake platform on Azure. The role is hands‑on: design, implement, test, and reconcile production pipelines feeding regulatory reports under strict parity requirements. Must-Have Skills

Scala / Spark — production experience writing Spark applications in Scala (not just notebooks); comfortable with the DataFrame API, joins, window functions, partitioning, and performance tuning Databricks — Serverless compute, Unity Catalog, Asset Bundles, Databricks CLI SQL fluency — confortable writing, analyzing and extracting requirements from complex SQL scripts Snowflake — schema design, performance, Spark‑Snowflake connector Azure — ADLS, networking basics, secrets/identity (Entra ID / managed identities) O...