Associate Director, Principal Data Engineer

As a Data Engineering Solution Architect, you will join a highly talented team at RBC Capital Markets responsible for designing and delivering next‑generation data engineering platforms on Databricks. You will be the hands‑on technical anchor driving Proof of Concepts (POCs) through to full production delivery, working across large‑scale Spark‑based data pipelines, ML engineering workflows, and Delta Lake architectures.

What will you do?

• Lead the end‑to‑end architecture, design, and hands‑on delivery of data engineering solutions on the Databricks Lakehouse Platform, from POC through to production.
• Drive Spark code development, optimization, and fine‑tuning to ensure high‑performance, cost‑efficient data pipelines at scale.
• Architect and implement Delta Lake solutions, including schema design, medallion architecture, data quality frameworks, and incremental ingestion patterns.
• Champion best practices in Databricks Workflows, U...