Director, Data Science, AI Evaluations Platform

Job Description

What is the opportunity? RBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes that possible. As Director, Data Science, AI Evaluations Platform, you will lead the data science function responsible for how RBC measures model and agent quality, safety, risk, and performance. You will hire, develop, and mentor a high-performing team that owns evaluation datasets, sourcing methods, LLM judge design, deterministic scorers, human evaluation protocols, quality benchmarks, and measurement frameworks that help AI systems move from experimentation to production with evidence and control.What will you do?

Lead and grow a high-performing data science team focused on model and agent evaluations, including evaluation datasets, rubrics, LLM-as-judge methods, deterministic scorers, human evaluation, and measurement frameworks.

Define evaluation science standards that t...