Found Description
We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Zug, Switzerland.
In this pivotal role, you will develop and scale automated evaluation and synthetic data generation (SDG) capabilities that underpin safety assessments across multiple languages and markets. You will work closely with language experts and multilingual annotators to validate automated safety approaches, ensuring robustness and reliability across diverse linguistic contexts.
Responsibilities
- Automated Judge Development: Train, fine‑tune, and validate automated judge models that can reliably score AI system outputs for safety and policy compliance. Develop calibration and agreement metrics to ensure judges meet human‑parity benchmarks.
- Validation Techniques: Design and implement validation frameworks to assess the accuracy, reliability, and cross‑linguistic consistency of automated evaluation systems. Develop methods to detect drift, bias, ...