Data Scientist for ML Model Evaluation

Enhance machine learning quality at our company as a Data Scientist focusing on ML and LLM model evaluation. You'll validate and monitor ML systems, ensuring high reliability and performance.
As a foundational team member reporting to the Director of Data Science, you'll emphasize ML model validation and monitoring processes. This role requires expertise in Python, deep learning frameworks, and statistical concepts to design and execute robust evaluation metrics. You’ll collaborate with MLOps and product teams to maintain model integrity and document methodologies clearly.
Key Responsibilities:
• Validate ML models through rigorous evaluation frameworks
• Design and execute Model Context Protocol evaluations
• Build regression test suites to catch performance regressions
• Monitor production models for drift and performance
• Document and communicate findings to stakeholders
Requirements:
• Industry experience in data science or related field
• Proficiency...