Found Description
About the Role
As the Senior Data Scientist for Generative AI within our Central AI Hub, you will be the foundational scientific owner of our LLM strategy. You are not just calling APIs; you will evaluate model performance, fine‑tune open‑source or proprietary models for complex business logic, and ensure our AI products behave predictably at scale.
Key Responsibilities
- Design and implement robust frameworks to quantitatively evaluate LLM performance (accuracy, repeatability, hallucination rates) before and after deployment.
- Lead the fine‑tuning and optimization of our Core Policy Models.
- Act as the central GenAI expert for product engineering teams, guiding them on improving JSON payload structures, advanced prompt engineering techniques, Retrieval‑Augmented Generation (RAG) architectures, and evaluation pipelines.
- Establish best practices, playbooks, and standardized pipelines for all AI/LLM integrations across Cover Geni...