Found Description
Join eBay as a Senior Product Manager, focusing on AI quality monitoring and human evaluation processes. Shape evaluation strategies while enhancing AI model outputs.
In this pivotal role, you'll lead programs assessing AI through structured human evaluations, connecting internal and external evaluators. Your analytical and data science skills will help translate insights into improvements for AI models. You'll be instrumental in ensuring that AI-driven experiences meet high standards through effective quality tracking and monitoring processes.
Key Responsibilities:
• Design and lead annotation evaluation programs
• Coordinate workflows for distributed teams
• Define quality standards in collaboration with partners
• Review AI outputs to maintain quality
• Track and report on evaluation metrics consistently
Requirements:
• 5+ years PM experience in AI/ML
• Experience with distributed annotator pools
• Strong SQL and analytical capability
• Understand...
In this pivotal role, you'll lead programs assessing AI through structured human evaluations, connecting internal and external evaluators. Your analytical and data science skills will help translate insights into improvements for AI models. You'll be instrumental in ensuring that AI-driven experiences meet high standards through effective quality tracking and monitoring processes.
Key Responsibilities:
• Design and lead annotation evaluation programs
• Coordinate workflows for distributed teams
• Define quality standards in collaboration with partners
• Review AI outputs to maintain quality
• Track and report on evaluation metrics consistently
Requirements:
• 5+ years PM experience in AI/ML
• Experience with distributed annotator pools
• Strong SQL and analytical capability
• Understand...