AI Evaluation Analyst – Financial Data (Bogotá)

Job Description

What is the opportunity?

This role will offer an opportunity to contribute to the development of trusted, high-performing AI models by validating their outputs against authoritative sources and identifying opportunities for improvement.

What will you do?

• Evaluate AI model responses for accuracy, hallucinations, and information capture rate against ground truth sources like SEC filings, earnings transcripts, news releases, and other golden source documents
• Collaborate closely with cross-functional engineering and QA teams to assess model performance and identify optimization opportunities
• Analyze AI prompts and model responses in detail, documenting findings and insights for continuous improvement
• Evaluate AI model outputs using AI-as-a-judge frameworks to assess performance at scale, helping identify systematic patterns and model improvement opportunities
• Validate extracted data points and ...