Found Description
Remote (Work From Anywhere)
Experience: 3+ Years
About the Role
We are seeking a highly analytical and detail-oriented LLM Analyst to evaluate, optimize, and improve the performance of Large Language Models (LLMs) and Generative AI systems. The ideal candidate will have experience in AI evaluation, prompt engineering, content quality analysis, research, data analysis, or AI operations.
As an LLM Analyst, you will play a key role in assessing model outputs, identifying performance gaps, analyzing user interactions, and providing actionable insights that enhance AI quality, accuracy, safety, and overall user experience.
Key Responsibilities
LLM Evaluation & Analysis
- Evaluate responses generated by Large Language Models (LLMs) across diverse domains and use cases.
- Assess outputs for accuracy, relevance, completeness, consisten...