Software Engineer I (Remote) (Vitoria-Gasteiz)

Project Overview

As a Software Engineering Evaluator, you will create cutting‑edge datasets for training, benchmarking, and advancing large language models. You will collaborate closely with researchers to curate code examples, provide precise solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. You will evaluate and refine AI‑generated code for efficiency, scalability, and reliability, and work with cross‑functional teams to enhance enterprise‑level AI‑driven coding solutions.

Responsibilities

• Create and curate code examples for AI model training.
• Evaluate and refine AI‑generated code for efficiency, scalability, and reliability.
• Build verification agents that assess code quality and identify error patterns.
• Hypothesize and evaluate the model’s capability across software engineering lifecycle stages (prototyping, architecture, API design, production, launch, experiments, monitor...