Senior AI Test Automation Engineer (Gerona)

Position

Senior AI Test Automation Engineer – Hybrid, Madrid

Responsibilities

• Own the design, architecture, and evolution of the test automation framework for the AI & MLOps platform
• Define and implement scalable, reusable automation patterns (UI, API, data, BDD)
• Automate test cases using Python stack (Playwright, pytest, requests, pytest-bdd/Behave) applying clean code practices
• Design and execute AI/ML‑specific tests (e.g., LLM evaluation, RAG validation, non‑deterministic outputs)
• Integrate and orchestrate automated tests within CI/CD pipelines (GitLab), ensuring reliable execution across environments
• Provision and manage test environments using Docker and Kubernetes
• Plan and execute regression, smoke, and release test suites across DEV, INT, UAT, and pre‑PROD
• Monitor execution quality, manage flaky tests, and ensure trustworthy test results
• Analyze defects, perform root cause...