U

Senior AI Test Automation Engineer (Valencia)

Ust

valencia, comunidad valenciana, Spain Full-time June 02, 2026

Found Description

Senior AI Test Automation Engineer - Hybrid Madrid

Responsibilities

  • Own the design, architecture, and evolution of the test automation framework for the AI & MLOps platform
  • Define and implement scalable, reusable automation patterns (UI, API, data, BDD)
  • Automate test cases using Python stack (Playwright, pytest, requests, pytest-bdd/Behave) applying clean code practices
  • Design and execute AI/ML‑specific tests (e.g., LLM evaluation, RAG validation, non‑deterministic outputs)
  • Integrate and orchestrate automated tests within CI/CD pipelines (GitLab), ensuring reliable execution across environments
  • Provision and manage test environments using Docker and Kubernetes
  • Plan and execute regression, smoke, and release test suites across DEV, INT, UAT, and pre‑PROD
  • Monitor execution quality, manage flaky tests, and ensure trustworthy test results
  • Analyze defects, perform root cause analysis, and repo...

Ready to Apply?

Submit your application for Senior AI Test Automation Engineer (Valencia) at Ust

Apply Now