Found Description
We are looking for a Senior AI Test Automation Engineer to lead and evolve the test automation strategy for an advanced AI & MLOps platform. You will combine strong hands‑on expertise in Python-based automation with the ability to design scalable frameworks and ensure quality across complex systems, including APIs, UIs, data pipelines, and AI/ML-driven components such as LLMs and RAG systems.
Main tasks and accountabilities
- Own the design, architecture, and evolution of the test automation framework for the AI & MLOps platform
- Define and implement scalable, reusable automation patterns (UI, API, data, BDD)
- Automate test cases using Python stack (Playwright, pytest, requests, pytest-bdd/Behave) applying clean code practices
- Design and execute AI/ML‑specific tests (e.g., LLM evaluation, RAG validation, non‑deterministic outputs)
- Integrate and orchestrate automated tests within CI/CD pipelines (GitLab), ensuring reliable execu...
Ready to Apply?
Submit your application for Senior Ai Test Automation Engineer (Marbella) at Ust
Apply Now