M

Senior AI Quality Engineer

Mitratech

Remote, Remote, India Full-time May 30, 2026

Found Description

  • Design and execute manual and automated test cases  for backend APIs, frontend interfaces, and end-to-end AI workflows.
  • Conduct exploratory testing  of new generative AI features and user interactions.
  • Develop and maintain automated test frameworks  for UI and API.
  • Build automation scripts for AI/ML pipelines  using pytest, unittest, or custom frameworks.
  • Create comprehensive test plans , manage defects, and report results using Jira, or similar tools.
  • Validate RAG (Retrieval-Augmented Generation)  pipelines, including embedding accuracy, retrieval quality, and model response evaluation.
  • Test AI agents and orchestration flows , ensuring correctness in multi-step reasoning and tool invocations.
  • Perform performance and scalability testing  for ML inference endpoints (SageMaker, Bedrock, custom APIs), monitoring latency and throughput.
  • Conduct inte...
  • Ready to Apply?

    Submit your application for Senior AI Quality Engineer at Mitratech

    Apply Now