Found Description
The Senior AI Engineer owns the enterprise LLM platform substrate that powers every generative-AI consumer across the organisation. This role designs, builds, and operates the LLM Gateway, the evaluation framework, and the AI best-practices playbook that engineers, business teams, and product squads depend on to ship trustworthy AI features at scale.
Key Responsibilities
- Design, build, and operate the enterprise LLM Gateway — provider abstraction, authentication, rate limiting, per-use-case cost tracking, prompt logging for audit, and model routing across major providers (Azure OpenAI, AWS Bedrock, Anthropic, Vertex AI).
- Operationalise an evaluation framework (Langfuse or equivalent) — tracing, eval scores, human feedback loops — as a platform service consumed by every production GenAI consumer.
- Define and enforce evaluation rubrics (accuracy, groundedness, hallucination rate, latency, cost per inference) and embed regressi...