Found Description
Join Baseten as a Lead Software Engineer focusing on GPU fabric observability. Drive high-volume telemetry and real-time diagnosis to enhance AI production infrastructures.
In this senior role, you will lead the development of observability and root-cause analysis systems for GPU fabrics at Baseten. You will tackle challenging distributed systems problems, integrating systems that monitor and diagnose intermittent failures across high-density NVIDIA infrastructures. Your engineering expertise will bridge networking and inference software, helping ensure accurate incident response and diagnosis.
Key Responsibilities:
• Own GPU fabric observability and root-cause architecture
• Build telemetry pipelines for switches, NICs, GPUs, and services
• Model service ownership, topology, and failure domains
• Differentiate fabric faults from other system failures
• Develop operator workflows for triage and learning
Requirements:<...
In this senior role, you will lead the development of observability and root-cause analysis systems for GPU fabrics at Baseten. You will tackle challenging distributed systems problems, integrating systems that monitor and diagnose intermittent failures across high-density NVIDIA infrastructures. Your engineering expertise will bridge networking and inference software, helping ensure accurate incident response and diagnosis.
Key Responsibilities:
• Own GPU fabric observability and root-cause architecture
• Build telemetry pipelines for switches, NICs, GPUs, and services
• Model service ownership, topology, and failure domains
• Differentiate fabric faults from other system failures
• Develop operator workflows for triage and learning
Requirements:<...
Ready to Apply?
Submit your application for Lead Software Engineer - GPU Observability at Baseten
Apply Now