Senior Software Engineer – AI Infrastructure

About the role

The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale. This team sits at the foundation of the agent platform, ensuring that model inference, orchestration, and execution layers are reliable, observable, and performant under real‑world load.

Key responsibilities

• Design and build the infrastructure layer powering AI agent systems in production.
• Develop high‑performance Rust services that handle model inference, orchestration, and execution.
• Architect scalable systems capable of supporting millions of users and high request throughput.
• Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
• Define guardrails, observability, and failure handling for agent‑driven workflows.
• Optimize latency, throughput, and cost across inference and orchestration layers.
• Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems.
• Contribute to foundational infrastructure decisions in a high‑scale, high‑impact environment.

Required profile

• 5+ years of experience building and operating high‑scale production systems.
• Strong proficiency in Rust and systems‑level programming.
• Deep understanding of distributed systems, reliability engineering, and performance optimization.
• Experience operating services serving millions of users or high‑throughput workloads.
• Familiarity with ML infrastructure, model serving, or MLOps in production environments.
• Experience designing observability, monitoring, and failure recovery systems.
• Strong collaboration skills working across infrastructure and applied engineering teams.
• High ownership mindset in high‑stakes production environment.

Required skills

• Rust
• Distributed systems
• Reliability engineering
• Performance optimization
• ML infrastructure
• Model serving
• MLOps
• Observability
• Monitoring
• Failure recovery