Senior Software Engineer – AI Infrastructure

About the role

We are looking for a Senior Software Engineer to join the AI Infrastructure team that powers intelligent agents at scale. You will work on the core platform that serves millions of users, ensuring reliability, performance and observability of model inference, orchestration and execution layers.

Key responsibilities

• Design and build the infrastructure layer for AI agent systems in production.
• Develop high‑performance Rust services for model inference, orchestration and execution.
• Architect scalable systems capable of handling millions of users and high request throughput.
• Implement reliable ML‑ops patterns for model deployment, evaluation and monitoring.
• Define guardrails, observability and failure‑handling mechanisms for agent‑driven workflows.
• Optimize latency, throughput and cost across inference and orchestration layers.
• Collaborate with the Agent Systems team to turn prototypes into hardened production services.
• Contribute to foundational infrastructure decisions in a high‑scale, high‑impact environment.

Required profile

• 5+ years of experience building and operating high‑scale production systems.
• Strong proficiency in Rust and systems‑level programming.
• Deep understanding of distributed systems, reliability engineering and performance optimization.
• Experience operating services that serve millions of users or high‑throughput workloads.
• Familiarity with ML infrastructure, model serving or MLOps in production.
• Proven ability to design observability, monitoring and failure‑recovery systems.
• Excellent collaboration skills across infrastructure and applied engineering teams.
• High ownership mindset in a high‑stakes production environment.

Required skills

• Rust
• Systems‑level programming
• Distributed systems
• Reliability engineering
• Performance optimization
• ML infrastructure / MLOps
• Model serving
• Observability and monitoring
• Failure recovery