Staff + Senior Software Engineer, Inference Deployment

Anthropic is a public benefit corporation focused on creating reliable and beneficial AI systems. They are looking for a Staff + Senior Software Engineer to join their Inference team, responsible for building and maintaining systems that serve AI models to millions of users, maximizing compute efficiency, and enabling breakthrough research.

Responsibilities:

• Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide
• Develop resilient, flexible systems that adapt in real time to real world events
• Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators
• Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads
• Build and operate production-grade deployment pipelines for releasing new models to users
• Provide high-performance inference infrastructure that enables researchers to develop next-generation models
• Integrate new AI accelerator platforms and support inference for new model architectures