Software Engineer, Infrastructure

Thinking Machines Lab builds AI systems intended to extend human will and judgment, including frontier models, model customization tools, and human-AI interfaces. The Software Engineer, Infrastructure will design, build, and operate distributed systems supporting large-scale model training and inference, while improving infrastructure reliability, performance, and observability.

Responsibilities:

• Design, build, and operate distributed systems that support large-scale model training and inference across thousands of accelerators
• Build and maintain core infrastructure, including orchestration, scheduling, storage, and resource management systems
• Improve the reliability, performance, and observability of infrastructure used across research and product teams
• Partner with researchers and platform engineers to understand infrastructure needs and turn them into robust, well-abstracted systems
• Debug and resolve complex distributed failures across the stack, from networking and storage to compute and scheduling
• Write and maintain internal libraries and APIs, primarily in Python and Go, that other engineers build on