Research Engineer, Infrastructure, Training Systems

Thinking Machines Lab's mission is to empower humanity through advancing collaborative general intelligence. They are seeking an infrastructure research engineer to design and build core systems for scalable training of large models, ensuring fast and reliable experimentation for research teams.

Responsibilities:

• Design, implement, and optimize distributed training systems that scale across thousands of GPUs and nodes for large-scale training workloads
• Develop high-performance optimizations to maximize throughput and efficiency
• Develop reusable frameworks and libraries to improve training reproducibility, reliability, and scalability for new model architectures
• Establish standards for reliability, maintainability, and security, ensuring systems are robust under rapid iteration
• Collaborate with researchers and engineers to build scalable infrastructure
• Publish and share learnings through internal documentation, open-source libraries, or technical reports that advance the field of scalable AI infrastructure