Research Engineer, Infrastructure, Inference

Thinking Machines Lab is dedicated to advancing collaborative general intelligence and making AI accessible for individual needs. They are seeking an infrastructure research engineer to design and optimize systems that enhance the performance and efficiency of large AI models, focusing on improving inference capabilities.

Responsibilities:

• Work alongside researchers and engineers to bring cutting-edge AI models into production
• Collaborate with research teams to enable high-performance inference for novel architectures
• Design and implement new techniques, tools, and architectures that improve performance, latency, throughput, and efficiency
• Optimize our codebase and compute fleet (e.g., GPUs) to fully utilize hardware FLOPs, bandwidth, and memory
• Extend orchestration frameworks (e.g., Kubernetes, Ray, SLURM) for distributed inference, evaluation, and large-batch serving
• Establish standards for reliability, observability, and reproducibility across the inference stack
• Publish and share learnings through internal documentation, open-source libraries, or technical reports that advance the field of scalable AI infrastructure