AI Software Engineer

ElastixAI is an early-stage startup building the next-generation AI inference infrastructure. We’re looking for a systems-minded AI Software Engineer to join our core inference platform team, responsible for designing and extending the low-level serving stack and integrating with proprietary AI accelerators.

Responsibilities:

• Architect, extend, and optimize core components of our AI serving platform for throughput, latency, and scalability
• Customize open-source serving frameworks (e.g., vLLM) for proprietary model ingestion and accelerator integration
• Develop efficient model partitioning, scheduling, and memory management strategies for multi-device inference
• Collaborate with ML engineers on model export and runtime optimization (quantization, graph transforms)
• Work closely with hardware engineers to influence accelerator interface design and performance tuning
• Build APIs and runtime tools enabling flexible, PyTorch-native model deployment on our infrastructure
• Profile, debug, and optimize across the full stack — from Python orchestration to C++ kernels and PCIe drivers