Inference Research Engineer (MTS)

Coral Bricks AI is building an inference platform to make frontier intelligence more affordable and accessible. The Inference Research Engineer will research and implement techniques to improve LLM inference throughput, latency, portability, and cost across production-shaped agent workloads, spanning research and systems engineering.

Responsibilities:

• Research ways to push throughput and bring down time-to-first-token and inter-token latency on workloads that are heavy on prompts, long-running, and high-fanout — batching, scheduling, parallelism, caching, and quantization
• Cross-platform serving: we're building for both NVIDIA and AMD GPUs — bring models up on each, close the performance gap between them, and keep the stack portable rather than vendor-locked
• Prototype changes across the GPU and CPU sides of the serving stack when the research requires it, and carry successful ideas far enough to demonstrate them under production-shaped load
• Bring up and tune new open-weight model families as they release
• Build the profiling and load-testing harness that tells us — honestly — what the system is doing under real agent load, not synthetic benchmarks
• Decide what we fork, what we contribute back upstream, and what we build ourselves