Staff Machine Learning Engineer

Mural Group is recruiting on behalf of a client for a Staff ML Engineer to set the technical direction for enterprise agent systems. The role focuses on building and shipping multi-step LLM systems, owning evaluation, improving system quality and efficiency, and mentoring engineers.

Responsibilities:

• Design multi-step LLM systems: reasoning, retrieval, planning and tool use
• Own evaluation, from offline benchmarks to online experiments and model-graded review
• Find and fix failure modes such as hallucination and tool misuse
• Set the quality, latency and cost targets the team builds against
• Mentor senior engineers and shape how the group works

Requirements:

• 7+ years shipping ML in production, including LLMs at scale
• Led the design of complex, multi-step LLM systems
• Depth in transformers, embeddings and retrieval
• Evaluation experience beyond single prompts
• PyTorch or similar, on distributed cloud infrastructure
• BS in CS or a related field
• MS or PhD a plus
• ML shipped before LLMs, then moved into generative AI
• detailed retrieval work (chunking, reranking, evals)