Senior Machine Learning Engineer

Cresta is an AI company providing a unified platform for conversational AI agents, real-time human agent augmentation, and conversation intelligence. The Senior Machine Learning Engineer will lead the design, development, evaluation, and optimization of production-grade LLM and agentic AI systems, while mentoring engineers and collaborating cross-functionally to advance Cresta’s AI platform.

Responsibilities:

• Lead the design and development of Cresta’s next-generation AI Agents and Agentic Assist systems, defining system architecture and core modeling approaches
• Architect intelligent, multi-step agent workflows that combine real-time guidance, knowledge retrieval, reasoning, summarization, and automated actions into cohesive production systems
• Design, deploy, and optimize LLM-powered systems, including Retrieval-Augmented Generation (RAG) pipelines, multi-agent orchestration, and domain-adapted models
• Improve reasoning, planning, and tool-use capabilities in real-world AI applications
• Develop evaluation strategies for complex, non-deterministic systems, including offline benchmarking, online experimentation, and LLM-as-a-judge methodologies
• Diagnose and mitigate real-world failure modes such as hallucinations, retrieval errors, tool misuse, prompt brittleness, and multi-step reasoning breakdowns
• Define and measure quality metrics (e.g., accuracy, faithfulness, task completion, latency, cost, robustness) to improve system reliability and performance
• Optimize AI systems for scalability, latency, security, and cost efficiency in production environments
• Collaborate cross-functionally with product, frontend, and backend teams to integrate AI capabilities seamlessly into Cresta’s platform
• Mentor engineers, contribute to technical strategy, and help shape the roadmap for Cresta’s AI systems