Software Engineer, AI Systems (Haven Safety)

Haven Safety AI is building an enterprise learning intelligence layer for safety-critical organizations. The Software Engineer, AI Systems will design, build, operate, and improve production LLM reasoning systems, agent orchestration, retrieval, evaluation, and AI operations that support incident investigation and enterprise learning.

Responsibilities:

• Production reasoning systems. Build and operate multi-step LLM pipelines that coordinate model calls, tool calls, graph queries, retrieval, quality gates, and specialist-agent handoffs
• Agent orchestration. Extend Haven’s coordinated agent team and the orchestration layer that carries an incident from evidence through analysis, review, and enterprise learning
• Grounding and retrieval. Design the context layer across Neo4j graph traversal, vector search, and hybrid retrieval so every model call receives the right evidence and organizational knowledge
• Evaluation. Build datasets, scoring, regression suites, model comparisons, human-label loops, and per-stage quality attribution for extraction and reasoning tasks
• Production AI operations. Implement tracing, tool-call audits, cost and latency monitoring, failure handling, and quality dashboards; catch loops, hallucinations, and silent drift before customers do
• Technical direction. Select models by task across OpenAI, Anthropic, and Google; partner with product and knowledge engineering; and help shape the AI roadmap