AI Engineer

Themis Intelligence builds AI platforms for utility operations. The AI Engineer – Co-op will develop, evaluate, and improve AI agents and workflows, focusing on LLM performance, retrieval, and system reliability.

Responsibilities:

• Develop, test, and improve LLM-powered agents and agentic workflows using Python and TypeScript
• Evaluate agent performance across accuracy, factual consistency, hallucination, reasoning, and tool-use correctness
• Experiment with prompting techniques, retrieval strategies, and model configurations to improve response quality
• Build and maintain automated evaluation pipelines, test datasets, and reproducible benchmarks
• Investigate agent failures, identify root causes, and implement improvements to grounding and reliability
• Contribute to Retrieval-Augmented Generation (RAG), semantic search, and knowledge retrieval workflows
• Analyze and visualize evaluation results to compare models, track improvements, and identify performance trade-offs
• Collaborate through Git-based development, code reviews, and technical discussions while taking ownership of assigned deliverables