Key skills
PythonTypeScriptAILLMCI/CD
About this role
Role Overview
- Maintain evals to keep close to 100% accuracy and update them as we get new feedback
- Monitor user feedback to ensure our agents have a high level of accuracy
- Run new experiments to proactively increase the performance of current agents
- Keep up to date with AI developments
- Design new agents
- Maintain Evals infrastructure to run reliably and at reasonable time and cost in our CI/CD pipeline
Requirements
- Functional coding in TypeScript or Python
- Demonstrated experience with LLMs (personal project or professional)
- Experience with creating AI agents
- Familiarity with LLM providers and model trade-offs
Tech Stack
- Python
- TypeScript
Benefits
- Health Insurance
- Competitive and flexible compensation
- Coverflex card
- Stock options
- MacBook
- €500 onboarding budget
- €2,000 yearly budget for professional development
- 25 days paid vacation
- 3 caring days per year
- 2 additional paid weeks on parental leave
- Paid birthday off