Staff Software Development Engineer in Test (SDET)

Assured provides software solutions that modernize insurance claims processing, from self-service claim filing to backend fraud detection. The Staff SDET will build automated testing and evaluation systems for traditional software and AI-powered products using TypeScript, modern test automation, and emerging AI evaluation techniques. The role partners with engineering, product, SRE, and data science teams to improve software quality, reliability, and delivery speed.

Responsibilities:

• Evaluate AI systems that don’t produce the same result twice
• Build evaluation frameworks for LLM and agentic applications using statistical QA, LLM-as-a-judge techniques, trace evaluations, and human-in-the-loop annotations
• Create test suites that become smarter over time
• Explore self-healing automation and use LLMs to generate, execute, diagnose, and maintain tests as applications evolve
• Build reliable automation across the product
• Develop scalable TypeScript frameworks for UI, API, end-to-end, and integration testing
• Make automated testing a dependable part of delivery
• Integrate fast, stable test suites into CI/CD pipelines and give engineers clear feedback before changes reach production
• Turn test failures into useful signals
• Investigate failures, reduce flaky tests, identify root causes, and distinguish product defects from automation issues
• Build testing systems teams can rely on
• Create and maintain automation that improves coverage, catches regressions, and supports faster product development
• Expand how we test AI and agentic applications
• Introduce practical approaches for evaluating nondeterministic behavior, agent traces, and end-to-end AI workflows
• Improve quality throughout the development process
• Work with developers to make software more testable and integrate quality practices earlier in the development lifecycle
• Make automation faster and more reliable
• Improve test performance, stability, and maintainability so teams can trust the results they receive
• Help teams build quality into their work
• Partner with engineering, product, SRE, and data science to define expectations, assess risk, and deliver dependable customer experiences

Requirements:

• You're comfortable building production-quality automation within the TypeScript and JavaScript ecosystem
• You have worked as an SDET, QA Automation Engineer, or software engineer with significant responsibility for automated testing
• You have experience with tools such as Playwright, Jest, Axios, and CI/CD platforms like GitLab CI/CD or CircleCI
• You're interested in automated statistical QA, LLM-as-a-judge, trace evaluation, human annotations, and testing nondeterministic systems
• You enjoy investigating unexpected behavior, finding root causes, and improving systems so the same problems don't happen again
• You communicate clearly and work well with engineering, product, SRE, and other cross-functional partners
• Experience with Langfuse, Braintrust, Arize, Inngest, or similar platforms is helpful, but not required