Senior Software Engineer - Test

Boulevard is a company that provides a client experience platform for appointment-based self-care businesses. The Senior Software Engineer - Test will be responsible for owning the health of CI/CD pipelines and establishing engineering patterns for automated testing across Elixir and TypeScript codebases.

Responsibilities:

• Own the stability and performance of CI across our frontend and backend repositories. You’ll drive success rates up, runtimes down, and help establish “no merge on red” as a cultural default rather than a negotiation
• Hunt down flakiness. You’ll identify, triage, and fix the top sources of non-determinism in our test suites, and build the tooling that will make flake visible and attributable before it becomes noise
• Establish Elixir unit and integration testing patterns. You’ll partner with backend engineers to define how we test service boundaries, write the reference implementations, and document the patterns so they scale beyond you
• Optimize pipeline performance. You’ll improve parallelization, caching, and test ordering to deliver meaningful reductions in CI runtime across both frontend and backend pipelines
• Build developer-facing tooling and dashboards that will surface CI health, test ownership, flake rate, coverage trends, and pipeline duration — making quality signal actionable for every team
• Contribute to release readiness. You’ll help define lightweight, durable criteria for what “ready to ship” looks like, and wire those criteria into the pipeline
• Bring AI-assisted test generation and spec-driven development workflows into our Elixir framework, starting with one service area and expanding based on what we learn
• Partner with the QA Engineer (E2E coverage) and the QA Lead to integrate end-to-end tests into pre-deployment pipelines without sacrificing speed

Requirements:

• 5+ Significant time as an SDET, test infrastructure engineer, or software engineer with a deep testing focus — enough to walk into a CI system you've never seen and start making it better within a week
• Strong hands-on experience with CI/CD systems such as CircleCI and GitHub Actions, including pipeline design, caching strategies, parallelization, and debugging the weird failures that only happen at 2 a.m
• Production-level proficiency in at least one backend language, ideally Elixir. If not Elixir, a demonstrated history of picking up new language ecosystems quickly and writing idiomatic test code in them
• You don't just retry failing tests — you understand why they fail and fix the root cause, whether that's shared state, timing, test data, or infrastructure
• Fluency with unit and integration testing patterns, especially at service boundaries. You know the difference between a test that gives confidence and a test that gives false comfort
• Experience building internal tooling or dashboards that other engineers actually use. Bonus points if you've built out test ownership models or flake detection systems from scratch
• Strong written communication. Much of the leverage of this role will come from documentation, patterns, and proposals that scale your influence beyond what you personally touch
• Hands-on experience with AI-assisted development tools such as Claude or Cursor, and a point of view on where they work well, where they don't, and how to incorporate them into a testing workflow responsibly