Key skills
Quality metrics programTest inventory managementTest coverage analysisTest pass/fail rate monitoringFlaky test detectionNightly test executionRegression alertingFailure triage toolingDefinition of Done standardsCI/CD quality gatesCoverage thresholds enforcementTest types standardsAI-assisted testing toolsTest generationFlakiness detectionCoverage gap analysisIntegration testingContract testingCI integrationEnd-to-end test coverageBackend testingFrontend testingData pipeline testingLoad testingPerformance testingService level objectives (SLOs)Security scanning toolingVulnerability dashboardEngineering dashboardsMetrics toolingObservability platformsMonitoring platformsQuality engineeringPlatform engineeringTesting tooling and frameworksContinuous integration/continuous delivery (CI/CD)API-first product testingContract drift managementVersioningConsumer-driven contract testingPost-mortem analysisAICI/CDLeadershipCommunication
About this role
Lob is a company transforming the way businesses use direct mail through technology. The Staff Engineer, Quality Platform will lead the quality program by establishing standards and tooling to enhance quality visibility and accountability across the engineering organization.
Responsibilities:
- Establish Lob's quality metrics program - standing up per-repo dashboards that surface test inventory, coverage trends, pass/fail rates, and flaky test signals across the engineering organization
- Define and roll out a scheduled nightly test execution strategy across all repos, with regression alerting and failure triage tooling that gives teams early warning before defects reach production
- Define and roll out Lob's Definition of Done - a shared standard for what 'ready to ship' means across the engineering organization and establish the CI/CD gates that enforce it: coverage thresholds, required test types, and quality checks per change category
- Define and champion Lob’s AI quality strategy - evaluating and adopting AI-assisted testing tools (test generation, flakiness detection, coverage gap analysis) and establish perspective on where AI accelerates quality outcomes vs where human judgment remains essential
- Partner with engineering teams to establish org-wide standards for integration and contract testing - defining what good looks like, configuring the CI integration that makes it adoptable, and creating visibility into which services have coverage and which don't
- Define the standards and evaluate the tooling for E2E test coverage across backend, frontend, and data pipelines - working with feature teams to establish ownership of their own workflows, with Lob's flagship print & mail and address verification products as the first adopters
- Evaluate, select, and roll out load and performance testing tooling - defining baseline SLOs for critical endpoints and integrating performance testing into the release process for high-risk changes
- Integrate security scanning tooling into a unified vulnerability dashboard that gives engineering teams and leadership clear, actionable visibility into open issues by repo, severity, and age
- Partner with engineering teams as a quality advocate - reviewing system designs for testability, identifying systemic risk patterns surfaced by incidents, and coaching engineers on testing best practices that build lasting engineering discipline
- Collaborate with engineering leadership to define org-wide quality goals, inform roadmap prioritization with quality signal data, and present engineering health metrics to stakeholders in a clear and compelling way
Requirements:
- 8+ years of hands-on experience in software engineering, quality engineering, or platform engineering roles, including at least 3 years establishing quality programs, standards, and tooling at a company where that infrastructure did not previously exist
- Demonstrated experience evaluating, selecting, and rolling out testing tooling and frameworks across multiple testing types: integration, contract, end-to-end, load, and performance - with the judgment to know which approach fits which problem
- Strong CI/CD fluency - experience configuring quality gates, integrating test results into delivery pipelines, and establishing standards that make the right behavior the default path
- A strong working knowledge of AI-assisted and testing tools with hands on experience leveraging AI for test generation, analysis or triage and a clear perspective on how AI should accelerate a quality program
- Experience standing up engineering dashboards and metrics tooling that surfaces test results across repositories, tracks flakiness, and visualizes quality trends - turning raw test data into actionable engineering health signals
- Experience integrating security scanning tooling into developer workflows, with the ability to create unified, prioritized visibility for both engineering teams and leadership
- Technical fluency across modern engineering tooling and infrastructure - able to evaluate, configure, and integrate tools to deliver impact quickly
- Exceptional communication and influence skills - the ability to earn the trust of engineers and shift culture through credibility, well-designed standards, and pragmatic advocacy rather than top-down mandates is essential
- Proven experience operating in startup or late-stage startup environments where quality culture and engineering discipline were built, not inherited. Comfort navigating ambiguity, sequencing work without established process, and delivering impact in phases
- Comfort running post-mortem analysis and connecting quality signals to production incidents, with the ability to quantify the business impact and ROI of quality investments for engineering and executive leadership
- Experience with observability and monitoring platforms is a strong plus
- Familiarity with API-first products and the specific testing challenges they present — including contract drift, versioning, and consumer-driven contract testing - is a strong plus