Design MLOps testing strategies which verify that the rules, policies, and procedures put in place as internal controls are properly designed and operating effectively
Champion automation, continuous testing and shift-left testing methodologies
Build and maintain test automation and ensure stds are adopted and followed
Identify controls gaps and develop test harnesses to detect and validate
Support test data and test environment readiness across environments
Analyze defect trends and production incidents — contributing to root cause analysis and recommending preventive measures
Provide quality sign off as needed
Contribute to QE standards and best practices for MLOps testing techniques, tools, and approaches within the ecosystem.

Strong understanding of the MLOps lifecycle, including model validation, deployment, and monitoring
Experience designing scalable test strategies across complex data and ML systems
Expertise in test automation and continuous testing within CI/CD pipelines
Proficiency in Python, API testing, and data validation (SQL)
Knowledge of cloud platforms (AWS, Azure, or GCP) and distributed data systems
Experience with risk-based testing, controls validation, and audit readiness
Ability to analyze defects and production issues and drive root cause solutions
Strong collaboration and stakeholder influence across engineering and QE teams
Self-driven with a strategic mindset and hands-on execution capabilities
5+ years of industry-relevant experience

medical/prescription drug coverage (with a Health Savings Account feature)
dental and vision options
employee and spouse/child life insurance
short and long-term disability protection
401(k) with PNC match
pension and stock purchase plans
dependent care reimbursement account
back-up child/elder care
adoption, surrogacy, and doula reimbursement
educational assistance, including select programs fully paid
robust wellness program with financial incentives
maternity and/or parental leave
up to 11 paid holidays each year
9 occasional absence days each year, unless otherwise required by law
between 15 to 25 vacation days each year, depending on career level; and years of service

Quality Engineering Architect – MLOps

Key skills