Senior Software Engineer, Open Harness Engineering

NVIDIA is a technology company advancing accelerated computing and artificial intelligence through GPU-based computing. The Senior Software Engineer will build core libraries, evaluation systems, and reusable harness capabilities for safer and more reliable AI agents, while improving open-source agent harnesses, sandboxed execution, model-provider infrastructure, and agent benchmarks.

Responsibilities:

• Define and evolve the technical approach for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments
• Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis
• Diagnose agent failures from traces, logs, tool results, and benchmark artifacts, separating harness, evaluator, environment, inference, and model causes
• Design controlled experiments and promotion criteria that distinguish genuine harness improvements from noise, benchmark artifacts, or model-specific gains
• Ship focused harness and runtime improvements, including upstream open-source contributions, detectors, regression tests, and maintainable documentation
• Partner with Relay, Hermes, model, infrastructure, and research teams to turn recurring optimization needs into reusable runtime, trace, and evaluation capabilities