Senior Software Engineer, Open Harness Engineering

NVIDIA is hiring a Senior Software Engineer to build core libraries, evaluation systems, and reusable harness capabilities for AI agents. The role focuses on open-source agent harnesses, sandboxed execution, model-provider infrastructure, and agent benchmarks, using evaluation evidence to improve agent quality, reliability, cost, and latency.

Responsibilities:

• Define and evolve the technical approach for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments
• Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis
• Diagnose agent failures from traces, logs, tool results, and benchmark artifacts, separating harness, evaluator, environment, inference, and model causes
• Design controlled experiments and promotion criteria that distinguish genuine harness improvements from noise, benchmark artifacts, or model-specific gains
• Ship focused harness and runtime improvements, including upstream open-source contributions, detectors, regression tests, and maintainable documentation
• Partner with Relay, Hermes, model, infrastructure, and research teams to turn recurring optimization needs into reusable runtime, trace, and evaluation capabilities