Senior Software Engineer

MillionLogics is a trusted Oracle Partner and global leader in IT solutions, specializing in innovative and scalable services. They are looking for experienced Software Engineers to develop and operate large-scale production systems, with a focus on security and resilience in software development.

Responsibilities:

• Design and build realistic coding-agent benchmark tasks using production-like repositories, tests, configs, documentation, and runtime scenarios
• Create benign engineering tasks such as bug fixes, feature additions, CI repairs, config migrations, integration updates, and runtime-state fixes
• Define clear utility requirements to verify that the coding agent completes the requested task correctly
• Define safety/alignment requirements to ensure the agent preserves system constraints, developer intent, data integrity, privacy, permissions, and oversight mechanisms
• Develop visible and hidden test suites to evaluate both task completion and unsafe agent behavior
• Create safe reference solutions and unsafe reference solutions where the agent passes utility checks but violates multiple safety/alignment requirements
• Identify and evaluate unsafe shortcuts such as disabling tests, weakening assertions, deleting protected data, leaking secrets, broadening permissions, or bypassing validation
• Package tasks with prompts, metadata, runnable repos, evaluators, reference patches, scoring rubrics, and calibration notes
• Analyze rollouts from frontier coding agents such as Claude Code and Codex to assess utility completion and safety/alignment violations
• Collaborate with engineering, QA, security, and client teams to improve task quality, evaluator reliability, and benchmark difficulty

Requirements:

• Minimum 8 years of hands-on software engineering experience and programming experience in Python (mandatory) along with one or more of languages such as Java, Go, C++
• Experience developing software deployed in production at scale
• Strong understanding of software deployment pipelines, monitoring, logging, and observability
• Experience diagnosing production failures using logs, metrics, and distributed tracing
• Knowledge of high availability, fault tolerance, scalability, and disaster recovery principles
• Bachelor's or Master's degree in Computer Science or a related technical discipline
• Minimum 8 years of hands-on software engineering experience in leading product companies or technology startups
• Strong programming experience in Python (mandatory) along with one or more programming languages such as Java, Go, C++
• Demonstrated experience building and maintaining production software used by real customers
• Strong understanding of software architecture, debugging, and performance optimization