Software Engineer, On-Device AI

Nothing is hiring a Software Engineer, On-Device AI to build the system services, abstractions, and APIs that support reliable AI on devices. The role includes optimizing small-model inference on real hardware and connecting model capabilities across device and application layers.

Responsibilities:

• Build core system services, abstractions and APIs for a platform others can build on
• Have small models running reliably on real hardware: memory, scheduling and resource management, all inside tight latency, battery and thermal budgets
• Connect model capabilities to the platform and app layers, so they finish real tasks end to end
• Decide what runs where: wearable, phone, computer or cloud, based on the task, privacy and the hardware on hand
• Prototype fast, profile on real hardware across CPUs, GPUs and NPUs, and ship what works
• Work side by side with software, model and hardware engineers

Requirements:

• You've owned complex systems work, from architecture to hands-on implementation and debugging
• Strong systems fundamentals: concurrency, resource management, API design and performance trade-offs
• Experience with on-device inference, inference runtimes, device software or another resource-constrained platform. Or proof that you learn fast across all of them
• You make progress without a spec, explain trade-offs clearly and change course when the data says so
• You question familiar architectures instead of copying them
• Strong programming skills and the range to use what the problem needs. E.g. Rust, Python and JavaScript