Distributed Systems Engineer

Relace is building a globally distributed inference cloud that runs customer requests on its GPU fleet. The Distributed Systems Engineer will develop the routing, capacity-management, and fleet-scaling systems that operate inference across multiple clouds, including Relace’s Rust service and Kubernetes services.

Responsibilities:

• You would work on how the globally distributed inference runs: the routing layer deciding which machine handles a request, what happens when more work arrives than we have capacity for, and how the fleet grows and shrinks across clouds as demand moves
• A lot of it is our own Rust service and the Kubernetes services that manage a multi-cloud fleet