Member of Technical Staff - AI Infra Algorithm

NeuroSpark AI builds and operates a high-performance AI inference platform for enterprise workloads. The Member of Technical Staff - AI Infra Algorithm designs and builds the platform’s scheduling and routing layer, balancing latency, utilization, and multi-tenant guarantees across a heterogeneous, multi-cloud GPU fleet.

Responsibilities:

• Own the scheduling and routing layer — design and build request admission, prioritization, batching, and placement across a heterogeneous GPU fleet spanning multiple clouds and accelerator types
• Engineer for latency and utilization at once — drive down tail latency while driving up fleet utilization; these fight each other, and resolving that tension well is the job
• Model the system, not just code it — apply queueing theory, control theory, and load-shedding principles to make the platform behave predictably under bursty, multi-tenant traffic
• Build multi-tenant fairness and isolation — ensure priority guarantees and SLO commitments hold when the fleet is saturated and customers are competing for the same capacity
• Own it in production — instrument, observe, and debug distributed behavior in a live system; carry your designs through rollout and real-world load
• Set the technical bar — make foundational architecture decisions, write the design docs that anchor them, and raise the engineering standard of everyone around you