Software Engineer, AI Infrastructure

Harell Data is a managed platform focused on unlocking valuable scientific datasets for various industries. The role involves owning the compute and inference layers, making architectural decisions, and working directly with customers to ensure the infrastructure meets their needs.

Responsibilities:

• Build the GPU compute layer - Orchestration for GPU workloads on Kubernetes: resource allocation, scheduling, multi-tenancy, and cost management
• Build the inference layer - Model loading, autoscaling, batching, and serving. You own the latency and throughput customers feel
• Own the ML pipeline end to end - Data ingestion, preprocessing, training and fine-tuning jobs, and recovery when multi-node jobs fail
• Work directly with customers - Debug fine-tuning jobs that fail or run slow. Build the observability that tracks model performance and resource health in real time
• Own reliability - Incident response, on-call, and keeping the platform up as usage grows
• Shape technical direction - Lead build-vs-buy decisions on infrastructure and security. Set engineering standards. Help hire the team you want to work with