Software Engineer, AI Infrastructure

Harell Data is a managed platform focused on transforming how scientific datasets are shared and utilized for model training. The Software Engineer, AI Infrastructure will lead the development of the core compute and orchestration layer, ensuring efficient resource management and building intuitive interfaces for developers.

Responsibilities:

• Architect GPU Compute Fabric: Build and manage the orchestration layer for GPU workloads, ensuring efficient resource allocation and cost management for large-scale training, fine-tuning, and inference
• Design Developer Interfaces: Build developer-centric SDKs and APIs that transform complex ML workflows into intuitive experiences for researchers and data scientists
• Operationalize the ML Lifecycle: Develop robust, end-to-end pipelines-from data ingestion and preprocessing to secure model serving and monitoring
• Client Success & Observability: Work closely with customers to debug fine-tuning jobs and build the observability tools required to track model performance and resource health in real-time
• Define Systems & Culture Strategy: Lead the technical roadmap by making critical "build vs. buy" decisions on infrastructure and security, while directly shaping the team’s engineering standards and hiring processes