Software Development Engineer II, AWS SageMaker AI

Amazon is a leading cloud services provider, and they are seeking a Software Development Engineer II for the AWS SageMaker AI team. The role involves designing, building, and operating distributed systems for a platform that facilitates the creation and management of foundation models.

Responsibilities:

• Design, build, test, and operate services that orchestrate foundation-model data preparation, training, evaluation, and deployment as reliable, contract-validated workflows
• Own delivery of individual components end-to-end — from design and implementation through deployment, monitoring, and on-call operations
• Build and extend compute-backend integrations and job launchers — submitting, monitoring, and recovering large-scale training jobs across SageMaker (Training/Processing/HyperPod), EMR, AWS Batch, and Kubernetes/EKS
• Improve the platform's resiliency and operability for long-running distributed jobs — checkpoint/resume, fault detection and recovery, retries, and observability (metrics, logging, experiment tracking)
• Contribute to the SDK, workflow orchestration, and schema/contract layer that teams use to declare and run jobs, and to the CDK infrastructure that deploys the platform
• Integrate containerized training and evaluation frameworks (e.g., PyTorch/FSDP, verl, NeMo/Megatron) into the platform's task and recipe model
• Contribute to design and architecture discussions, write clear technical designs, and uphold engineering best practices (code review, testing, operational readiness)
• Collaborate with ML scientists and internal customers to translate training requirements into reliable, self-service platform capabilities, and help onboard and mentor interns and new engineers as you grow