Software Engineer Intern (AML-Engine-Orchestration) - 2027 Start

ByteDance is a tech company known for its innovative products, including TikTok. They are seeking a Software Engineer Intern to join their Data-AML-Engine Orchestration team, where the intern will work on building large-scale machine learning infrastructure and orchestration capabilities.

Responsibilities:

• Design and build foundational orchestration capabilities for machine learning platforms, including Kubernetes Operators, container runtimes, and lifecycle management for jobs, services, and stateful workloads
• Build multi-tenant resource and quota systems that support priorities, preemption, fair sharing, elasticity, and cross-cluster scheduling. Improve GPU utilization and cost efficiency through resource pooling and FinOps
• Build lifecycle orchestration for online model serving, including model and image distribution, deployment, upgrades, rollback, autoscaling, multi-cluster operation, and disaster recovery
• Build serving orchestration and traffic management capabilities for disaggregated serving clusters, including topology-aware scheduling, KV Cache affinity, intelligent request routing, and QoS/SLA management