Software Engineer, ML Infra & Distributed Systems (Staff & Principal)

Tubi is a free streaming service that entertains over 100 million monthly active users. As a Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference platforms that support essential services like personalized recommendations and search.

Responsibilities:

• Design and build scalable, high throughput, and low latency distributed systems using Scala
• Build reusable components and services that serve various ML applications like Personalization, Search, Ads and Exploration
• Partner closely with ML engineers to understand their challenges and limitations and develop scalable solutions to address them. Proactively recommend solutions to keep our ML Inference stack state of the art
• Take a data driven approach to identifying & optimizing latency, cost, and efficiency of our infra. Lead large scale cross functional refactorings if necessary
• Mentor other engineers on the team on system design, effective incident management, interviewing, leveraging LLMs for work, etc
• Collaborate with ML, Product, and cross functional engineering teams to define the long term vision and architecture for ML Infrastructure at Tubi