Principal Engineer, Big Data Platform

Pinterest is a platform that helps people discover creative ideas and plan meaningful experiences. The company seeks a Principal Engineer to lead the strategy, technical direction, and development of large-scale data infrastructure supporting big data and AI applications.

Responsibilities:

• Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications
• Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling
• Work with internal customers on critical business use cases that rely on big data
• Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale
• Contribute to the team’s technical vision and long-term roadmap

Requirements:

• 12+ years of industry experience with a proven track record of technical excellence
• 8+ years of experience of building and support large scalable Kubernetes or big data platform
• Deep knowledge of big data / ML technologies (e.g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow)
• Proficiency in one or more programming languages (Java, Go, Scala, Python)
• Experiences in Kubernetes and AWS technologies
• Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress
• Bachelor's degree in Computer Science, a related technical field, or equivalent experience
• This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country
• US based applicants only