Airbnb is a global platform that connects hosts and guests for unique stays and experiences. The role involves architecting and managing a next-generation big data compute platform to support data ETL, analytics, and machine learning initiatives while ensuring reliability and performance.
Responsibilities:
- Architect, design, and implement Airbnb's next-generation big data compute platform to support data ETL, analytics, and machine learning initiatives
- Manage and operate the platform, continually enhancing its reliability, performance, observability, and cost-efficiency
- Produce high-quality, maintainable, and self-documenting code, actively participating in code review processes
- Contribute to open-source software and drive meaningful industry impact
Requirements:
- Experience: 6+ years of professional experience in data infrastructure, with a deep focus on big data technologies
- Big Data Proficiency: Expert-level knowledge of big data technologies, including Spark, Trino, Kunbernates, and AWS EMR
- Programming: Strong programming abilities in languages such as Java, Scala, and SQL
- System Design: Extensive experience in the design, construction, and maintenance of scalable, fault-tolerant distributed systems
- Database Systems: Familiarity with a variety of database systems, including both SQL and NoSQL
- Troubleshooting: Capacity to diagnose and resolve complex issues within data infrastructure environments
- Collaboration: Proven track record of working effectively with cross-functional teams to define system requirements, evaluate potential solutions, and manage system testing and integration
- Communication: Excellent written and verbal communication skills
- Teamwork: Demonstrated ability to thrive and contribute effectively within a team-oriented setting
- Education: BS/MS/PhD in Computer Science, a related field, or equivalent practical experience