Reddit is a community of communities and is looking to hire a Software Engineer for their Data Movement team to solve large scale data platform challenges. The role involves creating and improving scalable systems, maintaining data infrastructure, and building solutions for efficient data processing.
Responsibilities:
- Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users
- Own the Data Movement Platform used to enable batch and stream data processing at Reddit
- Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed
- Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data
- Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit’s Data Platform
Requirements:
- 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
- Proficient in object-oriented programming languages like Python, Scala, Go, or Java
- Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects
- Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure
- Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context