Reddit, Inc. is a community-driven platform that fosters open conversations among its users. They are seeking a Software Engineer for their Data Movement team to enhance data processing capabilities and improve the efficiency of their data platform, which supports various critical operations across the company.
Responsibilities:
- Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users
- Own the Data Movement Platform used to enable batch and stream data processing at Reddit
- Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed
- Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data
- Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit’s Data Platform
Requirements:
- 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
- Proficient in object-oriented programming languages like Python, Scala, Go, or Java
- Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects
- Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure
- Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context