Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. As an Airflow Reliability Engineer on the Customer Reliability Engineering team, you will provide expertise directly to customers, solving challenging Airflow problems and contributing to the overall success of Astronomer.
Responsibilities:
- Learn and build expertise across several software engineering disciplines, including:
- Airflow and data engineering
- Kubernetes
- Cloud Engineering
- Gain exposure to the big picture; learn about product, engineering, customer relationship management, and more
- Solve challenging Airflow problems for our customers. From optimizing configuration to identifying world-first Airflow bugs, you’ll see it all here
- Spend up to 20% of your time on side projects that contribute to Astronomer’s overall success, such as contributing to the open-source Airflow repository or developing Astronomer’s internal monitoring and alerting systems built on Airflow
- Work on a modern, sophisticated, cloud-native product that customers use to connect to dozens of other systems. Gain depth and breadth of learning!
- Work directly with our customers’ data engineers, system admins, DevOps teams, and management
- Provide feedback from your experience that can shape the direction of the Airflow project
- Own the customer experience, working directly with customers to prioritize and solve issues, meet SLAs, and provide “white glove” guidance on the path to production
- Participate remotely within a fully distributed team
- Help maintain 24x7 coverage through a specified 6-hour pager period during your work day
- Participate in paid on-call rotation for weekend coverage
Requirements:
- Data Engineering background
- 4 years of experience with Python
- 1 year of experience in Airflow administration and DAG creation
- Experience with Kubernetes/Docker/Containers
- Experience working with a distributed system with any major cloud provider (AWS, GCP, Azure)
- Problem-solving and troubleshooting abilities
- Ability to work well with autonomy and independence
- Strong written and verbal communication for connecting with our customers over our ticketing system and through Zoom
- Experience mentoring junior team members
- Contributions to open-source projects
- Customer Support experience
- Familiarity with SQL and PostgreSQL
- Experience with Databricks, Snowflake, Redshift, dbt, or other similar data engineering tools