Data Engineer

Education Analytics is a non-profit organization that provides research-informed analytics to educators and school administrators. The Data Engineer will design, build, and maintain automated data pipelines and analytic systems for partner education agencies, and contribute practical experience to core product development.

Responsibilities:

• Data Engineers at EA enable this mission by ensuring that the data educators receive is accurate, up to date, secure, and easily accessible
• The person in this role will design, build, and maintain automated data pipelines and analytic systems for our partner education agencies
• This will involve working directly on partner education agency projects to build data systems using EA’s tools, and use the experience of building real systems to advise and contribute to core product development
• Data engineers are responsible for extract/load processes, data warehouse design, data transformations, and data modeling

Requirements:

• 2+ years experience designing data pipelines, systems, and warehouses
• Knowledge of best design practices in cloud-based data warehouses
• Knowledge of software engineering practices, particularly in team-based development using Git
• Fluency in SQL and experience working with real world data
• Experience with Python
• Experience with Linux
• Experience with database administration, security, and management
• Experience with cloud-based columnar data warehouses and other cloud data technologies (Snowflake, RedShift, Databricks, Fabric, BigQuery)
• Experience working in environments with strict data security requirements
• Experience with dbt
• Experience with Apache Airflow
• Familiarity with AWS tooling and best practices
• Experience with education data, and the Ed-Fi data standard in particular
• Experience and interest in using AI code tools as part of development and automation workflows