The Judge Group is seeking an Azure Data Engineer to build data pipelines from scratch. The role involves designing and developing scalable data pipelines and working on cross-functional teams to deploy data-driven applications.
Responsibilities:
- Design and develop highly scalable and extensible data pipelines from internal and external sources
- Leveraging open source technologies like Spark, Python, Hadoop, and cloud native tools to curate high-quality data sets
- Work on cross-functional teams to design, develop, and deploy data-driven applications and products, particularly within the space of data science
- Establishing best practices with respect to data integration, data visualization, schema design, performance and reliability of data processing systems
Requirements:
- Expert knowledge of relevant languages, such as SQL, dbt, Python, and/or C#
- Expert knowledge of at least one data pipeline orchestration tool, such as Azure Data Factory
- Expert understanding of data modeling and ETL concepts