Enterprise Data Warehouse ETL/Data Engineer

Role Overview

• Design and develop reusable, parameter-driven ingestion and transformation pipelines
• Build and maintain medallion architecture solutions
• Develop performant ELT workflows
• Create and optimize PySpark notebooks and distributed processing jobs
• Design dimensional data models
• Implement data vault patterns
• Optimize distributed SQL workloads
• Implement CI/CD processes
• Build monitoring, logging, and auditing solutions
• Lead or contribute to cloud modernization initiatives

Requirements

• Deep hands-on expertise with Azure Data Factory
• Strong experience with Azure Databricks and PySpark
• Production experience with Azure Synapse Analytics
• Strong understanding of Azure Data Lake Storage Gen2
• Experience with Azure Key Vault and Azure AD / Entra ID
• Experience monitoring and troubleshooting data solutions
• Advanced SQL skills
• Strong Python skills
• Proficiency with T-SQL and familiarity with Spark SQL

Tech Stack

• Azure
• Cloud
• PySpark
• Python
• Spark
• SQL
• Vault

Benefits

• Health insurance
• Professional development opportunities