Key skills
PythonSQLETLELTData EngineeringData WarehousingData LakeDatabricksSparkAWSAzureGoogle CloudSQL ServerOAuth
About this role
Dice is a recruiting company seeking an Azure Data Engineer for a fully remote contract position. The role involves developing ETL/ELT pipelines, working with Azure Data Factory, and ensuring data security and governance.
Responsibilities:
- Advanced Databricks experience
- PySpark
- Python
- ETL/ELT Pipeline Development
- Strong SQL
- Azure Data Factory (ADF)
- Azure Cloud (or AWS/Google Cloud Platform experience)
- Big Data Processing
- Data Integration (APIs, Flat Files, Databases)
- Azure Data Lake Storage (ADLS)
- Secure External Connections (Service Principals, SAS Tokens, OAuth)
- Data Security & Encryption
- Data Governance & Data Quality
- Cloud Data Engineering
Requirements:
- Advanced Databricks experience
- PySpark
- Python
- ETL/ELT Pipeline Development
- Strong SQL
- Azure Data Factory (ADF)
- Azure Cloud (or AWS/Google Cloud Platform experience)
- Big Data Processing
- Data Integration (APIs, Flat Files, Databases)
- Azure Data Lake Storage (ADLS)
- Secure External Connections (Service Principals, SAS Tokens, OAuth)
- Data Security & Encryption
- Data Governance & Data Quality
- Cloud Data Engineering
- AWS or Google Cloud Platform
- Spark Optimization
- Cloud-native Data Architecture
- Performance Tuning
- Enterprise Data Warehousing
- On-Prem SQL Server Integration