GAC SolutionsRemote
Senior Azure Data Engineer
United States of America
Full Time
3 hours ago
H1B Sponsor Likely
Key skills
PythonPySparkSpark SQLSQL ServerAzure Data FactoryAzure Data Lake Storage Gen2Azure Key VaultAzure MonitorDatabricksDelta LakeUnity CatalogApache AirflowGitAzure DevOpsTerraformAzure ARM templatesSQLSparkAirflowAzureVault
About this role
GAC Solutions is seeking a Senior Azure Data Engineer. The role involves working with various technologies such as Python, Azure, and Databricks to manage and optimize data workflows.
Responsibilities:
- Python, PySpark, Spark SQL, SQL Server
- Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor)
- Databricks (Delta Lake, Unity Catalog, Workflows)
- Apache Airflow
- Git / Azure DevOps
- Deep Spark internals (DAG optimization, spill analysis, skew handling)
- Delta Lake advanced features (time travel, deletion vectors, predictive I/O)
- Unity Catalog governance (row/column security, external locations, system tables)
- IaC — Terraform, Azure ARM templates
Requirements:
- Python
- PySpark
- Spark SQL
- SQL Server
- Azure (ADF, ADLS Gen2, Key Vault, Azure Monitor)
- Databricks (Delta Lake, Unity Catalog, Workflows)
- Apache Airflow
- Git / Azure DevOps
- Deep Spark internals (DAG optimization, spill analysis, skew handling)
- Delta Lake advanced features (time travel, deletion vectors, predictive I/O)
- Unity Catalog governance (row/column security, external locations, system tables)
- IaC — Terraform, Azure ARM templates