Key skills
Azure DatabricksDatabricks notebooksSpark workloadsStructured pipelinesETL pipelinesMetadata-driven ingestion frameworkData warehouse designSQLT-SQLSSISStored proceduresFunctionsPerformance tuningHealthcare domain experienceETLData WarehousingAnalyticsDatabricksSparkAzure
About this role
Polar IT is seeking an Azure Databrick Engineer for a remote position. The role involves integrating ETL pipelines into Databricks and supporting data warehousing and analytics workloads.
Responsibilities:
- Integrating ETL pipelines into Databricks for transformation/analytics
- Supporting operational and analytics workloads
- Clear documentation of schemas, ETL flows, and data mappings
- Building, optimizing, and supporting SSIS-based ETL pipelines
- Writing complex SQL / T‑SQL (stored procedures, functions, performance tuning)
- Troubleshooting ETL failures and performance bottlenecks
Requirements:
- Native Databricks technologies
- Metadata-driven ingestion framework
- Databricks Integration Experience -Integrating ETL pipelines into Databricks for transformation/analytics
- Databricks notebooks, Spark workloads, or structured pipelines
- Data warehouse design (facts/dimensions, ingestion patterns)
- Supporting operational and analytics workloads
- Clear documentation of schemas, ETL flows, and data mappings
- SQL + SSIS development skills
- Building, optimizing, and supporting SSIS-based ETL pipelines
- Writing complex SQL / T‑SQL (stored procedures, functions, performance tuning)
- Troubleshooting ETL failures and performance bottlenecks
- Azure Databricks strongly preferred
- Healthcare experience is preferred