Coherent Solutions is a leading life insurance company that is part of a global financial services group. They are seeking an experienced Data Engineer to focus on developing and optimizing data pipelines within an Azure-based data platform, while collaborating with a team on Databricks solutions.
Responsibilities:
- Develop and maintain data pipelines in the Azure environment
- Work with Azure SQL Pools for data storage and processing
- Write and optimize SQL queries
- Perform performance tuning for queries and data workflows
- Collaborate with a team of engineers on Databricks-based solutions
- Build and orchestrate data workflows using Synapse Pipelines / Azure Data Factory
- Ensure reliability and consistency of data pipelines
Requirements:
- 3+ years of experience as a Data Engineer
- Solid proficiency in SQL
- Experience working in Azure cloud environment
- Experience with Azure SQL Pools
- Strong understanding of performance tuning for data workloads
- Excellent communication skills
- English level: B2 (Upper-Intermediate) or higher
- Experience with Azure data integration tools (Synapse Pipelines, Azure Data Factory)
- Experience with Python
- Experience with Databricks ecosystem (architecture, Unity Catalog, Delta tables, notebooks, lineage, permissions)
- Experience with CI/CD, DevOps practices, Infrastructure as Code (IaC)
- Familiarity with Databricks Asset Bundles