Microsoft Fabric Data Engineer

Key Responsibilities

Data Migration & Engineering

Migrate data from Azure SQL databases and legacy ETL pipelines into Microsoft Fabric.

Redesign ETL processes and rebuild using Fabric capabilities.

Implement Medallion architecture (Bronze, Silver, Gold).

Design and Develop efficient ingestion, transformation, and orchestration pipelines.

Fabric Data Development

Build and manage pipelines using Fabric Data Factory.

Develop transformations using Spark notebooks (PySpark/SQL).

Create and model Fabric Warehouses.

Work with OneLake for unified storage and data access.

Performance & Optimization

Optimize Spark jobs, pipelines, and warehouse queries for performance.

Implement partitioning, incremental loads, and CDC patterns.

Ensure data quality, consistency, and reliability.

Security & Governance

Work with Fabric administrators on RBAC, workspace design, and data access controls.

Apply data governance standards including naming conventions, lineage, and metadata.

Support integration with Microsoft Purview.

DevOps & Automation

Implement CI/CD pipelines for Fabric artifacts using Git/Azure DevOps.

Support environment promotion (Dev Test Prod).

Automate deployments and data validation checks.

Collaboration & Support

Collaborate with BI teams to enable Power BI semantic models and reporting.

Work with stakeholders to understand data requirements and SLAs.

Provide production support and troubleshooting.

Required Skills & Qualifications

Technical Skills

Strong experience in data engineering using Microsoft Azure.

Hands-on experience with Microsoft Fabric, including:

Fabric Data Factory

Lakehouse & OneLake

Spark / Notebooks

Fabric Data Warehouse

Experience with Azure SQL, SQL Server, and relational databases.

Strong SQL and PySpark skills.

Knowledge of modern data architectures (Lakehouse, ELT, Medallion).

Experience with data migration and modernization projects.

Preferred / Nice-to-Have Skills

Power BI (data modeling, performance tuning).

Microsoft Purview / data governance tools.

CDC, event-driven ingestion, or streaming experience.

Fabric or Azure Data Engineer certifications.

Soft Skills