
Key Responsibilities
Data Migration & Engineering
Migrate data from Azure SQL databases and legacy ETL pipelines into Microsoft Fabric.
Redesign ETL processes and rebuild using Fabric capabilities.
Implement Medallion architecture (Bronze, Silver, Gold).
Design and Develop efficient ingestion, transformation, and orchestration pipelines.
Fabric Data Development
Build and manage pipelines using Fabric Data Factory.
Develop transformations using Spark notebooks (PySpark/SQL).
Create and model Fabric Warehouses.
Work with OneLake for unified storage and data access.
Performance & Optimization
Optimize Spark jobs, pipelines, and warehouse queries for performance.
Implement partitioning, incremental loads, and CDC patterns.
Ensure data quality, consistency, and reliability.
Security & Governance
Work with Fabric administrators on RBAC, workspace design, and data access controls.
Apply data governance standards including naming conventions, lineage, and metadata.
Support integration with Microsoft Purview.
DevOps & Automation
Implement CI/CD pipelines for Fabric artifacts using Git/Azure DevOps.
Support environment promotion (Dev Test Prod).
Automate deployments and data validation checks.
Collaboration & Support
Collaborate with BI teams to enable Power BI semantic models and reporting.
Work with stakeholders to understand data requirements and SLAs.
Provide production support and troubleshooting.
Required Skills & Qualifications
Technical Skills
Strong experience in data engineering using Microsoft Azure.
Hands-on experience with Microsoft Fabric, including:
Fabric Data Factory
Lakehouse & OneLake
Spark / Notebooks
Fabric Data Warehouse
Experience with Azure SQL, SQL Server, and relational databases.
Strong SQL and PySpark skills.
Knowledge of modern data architectures (Lakehouse, ELT, Medallion).
Experience with data migration and modernization projects.
Preferred / Nice-to-Have Skills
Power BI (data modeling, performance tuning).
Microsoft Purview / data governance tools.
CDC, event-driven ingestion, or streaming experience.
Fabric or Azure Data Engineer certifications.
Soft Skills