Key skills
PythonSQLETLELTData EngineeringData WarehousingData LakeBIBusiness IntelligenceTableauPower BISnowflakedbtAzureAzure FunctionsCI/CDLeadershipCommunicationCollaboration
About this role
EXL is a company that specializes in data-driven solutions, and they are seeking a Lead Data Engineer with expertise in Azure. The role involves designing and developing ETL/ELT pipelines, maintaining data integration workflows, and providing technical leadership to junior engineers.
Responsibilities:
- Design and develop ETL/ELT pipelines using Azure Data Factory , Snowflake , and DBT
- Build and maintain data integration workflows from various data sources to Snowflake
- Write efficient and optimized SQL queries for data extraction and transformation
- Work with stakeholders to understand business requirements and translate them into technical solutions
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability
- Provide technical leadership and mentorship to junior data engineers
- Maintain and enforce data quality, governance, and documentation standards
- Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment
Requirements:
- Strong experience with Azure Cloud Platform services
- Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines
- Proficiency in SQL for data analysis and transformation
- Hands-on experience with Snowflake and SnowSQL for data warehousing
- Practical knowledge of DBT (Data Build Tool) for transforming data in the warehouse
- Experience working in cloud-based data environments with large-scale datasets
- Bachelor's degree in Data Engineering or a related field
- 8+ years of experience in data engineering roles using Azure and Snowflake
- Strong problem-solving, communication, and collaboration skills
- Experience with DataStage, Netezza, Azure Data Lake, Azure Synapse, or Azure Functions
- Familiarity with Python or PySpark for custom data transformations
- Understanding of CI/CD pipelines and DevOps for data workflows
- Exposure to data governance, metadata management, or data catalog tools
- Knowledge of business intelligence tools (e.g., Power BI, Tableau) is a plus