Gallagher is a global community focused on empowering businesses and individuals to thrive. The Data Engineering Manager will lead the design, development, and implementation of data initiatives, mentor teams, and ensure alignment with business goals while managing project deliverables and operational excellence.
Responsibilities:
- Lead requirements gathering, scope definition, and technical design of integration workflows, ensuring alignment with business objectives and providing strategic direction to the team
- Experience managing and mentoring a team of Data Engineers (onsite and offshore)
- Proactively identify risks and uncertainties in data initiatives, and develop strategies to mitigate them while ensuring project success
- Provide leadership, direction, and coordination for development and support teams, including globally located resources, ensuring effective communication and collaboration
- Act as a liaison between technical teams and business users, ensuring that data solutions meet business needs and addressing concerns or uncertainties effectively
- Manage deliverables across multiple teams, ensuring timely completion and alignment with business priorities
- Seek out, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability
- Build the infrastructure required for optimal ETL/ELT pipelines to ingest data from a wide variety of data sources using Microsoft Azure technologies such as Azure Data Factory and Databricks
- Construct and maintain enterprise-level integrations using the Snowflake platform, Azure Synapse, Azure SQL, and SQL Server
- Create data tools for data analytics and data science team members that assist them in building and optimizing our product into an innovative industry leader
- Lead troubleshooting efforts, driving root-cause analysis, and coordinating with infrastructure teams to resolve incidents while maintaining transparency with stakeholders
- Design analytics tools that utilize the data pipeline to deliver actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
- Provide ongoing support for data systems and integrations, ensuring reliability and performance while addressing issues promptly
Requirements:
- A relevant technical BS Degree in Information Technology
- Proven experience in leading cross-functional teams, managing business users, and driving alignment between technical and business objectives
- 3+ years of experience leading a technical team
- 7+ years of data engineering experience leveraging technologies such as Snowflake, Azure Data Factory, ADLS Gen 2, Logic Apps, Azure Functions, Databricks, Apache Spark, Scala, Synapse, SQL Server
- Experience with scripting tools such as Power Shell, Python, Scala, Java, and XML
- Understanding the pros and cons, and best practices of implementing Data Lake, using Microsoft Azure Data Lake Storage
- Experience structuring Data Lake for reliability, security, and performance
- Experience implementing ETL for Data Warehouse and Business Intelligence solutions
- Skills to read and write effective, modular, dynamic, parameterized, and robust code, establish and follow already established code standards, and ETL framework
- Strong analytical, problem-solving, and troubleshooting abilities
- Good understanding of unit testing, software change management, and software release management
- Knowledge of DevOps processes (including CI/CD) and Infrastructure as Code fundamentals
- Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement
- Experience working within an agile team
- Exceptional communication and interpersonal skills, with the ability to influence and guide stakeholders at all levels
- Demonstrated ability to manage relationships with business users, address their concerns, and ensure their needs are met through effective communication and collaboration
- Experience in navigating ambiguity and uncertainty in projects, with a track record of delivering successful outcomes
- Proven experience managing deliverables across multiple teams and providing ongoing support for data systems and integrations