Senior Manager – Data Engineer

Role Overview

• Provide technical leadership across multiple client engagements and internal product initiatives, setting direction and assuring quality for data engineering deliverables in line with the DDAT framework.
• Own end-to-end delivery governance for data engineering workstreams, including engagement planning, estimating, budgeting, mobilisation, RAID management, and delivery assurance.
• Lead architecture and design of scalable, secure, and cost-effective data platforms and pipelines (batch, streaming, API, event-driven, and unstructured), ensuring appropriate technology choices and design patterns.
• Define and enforce data engineering standards (coding, testing, CI/CD, observability, documentation, and operational readiness), and conduct technical assurance including design and code reviews.
• Partner with client stakeholders to understand business objectives, data maturity, information governance requirements, and security constraints; translate needs into robust roadmaps, backlogs, and delivery plans.
• Ensure compliance with relevant policies and regulations (e.g., data protection, access controls, retention), embedding data quality, lineage, metadata management, and auditability into delivered solutions.
• Lead multi-disciplinary teams (data engineers, platform/infrastructure engineers, analysts, data scientists, and product delivery) and contribute to ways of working that enable effective delivery (Agile, Discovery–Alpha–Beta–Live where appropriate).
• Drive platform reliability and performance, setting SLOs/SLAs where appropriate, and implementing monitoring, alerting, incident response processes, and continuous improvement.
• Lead and contribute hands-on to critical technical delivery when required (e.g., complex pipeline development, optimisation, troubleshooting, and secure integration design).
• Develop client and internal capability through coaching, mentoring, and formalised knowledge sharing; build and maintain communities of practice and reusable assets (patterns, accelerators, templates).
• Support growth of the Data & Digital practice through business development activities, including shaping proposals, defining delivery approaches, contributing to thought leadership, and supporting recruitment and capability planning.
• Provide people leadership for direct reports, including objective setting, performance reviews, development planning, and creating an inclusive, high-performing culture.

Requirements

• Demonstrable expertise in data engineering, including creating robust data pipelines for streamed, batched and on-demand data sources.
• Strong data modelling and analysis skills.
• Cloud and platform experience (Azure centric, strong understanding of Azure data services; Azure Data Factory etc.), Must Have experience in Databricks and Delta Lake.
• Strong understanding of API based integrations.
• Experience with integrating to SaaS platforms.
• Strong SQL experience.
• Exceptional problem-solving skills – an analytical, innovative, and creative mindset.
• Experience supporting the designing and delivering of data and digital solutions to solve business problems and create enduring value for clients.
• A growth mindset, enthused by challenge and the opportunity for continuous learning.
• Excellent interpersonal and communication skills, both written and verbal.
• Strong stakeholder management skills, including the ability to communicate technical concepts to non-technical audiences, influence decisions, and manage expectations at senior levels.
• Demonstrable leadership experience, including line management and coaching/mentoring of data engineering practitioners and multi-disciplinary delivery teams.
• Intellectual curiosity, exceptional client service, and a strong work ethic.
• Proven experience leading delivery of complex data engineering workstreams, including planning, estimation, prioritisation, governance, and active management of risks, assumptions, issues, and dependencies (RAID).
• Ability to adapt to rapidly changing circumstances and to think creatively to solve client issues.

Tech Stack

• Azure
• Cloud
• SQL

Benefits

• Generous leave package 26 days of annual leave (including your birthday!) plus UK bank holidays — increasing to 27 days after three years, and 28 after seven years
• You’ll also get five extra days for your five and 10-year anniversaries
• Additional leave for members of the Reserve Forces and CFAV.
• Private medical insurance Provided once you’ve completed your probation.
• Recognition and rewards £1,000 referral bonus for successful hires
• Performance-related awards
• Milestone and life-event hampers to celebrate life’s big moments
• Development & learning Annual training week abroad
• Funding for qualifications that benefit both you and the business
• Travel & wellbeing Cycle to work scheme
• Discounted travel through funded railcards
• Pension Our pension provider is NOW Pensions, pension contributions are 3% employer and 5% employee