Data Engineer

Role Overview

• Maintain the existing processes in place, monitoring batch failures, acting accordingly in identifying and resolving the root cause and communicate with stakeholders on resolution and timescales;
• Design and build data pipelines to collect data from different sources for different purposes and types of consumption across the whole data engineering life cycle;
• Build productive relationships with business stakeholders to understand high value business problems that can be solved through the application of data processing and analytical systems and deliver robust solutions on the back of it;
• Act as the single point of contact for the team in large projects being able to follow the process end to end – understand requirements, negotiate deadlines, raise with management resources required and risks, maintain status updates and technical delivery of the data requirements;
• Supporting other teams including data scientists and data operations analysts, by providing technical expertise, understanding and critically assess their requirements, negotiating delivery and deadlines;
• Understand business requirements and refine into development tasks, estimating their complexity and dependencies, including management of tasks delivered by other technical teams (ie. Devops);
• Contribute to define the best practices and standards for the development being done, including working with solutions architects to implement sustainable and consistent solutions for Hiscox UK.
• Review the work and coach junior team members, including embedded peer review process.

Requirements

• Passion for and experience of building data analytical platforms to deliver business value;
• Experience working with Microsoft Azure Data Lake Storage, Microsoft Azure Data Factory, Databricks, EventHub, SSIS and relational databases;
• Good understanding of different types of data (i.e. structured, semi-structured and unstructured data) and the considerations that should be made in how they are stored;
• Ability to contribute to all aspects of technical solutions to business problems – design, infrastructure, development, testing and maintenance;
• Track record of taking initiative and delivering projects end-to-end; clear evidence of being self-driven/ motivated, working autonomy;
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions, identify the source of any data errors or performance issues, identify opportunities for improvement and solve and /or implement them;
• The ability to communicate with all levels, and be confident enough to lead meetings, negotiate deliveries and deadlines and represent the team in projects;
• Immense curiosity, high energy and desire to go the extra mile to make a difference;
• Fluent in English, verbally and written.

Tech Stack

• Azure
• SSIS

Benefits

• great employee benefits that take care of your mental and physical wellbeing