Manage an assigned team through day-to-day support tasks
Oversee development plans for the team and provide mentorship to the team
Support pipelines end to end
Build and deploy enhancements and new developments or new data pipelines
Identify and drive optimisation opportunities across the environment
Manage the handover of new applications ensuring that required standards and practices are met

3+ years’ experience working in Big data environment, optimising and building big data pipelines
Minimum one year experience managing a team
Familiarity with Hadoop ecosystem and its components
Good knowledge of the concepts of Hadoop
Solid experience in a working environment in Big Data development utilising SQL or Python
Experience in Big Data development using Spark
Experience in Hadoop, HDFS and MapReduce
Experience in database design, development and data modelling

Specialist Support Engineer – DataOps

Key skills