Key skills
Ab InitioETLAb Initio GDEConduct ITMeta ProgrammingPDLHadoopShell ScriptingSQLAWSAmazon S3Amazon RedshiftHiveData WarehousingCloud MigrationPySparkBanking IndustryShellData EngineeringRedshiftS3AgileScrumProduct Management
About this role
Accenture is a leading global professional services company that offers local fixed-duration project-based work. They are seeking a Lead Data Engineer to design and implement scalable data applications while collaborating with various stakeholders to drive business transformation and deliver innovative solutions.
Responsibilities:
- Responsible for the design and implementation of scalable & fault tolerant data applications on on-prem & AWS to store and process terabytes of data from upstream sources with high availability
- Partner with information architects, platform architects, data scientists, and product management on solution requirements to design solutions
- Hands-on experience with Advanced Ab Initio concepts, including ETL project development, solution design, metaprogramming, PDL
- Design generic ETL frameworks using Ab Initio, coupled with strong hands-on involvement in audit and reconciliation workflows
- Strong cloud engineering skills with AWS, including hands-on experience with S3 , Amazon Redshift and related data services
- Work with batch and real-time data pipelines in a DevOps environment
- Hands-on understanding and working knowledge of the Hadoop ecosystem, including Hive
- Utilize innovative frameworks to avoid redundancy by promoting automation
- Identify enablers and level of effort required to properly ingest and transform data for the DWH & data
- Stay up to date on latest trends in data engineering, Coaches team members and recommend best practice, insights and/or expertise in deliverables
- Work closely with Product Owners, Product Managers, Program Manager, Scrum Masters and Team Members in a Scaled Agile framework
- Develop and maintain strong collaborative working relationships with Technology and Business Stakeholders
Requirements:
- Minimum of 5 years of data warehouse and ETL Ab Initio experience, including hands on technical and lead capabilities
- Minimum of 5 years of experience working with Ab Initio GDE, Conduct IT, Meta Programming, PDL, Hadoop, Shell Scripting, and SQL
- Minimum of 5 years of experience working in the banking industry
- High School Diploma or GED
- Bachelors or Associates degree
- Cloud Migration experience and PySpark