Data Engineer

Inizio Partners is a company seeking a Data Engineer specializing in consent management. The role involves developing and optimizing data pipelines, automating data processes, and ensuring smooth operations between various platforms.

Responsibilities:

• Develop, build, optimize and implement pipeline, data ingestion, storage, wrangling, cataloguing, quality, security features from various data sources on cloud
• Monitor and ensure the smooth operation of data pipelines between OneTrust and external Club platforms (ESPs, CRMs, etc.)
• Automate jobs (ingestion & pipelines), notifications and reports
• Assist in the ongoing data integration tasks (e.g., connectors, APIs) between OT and various business systems
• Write quality code and participate in code reviews
• Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD
• Continuously improve systems through performance enhancements and cost reductions in compute and storage
• Prioritize to manage ad-hoc requests in parallel with ongoing sprints
• Participate with the team to execute sound solutions and approaches to meet business expectations in an efficient manner; deliver and execute the technical and product roadmap for data engineering across a variety of technologies
• Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations

Requirements:

• Experience working in AWS, Redshift, Glue and basic API integrations
• Prior exposure to Data Ingestion and Curation work (such as working with Data Lakehouse)
• Knowledge in SQL for purpose of data analysis/investigation
• Work with the Data Product Owners and Data Analysts to help manage and deliver on the product technical roadmap for the data platform
• Degree in computer science, statistics, or related discipline
• 5+ years as a data engineer
• Comfortable making decisions and leading
• Familiar with version control and relational databases
• Familiar with OneTrust or similar consent management platforms