Key skills
SQLDimensional ModelingData WarehouseETL PipelinesPythonSnowflakeAirflowETL/Integration Tools AdministrationRedshiftHadoopHiveSparkKafkaKinesisAWSAzureFivetranDBTPower BICI/CD PipelinesInfrastructure as Code (IaC)ScrumAIETLBIdbtCI/CD
About this role
OneTrust is a company focused on enabling innovation through the responsible use of data and AI. They are seeking a Senior Data Platform Engineer to be part of an innovative Enterprise data team that helps various departments explore data and build best-in-class data platform solutions and architecture for scale.
Responsibilities:
- You will work closely with data engineers, data architects, domain experts and business analysts to understand business requirements and help to build best in class data platform solutions and architecture for scale
- Build and automate modern data platforms (AWS, AZURE, Snowflake) with native technologies, deploy applications, and provision of infrastructure
- Perform Administration, Maintenance and provide support to production systems (Snowflake, Fivetran, DBT, Power BI, Airflow)
- Build and maintain CI/CD pipelines and infrastructure as code (IaC) practice across the platform for safe and reproducible deployments
- Design, build and implement automation framework for scale that deliver data with measurable quality under the SLA
- Drive technical conversations with stakeholders to understand the platform's needs and come up with a provisioning strategy
- Work effectively using scrum with multiple team members to deliver value effectively
- Reduce technical debt over time with root cause identification, issue resolution and promote best practices across the platform
Requirements:
- Bachelor's or master's degree in computer science, Engineering or related field
- 3+ years of overall experience and 3+ years of experience with very large-scale data warehouse projects
- Strong experience in SQL, knowledge of dimensional modeling, supporting data warehouse, scaling, optimizing and performance tuning ETL pipelines
- 1+ years of experience with Python and manipulation of various data formats for extraction and transformation
- 1+ years of experience with Snowflake, Airflow, ETL/Integration tools administration
- Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data technologies (Hadoop, Hive, Spark, Kafka, Kinesis)
- Experience evaluating new tools and enriching existing architecture
- You are a self-starter, hands-on technical expert who continuously gather and synthesize high-impact needs from business partners, design and implement the appropriate technical platform solution, and effectively communicate about deliverables, timelines and tradeoffs