Senior Data Engineer

Unite Us is on a mission to unlock the potential of every community, enhancing its positive influence on the healthcare industry. The Senior Data Engineer will be instrumental in constructing data warehouses, lakes, and pipelines, ensuring data integrity and accessibility for both internal and external stakeholders.

Responsibilities:

• Implement a data architecture and infrastructure that aligns with business objectives. Collaborate closely with Application Engineers and Product Managers to ensure that the technical infrastructure robustly supports client requirements
• Create ETL and data pipeline solutions for efficient loading of data into the warehouse along with their testing to ensure reliability and optimal performance
• Collect, validate, and provide high-quality data, ensuring data integrity
• Champion data democratization efforts, facilitating accessibility to data for relevant stakeholders
• Guide the team with regard to technical best practices and contribute substantially to the architecture of our systems
• Supporting operational work like onboarding new customers to our data products and participating in on-call for the team
• Engage with cross-functional teams, including Solutions Delivery, Business Intelligence, Predictive Analytics, and Enterprise Services, to address and support any data-related technical issues or requirements

Requirements:

• At least 6-8 years of experience in working with data warehouses, data lakes, and ETL pipelines
• Proven experience with building optimized data pipelines using Snowflake
• Expert in orchestrating data pipelines using Apache Airflow, including authoring, scheduling, and monitoring workflows
• Experience designing ETL/ELT data pipelines using data transformation tools like DBT
• Advanced SQL knowledge, with experience in pulling complex queries, query authoring, and strong familiarity with Snowflake or various relational databases like Redshift, Postgres, etc
• Strong proficiency in Python for building, optimizing and maintaining data pipelines and services
• Experience with CI/CD pipelines to automate testing, deployment and release of data engineering and analytics workflows using tools such as GitHub Actions, Jenkins etc
• Exposure to AWS and proficiency in cloud services such as ECS, S3, RDS, etc
• Experience with tools like Kubernetes, Terraform, Docker, Kafka
• Experience in developing applications for large enterprise clients
• Previous engagement with healthcare and/or social determinants of health data products
• Experience designing, building and maintaining data pipelines for healthcare claims and clinical data, ensuring data quality, scalability and compliance
• A dedicated focus on building high-performance systems
• Exposure to building data quality frameworks
• Experience using and building solutions to support various reporting and data user tools (Tableau, ThoughtSpot, etc)
• Strong problem-solving and troubleshooting skills, with the ability to identify and resolve data engineering issues and system failures
• Excellent communication skills, with the ability to communicate technical information to non-technical stakeholders and collaborate effectively with cross-functional teams
• The ability to envision and construct scalable solutions that meet diverse needs for enterprise clients with dedicated data teams