Definitive Healthcare is a rapidly growing company that focuses on transforming data and analytics into meaningful intelligence for the healthcare sector. The Senior Data Engineer will manage and integrate data from various sources, optimizing data flows and collaborating with engineering teams to enhance product development.
Responsibilities:
- Managing data coming from various sources and integrating data into our product utilizing expertise in SQL, Python, AWS Argo and/or Airflow workflows
- Integrating new data assets into our product and re-engineering existing data flows for optimal performance utilizing SQL, Python, and AWS workflows
- Adding value to our product through creativity and ability to explore innovative solutions pertaining to optimizing and operationalizing the ways in which we currently collect and transform data and regarding how to best incorporate new and evolving data sets based in your SQL and ETL expertise and familiarity with automation tools
- Working collaboratively with other engineers on large scale projects and serve as a mentor for junior engineers, helping them hone their technical acumen relating to SQL, Python and AWS
- Working closely with Product Management and Product Engineering teams on the development and engineering of our product and the complex data and data structures it contains. Additionally, partnering with teams to support the continuous evolution and growth of our product and its intricacy
Requirements:
- 5+ years of professional experience, ideally in a data engineering role
- Intermediate to advanced SQL proficiency
- Experience using Python or a similar language
- Experience using ETL tools. Preferably AWS Argo and/or Airflow. Nice to have SSIS
- Experience with data engineering, preferred within healthcare
- Understand data modelling concepts
- Familiar with code repos such as GitHub and/or Azure
- Experience with database systems such as SQL Server and Postgres
- Familiar with AWS S3 storage and Databricks unified data platform
- Leverage AI tools to help facilitate code development
- Desire to take on more responsibility and ownership of your work
- Excellent analytical skills, including working with large data sets