Key skills
Data engineeringSQLPythonJavaGoogle Cloud Platform (GCP)Microsoft AzureBigQuerySQL ServerETL/ELT pipeline design and operationData modelingDimensional modelingSchema designSlowly Changing Dimensions (SCDs)AirflowCloud ComposerAzure Data Factory (ADF)DagsterPrefectHIPAA complianceProtected Health Information (PHI) data handlingGitCI/CDEnterprise cloud standardstranslate business requirements into technical solutionsDrive delivery independentlyETLELTData EngineeringAzureGCPcomposer
About this role
IDR, Inc. is seeking a Senior Data Engineer to join one of their top clients in the Healthcare industry. The role involves designing, building, and supporting scalable ETL/ELT pipelines across GCP and Azure cloud environments to support healthcare data initiatives.
Responsibilities:
- Design, build, and support scalable ETL/ELT pipelines across GCP and Azure cloud environments
- Own solutions end-to-end, from requirements and architecture through deployment and production support
- Drive technical decisions in ambiguous environments
- Translate business requirements into technical solutions and drive delivery independently
- Build and maintain automated batch and/or streaming data pipelines
- Design and operate scalable ETL/ELT pipelines
- Strong data modeling experience including dimensional modeling, schema design, and SCDs
- Work with Airflow, Cloud Composer, ADF, Dagster, Prefect, or similar orchestration tools
- Ensure compliance with HIPAA and PHI data handling requirements
- Work with Git, CI/CD, and enterprise cloud standards
- Expose to modern cloud technologies across GCP and Azure
- Build and support enterprise-scale healthcare data platforms
- Collaborate in a technology-focused environment
Requirements:
- Bachelor's degree in Computer Science, Information Technology, or related field; OR equivalent experience
- 7+ years of data engineering experience delivering production systems
- 5+ years of hands-on SQL development experience
- 3+ years building and maintaining automated batch and/or streaming data pipelines
- Strong SQL and Python or Java development skills
- Experience with GCP, Azure, BigQuery, and SQL Server
- Expertise designing and operating scalable ETL/ELT pipelines
- Strong data modeling experience including dimensional modeling, schema design, and SCDs
- Experience with Airflow, Cloud Composer, ADF, Dagster, Prefect, or similar orchestration tools
- Working knowledge of HIPAA and PHI data handling requirements
- Experience with Git, CI/CD, and enterprise cloud standards
- Ability to translate business requirements into technical solutions and drive delivery independently
- Interest in modern data technologies, cloud platforms, and emerging industry trends