Remote || Data bricks Architect (Healthcare Domain)

Position: Databricks Architect (Healthcare Domain)

Location: Remote

Job Description

Required Skills & Experience

1. 15+ years of overall experience in Data Engineering, Data Architecture, Data Warehousing, Analytics, or Business Intelligence.
2. Strong hands-on experience with AWS cloud services and enterprise-scale Databricks implementations.
3. Proven experience serving as a Lead Architect or Principal Architect for enterprise data platform initiatives.
4. Advanced expertise in Python, PySpark, Spark SQL, Apache Spark, Delta Lake, and distributed data processing.
5. Deep hands-on experience with Databricks Architecture, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows, Databricks Asset Bundles, and cluster optimization.
6. Proven experience designing and implementing enterprise-scale data pipelines and metadata-driven frameworks.
7. Extensive expertise in ETL/ELT architecture, orchestration, optimization, and data platform operations.
8. Strong knowledge of Lakehouse Architecture and Medallion Framework (Bronze, Silver, Gold).
9. Experience designing dimensional models, enterprise data warehouses, semantic layers, and analytical solutions.
10. Experience with batch processing, streaming, incremental loads, CDC, and real-time data processing frameworks.
11. Strong understanding of data quality, governance, lineage, reconciliation, metadata management, and platform observability.
12. Hands-on experience with CI/CD pipelines, source control, Infrastructure as Code, and automated deployments.
13. Strong experience architecting large-scale healthcare data platforms involving:
    1. Claims Data
    2. Clinical Data
    3. EMR/EHR Systems
    4. Patient Data
    5. Provider Data
    6. Member Data

1. Knowledge of healthcare interoperability standards and regulations including:
   1. HL7
   2. FHIR
   3. ICD-10
   4. CPT
   5. HIPAA

1. Experience implementing enterprise data governance, MDM, data cataloging, and security frameworks.
2. Strong understanding of data security, privacy, encryption, role-based access controls, and PHI protection.
3. Experience migrating legacy data warehouses and ETL platforms to AWS and Databricks Lakehouse environments.
4. Excellent communication, stakeholder management, presentation, and customer-facing consulting skills.
5. Experience leading and mentoring cross-functional Data Engineering teams.
6. Ability to own architecture decisions from project initiation through deployment and production support.
7. Willingness and ability to work onsite and engage directly with business stakeholders.