Architect, design, and implement advanced data products leveraging Azure Databricks, PySpark, and Apache Spark for large-scale data processing and machine learning opportunities.
Develop secure, scalable ETL/ELT pipelines using PySpark, integrating with Azure Data Factory, Event Hubs, Data Explorer, and other Azure services.
Ensure compliance with Humana’s cloud security controls and enterprise information protection (EIP) standards, including cluster configuration, data encryption, access management, and DDoS protection.
Lead technical evaluations, proof-of-concepts, and solution design for new data workloads, with emphasis on performance optimization and reliability.
Provide architectural guidance and mentorship to data engineers, scientists, and business stakeholders, promoting best practices for collaborative analytics development in Databricks notebooks and workflows.
Develop and maintain architectural documentation, standards, and governance processes in alignment with Humana’s technology strategies.
Coordinate incident response and remediation for cloud data platforms, partnering with security, infrastructure, and compliance teams.
Stay current with industry trends and Azure technology updates, proactively identifying improvements to Humana’s cloud analytics ecosystem.
Requirements
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field, or equivalent experience.
8+ years of experience in cloud architecture, with at least 4 years specializing in Azure Databricks and PySpark.
Proven expertise in designing and securing big data pipelines and analytics platforms in Azure.
Strong knowledge of Azure security controls, including DDoS Protection, data encryption, and access management.
Experience integrating Databricks with Azure Data Factory, Event Hubs, Data Explorer, and other Azure services.
Demonstrated ability to lead complex technical projects and communicate effectively with technical and non-technical stakeholders.
Advanced skills in Python, PySpark, and Spark SQL.
Familiarity with healthcare industry data privacy and compliance requirements (HIPAA, HITRUST, etc.) is a plus.
Tech Stack
Apache
Azure
Cloud
ETL
PySpark
Python
Spark
SQL
Benefits
medical, dental and vision benefits
401(k) retirement savings plan
time off (including paid time off, company and personal holidays, paid parental and caregiver leave)