TRAC Recruiting is seeking a Lead Data Platform Engineer for a full-time and direct hire role for one of their health tech partners in the United States. This hands-on position involves architecting, building, and maintaining modern cloud-based data solutions, focusing on scalable data platforms and analytics infrastructure.
Responsibilities:
- Design, develop, and support scalable data pipelines and cloud-native data architectures
- Build and maintain production-ready applications and data processing frameworks using Python, PySpark, Scala, and related technologies
- Partner with engineering and business stakeholders to deliver analytics-ready datasets and reporting capabilities
- Contribute to technical architecture decisions, platform improvements, and development best practices
- Develop and optimize ETL/ELT workflows and streaming data solutions
- Create and manage data models, reporting structures, and analytics dashboards using AWS-native tools
- Work with relational and NoSQL databases to support high-volume data processing and storage requirements
- Implement cloud infrastructure solutions leveraging AWS services and container orchestration platforms such as Kubernetes or ECS
- Collaborate with operations teams on backup, disaster recovery, data retention, and security strategies
- Participate in code reviews, technical mentorship, and collaborative problem-solving across the engineering organization
- Evaluate and recommend modern technologies and frameworks that improve scalability, efficiency, and reliability
Requirements:
- 3+ years of professional experience in software engineering, data engineering, or cloud platform development
- Strong experience building and maintaining scalable data platforms and distributed processing systems
- Proficiency in Python, PySpark, Scala, and/or Typescript
- Hands-on experience developing Spark-based ETL and reporting frameworks using Spark SQL and Spark Streaming
- Experience with AWS cloud services, including tools such as S3, Redshift, Glue, Athena, EMR, Lambda, Step Functions, EventBridge, and QuickSight
- Knowledge of modern data storage and serialization formats such as Parquet and Iceberg
- Experience with relational databases and NoSQL technologies
- Strong understanding of cloud security concepts, including IAM, KMS, encryption, Secrets Manager, and data access controls
- Ability to independently troubleshoot technical challenges and deliver scalable solutions with minimal oversight
- Experience designing cloud-native applications and services in production environments
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical discipline, or equivalent practical experience
- Experience building enterprise data lakes, data platforms, or Data-as-a-Service solutions
- Familiarity with healthcare systems, healthcare analytics, or healthcare IT environments
- Exposure to modern analytics and reporting platforms in large-scale cloud ecosystems