Designing, developing, and maintaining software applications that handle and process large volumes of data
Collaborating with cross-functional teams to understand data requirements and develop software solutions that effectively integrate and utilize data
Building and optimizing data models and databases for performance and efficiency
Writing code to extract, transform, and load data from various sources into data warehouses or data lakes
Implementing data quality checks and data governance processes to ensure data accuracy and consistency
Troubleshooting and resolving software and data-related issues
Working with big data technologies such as Hadoop, Spark, and Kafka
Conducting performance testing and optimization of software applications that handle large datasets

4+ years' work experience in the software engineering or data engineering domain
Expert knowledge and experience working with Scala or PySpark
Experience working with modern data pipeline orchestration tools to create complex ETL pipeline jobs
Experience working with SQL and NoSQL database systems
Experience in distributed system architecture design
Experience with acquiring and preparing data from primary and secondary disparate data sources
Experience with cloud environments (Azure Preferred)
Experience working with Databricks
Healthcare industry experience

Data Platform Engineer III

Key skills