Key skills
ScalaC#SQLAPI designETL pipelinesData microservicesLarge language models (LLMs)Retrieval-Augmented Generation (RAG) frameworksDevOpsQuality AssuranceData ingestion frameworksAzureEnterprise software developmentHealthcare ITBatch and streaming data pipelinesEvent sourcingBig Data architecturesDatabricksHiveSparkFunctional programmingDistributed systemsMicroservicesService-oriented architecturesAzure administrationContainerizationDockerKubernetesCI/CDCAILarge Language ModelsRAGETLAnalytics
About this role
NeueHealth is a value-driven healthcare company committed to transforming healthcare and creating a better care experience for all. The Senior Data Engineer will focus on hands-on creation and maintenance of data properties, while also assisting in team productivity and system design improvements.
Responsibilities:
- Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala. May include development with C# and SQL
- Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores
- Develop and optimize processes for fine-tuning large language models (LLMs) and implementing Retrieval-Augmented Generation (RAG) frameworks to enhance AI-driven solutions
- Participate in building and owning a culture of DevOps and Quality Assurance
- Continuously document your code, framework standards, and team processes
- Build and support Data Ingestion frameworks deployed in Azure
- Other duties and responsibilities as assigned
Requirements:
- Bachelor's degree in Computer Science, Computer Engineering, Information Systems, or equivalent experience required
- Around Five (5) years of experience in an enterprise or commercial software development environment
- Enterprise development experience coding in Scala
- Experience building batch and streaming data pipelines (Scala)
- Experience with API design
- Extensive experience developing data-intensive solutions in a Cloud environment
- Extensive experience developing solutions that use event sourcing and/or Big Data architectures
- Experience engineering big-data solutions using technologies like Databricks, Hive, and Spark
- Experience with functional programming in Scala and C#
- Experience building distributed systems with microservices and/or service-oriented architectures
- Experience working within an Azure environment. Hands on Azure admin and DevOps experience is a plus
- Familiarity with containerization/virtualization, e.g., Docker, Kubernetes
- Familiarity with Databricks infrastructure management
- Familiarity with CI/CD best practices