Key skills
Azure DatabricksPySparkSQLLakehouse ArchitectureMedallion ArchitectureLakebase PostgresPower BIDatabricks AppsMLflowAzure MLGenerative AIEmbeddingsVectorized DataRAG WorkflowsADLS Gen2Azure SynapseAzure Data FactoryAzure Key VaultPythonSparkDelta LakeRelational ModelingAI Data Access PatternsDatabricks Certified Generative AI Engineer AssociateAIMLRAGAnalyticsBIDatabricksAzureVaultPostgres
About this role
Abbott is a global healthcare leader that helps people live more fully at all stages of life. The AI/Data Engineer will contribute to the design, development, and operation of analytics and AI‑ready data solutions on Azure, focusing on building reliable data pipelines and AI-enabled applications.
Responsibilities:
- Develop and maintain batch and streaming pipelines using Azure Databricks, PySpark, and SQL
- Contribute to Lakehouse and Medallion Architecture components supporting BI, AI, and operational workloads
- Assist in designing and maintaining Lakebase Postgres data models to support AI applications and agents
- Build curated datasets and semantic layers for Databricks AI/BI Dashboards, Genie Spaces, Power BI, and downstream consumers
- Support Lakebase Postgres‑powered AI applications, ensuring data accuracy and reliability
- Contribute to Databricks Apps that surface analytics and AI insights to business users
- Assist with development and enhancement of AI agents, including data preparation and embedding pipelines
- Support ML workflows using MLflow and Azure ML integrations
- Contribute to generative AI pipelines such as embeddings, vectorized data, and RAG workflows
- Monitor and troubleshoot pipelines and application workloads
- Follow established Unity Catalog, governance, and security standards
- Collaborate with BI developers, data scientists, and senior engineers to deliver business outcomes
Requirements:
- Bachelor's degree in STEM related field or associate's degree in similar field and 7 years of experience in similar area
- 3 or more years of experience in similar area of expertise with bachelor's degree
- Databricks Certified Generative AI Engineer Associate
- Familiarity with ADLS Gen2, Synapse/Data Factory, Key Vault, and cloud fundamentals
- Understanding of ML and generative AI concepts
- Proficiency in Python and SQL; exposure to PySpark preferred
- Working knowledge of Spark, Delta Lake, and Databricks Apps
- Introductory experience with relational modeling and AI data access patterns
- Master's Degree in similar field