Databricks Engineer

Blu Omega is hiring a Databricks Engineer to support data engineering, analytics, and modernization initiatives for a federal agency program. The role designs and maintains scalable Databricks data pipelines and analytics solutions in cloud-based enterprise environments.

Responsibilities:

• Design, develop, and maintain scalable Databricks data pipelines using PySpark, Spark SQL, Delta Lake, and Unity Catalog
• Configure, operate, and optimize Databricks clusters, jobs, and workflows to support performance, reliability, and cost efficiency
• Develop and maintain modular SQL transformations and data pipelines using dbt and modern data engineering practices
• Integrate Databricks solutions with CI/CD pipelines, version control, and enterprise SDLC processes
• Implement data quality, validation, monitoring, and observability practices to support accurate and reliable data
• Collaborate with stakeholders, data engineers, and technical teams to translate business requirements into scalable data solutions
• Support cloud-based data architectures and compliance with established security and governance standards

Requirements:

• Public Trust eligibility required
• Bachelor's degree and 3+ years of experience in data engineering or analytics engineering
• 2+ years of hands-on experience with the Databricks platform
• Strong experience developing data pipelines using PySpark, Spark SQL, and Python
• Experience with Databricks clusters, jobs, workflows, Delta Lake, and Unity Catalog in production environments
• Experience developing modular SQL transformations and managing data dependencies using dbt
• Experience integrating Databricks with CI/CD pipelines, Git, and enterprise SDLC tools
• Knowledge of cloud platforms such as AWS, Azure, or GCP and associated data services
• Experience implementing data quality, validation, and performance optimization practices
• Ability to work effectively in structured, compliance-driven environments
• Strong analytical, troubleshooting, communication, and collaboration skills
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination
• Experience supporting federal government or regulated industry programs
• Experience implementing machine learning or AI solutions in Databricks, including MLflow
• Knowledge of streaming data pipelines, data quality frameworks, or observability tools
• Databricks or cloud platform certifications