Mid-Level Data Engineer, Databricks

TeamWorx Security is seeking a Data Engineer to build and maintain data pipelines and data products for a federal government client. The role involves bringing in, cleaning, validating, and delivering reliable datasets for analytics, reporting, and automation using Databricks.

Responsibilities:

• Build, test, and support data pipelines in Databricks using Python, PySpark, and SQL, moving data from source systems into layered, reusable tables
• Validate data against its sources, track down discrepancies, and fix quality issues before they reach reporting
• Document pipelines, table definitions, and business rules so other engineers and analysts can use and maintain them
• Take ownership of assigned work through delivery and production support, raising risks and blockers early and keeping the team informed of progress
• Work with stakeholders and senior engineers to clarify requirements and pick up new tools as project needs change

Requirements:

• U.S. citizenship is required
• The candidate must be eligible to obtain and maintain federal suitability, a government-issued PIV credential, and required system access
• Bachelor's degree in computer science, data science, information systems, engineering, or a related field, or equivalent professional experience
• 5 years of data engineering, data analysis, or related technical experience
• Hands-on experience building pipelines in Databricks, including notebooks, PySpark or Spark SQL, and Delta tables
• Proficiency in Python and SQL
• Understanding of ETL/ELT, data modeling, and data quality practices
• Experience ingesting data through APIs
• Experience with Unity Catalog, Databricks Jobs or Workflows, and CI/CD deployment
• Experience with Google Cloud Platform
• Experience supporting a federal client