Architect and lead delivery of AWS-based lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate.
Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases.
Define and enforce data architecture standards including ingestion patterns, layered/medallion designs, schema evolution, performance tuning, and cost optimization.
Implement production-grade engineering practices, including data quality validation, reconciliation, logging, monitoring, and operational alerting.
Apply data security and governance controls appropriate for federal and defense environments, including role-based access, controlled data handling, and auditability.
Partner with client stakeholders and product owners to translate mission and business requirements into technical designs, delivery roadmaps, and implementation plans.
Lead and mentor data engineers through code reviews, architecture reviews, and delivery execution; contribute to reusable accelerators and reference architectures.
Establish and mature CI/CD pipelines for Databricks workloads and supporting infrastructure, improving reliability, repeatability, and compliance of releases.
Requirements
US Citizenship required.
An ACTIVE and MAINTAINED "SECRET" Federal or DoD security clearance.
Bachelor’s degree obtained or equivalent experience.
Seven (7+) years of progressive experience in data engineering, data platform delivery, or data architecture roles, including leading technical teams or workstreams.
Strong hands-on experience with AWS data platforms, including designing and operating production systems leveraging Databricks on AWS.
Deep expertise with Apache Spark, Databricks, Delta Lake, Python, and SQL, including performance tuning of distributed workloads.
Experience designing scalable, secure data architectures that support analytics, reporting, and advanced use cases (e.g., AI/ML enablement).
Familiarity with Agile delivery methods and proven ability to collaborate effectively with cross-functional and client teams.
Strong written and verbal communication skills, including the ability to explain complex technical topics to non-technical stakeholders.
Tech Stack
Amazon Redshift
Apache
AWS
ETL
Python
Spark
SQL
Benefits
Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Position may be eligible for a discretionary variable incentive bonus
Parental Leave and Adoption Assistance
401(k) Retirement Plan
Basic Life & Supplemental Life
Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
Short-Term & Long-Term Disability
Student Loan PayDown
Tuition Reimbursement, Personal Development & Learning Opportunities