Senior Data Engineer

Capital Technology Group provides expert consulting services in software development, digital transformation, and data analytics. They are seeking a Senior Data Engineer to architect, build, and optimize modern data platforms for federal initiatives, focusing on cloud-native data engineering and large-scale data pipelines.

Responsibilities:

• Design, build, and maintain scalable, high-performance data pipelines and data platforms using modern data engineering best practices
• Lead technical evaluations of emerging technologies through prototypes and proof-of-concept initiatives
• Build and optimize data solutions using Databricks, dbt, SQL (PostgreSQL), Python, and Java
• Develop cloud-native data architectures leveraging AWS services, including Redshift, RDS, S3, Glue, Lambda, DMS, and CloudWatch
• Design and implement efficient data models, ETL/ELT pipelines, and data integration solutions
• Implement Infrastructure as Code (IaC) using Terraform to automate cloud infrastructure deployments
• Monitor, troubleshoot, and optimize system performance using CloudWatch, Splunk, and other observability tools
• Collaborate with cross-functional teams to define business requirements and deliver scalable data solutions in Agile environments
• Provide technical leadership through mentorship, code reviews, architectural guidance, and engineering best practices
• Communicate technical concepts and solution strategies to both technical and non-technical stakeholders

Requirements:

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related technical field (or equivalent experience)
• 7+ years of professional experience in data engineering or related technical disciplines
• Deep hands-on expertise with Databricks
• Strong experience building cloud-native data platforms within AWS environments
• Advanced proficiency with dbt, SQL (PostgreSQL), Python, and Java
• Experience with AWS services, including Redshift, RDS, S3, Glue, Lambda, DMS, and CloudWatch
• Strong experience designing and maintaining scalable data pipelines and data models
• Experience implementing Infrastructure as Code (IaC) using Terraform
• Proven experience leading technical teams and mentoring engineers
• Strong analytical, troubleshooting, and problem-solving skills
• Experience working in Agile software development environments
• Ability to quickly learn new technologies and adapt to evolving project needs
• Excellent written and verbal communication skills with the ability to explain complex technical concepts to diverse audiences
• Applicants must be U.S. Citizens
• Ability to obtain a Public Trust clearance
• Experience with Kafka and real-time streaming data architectures
• Experience with Docker and Kubernetes
• Experience using Splunk for logging, monitoring, and observability
• Advanced SQL optimization, query tuning, and database performance experience
• Experience automating infrastructure and deployments with Terraform
• Experience supporting highly regulated, federal, or mission-critical environments
• Experience designing enterprise-scale data lakes or modern analytics platforms