Capital Technology Group provides expert consulting services in software development and data analytics. They are seeking a Junior Data Engineer to design, build, and maintain scalable data pipelines and systems, partnering with other Data Engineers to evaluate new tools and technologies.
Responsibilities:
- Build and maintain scalable data pipelines and models using Databricks, dbt, and SQL (PostgreSQL)
- Develop robust data solutions leveraging AWS services (Redshift, RDS, S3, Glue, Lambda, DMS, CloudWatch)
- Implement data transformations and integrations using Python and Java
- Ensure reliability, performance, and maintainability of end-to-end data systems
- Implement infrastructure-as-code using Terraform for managing cloud resources
- Monitor and optimize system health and performance using CloudWatch and Splunk
- Mentor junior engineers and code reviews
- Clearly communicate technical topics to both technical and non-technical audiences
- Collaborate with cross-functional stakeholders to define data requirements and deliver solutions in agile environments
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related technical field
- 1+ years of professional experience in data engineering or related domains
- Strong hands-on experience with Databricks (deep expertise required)
- Strong hands-on experience with AWS native
- Strong hands-on experience with Dbt, SQL (PostgreSQL), Python, Java, Harness, AWS (Redshift, RDS, S3, Glue, Lambda, DMS, CloudWatch), Data Pipelines, Data Modeling, System Maintenance, Data Integration, Performance Optimization
- Strong analytical and problem-solving skills
- Experience working in agile, iterative software development environments
- Ability to quickly learn and apply new technologies and domain knowledge
- Excellent written and verbal communication skills, with the ability to explain complex topics to diverse audiences
- Experience with Kafka (streaming/data pipelines)
- Experience with Docker and Kubernetes for containerization and orchestration
- Proficiency with Splunk for log aggregation and system monitoring
- Experience using Terraform for infrastructure automation and management
- Strong SQL skills, including performance tuning and complex query design