Big Data Systems Engineer - Cloud (DevOps)

Hired Recruiters is seeking a Big Data Systems Engineer - Cloud (DevOps) to join their team. The role focuses on designing and implementing AWS solutions, managing infrastructure, and ensuring the integrity of complex systems' data.

Responsibilities:

• Designing, implementing, and operating AWS solutions primarily using EKS and EMR
• Manage our infrastructure with Git as the source of truth
• Use Terraform and Ansible to do all the heavy lifting
• Utilize Python and Bash
• Maintain proper immutable infrastructure using CICD declarative pipelines with Jenkins

Requirements:

• At least three years experience with Hadoop, Hbase, and Kafka
• Experience with Spark
• Familiarity with AWS EMR
• Experience with Kafka (Strimzi) and Spark on Kubernetes
• Certifiable in both AWS and Kubernetes or willingness to obtain certification
• Experience with Terraform and Ansible
• Ability to triage, diagnose, and remediate production failures at scale
• Strong monitoring and documentation skills
• Experience designing, implementing, and operating AWS solutions primarily using EKS and EMR
• Familiarity with infrastructure as code
• Experience managing infrastructure with Git
• Proficiency in Python and Bash
• Experience with CICD declarative pipelines with Jenkins