Big Data Systems Engineer - Cloud (DevOps)

Hired Recruiters is seeking a Big Data Systems Engineer - Cloud (DevOps) to join their team. The role involves designing, implementing, and operating AWS solutions primarily using EKS and EMR, while managing infrastructure with Git, Terraform, and Ansible.

Responsibilities:

• Designing, implementing, and operating AWS solutions primarily using EKS and EMR
• Managing our infrastructure with Git as the source of truth
• Using Terraform and Ansible to do all the heavy lifting
• Utilizing Python and Bash for various tasks
• Maintaining proper immutable infrastructure using CICD declarative pipelines with Jenkins

Requirements:

• at least three years experience with Hadoop, Hbase, and Kafka
• experience with Spark
• certifiable in both AWS and Kubernetes or willingness to obtain certification
• experience with Terraform and Ansible
• ability to triage, diagnose, and remediate production failures at scale
• strong monitoring and documentation skills
• experience designing, implementing, and operating AWS solutions primarily using EKS and EMR
• familiarity with infrastructure as code
• experience managing infrastructure with Git
• proficiency in Python and Bash
• experience with CICD declarative pipelines with Jenkins