Dice is seeking a Big Data Support Engineer to provide support for Big Data applications primarily in AWS for Market Regulation. This mid-level role involves monitoring batch processing, automating data monitoring using Python scripting, and managing cloud infrastructure solutions on AWS and Azure.

Responsibilities:

Big data operations activities for AWS services in support of the processing of market volumes of big data. Work involves monitoring batch processing, data processing execution, SQL status queries, management / remediation of issues, and escalation activities
Work also includes automation of data monitoring using Python scripting and SQL queries. Usage of central batch processing tools like JAMS or any other equivalent is valuable to have. Scripting experience is required, and mid-level knowledge of Python and PowerShell is desired. Client has a very mature automated deployment pipeline for deploying applications through their development lifecycles
SQL, Postgres, Oracle, or equivalent database experience and building/running queries is a must
Review and analyze process and system specifications to ensure delivery requirements are met across hybrid Linux and Windows environments
Operate cloud infrastructure solutions on AWS (EC2, ECS, Lambda, Cloud Watch, IAM) and Azure (Virtual Machines, Container Instances, Monitor, Active Directory)
Ensure the Company's Reliability, Availability and Serviceability (RAS) metrics are sustained and improved through proactive monitoring, automation, and continuous optimization across hybrid environments
Document test plans as well as create/revise and execute Bash, Python, or other scripting languages for automation and infrastructure-as-code implementations
Proficiency in Workload Automation Scheduler and ability to Implement and manage batch schedules using software such as JAMS/Broadcom AutoSys
Monitor system performance and resolve scheduling conflicts or failed job as well as implement change management procedures for Job scheduling
Implements and updates monitoring tools for Linux systems, containerized applications, and cloud resources using industry-leading platforms and AI-enhanced observability solutions
Monitors operating system and cloud infrastructure performance to achieve optimum performance levels, checking system logs, analyzing CPU/memory/IO usage, and using performance monitoring tools to detect and resolve bottlenecks
Proficiency in Operating System & Software Debugging, experienced-level troubleshooting of Windows Server and/or Linux operating systems, including patching, application deployment, and server hardware maintenance
Proficiency in CI/CD pipeline tools such as Jenkins and GitLab with good understanding of git branching strategies, deployment pipelines and performances and ability to identify and resolve deployment failures
Interface with other team members and other teams to ensure technology solutions and staff are aligned with customer expectations and overall technology vision, including DevOps, Security, and Application Development teams
Lead/Co-lead internal process improvement initiatives focused on automation, containerization, and AI adoption. Provide feedback on processes by offering suggestions
Participate in periodic Disaster Recovery (DR), Business Continuity Planning (BCP) and Sarbanes Oxley (SOX) testing and reporting, including validation of backup/recovery procedures for Linux systems, containerized applications, and cloud resources

Requirements:

Bachelor's degree in Computer Science, Information Systems or related discipline with at least five (5) years of related experience, or equivalent training and / or work experience
Mid-level support engineer that will provide primarily support of Big data operations in AWS for Market Regulation
Experience with AWS Services, UNIX, Windows, SQL, Postgres, Batch Scheduling
Ability to work under minimal supervision to maintain enterprise Linux infrastructure across on-premises data centers and cloud environments
Experience with automation of data monitoring using Python scripting and SQL queries
Scripting experience is required, and mid-level knowledge of Python and PowerShell is desired
SQL, Postgres, Oracle, or equivalent database experience and building/running queries is a must
Review and analyze process and system specifications to ensure delivery requirements are met across hybrid Linux and Windows environments
Operate cloud infrastructure solutions on AWS (EC2, ECS, Lambda, Cloud Watch, IAM) and Azure (Virtual Machines, Container Instances, Monitor, Active Directory)
Ensure the Company's Reliability, Availability and Serviceability (RAS) metrics are sustained and improved through proactive monitoring, automation, and continuous optimization across hybrid environments
Document test plans as well as create/revise and execute Bash, Python, or other scripting languages for automation and infrastructure-as-code implementations
Proficiency in Workload Automation Scheduler and ability to Implement and manage batch schedules using software such as JAMS/Broadcom AutoSys
Monitor system performance and resolve scheduling conflicts or failed job as well as implement change management procedures for Job scheduling
Implements and updates monitoring tools for Linux systems, containerized applications, and cloud resources using industry-leading platforms and AI-enhanced observability solutions
Monitors operating system and cloud infrastructure performance to achieve optimum performance levels, checking system logs, analyzing CPU/memory/IO usage, and using performance monitoring tools to detect and resolve bottlenecks
Proficiency in Operating System & Software Debugging, experienced-level troubleshooting of Windows Server and/or Linux operating systems, including patching, application deployment, and server hardware maintenance
Proficiency in CI/CD pipeline tools such as Jenkins and GitLab with good understanding of git branching strategies, deployment pipelines and performances and ability to identify and resolve deployment failures
Interface with other team members and other teams to ensure technology solutions and staff are aligned with customer expectations and overall technology vision, including DevOps, Security, and Application Development teams
Lead/Co-lead internal process improvement initiatives focused on automation, containerization, and AI adoption
Participate in periodic Disaster Recovery (DR), Business Continuity Planning (BCP) and Sarbanes Oxley (SOX) testing and reporting, including validation of backup/recovery procedures for Linux systems, containerized applications, and cloud resources
Knowledge of industry leading monitoring and diagnostic tools
Knowledge of at least one operating system and at least one contemporary scripting language
Knowledge of communication and network technologies
Exposure to common operational practices like metrics reporting, change management, incident management, problem management and communication
Strong written and verbal technical communication skills
Demonstrated ability to develop effective working relationships that improved the quality of work products
Should be well organized, thorough, and able to handle competing priorities
Ability to maintain focus and develop proficiency in new skills rapidly
Ability to work in a fast paced environment
Ability to working well under pressure

Desktop Support Engineer

About this role