Software Engineer II - Core Ingest

Sumo Logic is hiring a Software Engineer II for their Core Ingest team. The role involves designing and developing distributed data processing capabilities across large data platforms to solve complex challenges related to low-latency and high-volume data management.

Responsibilities:

• Designing and implementing large data, extremely high-volume, fault-tolerant, scalable backend systems that process and manage petabytes of customer data
• Working to improve algorithms built to schedule load on clusters of thousands of machines elastically at runtime
• Improving systems to provide performance guarantees to customers in a shared-everything multi-tenant architecture
• Contributing to the re-architecting of our internal message processing technology to petabyte per day scale
• Helping manage exabytes of data using the latest and greatest technologies such as Kafka, Kubernetes and Docker
• Partnering across Sumo interfacing with multiple teams including Search, Security and Metrics & Tracing to identify requirements and architect solutions to meet their data core ingest needs

Requirements:

• B.S. or higher in Computer Sciences or related discipline (M.S. a plus)
• 2+ years of industry experience with a proven track record of ownership and delivery
• Experience developing scalable distributed data processing solutions
• Experience in multi-threaded programming
• Experience in running large, scalable distributed services following a microservice architecture
• Hands-on object-oriented programming experience (e.g., Java, Scala)
• Excellent verbal and written communication skills
• Willingness and experience with occasional on-call availability. Rotations scheduled approximately every 6-8 weeks for a 12-hour timeline, duration 1 week primary, 1 week to assist primary only if needed, starting 9-11 am PDT/MDT/CDT and ending 12 hours later
• Experience in big data and/or 24x7 commercial service is highly desirable
• Experience with Apache Kafka is a plus
• You should be happy working with Unix (Linux, OS X)
• Agile software development experience (test-driven development, iterative and incremental development) is a plus