Staff Software Engineer - Core Ingest

Sumo Logic, Inc. helps make the digital world secure, fast, and reliable by unifying critical security and operational data through its Intelligent Operations Platform. As a Staff Software Engineer - Core Ingest, you will lead engineers in designing and developing distributed data processing capabilities and solve complex challenges related to high-volume data ingestion and management.

Responsibilities:

• Designing and implementing extremely high-volume, fault-tolerant, scalable backend systems that process and manage petabytes of customer data
• Work to improve algorithms built to schedule load on clusters of thousands of machines elastically at runtime
• Experience in multi-threaded programming and distributed systems
• Improve systems to provide performance guarantees to customers in a shared-everything multi-tenant architecture
• Lead and contribute to the re-architecting of our internal message processing technology to petabyte per day scale
• Help manage exabytes of data using the latest and greatest technologies such as Kafka, Kubernetes, and Docker
• Work across Sumo, interfacing with multiple teams, including Search, Security, and Metrics & Tracing, to identify requirements and architect solutions to meet their data core ingest needs

Requirements:

• B.S. or higher in Computer Sciences or related discipline (M.S. a plus)
• 6-8+ years of industry experience with a proven track record of ownership and delivery
• Experience developing scalable distributed data processing solutions
• Experience in multi-threaded programming
• Experience in running large scalable distributed services following a microservice architecture
• Experience in Apache Kafka
• Hands-on object-oriented programming experience (e.g., Java, Scala)
• Excellent verbal and written communication skills
• Understand performance characteristics of commonly used data structures (maps, lists, trees, etc)
• Experience in big data and/or 24x7 commercial service is highly desirable
• You should be happy working with Unix (Linux, OS X)
• Agile software development experience (test-driven development, iterative and incremental development) is a plus