Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related analytics
Design, develop, and maintain ultra-high-scale data platforms that process petabytes of data
Participate in technical reviews of our products and help us develop new features and enhance stability
Continually help us improve the efficiency and reduce latency of our high-performance services to delight our customers
Research and implement new ways for both internal stakeholders as well as customers to query their data efficiently and extract results in the format they desire
Requirements
10+ years' experience combined between backend/cloud development and data platform engineering roles
5+ years of experience building data platform product(s) or features with (one of) Apache Spark, Flink or Iceberg, or with comparable tools in GCP
5+ years of experience programming with Java, Scala or Kotlin
Proven experience owning robust feature/product design end to end
Proven expertise with algorithms, distributed systems design and the software development lifecycle
Experience building large scale data/event pipelines
Expertise designing solutions with relational SQL and NoSQL databases, including Postgres/MySQL, Cassandra, DynamoDB
Good test driven development discipline
Reasonable proficiency with Linux administration tools
Proven ability to work effectively with remote teams
Tech Stack
Apache
Cassandra
Cloud
Distributed Systems
DynamoDB
Google Cloud Platform
Java
Kotlin
Linux
MySQL
NoSQL
Postgres
Scala
Spark
SQL
Benefits
Market leader in compensation and equity awards
Comprehensive physical and mental wellness programs
Competitive vacation and holidays for recharge
Paid parental and adoption leaves
Professional development opportunities for all employees regardless of level or role
Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections