Staff Software Engineer, Data Platform

Agility Robotics develops commercially deployed humanoid robots that operate alongside teams in warehouses, manufacturing facilities, and distribution centers. The Staff Software Engineer will design, develop, and maintain a fleet-scale data platform for ingesting, processing, discovering, serving, and analyzing massive datasets generated by robots. The role focuses on data pipelines, observability systems, big data processing, cloud platforms, and IoT integration.

Responsibilities:

• Data Ingestion: Design and implement scalable data pipelines for ingesting and processing telemetry, logs and sensor data from our fleet of robots and associated cloud software
• Data Agents: Develop and maintain data ingestion agents running directly on robot software to ingest high volume data in low connectivity environments
• Data Formats: Maintain and develop data formats and protocols optimized for transmission, storage and query of data recordings, sensor data and telemetry
• Observability systems: Develop and maintain observability systems using tools like fluentbit, OpenTelemetry etc enabling real-time monitoring and analytics of fleet operations
• Big Data Processing: Implement solutions to prepare high volume, high velocity data for analysis using technologies such as Spark, Kafka or equivalent
• Cloud Platform: Build and optimize tools for internal stakeholders for business intelligence and long-horizon fleet analytics and forecasting using existing tools like AWS S3, Athena, Sagemaker etc
• IoT integration: Leverage IoT experience to improve data collection and processing pipelines from robot sensors and edge devices

Requirements:

• 5+ years of strong experience in building and scaling cloud-based data platforms with familiarity in cloud providers like AWS, GCP or Azure
• Proficient in big data frameworks like Spark, Kafka, Beam, Flink etc
• Familiarity with OSS data formats like Parquet, Arrow, Iceberg and protocols like Avro and Protobuf
• Experience with observability tools(e.g. OpenTelemetry, Prometheus etc) and implementing metrics, tracing and logging systems
• Proficiency in languages like Java, Scala (any JVM), or Python and a solid understanding of distributed systems and microservices architectures
• Knowledge of IoT systems, edge computing or working with embedded devices is nice-to-have
• Data catalog experience (Datahub, Amundsen, Databricks Unity Catalog)
• Experience with Databricks
• Experience with Kubernetes
• Experience with Bazel/Blaze or other build systems
• Experience with C++, Rust
• Experience with robot data formats like mcap, ROS etc and data playback and visualization tooling like Rerun etc
• All of our roles are U.S.-based. Applicants must have current authorization to work in the United States
• Experience with Robotics, Autonomous Vehicles, or other sensor heavy workloads will be strongly preferred