Robot Learning Engineer

LightSpeed Build Technologies develops AI-powered robotic systems for construction and homebuilding. The Robot Learning Engineer will build teleoperation and demonstration-data systems, train imitation-learning and vision-language-action policies, and evaluate and deploy reliable behaviors on real robots. The role also oversees robotics data pipelines and external data partners.

Responsibilities:

• Build and improve teleoperation pipelines using leader arms for bulk arm motion and VR hand tracking for fine, finger-level interaction
• Retarget human hand motion to a dexterous robot hand, developing in simulation first and validating on hardware
• Design data collection protocols so demonstrations are consistent, well-structured, and train well
• Define what data is worth collecting and how much, and guide technicians who run collection sessions
• Train and fine-tune manipulation policies using imitation learning and vision-language-action (VLA) models
• Choose policy architectures and action representations suited to multi-step, contact-rich tasks
• Combine teleoperation data with human demonstration video to improve policies
• Iterate quickly from data to trained policy to real-robot trial
• Define and run evaluation protocols on real robots, measuring success rate per task step
• Diagnose failures across data, model, and hardware, and fix the right one
• Deploy policies on robots with ROS2-based control and optimize inference for real-time performance
• Work with integration engineers to run policies across a full task sequence
• Define dataset formats and data quality standards for training
• Supervise external partners who build data pipeline infrastructure and label human demonstration video, and set specs and accept deliveries
• Prototype extraction of useful training signals from egocentric (head-mounted camera) video in-house before scaling it out