Senior Software Engineer, Data Ingestion - Autonomous Vehicles

NVIDIA is hiring a Senior Software Engineer for its Autonomous Vehicles division to improve the data ingestion platform. The role focuses on building and optimizing ingestion and data-serving pipelines, monitoring reliability, validating data quality, scaling infrastructure, and collaborating with AV development teams.

Responsibilities:

• Implement and maintain data ingestion pipelines from diverse sources, ensuring a continuous and reliable flow of AV data into the system
• Design and optimize data serving mechanisms to deliver AV data to different teams and applications in real-time and batch processing scenarios
• Monitor data pipelines and services to proactively identify and resolve any issues, ensuring data availability and reliability
• Collaborate with cross-functional teams to improve data processing efficiency, reduce latency, and enhance overall system performance
• Implement validation and data quality checks to ensure the integrity and accuracy of ingested data
• Scale data infrastructure to handle the ever-increasing volumes of AV data generated by our expanding fleet of vehicles
• Create and maintain detailed documentation for data ingestion and serving processes, ensuring knowledge sharing across the team
• Work closely with the AV development team to understand data requirements and contribute to the enhancement of data-driven solutions

Requirements:

• Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience)
• 8+ years of relevant experience working on autonomous vehicles and/or software infrastructure
• Extensive expertise in developing distributed systems
• Proven experience in designing and building data ingestion pipelines for large-scale systems
• Strong proficiency in data warehousing concepts, data modeling, and database management systems
• Proficient in Go, C++ and have experience with scripting languages such as Python or Matlab in a Linux environment
• Familiarity with distributed computing frameworks like Apache Spark or Hadoop
• Knowledge of cloud-based platforms (AWS, GCP, or Azure) and containerization (Docker/Kubernetes)
• Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment
• Hands-on experience with data streaming technologies (e.g., Kafka, RabbitMQ) is a plus