General MotorsRemote
Senior Software Engineer, ML Data Platform
United States of America
Full Time
2 weeks ago
$216,000 USD
H1B Sponsor Likely
Key skills
Data consumption tools developmentData miningData processing toolsData orchestrationLarge-scale data pipelinesApache BeamApache SparkCloud computingDistributed data systemsPythonJavaScalaSQLData management systems at petabyte scaleCost optimization of data clustersHigh-throughput data serving systemsLow-latency data serving systemsHigh QPS data serving systemsMLSparkData Mining
About this role
General Motors is a leading automotive company committed to innovation and sustainability. They are seeking a Senior Software Engineer for their ML Data Platform to develop robust data tools, optimize data processing systems, and lead technical projects in a cloud environment.
Responsibilities:
- Develop fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company
- Develop orchestration for large-scale post-processing, and computational pipelines
- Participate in the development, optimization and productionization of the next generation data processing platform using Beam and Spark in the cloud
- Build self-serve capabilities to help customers to adopt the next generation data processing platform
- Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud
- Champion engineering excellence by continuously improving systems and processes
- Own technical projects from start to finish, contribute to the team’s product roadmap, and be responsible for major technical decisions and tradeoffs
- Effectively participate in team’s planning, code reviews and design discussions
- Consider the effects of projects across multiple teams and proactively manage conflicts
- Work with partner teams and orgs to achieve cross-organizational goals and satisfy broad requirements
- Conduct technical interviews with well-calibrated standards and play an essential role in recruiting activities
Requirements:
- Bachelor's degree in Computer Science, Electronic Engineering, Management Information Systems, or related field of study
- Five (5) years of experience as a Software Engineer, Programmer Analyst, or related occupation
- Five (5) years of experience with Building Peta Byte (PB) scale data management systems
- Five (5) years of experience with Optimizing those data processing clusters for cost efficiency and performance
- Five (5) years of experience with Building serving systems capable of delivering data at high-throughput, low-latency and high QPS (Queries Per Second) in a cost-efficient and spike-resilient manner
- Five (5) years of experience with Building scalable infrastructure on the cloud with Python, Java, or Scala
- Five (5) years of experience with Writing SQL queries for analytic purposes