Principal / Distinguished Engineer, Machine Learning

Netskope is a market-leading cloud security company redefining Cloud, Network, and Data Security. They are seeking a visionary Distinguished Machine Learning Engineer to lead the architecture and deployment of large-scale AI/ML solutions for their Secure Access Service Edge architecture.

Responsibilities:

• Define the AI Transformation Roadmap: Drive the overarching AI/ML technical strategy, ruthlessly prioritizing architectural choices to ensure highly scalable, reliable, and production-grade systems
• Architect Production-Grade Inference Systems: Design, optimize, and deploy highly scalable AI/ML inference systems, leveraging the latest LLM serving technologies such as vLLM, SGLang, and advanced KV Cache optimization to maximize throughput and minimize latency
• Lead the End-to-End AI Lifecycle: Collaborate with ML scientists, engineers, and executive stakeholders to translate complex business requirements into industrialized enterprise solutions
• Establish Rigorous AI Evaluation: Create strict 'Report Cards' for AI models in production, ensuring models are robust, scalable, and well-documented by measuring accuracy, latency, and security relevance before deployment

Requirements:

• 12-15+ years of industry experience (or equivalent combination of an Advanced technical degree + experience) in architecting and developing AI/ML solutions, preferably on large-scale security products or services
• Fluency in the modern AI stack with proven, hands-on experience optimizing cutting-edge LLMs in production environments, with deep knowledge of vLLM, SGLang, and KV Cache optimization
• Ability to translate complex technical architectures and concepts between CXOs, non-technical stakeholders, and Data Scientists
• Energetic self-starter with a true startup spirit, demonstrated ability to influence without authority, and the willingness to wear multiple hats to deliver end-to-end solutions in a dynamic, fast-paced environment
• Advanced degree (Masters or PhD) in Computer Science, Electrical Engineering, or equivalent technical degree