AI Model Architecture Optimization Engineer R&D

OpenInfer is a company focused on AI optimization and research, and they are seeking an experienced AI Model Architecture Optimization Engineer to enhance large model architectures. The role involves innovating on AI model components, optimizing techniques for the PyTorch stack, and working collaboratively to drive features that improve performance and scalability.

Responsibilities:

• Innovate on AI model components, such as attention blocks, KV-cache strategies, layer streaming, tokenization, layer norms, and more, to improve AI model performance and scalability
• Optimize and integrate AI acceleration techniques into the PyTorch stack, enabling efficient use across diverse hardware platforms
• Own & drive features end to end to push the limits of large model architecture, ensuring seamless integration with existing frameworks
• Benchmark and profile AI models to evaluate performance improvements, ensuring optimal execution on target hardware
• Write and maintain clean, efficient code in Python, with a focus on integration with PyTorch
• Leverage CUDA for GPU-based acceleration when necessary, optimizing the attention blocks for maximum performance
• Work on cross-functional teams to design, implement, and test new features