LLM Inference Engineer

NEAR AI is building decentralized and confidential machine learning infrastructure to enable user-owned AI at global scale. The LLM Inference Engineer will architect and maintain high-traffic LLM serving systems and optimize throughput, latency, and cost for leading open-source LLMs.

Responsibilities:

• Architect and maintain production high-traffic LLM serving systems
• Optimize throughput, latency, and cost for leading open-source LLMs