AI Developer

Salvo Software is hiring an AI Developer to build and operate LLM-powered systems, including open-source model serving, RAG pipelines, and MCP integrations. The role also supports AI service deployment and operations across cloud infrastructure, CI/CD, and event-driven systems.

Responsibilities:

• Serve and operate open-source LLMs using Ollama and llama.cpp, locally and in on-prem environments
• Build and maintain RAG pipelines: embeddings, vector databases, chunking strategies, and retrieval quality
• Develop MCP (Model Context Protocol) integrations connecting LLMs to internal tools and data sources
• Build backend services in Python that power ML inference and AI-driven product features
• Parse and process structured and semi-structured data (XML/XSD, Office document formats) as pipeline inputs
• Grow into model optimization over time: quantization (GGUF), GPU/CUDA tuning, and offline/air-gapped deployments
• Build and maintain CI/CD pipelines for AI services (Azure DevOps preferred; GitHub Actions / GitLab CI also used)
• Deploy AI workloads to Microsoft Azure,AWS and containerize services with Docker
• Automate operational tasks with Python, Bash and/or PowerShell scripting
• Troubleshoot across the stack - dig into root causes rather than patching symptoms
• Support event-driven architectures using Apache Kafka (producers/consumers)