Key skills
PythonGoRustDistributed SystemsDatabase InternalsVector DatabasesSearch EnginesMachine Learning InfrastructureModel Serving InfrastructureONNXTensorRTTransformer ArchitecturesEmbedding ModelsKubernetesRayInformation RetrievalNatural Language ProcessingAIMLVector DatabaseCommunication
About this role
Mixedbread.ai is focused on building AI search infrastructure that enhances user experience. They are seeking a Senior Software Engineer to develop scalable backend services and optimize performance for their AI search and embedding services.
Responsibilities:
- Design and implement scalable backend services that handle millions of embedding and search requests
- Optimize our vector database for sub-millisecond query performance at scale
- Build and maintain our model serving infrastructure across multiple deployment targets
- Collaborate with ML engineers to productionize new models and algorithms
- Improve observability and reliability of our distributed systems
- Mentor junior engineers and contribute to technical architecture decisions
- Write clean, maintainable code with comprehensive test coverage
Requirements:
- Strong experience with Python, Go, or Rust in production environments
- Deep understanding of distributed systems and database internals
- Experience with vector databases, search engines, or ML infrastructure
- Track record of building and scaling high-performance systems
- Excellent communication skills and ability to work in a remote-first environment
- Bachelor's degree in Computer Science or equivalent practical experience
- Experience with ONNX, TensorRT, or other model optimization frameworks
- Contributions to open-source projects in ML or infrastructure
- Knowledge of transformer architectures and embedding models
- Experience with Kubernetes, Ray, or similar orchestration systems
- Background in information retrieval or natural language processing