AI Infrastructure Engineer

Magen Financial LLC is a fintech brokerage company focused on delivering modern, technology-driven financial services and trading solutions. The AI Infrastructure Engineer will own the platform layer for AI services, ensuring advanced models are reliable and secure in production, while managing infrastructure and deploying GPU-based workloads.

Responsibilities:

• Designing and operating infrastructure for serving large and smaller specialist models
• Building secure internal APIs for AI-powered applications
• Deploying and managing GPU-based workloads across development and production
• Integrating model serving with retrieval systems, databases, internal services, and authentication
• Building CI/CD pipelines for model and application deployments
• Implementing observability for latency, throughput, errors, GPU utilization, and service health
• Supporting batch, interactive, and evaluation inference workloads
• Supporting fine-tuning, evaluation, and deployment while implementing secure access controls, audit logging, and environment separation
• Optimizing reliability, cost, and performance
• Defining standards for model packaging, versioning, rollout, and rollback