Senior AI Engineer

QuinStreet is a pioneer in powering decentralized online marketplaces that match searchers and consumers with brands. They are seeking a Senior AI Engineer to design, build, and own an AI-powered compliance scraping engine and cloud infrastructure for monitoring credit card offer pages.

Responsibilities:

• Design and configure the production AWS environment (ECS/Fargate, SQS, API Gateway, RDS PostgreSQL, S3, IAM, CloudWatch) using infrastructure as code (Terraform or CDK)
• Build a stateless, containerized worker fleet that integrates Playwright-based page rendering, structured rule evaluation, and Claude API analysis
• Implement token optimization strategies across the LLM pipeline — prompt engineering, context pruning, caching, model selection, and batching — with measurable cost outcomes
• Define and document API contracts, job payload schemas, and database write patterns with the internal Laravel portal team to enable parallel development
• Build third-party API ingestion and field-level diff-detection logic that automatically adjusts monitoring rules when product data changes
• Handle modern web rendering challenges at scale: JavaScript-heavy SPAs, interstitials, cookie consent overlays, dynamic content, viewport switching, and full-page screenshot capture
• Evaluate when LLM analysis is the correct tool versus a classifier or rules-based approach, and design the two-stage rule-engine-plus-AI pipeline accordingly
• Build and maintain a unit test suite covering all modules and APIs to ensure uptime and proper functionality
• Document every architecture decision, configuration, API contract, and operational procedure continuously — not as a final-week deliverable
• Deliver a complete runbook and knowledge transfer to the internal team at engagement close
• Operate independently end-to-end while coordinating closely with the internal portal team and reporting directly to the Senior Director, surfacing risks and trade-offs early