Progressive InsuranceRemote
Data Engineer Junior or Senior
United States of America
Full Time
3 hours ago
$98,000 - $131,000 USD
No H1B
Key skills
PythonLinux Shell scriptingPrefectSnowflakeAWS S3AWS DynamoDBAWS CloudWatchAWS LambdaAWS SQSAzure OpenAI servicesTerraformGitHub ActionsAzure DevOpsCI/CD automationCloud PlatformsReal-time data streaming pipelinesBatch data pipelinesAI/ML infrastructure solutionsShellAIMLOpenAIAgenticData EngineeringAWSAzureLambdaS3CloudWatchSQSGitHubGitOpsCI/CDSales
About this role
Progressive Insurance is dedicated to helping employees move forward in their careers. They are seeking a Data Engineer, either Junior or Senior, to support data scientists on AI/ML experiments driving personalization and sales in their quote funnel, while owning the design and deployment of real-time data pipelines and cloud infrastructure.
Responsibilities:
- Support a talented team of data scientists on Real Time Decisioning (RTD) AI/ML experiments that drive personalization and sales in the direct-to-consumer Progressive quote funnel
- Own the design and CI/CD deployment of our real time data pipelines, engineered ML model features and cloud infrastructure that support our business-owned ML model serving APIs
- Work hands on with our Business and IT partners to design the next generation of generative and agentic infrastructure for our business-built applications
Requirements:
- Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of one year of work experience designing, programming, and supporting software programs or applications
- In lieu of degree, minimum of two years related work experience designing, programming, and supporting software programs or applications may be accepted
- Proficient in Python and Linux Shell scripting to build and support batch and real-time data streaming pipelines for use by ML/AI solutions (e.g., Prefect, Snowflake, AWS S3, AWS Dynamo DB)
- Familiar with supporting the AI model lifecycle by building and monitoring enterprise AI/ML infrastructure solutions leveraging Cloud Platforms (AWS CloudWatch, Lambda, SQS, Azure OpenAI services), Infrastructure as Code/GitOps tooling (e.g., Terraform), and CI/CD automation for real-time ML use cases (e.g., GitHub Actions, Azure DevOps)
- Strong verbal and written communications skills with the ability to translate technical information into understandable terms to a variety of audiences
- Passionate for innovating with cutting-edge technologies and owning end-to-end projects that evolve the data engineering landscape