Senior Data Engineer – Temp to Hire
Madison, Wisconsin, United States of America
Full Time
3 hours ago
No Visa Sponsorship
Key skills
AWSPySparkPythonTerraformData LakeAnalyticsLambdaS3GlueGitHubAgileScrumKanbanCI/CDLeadership
About this role
Role Overview
- Develop and optimize data and data pipeline architecture
- Provide thought leadership to support software developers and data scientists
- Assemble large, complex data sets that meet functional requirements
- Identify and implement internal process improvements
- Build AWS infrastructure for data extraction and transformation
- Automate deployment and management of data services using IaC
- Contribute to CI/CD processes
- Develop analytics tools for actionable insights
Requirements
- 5 years of experience with Python and building data pipelines
- 3 years of experience working with AWS services
- 1-2 years of experience building or maintaining CI/CD pipelines
- 4 years applying Agile methodology (Scrum and/or Kanban)
- Advanced working Python and PySpark knowledge
- Strong knowledge of AWS services such as Glue, Lambda, S3, Data Lake
- Strong knowledge of Terraform and GitHub
- Experience building and optimizing data pipelines
- Strong understanding of DevOps practices
- AWS certifications are a plus
Tech Stack
- AWS
- PySpark
- Python
- Terraform
Benefits
- Flexible work environment
- Employee Resource Groups for professional and personal development