Senior Data Engineer I

Pax8 is a fast-growing, dynamic organization focused on building a managed intelligence marketplace. The Senior Data Engineer will design and maintain scalable data pipelines, tackle complex data challenges, and mentor fellow engineers, contributing to the company's AI and automation journey.

Responsibilities:

• Design, build, and maintain scalable data pipelines that support diverse analytical and operational use cases
• Transform, model, and optimize data for performance, reliability, and accessibility
• Embed testing and quality practices throughout the data development lifecycle
• Collaborate on architecture, design reviews, and technical decision-making
• Continuously improve existing pipelines, tooling, and deployment processes
• Mentor and support the growth of fellow data engineers
• Troubleshoot and resolve complex data issues, including participation in an on-call rotation

Requirements:

• Substantial experience building data pipelines using Python and Structured Query Language (SQL)
• Proven expertise with distributed data processing frameworks such as Apache Spark
• Demonstrated experience with streaming platforms like Apache Kafka
• Strong background with orchestration and extract, transform, load (ETL) tools including Airflow, Prefect, or similar
• Experience working within major cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• Proficiency with analytical data stores like Redshift, BigQuery, Athena, or Presto
• Experience with infrastructure and deployment tooling (for example: Terraform, Docker, Kubernetes)
• Confidence building or contributing to continuous integration and continuous delivery (CI/CD) pipelines
• Clear communication skills and the ability to solve complex, ambiguous problems collaboratively