Senior Data Engineer | Education | RVPR

Red Ventures is a global portfolio of high-growth companies, and they are seeking a Senior Data Engineer to help build, maintain, and strengthen the data platform that powers analytics, reporting, and decision-making across their education platforms. The role involves owning and improving production data pipelines, developing analytics-ready data models, and partnering with various teams to deliver reliable, scalable data solutions.

Responsibilities:

• Build, maintain, and optimize batch ETL/ELT pipelines in Databricks using Python and SQL
• Support day-to-day production pipeline operations, including monitoring, troubleshooting failures, managing backfills, and performance tuning
• Develop and maintain analytics-ready data models that support reporting, dashboards, and business insights
• Partner with analytics, BI, product, and business stakeholders to align data definitions and deliver scalable data solutions
• Integrate third-party data sources and APIs into the platform, ensuring clean ingestion, transformation, validation, and documentation
• Implement and maintain data quality checks, validation logic, observability practices, and operational documentation
• Support BI and reporting tools such as Tableau, Looker, or similar platforms by ensuring underlying data tables are performant, trusted, and well-modeled
• Help optimize Databricks workloads for reliability, scalability, performance, and cost efficiency
• Contribute to infrastructure-related work for data pipelines, including Terraform-managed resources and environment configuration
• Work with platform and security teams on Databricks governance, identity and access management, Unity Catalog registration, ownership, and permissions
• Participate in code reviews and contribute to engineering standards, CI/CD practices, and collaborative development workflows
• Support data migration and platform improvement efforts that move datasets and pipelines into production-grade environments

Requirements:

• 5+ years of professional data engineering experience designing, building, and operating production data solutions
• Hands-on experience with Databricks, Spark, and cloud-based data platforms, preferably AWS
• Strong SQL skills and proficiency in Python or Scala for building reliable, performant data pipelines
• Experience building and maintaining batch ETL/ELT pipelines in production environments
• Strong understanding of data modeling for analytics, including fact/dimension-style schemas and semantic-layer support
• Experience debugging, monitoring, backfilling, and tuning production data pipelines
• Working knowledge of infrastructure-as-code, particularly Terraform, as it applies to data platforms
• Familiarity with CI/CD, Git, GitHub, pull requests, code reviews, and collaborative engineering workflows
• Experience with Databricks Unity Catalog, including table registration, ownership, grants, and permission management
• Understanding of data governance, identity and access management, role-based access control, and service principals
• Ability to communicate clearly with technical and non-technical stakeholders
• Collaborative mindset and experience working across analytics, product, platform, and business teams
• Experience supporting BI and analytics platforms such as Tableau, Looker, or similar tools
• Familiarity with Delta Lake and governed lakehouse environments
• Exposure to dbt or other SQL-based transformation frameworks
• Experience integrating third-party data sources and external APIs into data platforms
• Experience with AWS services such as S3, EC2, Lambda, IAM, or related cloud infrastructure
• Background working with consumer-facing, content-driven, education, media, or digital platform data
• Experience supporting privacy-safe data sharing patterns, secure data exchange, or clean-room environments