Principal Data Engineer (GCP & Big Query)

Sparq is a modern product engineering partner helping organizations modernize confidently in the age of AI. The Principal Data Engineer will own end-to-end data pipelines and architect scalable solutions while applying expertise in Google Cloud Platform and BigQuery.

Responsibilities:

• Own data pipelines end to end—from ingestion and transformation through validation and delivery—while bridging modern cloud data architecture with legacy enterprise reporting systems still in active use
• Architect solutions for scale, including designing data models, partitioning and clustering strategies, and query optimization for datasets ranging from multiple terabytes to petabytes
• Apply advanced, hands-on Google Cloud Platform and BigQuery expertise to make architectural decisions related to partitioning, clustering, and cost and slot management
• Build and operate production pipelines from ingestion through final delivery, taking full ownership rather than contributing to only one part of a shared system
• Use advanced SQL to develop complex queries and optimize performance at scale
• Work extensively within legacy enterprise reporting environments using SQL Server, stored procedures, and SSRS. This is an active requirement, not simply a technology associated with a previous role
• Build data monitoring, reconciliation, and automated quality-assurance frameworks to support data validation and integrity
• Manage ETL/ELT processes and data integration at production scale
• Use intermediate-level Python for automation and data processing
• Apply strong database design principles across data solutions
• Work with data visualization tools such as Power BI, Looker, or comparable platforms; Tableau experience is transferable
• Approach work with strong analytical skills and attention to detail while independently managing responsibilities and delivering results
• Actively use AI tools, including Claude through our Anthropic partnership, to streamline tasks, improve the quality of your work, and share best practices with teammates while continuously identifying new ways to integrate AI into everyday workflows

Requirements:

• Must be authorized to work in the U.S. without sponsorship
• Own data pipelines end to end—from ingestion and transformation through validation and delivery
• Architect solutions for scale, including designing data models, partitioning and clustering strategies, and query optimization for datasets ranging from multiple terabytes to petabytes
• Apply advanced, hands-on Google Cloud Platform and BigQuery expertise to make architectural decisions related to partitioning, clustering, and cost and slot management
• Build and operate production pipelines from ingestion through final delivery
• Use advanced SQL to develop complex queries and optimize performance at scale
• Work extensively within legacy enterprise reporting environments using SQL Server, stored procedures, and SSRS
• Build data monitoring, reconciliation, and automated quality-assurance frameworks to support data validation and integrity
• Manage ETL/ELT processes and data integration at production scale
• Use intermediate-level Python for automation and data processing
• Apply strong database design principles across data solutions
• Work with data visualization tools such as Power BI, Looker, or comparable platforms; Tableau experience is transferable
• Approach work with strong analytical skills and attention to detail while independently managing responsibilities and delivering results
• Actively use AI tools, including Claude through our Anthropic partnership, to streamline tasks, improve the quality of your work, and share best practices with teammates while continuously identifying new ways to integrate AI into everyday workflows
• Consultative approach and problem solving skills to successfully align digital solutions with long-term business goals of the client
• Hands-on experience using AI tools to enhance daily work, or a strong desire to do so, including a willingness to experiment, learn, and champion AI adoption within your role
• Commitment to understanding and exceeding client expectations
• Ability to perform project oversight and execution of deliverables
• Flexibility to adapt within a high-growth organization
• Ability to lead, mentor and motivate those around them
• Hunger for continuous learning and professional development
• Intellectual curiosity to provide creative solutions
• Full understanding of the software development life cycle
• Ability to positively impact fellow colleagues through effective leadership, presentations, coaching, etc
• Desire to work in a team environment
• Good interpersonal, written and verbal communication skills