Senior Data Engineer

Qualis1 Inc. is seeking a highly skilled Senior Data Engineer to lead the architectural design and implementation of their next-generation data platform on Google Cloud Platform. The role involves bridging high-level architectural strategy with technical execution to ensure a performant and cost-effective data ecosystem supporting advanced analytics and machine learning initiatives.

Responsibilities:

• Design and implement end-to-end data architectures on GCP, ensuring high availability, security, and scalability
• Establish best practices for data modeling (Medallion architecture, Star Schema) specifically optimized for BigQuery's columnar storage
• Evaluate emerging GCP technologies and provide strategic recommendations for platform evolution
• Mentor junior engineers and conduct rigorous code reviews to maintain high engineering standards
• Develop complex ELT workflows using Dataform to manage SQL-based transformations, ensuring data lineage and quality through automated testing
• Build and maintain large-scale batch and streaming data processing pipelines using Dataflow (Apache Beam)
• Preferred to have Dataproc knowledge for distributed processing of massive datasets using Spark or Hadoop where specialized compute is required

Requirements:

• Highly skilled Senior Data Engineer
• Subject matter expert in BigQuery
• Deep experience building robust, scalable data pipelines using Dataform, Dataflow, and Dataproc
• Design and implement end-to-end data architectures on GCP, ensuring high availability, security, and scalability
• Establish best practices for data modeling (Medallion architecture, Star Schema) specifically optimized for BigQuery's columnar storage
• Evaluate emerging GCP technologies and provide strategic recommendations for platform evolution
• Mentor junior engineers and conduct rigorous code reviews to maintain high engineering standards
• Develop complex ELT workflows using Dataform to manage SQL-based transformations, ensuring data lineage and quality through automated testing
• Build and maintain large-scale batch and streaming data processing pipelines using Dataflow (Apache Beam)
• Preferred to have Dataproc knowledge for distributed processing of massive datasets using Spark or Hadoop where specialized compute is required