Key skills
SQLETLELTAnalyticsBigQueryGCPGoogle CloudPub/Subcomposer
About this role
Diverse Lynx is seeking a highly skilled Data Engineer with strong expertise in Google Cloud Platform (GCP) and BigQuery. The role involves building cloud-native data pipelines, enabling advanced analytics, and supporting enterprise data integration initiatives.
Responsibilities:
- Design and implement scalable data pipelines using GCP services (BigQuery, Dataflow, Cloud Composer, Pub/Sub)
- Develop and optimize data models and schemas in BigQuery for high-performance analytics
- Build and maintain ETL/ELT pipelines for ingesting structured and unstructured data
- Implement data partitioning, clustering, and query optimization strategies in BigQuery
- Ability to interpret and convert SQL, and CCL Scripts into a BigQuery along with integration with GCP
Requirements:
- strong expertise in Google Cloud Platform (GCP)
- strong expertise in BigQuery
- Design and implement scalable data pipelines using GCP services (BigQuery, Dataflow, Cloud Composer, Pub/Sub)
- Develop and optimize data models and schemas in BigQuery for high-performance analytics
- Build and maintain ETL/ELT pipelines for ingesting structured and unstructured data
- Implement data partitioning, clustering, and query optimization strategies in BigQuery
- Ability to interpret and convert SQL, and CCL Scripts into a BigQuery along with integration with GCP