Veridian Tech Solutions, Inc. is seeking a GCP Data Engineer. The role involves advanced data engineering tasks, utilizing GCP tools and programming languages to build and maintain scalable data pipelines.
Responsibilities:
- Data Engineering: Advanced SQL, data modeling, ETL/ELT, batch & streaming pipelines
- GCP Expertise: BigQuery, Dataflow, GCS, Pub/Sub, Dataproc
- Programming: Python (primary), with Java/Scala for distributed processing
- Data Integration: Ingestion patterns, APIs, CDC, and scalable pipeline design
- DevOps & Security: CI/CD, Terraform, IAM, data governance & lifecycle management
Requirements:
- 3+ Years of experience
- Advanced SQL
- Data modeling
- ETL/ELT
- Batch & streaming pipelines
- GCP Expertise: BigQuery, Dataflow, GCS, Pub/Sub, Dataproc
- Programming: Python (primary), with Java/Scala for distributed processing
- Data Integration: Ingestion patterns, APIs, CDC, and scalable pipeline design
- DevOps & Security: CI/CD, Terraform, IAM, data governance & lifecycle management