Data Engineer
Mumbai, Maharashtra, India
Full Time
4 hours ago
No Sponsorship
Key skills
Amazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonAIGenerative AIELTData LakeAnalyticsSnowflakeRedshiftDatabricksGCPGoogle CloudLambdaS3GlueAzure FunctionsCloud RunCloud FunctionsCloud StorageCI/CD
About this role
Role Overview
- Create data pipelines and perform ETL/ELT on cloud
- Collaborate with team members to implement cloud solutions
- Maintain and optimize data storage and processing
- Support infrastructure as code and CI/CD workflows
- Develop utility functions to enhance cloud capabilities.
Requirements
- 4-5 years of IT experience
- Minimum 3 years of experience in creating data pipelines, ETL/ELT on cloud
- Experience with AWS, Azure, GCP
- Experience with cloud storage, cloud database, cloud data-warehousing, and Data lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3
- Experience in writing cloud utility functions such as AWS lambda, AWS step functions, Cloud Run, Cloud functions, Azure functions
- Experience in using cloud data integration services for structured, semi structured and unstructured data such as Azure Databricks, Azure Data Factory, Azure Synapse Analytics, AWS Glue, AWS EMR, Dataflow, Dataproc
- Exposure to cloud Dev ops practices such as infrastructure as code, CI/CD components, and automated deployments on cloud
- Expertise in programming using python.
Tech Stack
- Amazon Redshift
- AWS
- Azure
- BigQuery
- Cloud
- ETL
- Google Cloud Platform
- Python
Benefits
- We recognize the significance of flexible work arrangements to provide support.
- At the heart of our mission is your career growth.
- Equip yourself with valuable certifications in the latest technologies such as Generative AI.