Data Engineer – Mid-level
São Paulo, São Paulo, Brazil
Full Time
1 week ago
No Sponsorship
Key skills
CloudETLGoogle Cloud PlatformNoSQLPySparkPythonSparkSQLELTData EngineeringGCPGoogle CloudSQL ServerCommunication
About this role
Role Overview
- Develop, maintain and optimize ETL/ELT processes across different platforms (SQL Server, Spark, NoSQL).
- Migrate routines and data loads from SQL Server to Spark (PySpark).
- Develop scripts and automations in Python.
- Model and structure data following governance and performance best practices.
- Collaborate with architects, analysts and testers to ensure data quality and integrity.
- Support data migration and modernization initiatives in cloud environments (GCP).
Requirements
- Strong SQL (ANSI), data modeling and relational database skills.
- Experience with SQL Server and Spark (PySpark).
- Knowledge of Python and NoSQL.
- Understanding of ETL/ELT concepts and data engineering best practices.
- Experience with GCP.
- Good verbal and written communication and analytical problem-solving skills.
Tech Stack
- Cloud
- ETL
- Google Cloud Platform
- NoSQL
- PySpark
- Python
- Spark
- SQL