Develop a robust, scalable data architecture that supports the data teams (Analytics, BI, Data Science, Machine Learning and other verticals) and the business, democratizing access to data in a secure, simple, structured and high-quality manner;
Design, build and integrate monitoring mechanisms and tracking for the data ecosystem;
Design/build standards and best practices for development, environment documentation and deliverables;
Document, monitor and ensure data quality;
Design and ensure the application of best practices for pipeline development, focusing on performance and scalability;
Ensure and maintain a vision capable of relating and integrating areas (Data Products and MLOps) and data solutions;
Ensure knowledge is shared across the team;
Identify, manage and mitigate risks for activities under your responsibility and for your team;
Ensure and implement the designed data architecture;
Ensure correct understanding of business needs and the strategic vision;
Ensure that all mapped requirements to be developed are delivered with quality, scalability and on schedule;
Requirements
Degree in Engineering, Computer Science or related fields;
Experience with Azure and/or AWS;
Experience with Databricks;
Experience with Delta Lake / Lakehouse;
Experience with Cosmos DB, Azure Synapse and Analysis Services;
Experience with programming languages Python, SQL and PySpark;
Experience with distributed data processing;
Experience with continuous integration and continuous delivery (CI/CD) pipelines and/or Azure DevOps;
Experience with API development and/or Azure Functions;
Tech Stack
AWS
Azure
PySpark
Python
SQL
Benefits
Flexible Meal and Food Vouchers;
Health insurance;
Dental plan;
Wellhub and TotalPass;
On-site Bio Ritmo gym exclusive to employees at the Headquarters Complex;
Profit sharing (PLR);
Share program: "Porto em Ação" complementary to PLR through 2025;
Sand and multi-sport courts at the Headquarters Complex;
Transportation voucher;
Van transportation services available at the main access stations to Porto;
Extended parental leave up to 40 days for all family configurations;
Extended maternity leave of 6 months;
On-site medical clinic with specialties at the Headquarters Complex and Barra Funda;
Childcare or nanny assistance;
Life insurance;
Private pension plan
PortoPrev;
Discounts on products and services;
Tuition assistance: reimbursement for undergraduate, postgraduate or MBA programs;
Monthly runs: subsidy for major São Paulo road races;
Language reimbursement (English or Spanish);
Porto Theatre: exclusive sessions for employees;
Library;
Rest room in the Headquarters Complex;
Game room in the Headquarters Complex;
Massage and podiatry services at the Headquarters Complex.