Senior Data Engineer
Mexico
Full Time
7 hours ago
No Sponsorship
Key skills
AzureETLPythonSOAPSparkSQLC#CArtificial IntelligenceMachine LearningData EngineeringdbtGitVersion ControlLeadershipCommunicationCollaboration
About this role
Role Overview
- Data Engineering: Design, build, and maintain scalable data pipelines and ETL workflows.
- Write advanced SQL queries and implement optimization techniques for performance.
- Leverage Microsoft Azure & Fabric, Spark, and Python to automate complex workflows.
- Lead engineering efforts on machine learning and artificial intelligence projects.
- Integration Development: Develop and maintain robust web APIs (SOAP, REST) to support seamless data integration across internal and external systems.
- Collaborate with external vendors to ensure the integrity and functionality of integrations.
- Operational Support: Monitor and troubleshoot data processes, ensuring high availability and minimal downtime.
- Proactively identify and resolve bottlenecks or inefficiencies in data pipelines and integrations.
- Collaboration: Manage and prioritize work using the ticketing system while maintaining regular communication in stand-ups and stakeholder meetings.
- Conduct code reviews to ensure adherence to best practices and high-quality deliverables.
- Contribute to technical documentation for processes, tools, and workflows.
- End User Support: Provide tier 3 support to end users of integrated systems such as reporting and accounting.
- Partner with business owners to identify areas for improvement and gather requirements.
- Leadership & Mentorship: Mentor other team members by sharing knowledge, conducting training sessions, and providing guidance on best practices.
- Take ownership of complex projects, ensuring timely delivery and alignment with business objectives.
Requirements
- Bachelor’s degree in Computer Science, Information Systems /other relevant degree or equivalent professional experience
- Expert knowledge of relevant languages, such as SQL, dbt, Python, and/or C#
- Expert knowledge of at least one data pipeline orchestration tool, such as Azure Data Factory
- Expert understanding of data modeling and ETL concepts
- Experience with version control systems (e.g., Git) and best practices
- Strong problem-solving skills and ability to work independently on complex tasks.
Tech Stack
- Azure
- ETL
- Python
- SOAP
- Spark
- SQL
Benefits
- Competitive compensation
- Remote-first lifestyle
- Career growth opportunities across industries and technologies