Data Engineer

Avenue Code is seeking a Data Engineer for a strategic project in the energy and utilities industry. The role focuses on designing and maintaining data models, pipelines, ETL processes, and cloud-based data solutions while partnering with analysts and data scientists to support scalable, reliable, and secure data-driven applications.

Responsibilities:

• Collaborate with Subject Matter Experts (SMEs) to design and develop data models (ontology) and data pipelines
• Design, build, and maintain robust data pipelines and ETL processes
• Develop and optimize cloud-based data storage and processing solutions
• Partner with data analysts and data scientists to deliver high-quality, scalable data solutions
• Ensure data integrity, security, and reliability across all workflows
• Monitor, troubleshoot, and enhance data pipelines to ensure continuous data availability

Requirements:

• Solid experience as a Data Engineer, with strong hands-on experience building data pipelines
• Strong SQL skills and experience working with large-scale and complex datasets
• Proficiency in Python and PySpark for ETL and data processing
• Experience with cloud-based data platforms and distributed data processing