Data Engineer

Quantum World Technologies Inc. is seeking a highly skilled and motivated Technical Team Lead with extensive experience in Azure Databricks to join their dynamic team. The ideal candidate will guide a team of developers in the design, development, and implementation of data-driven solutions leveraging Azure Databricks.

Responsibilities:

• Lead and mentor a team of technical professionals, fostering a collaborative and high performance culture
• Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency
• Collaborate with cross functional teams to gather requirements and translate them into technical specifications
• Oversee the development lifecycle, from planning and design to deployment and maintenance
• Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices
• Stay up to date with industry trends and emerging technologies related to Azure Databricks and data engineering
• Facilitate communication between technical and non technical stakeholders to ensure alignment on project goals
• Identify and mitigate risks associated with project delivery and team performance

Requirements:

• Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes
• Strong programming skills in languages such as Python, Scala, or SQL
• Experience with cloud based data storage solutions, particularly Azure Data Lake Storage and Azure SQL Database
• Solid understanding of data modeling, ETL processes, and data warehousing concepts
• Demonstrated ability to lead technical teams and manage multiple projects simultaneously
• Bachelor's degree in Computer Science, Information Technology, or a related field
• 7 10 years of experience in data engineering, software development, or a related technical role
• Proven track record of leading technical teams and delivering successful projects
• Familiarity with Azure DevOps for CI/CD processes
• Experience with machine learning frameworks and libraries
• Knowledge of data governance and compliance standards
• Strong analytical and problem solving skills
• Excellent communication and interpersonal skills
• Relevant certifications in Azure or data engineering are a plus