Senior Data Engineer – Snowflake

Role Overview

• Responsible for expanding and optimizing our data and data pipeline architecture.
• Optimizing data flow and collection for cross functional teams.
• Support our product owners, product analysts, data analysts and data scientists on data initiatives.
• Ensure optimal data delivery architecture is consistent throughout ongoing work.
• Engage with business stakeholders to establish clear needs and links to solutions, including setting up prototypes, and involving multiple parties in design sessions.
• Create data collection, extraction, and transformation frameworks for structured and unstructured data.
• Develop and maintain data infrastructure systems (e.g. data warehouses) including data access points.
• Prepare and manipulate data using a variety of data integration and data pipeline tools including, but not limited to, Talend, SQL, Snowflake, Kafka, Azure Data Factory.
• Create efficient load processes including logging and handling of exceptions, notification to support, and overall visibility operations.
• Organize data into formats and structures that optimize reuse and efficient delivery to businesses and analytics teams and system applications.
• Integrate data across data lake, data warehouse and systems applications to ensure the consistent delivery of information across the enterprise.
• Accountable for efficient architecture and systems design.
• Build and evolve the data service layer and engages the team to bring together components for a best-in-class customer offering.

Requirements

• Bachelor’s degree required, Master’s an asset, in Software Engineering, Computer Science, or equivalent work experience in a Technology or business environment.
• Minimum of 7 years of experience working in developing and following structured work processes in data engineering.
• Minimum of 7 years of experience in integration solutions development with data integration tools (e.g., Talend, Azure Data Factory).
• Minimum of 3 years of experience with real-time data streaming tools like Kafka, or any similar tools.
• Experience with cloud platforms including Azure, AWS, or GCP.
• Experience with data warehousing platforms such as Snowflake or Databricks.
• High proficiency in SQL, Python, and other programming languages.
• Highly proficient in data management, governance, data design and database architecture.
• Proven track record of manipulating, processing, and extracting value from large, disconnected datasets.
• Proficient in data modelling and data architecture with experience using WhereScape RED/3D an asset.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Highly proficient in data modelling, data integrations, data orchestration, and supporting methodologies.
• Highly proficient in leading large-scale projects or significant project steps and communicating progress/approach with technical/non-technical peers/clients and leaders.
• Highly proficient in multiple programming languages and coding.
• Excellent ability to design and engineer moderately complex enterprise solutions.
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Strong project management and organizational skills.

Tech Stack

• Airflow
• Amazon Redshift
• AWS
• Azure
• Cassandra
• Cloud
• EC2
• Google Cloud Platform
• Hadoop
• Java
• Kafka
• NoSQL
• Postgres
• Python
• Scala
• Spark
• SQL

Benefits

• Work from anywhere with true flexibility and freedom.
• Earn in USD with compensation that matches your expertise.
• Recharge confidently with dedicated paid time off.
• Advance your career with fully covered international certifications.
• Access coworking spaces worldwide whenever you want a professional setup.
• Strengthen your English and expand your global reach.
• Connect and have fun with activities that unite our international team.
• Feel appreciated with personalized gifts and a thoughtful welcome kit.
• Grow our community and earn through our referral program.