Senior Data Engineer

Pipe Recruit is seeking a Senior Data Engineer to enhance their data infrastructure. The role involves migrating and optimizing data models, ensuring compatibility across different platforms, and collaborating with engineering and analytics teams.

Responsibilities:

• Migrate and Refactor Data Models: Convert and optimize dbt models from Redshift and Snowflake to Trino (Iceberg), ensuring compatibility and performance
• SQL Syntax Conversion: Fix SQL syntax differences between Redshift, Snowflake, and Trino
• Data Modeling: Refactor and optimize data models to align with modern best practices for Iceberg
• BI Integration: Work with Tableau assets to ensure data sources align with the new infrastructure
• Collaboration: Partner with engineering and analytics teams to validate and test migration impacts
• Version Control: Use Git to version control dbt models and ensure seamless deployments
• Daily Standups: Participate in agile workflows to prioritize and execute migration tasks efficiently

Requirements:

• Bachelors degree in Computer Science, Information Systems, Mathematics, or a related field (or equivalent experience)
• 3+ years in data engineering, BI, or analytics
• 2+ years in financial services or SaaS
• Hands-on experience with dbt (Data Build Tool) and modern data modeling practices
• Strong proficiency in SQL (Redshift, Snowflake, Trino/Iceberg)
• Experience with BI tools like Tableau
• Familiarity with Git for version control
• Knowledge of Jinja templating and macros in dbt
• Strong communication skills to guide teams through infrastructure changes
• Pragmatic approach to balancing speed and accuracy in data solutions
• Experience working in startup environments
• Familiarity with agile methodologies