Principal Solution Architect – Managed Services

Role Overview

• Propose, design, and provision cloud-native data solutions on AWS/Azure. Leverage a deep understanding of Snowflake, IAM, S3, EC2, Kinesis, Sagemaker, Airflow, Kafka, Azure Data Factory, ADLS, Fivetran, Matillion, DBT, and/or other services and tools in designing and enhancing these solutions.
• Lead a technical team operating and managing modern data platforms
• from streaming, to data lakes, to analytics, and beyond across a progressively evolving technical stack.
• Provide clear ownership of multiple simultaneous customer accounts across a variety of technical stacks as the technical leader.
• Skillfully navigate complex customer environments and build Epics, Stories, and Tasks in order to mature and improve our customers’ data platform. Delegate to and coach Engineers and ensure the successful and timely delivery of these Epics.
• Provide thought leadership by recommending the right technologies and approaches to maturing and solving problems to help ensure performance, security, scalability, and user satisfaction.
• Lead discussions and contribute to design recommendations for data model design for Data Warehouses and Data Lakes.
• Continually hunt for ways to automate, optimize, and expand our customers’ data platform and our service offering.

Requirements

• Advanced Data Platform expertise in enterprise data platforms such as Snowflake, AWS, Azure, or Databricks.
• Extensive experience in providing architectural and operational guidance across a large user base for a cloud-native data warehouse (Snowflake and/or Redshift)
• Production experience working with Cloud and Distributed Data Storage technologies such as S3, ADLS, Cassandra or other NoSQL storage systems.
• Production experience working with Data integration technologies such as Spark, Kafka, event/streaming, Matillion, Fivetran, HVR, AWS Data Migration Services, Azure DataFactory or others.
• Production experience working with Workflow Management and Orchestration, such as Airflow, AWS Managed Airflow, and Luigi.
• Strong working knowledge of SQL and the ability to write, debug, and optimize SQL queries.
• Deep expertise with cloud-native data technologies in AWS or Azure.
• Extensive experience with infrastructure as code using Terraform or CloudFormation.
• Experience building automated solutions for repetitive administrative tasks using Python or a similar language.
• Well-versed with continuous integration and deployment frameworks with hands-on experience using CI/CD tools like Bitbucket, Github, Flyway, and Liquibase.
• Professional track record of creating, challenging, and improving processes and procedures.
• Unmatched troubleshooting and performance tuning skills.
• Proven experience as a technical team lead and mentor of engineers.
• Passion for learning new technology stacks and up-skilling/training team members.
• Create and deliver detailed technical presentations for an executive audience.
• Excellent client-facing written and verbal communication skills and experience.

Tech Stack

• Airflow
• Amazon Redshift
• AWS
• Azure
• Cassandra
• Cloud
• EC2
• Kafka
• Matillion
• NoSQL
• Python
• Spark
• SQL
• Terraform

Benefits

• Join a remote-first data and AI consultancy company
• Partner with industry leaders like Snowflake, AWS, and Azure
• Opportunity for real ownership over work
• Recognized as an award-winning workplace