Data Engineer II

Mediavine is a fast-growing advertising management company representing over 10,000 websites. They are seeking a Data Engineer II to build and maintain data infrastructure, develop scalable data pipelines, and ensure data quality and security while collaborating with various teams.

Responsibilities:

• Create data pipelines that make data available for analytic and application use cases
• Develop self-healing, resilient processes that do not require constant care and feeding to run smoothly
• Create meaningful data quality notifications with clear actions for interested parties including other internal teams and other members of the data and analytics team
• Leading projects from a technical standpoint, creating project Technical Design Documents
• Support data analysts and analytics engineers ability to meet the needs of the organization
• Participate in code reviews, understanding coding standards, ensuring test coverage and being aware of best practices
• Build or implement tooling around data quality, governance and lineage, in the dbt framework and Snowflake but external to that as needed
• Provide next level support when data issues are discovered and communicated by the data analysts
• Work with data analysts and analytics engineers to standardize transformation logic in the dbt layer for consistency and ease of exploration by end users
• Enable analytics engineers and data analysts by providing data modeling guidance, query optimization and aggregation advice

Requirements:

• 3+ years of experience in a data engineering role
• Strong Python skills (Understands tradeoffs, optimization, etc)
• Strong SQL skills (CTEs, window functions, optimization)
• Experience working in cloud environments (AWS preferred, GCS, Azure)
• Experience managing complex dbt environments with hundreds or more flows
• An understanding of how to best structure data to enable internal and external facing analytics
• Familiarity with calling APIs to retrieve data (Authentication flows, filters, limits, pagination)
• Experience working with DevOps to deploy, scale and monitor data infrastructure
• Scheduler experience either traditional or DAG based
• Experience using LM-powered tools for code generation, documentation, and architectural diagramming
• Comfortable working with multi-TB cloud data warehouses (Snowflake preferred, Redshift, Big Query)
• Experience with other DBMS systems (Postgres in particular)
• Ability to travel up to approx 15%
• Experience with web analysis such as creating data structures that support product funnels, user behavior, and decision path analysis
• Understanding of Snowflake external stages, file formats and snowpipe
• Experience managing the semantic layer in either dbt or Snowflake
• Experience with orchestration tools particularly across different technologies and stacks
• Knowledge of Ad Tech, Google Ad Manager and all of its fun quirks (so fun)
• The ability to make your teammates laugh (it wouldn't hurt if you were fun to work with is what I'm saying)
• Familiarity with event tracking systems (Snowplow, etc)
• Experience with one or more major BI tools (Omni, Sigma, Metabase, etc.)