Senior Data Engineer - Data Platform

Buildertrend is hiring a Senior Data Engineer-Data Platform to lead the migration of its data platform to a Databricks lakehouse built on dbt. The role designs and maintains reliable data pipelines, curated datasets, governance, and data quality standards, while partnering with engineering, analytics, data science, and AI teams.

Responsibilities:

• Design, build and maintain Buildertrend's Databricks lakehouse using a medallion (bronze, silver, gold) architecture in dbt, and set the layer standards, naming conventions and build rules other engineers follow
• Build ELT pipelines with Databricks, dbt and Fivetran that bring in data from SQL Server, Salesforce, MongoDB, Gong, OpenTelemetry and vendors like Zonda, turning it into curated, analytics- and AI-ready datasets
• Lead the exit from legacy systems like BigQuery, Data Fusion and Cloud Fusion by refactoring pipelines rather than copying them over as-is, untangling circular dependencies, and repointing tools like Tableau to the new platform with clear owners and deadlines
• Strengthen reliability by improving SQL Server log-ship replication and Fivetran ingestion, and by building automation like auto-recovery, full-refresh jobs and watchdog orchestration that cuts down on manual fixes and outages
• Build data quality checks, freshness monitoring and quality metrics using dbt tests, Unity Catalog and Fivetran metadata, so stakeholders can trust the numbers without double-checking them
• Design access controls for large datasets, including permission models, per-team clusters, service principals and scoped access for AI tools, and handle privacy requests through tools like DataGrail to meet CCPA requirements
• Set up data contracts with product engineering so upstream schema changes don't silently break the warehouse, and write documentation (data dictionary, ERDs, spec docs, column notes) clear enough for people and AI tools to use
• Build and improve the curated data products that let stakeholders and customers turn raw data into decisions
• Partner with data science, machine learning and AI teams to build and curate the datasets their models and experiments depend on, alongside the broader data products that help stakeholders and customers turn raw data into decisions
• Partner with engineers, analysts, business leaders and other stakeholders to prioritize work, manage dependencies and deliver meaningful platform improvements
• Mentor other engineers, contribute to architectural decisions, evaluate emerging technologies and grow toward a technical leadership role while using AI thoughtfully to improve productivity and engineering outcomes

Requirements:

• Bachelor's degree in computer science, software engineering or a related field is required
• 5+ years of experience in data engineering, data science or data analytics
• Hands-on, production-level experience with Databricks, including building and orchestrating pipelines, managing jobs and clusters, and using Unity Catalog for governance is required
• Hands-on, production-level experience with dbt, including building and maintaining models, tests and macros in a real production environment is required
• Proven experience leading a data platform migration, such as moving off a legacy warehouse onto a modern lakehouse, from planning through delivery, including setting deadlines and owning the outcome
• Experience partnering with data science, machine learning, or AI teams to build and curate datasets to support model development and experimentation
• Strong proficiency in SQL, Microsoft SQL Server, Python and working with APIs and large, complex datasets
• Deep understanding of data modeling, ETL and ELT pipelines, medallion architecture and building analytics and machine learning-ready datasets
• Experience writing data tests, setting up freshness and alerting monitors, and building access controls or governance policies in a live production environment (not just in a sandbox or one-off project)
• Strong communication skills, with the ability to explain technical tradeoffs to both engineers and non-technical stakeholders, especially during a system migration where people need clear, direct answers about what's changing and when
• Demonstrated experience mentoring engineers, reviewing technical work and influencing engineering standards
• Previous experience at a B2B SaaS company is preferred
• BigQuery or FiveTran experience is a plus!