Senior Data Engineer

Microsoft is a leading technology company committed to empowering every person and organization on the planet. As a Senior Data Engineer for Product Engineering Partnership, you will serve as the technical lead, owning telemetry contracts and building experimentation data infrastructure to ensure actionable insights flow back to product teams.

Responsibilities:

• Own telemetry contracts and instrumentation that ship with Global Skilling products (e.g., Microsoft Learn, ASN, Skilling Catalog)
• Design and operate experimentation data infrastructure, including A/B testing pipelines, metric definitions, and significance tooling
• Build catalog and content management data integrations across the Global Skilling product surface
• Lead semantic model design for product analytics in partnership with Reporting and Analytics teams
• Build and maintain external (end-customer) reporting pipelines for ASN and partner-facing products
• Operate Insights and Analytics feedback loops, including pipelines that surface usage patterns, customer feedback, and product signals to engineering teams
• Mentor Data Engineer II (DE II) engineers on telemetry design, experimentation practices, and product–engineering partnership approaches
• Partner with Microsoft-wide alignment forums to align WISE telemetry standards with broader Microsoft frameworks
• Provide on-call leadership for product-tier pipelines (severity levels 1–3)
• Embody our Culture and Values

Requirements:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of experience in business analytics, data science, software development, data modeling, or data engineering
• OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years of experience in business analytics, data science, software development, data modeling, or data engineering
• OR equivalent experience
• Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
• 5+ years of experience building production data systems on Azure (ADLS, Synapse, Fabric, or Databricks) or comparable cloud platforms
• Demonstrated experience instrumenting product telemetry and owning end-to-end data contracts with product engineering teams
• Experience with experimentation platforms, A/B testing data, or feature-flag analytics infrastructure
• Demonstrated distributed systems fundamentals; experience with PySpark, SQL, and pipeline orchestration
• Experience mentoring mid-level engineers
• Master's degree in Computer Science, Engineering, or related technical field
• Experience with Microsoft internal data platforms (Cosmos, Scope, Conform, Aria)
• Experience with catalog and content management data systems (e.g., Microsoft Learn, ASN, credential catalogs)
• Experience building external or end-customer reporting (e.g., ASN partner reporting)
• Experience designing semantic models for product analytics and decision support
• Experience with AI-driven telemetry discovery (e.g., agent-assisted instrumentation, anomaly detection, intelligent feedback loops)