Data Engineer

XBOW is redefining the future of cybersecurity by building the world's first autonomous pentester powered by AI. The Data Engineer will be responsible for building and maintaining the core data infrastructure that powers analytics across the company, designing data pipelines and models, and ensuring data quality and compliance.

Responsibilities:

• Design, deploy, and maintain data pipelines, including a data lake, data shaping pipeline, and analysis tooling
• Maintain engineering-level observability stacks
• Own data quality across the product and its observability stack
• Own the detailed definitions of KPIs that allow us to measure product development and quality
• Collaborate with the Site Reliability Engineering team where observability intersects with product reliability or debuggability
• Work with the Product Management teams to collaborate on gathering and analysis of product metrics and user-behavioral analytics
• Support the development teams in their use of observability pipelines, and ensure that the data semantics are aligned between teams and product components
• Ensure that data-gathering meets the privacy, security, and compliance needs of our customers
• Ensure that we comply with regulations governing data security and user privacy, such as GDPR and CCPA

Requirements:

• SQL RDMSs such as PostgreSQL
• Experience with large-scale analytics engines such as Apache Spark, Hadoop, or Databricks
• Experience with observability solutions such as Datadog or NewRelic
• Experience with OpenTelemetry, Prometheus, and Grafana
• Experience with Infrastructure-as-code tools such as Terraform
• Experience with public cloud deployment, including Kubernetes
• Understanding of GDPR and similar regulations worldwide
• Experience with the Microsoft Fabric platform
• Understanding of data pipeline design, workflow orchestration, and tools such as Apache Airflow or Dagster