Senior Data Engineer | Emerging Products

NinjaOne provides a unified IT operations platform for endpoint management, patching, backup, and remote access. The company is seeking a Senior Data Engineer for its Emerging Products team to design and scale lakehouse architectures, develop streaming and batch pipelines, manage data platforms, and enable analytics and data science workloads.

Responsibilities:

• Lakehouse Architecture: Design and implement Medallion-layer data architectures (Bronze, Silver, Gold), building structured ingestion pipelines and curated data layers that serve downstream analytics and data science workloads
• Pipeline Development: Build and maintain scalable streaming and batch data pipelines using Kafka, Spark, and Airflow, supporting reliable and low-latency data movement across the platform
• Table Format Management: Own and manage open table formats including Iceberg, Delta, and Hudi — selecting the right format for the workload and maintaining performance and reliability at scale
• Query Engine Optimization: Work with Trino/Starburst and Databricks-based environments to optimize large-scale analytics queries and support platform consumers
• Platform Reliability: Monitor pipeline health, troubleshoot data quality and performance issues, and continuously improve the reliability and efficiency of the data platform
• Collaboration: Partner closely with data scientists, analysts, and product teams to understand data requirements and deliver platform solutions that enable data-driven decision-making
• Other duties as needed

Requirements:

• 10+ years of experience in data engineering with a strong focus on data platform and distributed systems
• Hands-on experience building and managing lakehouse architectures, including Medallion (Bronze/Silver/Gold) layering patterns
• Deep expertise in Apache Kafka, Apache Spark, and Apache Airflow for both streaming and batch pipeline development
• Proficiency in open table formats — Iceberg, Delta Lake, or Hudi — with the ability to evaluate trade-offs and select the right format for the workload
• Experience with Databricks for large-scale data processing and analytics workloads
• Strong proficiency in Python and SQL
• Hands-on experience with Trino or Starburst for distributed query execution
• Familiarity with hybrid streaming/batch architectures and event-driven data systems
• Experience designing Gold-layer datasets optimized for business intelligence and self-serve analytics
• candidates must be U.S. citizens or lawful permanent residents
• We will consider all qualified candidates who reside outside of the city proper or are willing to self-relocate
• Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent work experience preferred