DoiT is a global technology company that helps cloud-driven organizations leverage the cloud for business growth and innovation. The Principal Data Engineer will design and build large-scale backend services and high-throughput data pipelines while also leading architectural decisions and technical initiatives for the PerfectScale platform.
Responsibilities:
- Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies
- Lead system-wide architectural decisions, focusing on data flow, performance, and resilience. Actively contribute to the codebase with high quality code
- Lead major technical initiatives, reduce technical debt and ensure the platform meets the reliability and scalability SLAs. Champion best engineering practices, code quality, testing and maintainability
- Collaborate with product and engineering teams and R&D management to define the technical roadmap, review architecture and mentor junior engineers
Requirements:
- 8+ years of backend engineering experience, with 3+ years architecting high-load systems or data pipelines in a production environment
- Deep expertise in distributed systems using modern languages (Go, Java, Rust, or Python)
- Strong, hands-on experience with relational and analytical databases (Postgres, ClickHouse is preferred)
- Proven experience with microservices, containers, and modern DevOps practices (Docker, Kubernetes, GitOps, CI/CD)
- Demonstrated ability to combine hands-on coding with architectural leadership, including strong debugging, benchmarking, and performance optimization skills
- Deep Golang expertise
- Deep Kubernetes Knowledge
- Experience with modern data engineering technologies: Spark, Trino, Iceberg, Parquet, ClickHouse, DBT
- DBA background (relational, OLAP, columnar)
- Expertise in telemetry and time series
- Cloud expertise (AWS, GCP, Azure)