VirtusLab is a company focused on fostering a friendly atmosphere and providing self-development opportunities. They are seeking a Staff Data Engineer to lead technical initiatives, design scalable data systems, and mentor engineers while engaging with clients to provide technical consulting and solutions.

Responsibilities:

Proven experience building web crawling or large-scale data systems from scratch
Strong architectural skills in designing scalable, fault-tolerant distributed systems
Track record leading complex technical initiatives and driving architecture direction for teams
Demonstrated ability to evolve production systems incrementally while maintaining reliability
Experience mentoring engineers at all levels and promoting a collaborative culture
Deep background in large-scale data engineering (terabytes daily)
Hands-on experience with cloud data warehouses (BigQuery, Snowflake)
Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow)
Familiarity with multi-cloud environments (GCP + AWS)
Expertise in designing and operating ETL/ELT pipelines
Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar)
Experience in extracting structured/unstructured web data and SERP extraction
Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling
Familiarity with crawling vendors and AI/LLM-based extraction approaches
Support the VirtusLab U.S. and international teams by lending senior technical expertise to client-facing activities, including technical discovery sessions, workshops, and solution architecture
Conduct requirements analysis and solution discovery, identifying business and technical needs
Provide technical consulting and advisory services, recommending appropriate data architectures aligned with customer goals
Prepare and review technical sections of commercial offers, including solution descriptions, statements of work (SoWs), project estimates, timelines, and delivery models

Requirements:

Proven experience building web crawling or large-scale data systems from scratch
Strong architectural skills in designing scalable, fault-tolerant distributed systems
Track record leading complex technical initiatives and driving architecture direction for teams
Demonstrated ability to evolve production systems incrementally while maintaining reliability
Experience mentoring engineers at all levels and promoting a collaborative culture
Deep background in large-scale data engineering (terabytes daily)
Hands-on experience with cloud data warehouses (BigQuery, Snowflake)
Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow)
Familiarity with multi-cloud environments (GCP + AWS)
Expertise in designing and operating ETL/ELT pipelines
Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar)
Experience in extracting structured/unstructured web data and SERP extraction
Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling
Familiarity with crawling vendors and AI/LLM-based extraction approaches
Support the VirtusLab U.S. and international teams by lending senior technical expertise to client-facing activities, including technical discovery sessions, workshops, and solution architecture
Conduct requirements analysis and solution discovery, identifying business and technical needs
Provide technical consulting and advisory services, recommending appropriate data architectures aligned with customer goals
Prepare and review technical sections of commercial offers, including solution descriptions, statements of work (SoWs), project estimates, timelines, and delivery models

VirtusLab

Open Positions (1)

Engineering

Staff Data Engineer