Senior Data Engineer - Python, CI/CD

ClickHouse is a fast-growing private cloud company recognized on the 2025 Forbes Cloud 100 list, specializing in real-time analytics and data warehousing. The Senior Data Engineer will be responsible for evolving the data warehouse platform, developing reusable components, and optimizing data models to support business users across the organization.

Responsibilities:

• Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture
• Build reusable dbt macros and abstractions: incremental strategies, ETL building blocks, and generic data quality tests, all optimized for ClickHouse-specific behavior and our data patterns
• Develop DataOps tooling - CI pipelines, data migration frameworks, and security controls - with a strong focus on reliability, self-service usability, and scale
• Conduct thorough code reviews for team members and other team contributors
• Actively participate in technical and architectural design discussions
• Drive technical leadership in specific areas of our stack
• Continuously improve the team's development environment, with a focus on automation - including AI-assisted workflows
• Contribute to platform stability through proactive troubleshooting and timely incident resolution
• Develop, refactor, and optimize business data models in line with our modeling standards and ClickHouse best practices
• Mentor and support contributors through code reviews and technical guidance
• Lead the design and implementation of the most technically demanding data marts - particularly those involving high data velocity, large volumes, or complex business logic

Requirements:

• Exceptional SQL skills - this is non-negotiable
• Strong hands-on experience with Airflow, dbt, and Python
• Proven track record building and optimizing large-scale, high-throughput data pipelines
• Solid understanding of data warehousing fundamentals: ETL/ELT, dimensional modeling, and data quality
• Bachelor's degree in Computer Science or a related field
• Comfortable thriving in a fast-paced startup environment — exciting and dynamic, but sometimes wonderfully chaotic
• Hands-on experience with ClickHouse - a significant advantage
• Familiarity with AWS or other cloud platforms
• Experience with CI/CD development, especially using GitHub Actions