Key skills
AirflowDistributed SystemsPythonPyTorchSparkSQLTensorflowAIMLLLMTensorFlowMLflow
About this role
Role Overview
- Lead the design and implementation of large-scale, production-grade distributed systems that power AI features for millions of daily users
- Own the architecture decisions for flexibility, cost-effectiveness, and robustness
- Champion engineering excellence and mentor junior engineers
- Collaborate across teams to enhance data usability
Requirements
- 5+ years building and operating production Python (or equivalent language) services at scale
- A track record of owning services or pipelines in production, including operational/on-call responsibility, incident response, and managing technical debt over time
- Deep understanding of distributed processing principles (Spark, Dask, or similar) alongside strong SQL capabilities
- Demonstrated experience integrating ML models or LLM-based features into production systems
- Familiarity with ML tooling such as MLFlow, TensorFlow, or PyTorch, and data orchestration tools like Airflow or Prefect
Tech Stack
- Airflow
- Distributed Systems
- Python
- PyTorch
- Spark
- SQL
- Tensorflow
Benefits
- Flexible hybrid working model
- Access to modern office spaces