Key skills
PythonSQLNoSQLBashMLETLELTData EngineeringAnalyticsSparkApache SparkKafkaAirflowApache AirflowdbtPlaywrightAWSGCPTerraformKubernetesDockerServerlessLambdaDynamoDBGlueCloud FunctionsBigTablePub/SubGitGitHubCI/CD
About this role
Banacha Street builds web-data analytics products that transform messy public web data into actionable insights for various teams. They are seeking a Data Engineer to enhance their data fetching and analysis pipelines, focusing on expanding their serverless data-fetching engine and designing analytical pipelines.
Responsibilities:
- Expand our serverless data-fetching engine to collect more and richer web data
- Design and implement analytical pipelines with ETL/ELT (dbt) and Apache Airflow/Dagster
- Ensure test coverage and data quality/observability (freshness, schema, anomalies)
- Implement CI/CD and infra as code for data/ML services
- Help shape the engineering culture (standards, reviews, docs)
Requirements:
- 3+ years in backend/data engineering
- Working knowledge of Git & GitHub
- Python and SQL
- Bash and containerization (Docker)
- Serverless (AWS Lambda or GCP Cloud Functions)
- NoSQL (e.g., AWS DynamoDB, Bigtable, or Firestore)
- ETL/ELT (e.g., AWS Glue, dbt, or Apache Beam)
- Good command of English; proactive about proposing new solutions
- Terraform / IaC, Kubernetes
- Big Data (e.g., Apache Spark/Flink), streaming (Kafka/Pub/Sub)
- Web scraping at scale (Scrapy/Playwright) and anti-bot resilience
- Cost optimization/FinOps and data lineage tooling