Capacity Engineer with Data Engineer - Full Time Only

Programmers.io is seeking a Capacity Engineer with Data Engineer expertise to ensure infrastructure scales efficiently to meet user demand. This role focuses on capacity planning, building data pipelines, and automating resource provisioning to prevent outages and optimize costs.

Responsibilities:

• Data Pipeline Development: Design and maintain ETL/ELT pipelines to collect, transform, and store infrastructure usage data
• Data Modeling: Build models to analyze system metrics and predict future resource needs
• Demand Forecasting: Analyze historical usage patterns to predict CPU, memory, and storage requirements
• Load Testing & Scaling: Simulate traffic spikes to identify bottlenecks and ensure systems scale linearly
• Cost Efficiency: Optimize resource allocation to avoid unnecessary costs while maintaining service availability
• Automation: Use Infrastructure as Code (IaC) tools like Terraform to automate scaling and provisioning
• Architecture Review: Collaborate with software teams to flag single points of failure and ensure resilient service design

Requirements:

• Strong background in data engineering and SRE practices
• Hands-on experience with capacity planning, forecasting, and scaling
• Proficiency in IaC tools (Terraform, Ansible, Harness)
• Experience with data pipelines, ETL/ELT frameworks, and big data tools
• Familiarity with monitoring/observability platforms (Prometheus, Grafana, Datadog)
• Knowledge of chaos engineering and resilience testing
• Excellent collaboration and communication skills