Senior Data Engineer

AgileEngine is seeking a Senior Data Engineer to build data pipelines and tooling for cost attribution, optimization, and financial modeling. The role focuses on developing reliable datasets, improving cost transparency, identifying optimization opportunities, and enabling data-driven decisions across product, engineering, analytics, and finance teams.

Responsibilities:

• Develop and implement tooling and datasets that drive telemetry-driven cost attribution and performance-informed financial modeling, enabling product, engineering, analyst, and finance stakeholders to make faster, data-driven decisions and trust the data
• Build and maintain data pipelines and tooling that provide cost transparency, surface optimization opportunities, and support committed use discount modeling and management

Requirements:

• 4+ years of experience in Data Engineering roles
• Hands-on experience with SQL, Python, Spark, and Scala
• Hands-on experience with workflow orchestration tools such as dbt, Airflow, and Dagster
• Hands-on experience with AWS (Glue, Aurora, Athena), GCP, and Snowflake
• Experience architecting and enhancing the long-term maintainability of end-to-end ELT/ETL data pipelines, including data modeling and schema maturity
• Exposure to CI/CD development processes, Infrastructure as Code ( Terraform ), and REST API programming
• Strong attention to detail, analytical skill, and comprehensive data auditing and end-to-end validation skills
• Ability to explain technical concepts to non-technical audiences
• Upper-intermediate English level
• Experience with FinOps teams or cost optimization job duties
• FinOps Practitioner or FinOps Engineer certification
• Experience with Datadog API endpoints
• Experience with Go