Staff Data Engineer / Tech Lead (Distribution Center)

Afresh is an AI platform for grocery retailers that helps grocers make smarter decisions and reduce food waste. The Staff Data Engineer / Tech Lead will lead the design and scaling of distribution center data integrations, build reliable ETLs and data tools, and collaborate with product, engineering, and applied science teams to support machine learning solutions.

Responsibilities:

• Design, build, and optimize robust ETLs using PySpark and dbt to process large-scale customer datasets while developing tools and frameworks to streamline data integrations and improve scalability
• Define the technical vision for DC data architecture, mentor engineers, and manage external contractors to ensure the team delivers high-quality, practical solutions for current and future needs
• Partner with product, engineering, and applied science teams to scope work and deliver data solutions that address real-world challenges in customer data quality and product feature requirements

Requirements:

• Significant experience designing and maintaining ETLs that process large-scale datasets
• Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or dbt
• 2+ years of experience in a technical lead role (e.g. Tech Lead or Engineering Manager), with a willingness to mentor and help others grow
• Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions
• A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done
• Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them
• A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort
• Excellent communication skills—you're able to explain your ideas clearly to both technical and non-technical audiences