Staff Software Engineer Data - DC Tech Lead

Afresh is an AI platform for grocery that focuses on reducing food waste and improving decision-making for grocers. They are seeking a Staff Data Engineer to lead the development of data integrations for their Distribution Center products, emphasizing scalable ETL processes and collaboration across teams.

Responsibilities:

• Design, build, and optimize robust ETLs using PySpark and DBT to process large-scale customer datasets while developing tools and frameworks to streamline data integrations and improve scalability
• Define the technical vision for DC data architecture, mentor engineers, and manage external contractors to ensure the team delivers high-quality, practical solutions for current and future needs
• Partner with product, engineering, and applied science teams to scope work and deliver data solutions that address real-world challenges in customer data quality and product feature requirements

Requirements:

• Significant experience designing and maintaining ETLs that process large-scale datasets
• Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT
• 2+ years experience in a technical lead role (e.g. Tech Lead or Engineering Manager), with a willingness to mentor and help others grow
• Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions
• A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done
• Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them
• A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort
• Excellent communication skills—you're able to explain your ideas clearly to both technical and non-technical audiences