← Back to jobsApply for this position
Afresh
Senior Data Engineer
datafull-timeRemote - United States
SALARY
Not listed
WORK TYPE
remote
JOB TYPE
full-time
INDUSTRY
ai
✦ AutoApply Let us apply to roles like this on your behalf.
Learn more
About the role
About the Role
As a Senior Data Engineer, you’ll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools/improve the platform to make customer integrations faster, more accurate, and more scalable. You’ll also contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution.
What You’ll Do
- Build tools and frameworks that streamline customer integrations, enabling faster onboarding and better handling of customer data.
- Create robust ETLs in PySpark and DBT to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.
- Investigate and implement new technologies into the data platform, focusing on practical solutions that address current pain points and anticipate future needs.
- Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.
- Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.
- Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.
- Support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback.
What Makes You a Great Fit
- Significant experience designing and maintaining ETLs that process large-scale datasets.
- Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT.
- Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
- A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done.
- Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them.
- A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort.
- Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences.
- Proven leadership in technical projects, with a willingness to mentor and help others grow.
Why Work Here
- Join a mission-driven company reducing millions of pounds of food waste in grocery stores per year.
- Work on challenging, real-world data problems at scale.
- Collaborate with a talented, passionate team.
- Competitive compensation and benefits package.
- Opportunity to make a significant impact in a rapidly growing company.
✦ Let us apply for you
We find roles like this and apply on your behalf. Cover letter written for each one. Plans from $14.99/mo. Cancel anytime.
Join waitlist