The Mill (themill.com)
Data Engineer
San Bruno, California
Sponsorship not specified$185k-$210kDetected 4 days ago
PythonDistributed SystemsSQLBigQuerySnowflakeRedshiftCloud PlatformsTerraformCI/CDAirflowdbtData AnalysisData EngineeringData VisualizationLLMsRAGTest Automation
About the role
- As a Data Engineer at Mill, you'll touch systems end-to-end - from raw ingestion to the recommendation a customer sees in the app to managing the data warehouse.
- You'll architect a warehouse model one week and tune recommendation logic the next.
Responsibilities
- Build and operate the customer-facing recommendation engine that turns food waste data into actionable recommendations - purchasing suggestions, anomaly explanations, operational nudges - including LLM-based logic where useful
- Co-create and drive Mill's self-serve analytics strategy with analysts and data scientists - defining golden datasets, setting SLAs for freshness and reliability, and establishing the governance model that keeps self-serve trustworthy at scale
- Own data quality monitoring against those SLAs - build alerting, validation frameworks, and observability tooling so golden dataset issues get caught before they become business problems
- Design, build, and maintain scalable data pipelines across Mill's product and operational systems
- Define and maintain the metrics, table endorsements, and business logic that analysts and stakeholders rely on - so everyone across the company is working from the same numbers
- Have designed, built, or operated a recommendation system in production - one that combines multiple data sources into a single customer-facing output - not just contributed data to someone else's model
- Experience building recommendation or personalization logic using LLMs (prompt-based scoring, retrieval-augmented generation, agent-based reasoning) in a live product, not just a prototype
Requirements
- Have brought CI/CD discipline to data pipelines or product logic (automated testing, staged rollout, rollback), with a track record of measuring whether a change actually improved outcomes, not just shipping it
- 5 years of experience operating data engineering systems in production
Nice to have
- Exposure to distributed systems concepts (partitioning, consistency, fault tolerance)
- Hands-on experience with infrastructure as code (Terraform, Pulumi) in a cloud environment
- Experience with Hex, Mixpanel, Tableau, or similar BI/analytics tools
- Familiarity with data contract or data mesh patterns
- Experience with event tracking or product analytics
Skills
- Mill is a waste prevention technology company reimagining what it means to eliminate waste, starting with food.
Compensation
- The estimated base salary range for this position is $185k to $210k, which does not include the value of benefits or a potential equity grant.
Company info
- What We're Looking For
Apply directly at The Mill (themill.com) →Create a free account for alerts like thisView The Mill (themill.com) immigration profile
This listing is sourced directly from The Mill (themill.com)'s careers page and normalized into a canonical job model.