WorkWhile
Senior Data Engineer, Engineering
San Francisco · Senior
Sponsorship not specifiedDetected 116 days ago
PythonSQLPostgreSQLBigQuerySnowflakeRedshiftGCPCloud PlatformsDockerKubernetesTerraformPlatform EngineeringMachine LearningAirflowData EngineeringData ScienceData VisualizationForecastingCollaborationDemand Planning
About the role
- You will work closely with Data Science, Product Engineering, and Operations to ensure reliable, well-modelled, high-quality data is available where and when it's needed.
Responsibilities
- Build and optimize data pipelines that ingest, transform, and model data from PostgreSQL, Amplitude, and external sources into BigQuery
- Own BigQuery data warehouse architecture: dataset organization, table design, partitioning, clustering, and query performance optimization
- Work to improve Ops ML platform capabilities and processes, partnering with the Data Science team to support efficient and reliable ML training and pipelines
- Support analytics by ensuring clean, performant datasets are available for self-serve reporting
- Optimize Cloud Tasks and Cloud Scheduler configurations for data refresh jobs and materialized view maintenance
- Expertise in SQL, with the ability to write and optimize complex analytical queries across BigQuery and PostgreSQL
Requirements
- Bachelor's degree in Computer Science, Data Engineering, Mathematics, or equivalent experience
- 5+ years in data engineering or data platform engineering
- Experience with Dagster or similar orchestration tools (Airflow, Prefect)
- Proficiency building data pipelines in Python
- Experience maintaining data warehouses on BigQuery, Snowflake, or Redshift
- Hands-on experience with Google Cloud Platform services
- Experience with infrastructure-as-code (Terraform) and containerized deployments (Docker, ECS, Cloud Run, Kubernetes, etc.)
- Proficiency with data quality frameworks, monitoring, and observability tooling
- Strong collaboration skills and a track record of partnering effectively with Data Science and Product Engineering teams
Nice to have
- Experience with reverse ETL tools like Hightouch or Census
- Familiarity with BI tools such as Metabase or Looker
- Background in marketplace, staffing, or gig economy data domains
- In-person company offsites
- 401(k) with employer match
Skills
- Work on reverse ETL workflows and API integrations that push model predictions back into production systems
- Collaborate with Engineering on Terraform-managed GCP infrastructure
Benefits
- Medical, dental, & vision coverage
- Flexible time off
- WFH stipend to support your home office needs
Company info
- What we're looking for
Equal opportunity
- Equal Opportunity Employer.
Apply directly at WorkWhile →Create a free account for alerts like thisView WorkWhile immigration profile
This listing is sourced directly from WorkWhile's careers page and normalized into a canonical job model.