Snorkel AI
Senior Software Engineer - Core Services
Redwood City, CA (Hybrid); San Francisco, CA (Hybrid) · Senior
Sponsorship not specified$220k-$260kDetected 34 days ago
PythonFastAPIGitSQLPostgreSQLSnowflakeRedshiftAWSTerraformCI/CDGitHub ActionsSite Reliability EngineeringAirflowdbtData EngineeringLLMsComplianceAuditingHIPAAResearchLeadership
About the role
- The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today.
Responsibilities
- Build and maintain the shared data access library and SDKs that Platform, Packaging, and Dataset API teams use to read from and write to multiple data sources (Snowflake, S3, RDS).
- Design interfaces that abstract source-level complexity while providing built-in auth, RBAC enforcement, pagination, and query governance.
- Design and implement event-driven data flows using event brokers, CDC connectors, schema registry, event routing, dead letter queues. Make sure events flow reliably and failures are visible and recoverable.
- Build the systems that track how data moves through the platform (lineage), enforce who can access what (governance and RBAC), and log what happened (auditing).
- Instrument the data platform with OpenTelemetry, define and monitor SLOs for query latency and pipeline success rates, and build alerting that catches issues before they become incidents. You will be on-call for the systems you build.
Requirements
- Experience with AWS - S3, RDS, EKS, EventBridge, IAM.
- Experience with Kubernetes.
- Familiarity with data orchestration tools (Prefect, Airflow, or Dagster) and transformation frameworks (dbt).
- You have built and operated pipelines, data access layers, or ETL/ELT systems in production.
- Strong proficiency in Python.
- Hands-on experience with SQL and at least two of: Snowflake, Redshift, Postgres.
Nice to have
- Experience with event-driven architectures - CDC, event buses, schema registries, at-least-once delivery semantics.
- Experience with OpenTelemetry, ClickHouse, or similar observability infrastructure.
- Experience with Ray for distributed compute workloads.
- Be Your Best at Snorkel
- As a member of our team, you'll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success.
- Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment.
- All employment is decided on the basis of qualifications, performance, merit, and business need.
- Please contact us to request accommodation.
Skills
- Excited to help us redefine how AI is built?
- Apply to be the newest Snorkeler!
- The decisions being made now will define how data flows at Snorkel for years.
- Your work will directly accelerate developer velocity, reliability, and product quality across the company
Compensation
- Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.
Apply directly at Snorkel AI →Create a free account for alerts like thisView Snorkel AI immigration profile
This listing is sourced directly from Snorkel AI's careers page and normalized into a canonical job model.