Versant
Senior Data Engineer
North Hollywood, CA, United States · Senior
Sponsorship not specified$140k-$160kDetected 9 days ago
Distributed SystemsCode ReviewGitSQLDatabricksCloud PlatformsCI/CDMachine LearningSparkAirflowData EngineeringData ScienceMLOpsCybersecurityComplianceRecruitingUnityEHR/EMRCommunicationCollaborationMentoring
About the role
- It operates across four core markets: political news and opinion, business news and personal finance, golf, and sports and genre entertainment.
- We include a good faith pay range for each position to comply with applicable state and local pay transparency laws and to promote equity across our organization.
- You can submit your request to candidateaccessibility@versantmedia.com.
Responsibilities
- Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel
- Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns
- Implement data governance and security using Unity Catalog, RBAC, and
- Optimize performance and manage costs through FinOps strategies, including cluster sizing, workload tagging, Spark tuning, and Photon acceleration
- Design, implement, and maintain CI/CD pipelines and orchestration workflows using Databricks Workflows, Delta Live Tables, and tools such as Airflow
- Collaborate with Data Science teams on ML workflows, including MLflow,
- Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto
- Build and operate batch and real-time ingestion pipelines using Spark based batch and streaming patterns (e.g., Structured Streaming, CDC), with experience on Databricks or comparable platforms
- VERSANT (Nasdaq: VSNT) is an industry-changing media and entertainment business and home to trusted brands that shape culture, inform audiences, and build lasting connections.
Requirements
- Bachelor's degree in Computer Science, Data Engineering, or equivalent practical experience
- 5+ years of experience building production-grade data pipelines in cloud environments using Spark-based platforms (e.g., Databricks, EMR, Dataproc, open-source Spark)
- Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production
- Proficiency with orchestration tools such as Apache Airflow or Dagster, with hands-on experience in CI/CD, monitoring, alerting, and data quality for production systems
- Experience working with modern data architectures, including event-driven and distributed systems
- Proficiency with Git and collaborative development workflows
- As part of our selection process, candidates may be required to attend an in-person interview with a VERSANT employee in New York.
Nice to have
- Familiarity with Unity Catalog, data governance, and compliance frameworks (e.g., PCI)
- Hands-on experience with CI/CD pipelines, orchestration tools, and infrastructure-as-code
- Experience with Lakeflow Spark Declarative Pipelines (SDP), MLflow, feature stores, and MLOps practices
- Background in media and entertainment data (e.g., video metadata, ad tech, audience analytics)
- understanding of audience analytics
- Experience working with large-scale analytical datasets (e.g., event logs, clickstream data, audience metrics)
- Comfortable using AI-assisted development tools (e.g., ChatGPT)
- Databricks or cloud certifications (e.g., Databricks Certified Data Engineer)
Compensation
- VERSANT is committed to fair and equitable compensation practices.
- We include a good faith pay range for each position to comply with applicable state and local pay transparency laws and to promote equity across our organization.
- Actual compensation will be based on factors such as the candidate's skills, qualifications, experience, and location and may include additional forms of compensation and benefits such as health insurance, retirement plans, paid time off, etc.
Benefits
- This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other benefits and perks.
Visa & Work Authorization
- ithout regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership i
Apply directly at Versant →Create a free account for alerts like thisView Versant immigration profile
This listing is sourced directly from Versant's careers page and normalized into a canonical job model.