Cylake
Data Pipeline Engineer
Sunnyvale
Sponsorship not specified$150k-$250kDetected 138 days ago
PythonPostgreSQLKafkaSparkData AnalysisData EngineeringCybersecurityCommunication
About the role
- Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality.
Responsibilities
- Join a small team building the next generation of cybersecurity products from the ground up.
- Led by industry veterans with a proven track record of success - you will get to architect, build, and deliver hugely impactful products with this world-class team.
- Design, build, and maintain a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads.
Requirements
- Experience with both batch and real-time processing architectures
- Experience with open source Data Lakehouse components, including Apache Iceberg, PostgreSQL, Neo4j, Apache Parquet, etc.
- Experience with tools for stream processing and data analytics - Apache Kafka, Spark, Flink, etc.
- Understanding and experience with data transformation solutions
- Excellent programming experience with Python
Nice to have
- Experience with CSP data platforms is a plus
- Understanding of data lineage, quality, and governance tooling is a plus
Compensation
- We offer competitive compensation and a comprehensive benefits package designed to support our employees' health, well-being, and long-term success.
This listing is sourced directly from Cylake's careers page and normalized into a canonical job model.