acceldata
Staff Engineer - Open Source Data Platform (ODP)
Kitchener · Staff+
Sponsorship not specifiedDetected 128 days ago
PythonJavaScalaDistributed SystemsAlgorithmsCode ReviewGitAWSGCPAzureCloud PlatformsDockerKubernetesCI/CDLinuxKafkaSparkLLMsExcelHRISLeadershipCommunicationPublic Speaking
About the role
- In this role, you will be a technical leader responsible for architecting and driving the technical direction of critical components within the Acceldata Open Data Platform (ODP).
- You will work on solving the most challenging distributed systems problems, contribute to open-source communities, and mentor senior engineers while shaping the future of large-scale data infrastructure.
- WHY JOIN US At Acceldata, you won't just be writing code
Responsibilities
- Own the end-to-end architecture of major platform components, driving design decisions that impact scalability, reliability, and performance.
- Architect and implement next-generation distributed data storage, processing, and query optimization systems.
- Partner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions.
- Lead contributions to Apache projects and open-source communities, establishing Acceldata's presence and technical reputation.
- Establish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform.
- Lead root cause analysis for critical production issues and drive systemic improvements to prevent recurrence.
- You'll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and open-source innovation.
- If you're ready to take ownership of complex technical challenges and drive innovation at scale, Acceldata is where you belong.
Requirements
- 9+ years of hands-on software development experience with at least 5 years focused on distributed systems or big data platforms.
- Extensive hands-on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).
- Expert-level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.
- Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).
- Deep expertise with Maven, Gradle, or SBT
- Proven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.
- Strong understanding of architectural patterns for scalable, fault-tolerant distributed systems.
- ability to articulate complex technical concepts to diverse audiences, including senior leadership.
- Demonstrated ability to work effectively with cross-functional teams, external contributors, and the open-source community.
- ABOUT THE ROLE We are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development.
Nice to have
- Expert-level proficiency in Java or Scala, with strong Python skills.
- Experience with systems languages is a plus.
Skills
- History of significant contributions or committer status in Apache projects (e.g., Spark, Kafka, Hive, Iceberg, Flink, etc.).
- Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.
- Familiarity with data governance, security, lineage, and compliance frameworks.
- Experience leading large-scale data platform migrations or Hadoop distribution upgrades.
- Published technical blogs, papers, or conference presentations on distributed systems topics.
- Experience leading or maintaining open-source projects.
- Bare Metals, VM, Kubernetes, and multi-cloud architectures.
Benefits
- At Acceldata, you won't just be writing code; you'll be defining the architecture and technical vision for modern data platforms used by some of the world's largest enterprises.
- Mentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning.
Company info
- Acceldata is the market leader in Enterprise Data Observability.
- Founded in 2018 and backed by top investors including Insight Partners, March Capital, Lightspeed, Sorenson Ventures, Industry Ventures, and Emergent Ventures, we are a Series-C funded company headquartered in Silicon Valley.
- Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey's, Dun & Bradstreet, and many more.
- Our Enterprise Data Observability Platform-the first of its kind-helps enterprises build and operate world-class data products by ensuring data is reliable, trusted, and ready to power today's most critical technologies, including AI, LLMs, Analytics, and DataOps.
- ABOUT US Acceldata is the market leader in Enterprise Data Observability.
Visa & Work Authorization
- Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey's, Dun & Bradstreet, and many more.
Apply directly at acceldata →Create a free account for alerts like thisView acceldata immigration profile
This listing is sourced directly from acceldata's careers page and normalized into a canonical job model.