Treeswift
Data Platform Engineer
New York Office · Full-time
Sponsorship not specified$160k-$200kDetected 137 days ago
PythonNode.jsFull-Stack DevelopmentMongoDBAWSKubernetesPlatform EngineeringMachine LearningAirflowData EngineeringRoboticsSensorsCommunicationCollaboration
About the role
- You are a skilled and motivated Data Platform Engineer.
- We run Apache Airflow 3 on Astronomer with pipelines that process terabytes of real-world physical data across many file types-imagery, audio, point clouds, and more.
- You will work closely with our in-house ML team (feature pipelines and model deployment live in these DAGs) and coordinate with our hardware team on ingestion and formats.
Responsibilities
- Come build the future of (field) work with us.
- Design, build, and maintain data pipelines at scale.
- You will develop and evolve DAGs that orchestrate complex, multi-step workflows: dozens of tasks, fan out/in in pipelines, Python and Kubernetes operators split across generalized and specialized node pools, and dynamic DAG generation.
- You will partner closely with some of the largest utilities in the country and contribute to efforts to develop new workflows in work planning, construction and disaster response.
Requirements
- If you enjoy writing pipelines and improving the platform that runs them, this role has room for both.
- We value the full picture you bring-whether that's deep expertise in orchestration, a knack for debugging at scale, or hidden talents outside work.
- Bachelor's degree in Computer Science, Computer Engineering, Math, or a related field (or equivalent experience).
- 4+ years of data engineering or backend engineering experience with a focus on pipelines, orchestration, or platform.
- we don't require Python expertise and are happy for you to learn on the job.
- Experience with cloud object storage and data-at-scale (we use AWS and S3
- cloud experience is required, but prior AWS experience is not).
- you work well with ML, hardware, and product stakeholders and can explain tradeoffs clearly.
- Experience in early-stage or fast-moving environments where scope and ownership evolve.
- Experience with Apache Airflow (especially 3.x) and/or Astronomer.
Compensation
- The estimated salary range for this position is 160,000 - 200,000 USD.
- This salary estimate excludes the value of any potential bonuses
Benefits
- Competitive salary and equity package
- Comprehensive medical, dental, and vision coverage for you and your eligible dependents
- Life insurance and short- and long-term disability coverage
- 16 weeks of fully paid parental leave to support all new parents
- Flexible, unlimited paid time off
- 401(k) retirement savings plan
- Commuter benefits
- the value of any benefits offered
Company info
- Scope is a mix of pipeline development and platform ownership and we are happy to adjust the scope and balance of responsibilities based on your interests and strengths.
- We are a small team where many people wear multiple hats.
- We take pride in managing complexity and providing high-fidelity data that our customers can use to make better-informed decisions.
- Be an owner at Treeswift; make the company better in whatever form that takes.
- Curiosity. We are constantly learning - from each other and from our customers.. We aren't afraid to learn we were wrong in the process and adapt our approach accordingly.
- Our platform is powered by cutting edge hardware, sensors (LiDAR, camera, etc…), AI and software designed to revolutionize work in the toughest environments.
- To date, our technology has enabled our customers to reduce wildfire risk, regulatory and outage risk from vegetation, avoid delays and cost overruns in new construction, and accelerate recovery from severe storms.
- To tackle this challenge, we are bringing together a team of mission-driven experts with deep industry experience in robotics (Penn, Caltech, CMU) and enterprise software development (Palantir, Stripe, Oracle, MongoDB).
- We are headquartered in midtown Manhattan, with additional offices in San Francisco and Philadelphia.
- We're looking for deeply curious and highly ambitious people who want to have a real world impact.
- Design, build, and maintain data pipelines at scale. We run Apache Airflow 3 on Astronomer with pipelines that process terabytes of real-world physical data across many file types-imagery, audio, point clouds, and more.
Equal opportunity
- equal opportunity employer.
Apply directly at Treeswift →Create a free account for alerts like thisView Treeswift immigration profile
This listing is sourced directly from Treeswift's careers page and normalized into a canonical job model.