K Health
Senior AI Backend Engineer
Tel-Aviv, IL · Senior
Sponsorship not specifiedDetected 8 days ago
PythonJavaGoRustKotlinNode.jsDistributed SystemsBackend DevelopmentCode ReviewNoSQLPostgreSQLMySQLMongoDBRedisDatadogGraphQLRESTRabbitMQMachine LearningData ScienceLLMsAgentic AILangGraphHL7/FHIR
About the role
- As a Senior Backend Engineer in the AI Engineering team, you will:
- Orchestrate a hybrid model stack that includes OpenAI and Google Gemini alongside self-hosted and fine-tuned LLMs like Gemma and Llama.
- Participate in code reviews, knowledge sharing, and mentoring to elevate the team's technical capabilities.
Responsibilities
- Build and maintain reliable, scalable backend services to support AI agent execution and orchestration.
- Develop AI agent systems for complex operational workflows using LangChain, LangGraph, LiteLLM, and Langfuse.
- Build and maintain integrations with clinical systems (FHIR, EMR).
- Drive observability and reliability using OpenTelemetry, Datadog, and Langfuse.
- Design APIs (GraphQL, REST), background workers, and event-driven systems that interface with AI inference engines and agent runtimes.
- Collaborate with Data Science, ML, and engineering teams to deploy AI features and improve the performance, scalability, and reliability of backend systems.
- As a core member of our AI Engineering team, you will collaborate with data scientists, ML engineers, and product managers to build scalable, production-ready infrastructure and APIs that power intelligent systems.
Requirements
- 6+ years of backend engineering experience, with strong proficiency in more than one major programming language (such as Python, Java, Go, Rust, or Kotlin).
- Solid understanding of AI systems architecture and experience working in environments involving AI agents, LLMs, or inference pipelines.
- Strong experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Redis), including schema design, data modeling, and query optimization.
- Experience with message brokers and distributed systems (e.g., Pub/Sub, Redis Streams, RabbitMQ).
- Highly adaptable, a strong team player, with the ability to quickly learn and apply new technologies.
- Strong proficiency in Python and/or Node.js/NestJS.
- Hands-on experience with AI agent frameworks such as LangChain, LangGraph, or LiteLLM.
- Familiarity with observability tools for AI systems (Langfuse, OpenTelemetry).
Compensation
- We offer competitive compensation packages based on industry benchmarks for function, level, and geographic location.
Company info
- Behind every leading health system is K Health's AI-powered virtual care engine.
- Esteemed health systems like Mayo Clinic, Cedars-Sinai, Mass General Brigham, Hackensack Meridian Health, and Hartford Healthcare partner with K Health to build and run modern primary virtual care clinics on their behalf.
- Our deeply integrated model modernizes the primary care loop by using AI to put humans first. For our patients, we offer clinical AI (i.e., PatientGPT) and unparalleled access to close care gaps around the clock. For our Providers, we deliver provider-serving agentic solutions (i.e., Perfect Note) to eliminate administrative overload and burnout. And for the health systems, we deploy our top-grade Virtualists in AI-powered virtual clinics 24/7 to capture the patients' care journeys at step one, retain the journey through the system for longitudinal care, and strengthen profitability.
- We're founded in 2016, headquartered in New York City, and backed by nearly $400 million from leading investors including Valor Equity Partners, Claure Group, Mangrove Capital Partners, 14W, Notable Capital, Lerer Hippeau, Primary Venture Partners, Comcast Ventures, PICO Venture Partners, Max Ventures, and other strategic healthcare partners.
- We offer competitive compensation packages based on industry benchmarks for function, level, and geographic location.
- Offer amounts are determined by multiple factors such as a candidate's experience and expertise.
- We're deeply committed to building teams as diverse as the patients we serve and strive to cultivate an environment where everyone can bring their most authentic self to work.
- We depend on our differences to make our team stronger, our workplace more dynamic, and our product accessible to all of our users.
- We are committed to maintaining the integrity of our hiring process and ensuring a safe environment for all candidates.
- All communication for job offers from K Health will come from email addresses ending in @khealth.com.
- Our deeply integrated model modernizes the primary care loop by using AI to put humans first.
- For our patients, we offer clinical AI (i.e., PatientGPT) and unparalleled access to close care gaps around the clock.
- For our Providers, we deliver provider-serving agentic solutions (i.e., Perfect Note) to eliminate administrative overload and burnout.
- And for the health systems, we deploy our top-grade Virtualists in AI-powered virtual clinics 24/7 to capture the patients' care journeys at step one, retain the journey through the system for longitudinal care, and strengthen profitability.
- We are proud to be an Equal Opportunity Employer and consider applicants for employment regardless of race, ethnicity, religion, color, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, sexual orientation, pregnancy, childbirth and breastfeeding, age, citizenship, military or veteran status, or any other class protected by applicable federal, state, and local laws.
- K Health will never ask you to provide financial information about yourself during the recruitment process.
- We will never use personal email accounts or other domains for official correspondence.
- Our official job postings are only listed on our official website and reputable job boards.
- Be cautious of job offers from sources other than these platforms.
Visa & Work Authorization
- tus, sex, gender, gender identity, gender expression, sexual orientation, pregnancy, childbirth and breastfeeding, age, citizenship, military or veteran status, or any other class protected by applicable federal, state,
Apply directly at K Health →Create a free account for alerts like thisView K Health immigration profile
This listing is sourced directly from K Health's careers page and normalized into a canonical job model.