Newfront
Senior AI Engineer
United States (Remote) · Senior · Full-time
Sponsorship not specifiedDetected 63 days ago
TypeScriptPythonNode.jsCode ReviewCloud PlatformsCI/CDDevOpsAPI DevelopmentMachine LearningLLMsRAGAgentic AIAI OrchestrationCommunicationCollaborationProblem SolvingUnderwriting
About the role
- Details of participation in these benefit plans will be provided if an employee receives an offer of employment.
Responsibilities
- Own model routing and the model gateway - selecting between hosted frontier models and on-premise / self-hosted models per use case, balancing quality, latency, cost, and data-residency constraints.
- Ship AI product features end-to-end on top of the platform - from problem discovery with brokering, underwriting, and operations partners through technical design, implementation, and the user-facing surfaces that make AI capabilities intuitive for non-technical users.
- Mentor engineers on production AI systems, review designs, and help establish best practices for building reliable AI in financial services.
- Partner with security, privacy, and compliance to bake controls - auth, audit, PII handling, retention, model risk management - into the platform rather than leaving them to each product team to rediscover.
Requirements
- Strong programming skills in TypeScript, including experience with Node.js or another TypeScript backend framework in production.
- Experience with modern development and deployment practices (e.g., containerization, CI/CD, infrastructure-as-code, production observability).
- Experience designing systems for reliability, cost, and scale in production.
- Strong problem-solving skills and the ability to take a pragmatic and efficient approach to tackling challenges.
- Working knowledge of Python and/or Go - we use Python for ML/AI tooling and Go in parts of our backend, and you will read and occasionally write both.
- Experience self-hosting or fine-tuning open-weight LLMs (e.g., GPU inference serving with vLLM/TGI/TensorRT-LLM, quantization, LoRA/PEFT, on-prem deployment).
- If you are excited about a role at Newfront but feel you're missing a few of the qualifications, we still encourage you to apply and tell us about yourself.
- BS, MS or PhD in computer science, or related field, or equivalent work experience
- 5+ years of professional software engineering experience, with a strong general software development background - building, shipping, and operating production services, not just notebooks or prototypes. We are looking for an engineer first, who has gone deep on AI, rather than someone whose experience is exclusively in ML research.
- Solid fundamentals in API design, data modeling, testing, debugging production systems, code review, and collaborating in a team codebase.
- A track record of leading AI/ML projects end-to-end, including API design, production operations, and long-term maintenance.
- Passion for staying up-to-date with the latest advancements in AI/ML and applying them to real-world problems.
- Excellent collaboration and communication skills, with the ability to partner with product teams and effectively communicate complex technical concepts to non-technical stakeholders.
- Hands-on experience building agent frameworks, tool-use runtimes, RAG systems, connector / integration frameworks, or evaluation harnesses for LLM-based applications.
Skills
- Experience deploying or leveraging machine learning models and Large Language Models (LLMs) to power business applications at scale.
- Knowledge of state-of-the-art LLM techniques, models, and vendors, including trade-offs across providers.
- Familiarity with LLM and related frameworks, including extracting structured data from unstructured text.
- Experience with popular AI/ML libraries and frameworks.
- Familiarity with DevOps practices, cloud infrastructure, authorization, authentication, and search infrastructure.
- This position is a salary, exempt, and full-time position.
- This is a US-remote or hybrid role with the option to work from any of Newfront's office locations. #LI-Remote
Compensation
- This position is a salary, exempt, and full-time position.
Apply directly at Newfront →Create a free account for alerts like thisView Newfront immigration profile
This listing is sourced directly from Newfront's careers page and normalized into a canonical job model.