Bright Vision Technologies

Bright Vision Technologies

ML Platform Engineer

Parsippany-Troy Hills, New Jersey · Full-time

H1B sponsorship available$100k-$150kDetected 15 days ago
PythonGoRustC++Distributed SystemsCloud PlatformsKubernetesPlatform EngineeringMachine LearningLLMsCybersecurityIncident ResponseSystems EngineeringResearchCommunication

About the role

  • The role focuses on the systems engineering side of AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads.
  • The ideal candidate brings strong distributed systems and performance engineering expertise, has shipped serving systems at scale, and understands the trade-offs between latency, throughput, cost, and quality in ML serving.

Responsibilities

  • Optimize inference performance using continuous batching, paged attention, speculative decoding, and request multiplexing
  • Implement multi-tenant routing, rate limiting, and quality-of-service policies across model endpoints
  • Build autoscaling and capacity management systems that balance latency, throughput, and cost
  • Implement caching, prompt deduplication, and response reuse strategies where appropriate
  • Drive end-to-end observability including latency histograms, queue dynamics, GPU utilization, and error tracking
  • Develop deployment workflows including canary releases, shadow testing, and automated rollback
  • Operate incident response for high-availability AI services and drive durable reliability improvements
  • Collaborate with ML and product teams to support new model releases and capability rollouts
  • Implement security controls including request signing, content filtering, and abuse detection at the serving layer
  • Document operational procedures, performance characteristics, and tuning guidance for internal teams

Requirements

  • Bachelor's or Master's degree in Computer Science or a related field
  • Six or more years of experience in distributed systems, infrastructure, or ML platform engineering
  • Strong proficiency in Python and a systems language such as Go, Rust, or C++
  • Deep experience operating high-throughput, low-latency services in production
  • Hands-on experience with LLM or large model inference frameworks such as vcLLM or TensorRT-LLM
  • Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization
  • Familiarity with Kubernetes, autoscaling, and modern cloud platforms
  • Experience with observability stacks including metrics, tracing, and structured logging

Nice to have

  • Open-source contributions to model serving infrastructure
  • Experience with multi-region or globally distributed AI serving
  • Familiarity with model quantization, distillation, and compression techniques
  • Experience supporting external-facing AI APIs at scale

Compensation

  • Competitive base salary commensurate with experience, plus benefits.

Benefits

  • Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations.
  • In-house Bright Vision Technologies SOW engagement (no third-party client or vendor)
  • Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party)
  • Long-term, multi-year, aligned to the Bright Vision SOW delivery roadmap
  • Design and operate model serving platforms supporting diverse workloads including LLMs, vision models, and recommendation systems
  • This role is part of Bright Vision Technologies' in-house Statement of Work (SOW) engagement.
  • The client, end customer, and employer for this position is Bright Vision Technologies - there is no third-party client, vendor, or implementation partner involved.
  • Learn more about Bright Vision Technologies at www.bvteck.com.
  • We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.
  • Bright Vision Technologies is an
  • Equal Opportunity Employer, including Disability/Veterans.

Company info

  • As we continue to grow, we're looking for a skilled ML Platform Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology.

Equal opportunity

  • equal opportunity employer and place a high value on diversity and inclusion at our company.
  • Equal Employment Opportunity (EEO) Statement

Visa & Work Authorization

  • No new H1B sponsorship available.
  • H1B transfers welcomed for qualified candidates.
  • Employment Terms & Visa Policy
  • No new H1B sponsorship is available for this role.
  • However, candidates who are currently on a valid H1B visa and require a transfer are welcome to apply.
  • We will support H1B transfers for qualified candidates.
Apply directly at Bright Vision Technologies →Create a free account for alerts like thisView Bright Vision Technologies immigration profile

This listing is sourced directly from Bright Vision Technologies's careers page and normalized into a canonical job model.