Bright Vision Technologies
AI Performance Optimization Engineer
Monroe Township, New Jersey · Full-time
H1B sponsorship available$100k-$150kDetected 32 days ago
PythonDistributed SystemsFull-Stack DevelopmentCode ReviewPlatform EngineeringMachine LearningDeep LearningData EngineeringLLMsResearchCommunicationCollaborationMentoring
About the role
- We are seeking an AI Performance Optimization Engineer to focus on extracting maximum throughput, minimizing latency, and reducing cost across training and inference workloads for large neural network systems.
- The role spans the full stack from low-level kernel optimization to distributed system tuning, requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler-level optimization.
- The ideal candidate has demonstrated impact on production AI workloads, with strong instrumentation and measurement discipline that enables rigorous, data-driven optimization decisions.
Responsibilities
- Profile and optimize end-to-end AI training and inference pipelines for throughput, latency, and cost.
- Implement and tune quantization, sparsity, and pruning strategies to reduce model footprint and accelerate inference.
- Optimize distributed training using tensor parallelism, pipeline parallelism, FSDP, and ZeRO-style sharding.
- Implement KV cache optimization, continuous batching, and speculative decoding for LLM serving.
- Drive compiler-level optimizations using Triton, XLA, TorchInductor, or TVM, working with the broader ML framework community to land improvements that translate into measurable end-to-end performance gains.
- Optimize data pipelines, sharding strategies, and storage access patterns for high-throughput training.
- Build and maintain rigorous benchmark suites and regression frameworks across workloads.
- Collaborate with ML and platform engineering teams to embed best practices in standard pipelines.
- Drive cost-efficiency improvements through model architecture, hardware selection, and scheduling strategies.
- Document performance tuning playbooks and share findings broadly across engineering teams.
Requirements
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field.
- Six or more years of experience in performance engineering, ML systems, or HPC.
- Strong proficiency in Python and C++.
- Experience with profiling tools across CPU, GPU, and distributed systems.
- Familiarity with model compression techniques and their accuracy implications.
Nice to have
- Experience optimizing LLM inference at production scale.
- Contributions to vLLM, TensorRT-LLM, DeepSpeed, or similar projects.
- Familiarity with custom kernel authoring in Triton or CUTLASS.
- Experience with FinOps for AI workloads.
- Publications or talks on AI systems performance.
Compensation
- Competitive base salary commensurate with experience, plus benefits.
- Employment Terms & Visa Policy
- We do not engage in C2C, 1099, or third-party arrangements for this role.
- BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES.
- ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE.
- No new H1B sponsorship is available for this role.
Benefits
- Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations.
- In-house Bright Vision Technologies SOW engagement (no third-party client or vendor)
- Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party)
- Long-term, multi-year, aligned to the Bright Vision SOW delivery roadmap
- This role is part of Bright Vision Technologies' in-house Statement of Work (SOW) engagement.
- The client, end customer, and employer for this position is Bright Vision Technologies - there is no third-party client, vendor, or implementation partner involved.
- Candidates must be willing to work directly as a full-time W2 employee of Bright Vision Technologies and contribute to our in-house SOW deliverables.
- Learn more about Bright Vision Technologies at www.bvteck.com.
- We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.
- Bright Vision Technologies is an
- Equal Opportunity Employer, including Disability/Veterans.
Company info
- As we continue to grow, we're looking for a skilled AI Performance Optimization Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology.
Equal opportunity
- equal opportunity employer and place a high value on diversity and inclusion at our company.
- Equal Employment Opportunity (EEO) Statement
Visa & Work Authorization
- No new H1B sponsorship available.
- H1B transfers welcomed for qualified candidates.
- Employment Terms & Visa Policy
- No new H1B sponsorship is available for this role.
- However, candidates who are currently on a valid H1B visa and require a transfer are welcome to apply.
- We will support H1B transfers for qualified candidates.
Apply directly at Bright Vision Technologies →Create a free account for alerts like thisView Bright Vision Technologies immigration profile
This listing is sourced directly from Bright Vision Technologies's careers page and normalized into a canonical job model.