Enchargeai36

Enchargeai36

LLM Inference Deployment Engineer

U.S.-Remote, Canada

Sponsorship not specified$180k-$240kDetected 12 days ago
PythonDockerKubernetesTensorFlowPyTorchNLPLLMsRAGElectrical Engineering

About the role

  • You will work at the intersection of AI frameworks, model optimization, and runtime execution to ensure efficient model execution and low-latency AI inference.

Responsibilities

  • Deploy and optimize LLMs (GPT, LLaMA, Mistral, Falcon, etc.) post-training from libraries like HuggingFace
  • Optimize batching, caching, and tensor parallelism to improve LLM scalability in real-time applications.
  • Develop and maintain high-performance inference pipelines using Docker, Kubernetes, and other inference servers.

Requirements

  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field.
  • Experience in LLM inference deployment, model optimization, and runtime engineering.
  • Strong expertise in LLM inference frameworks (PyTorch, ONNX Runtime, vLLM, TensorRT-LLM, DeepSpeed).
  • In-depth knowledge of the Python programming language for model integration and performance tuning.
  • Strong understanding of high-level model representations and experience implementing framework-level optimizations for Generative AI use cases
  • Experience with containerized AI deployments (Docker, Kubernetes, Triton Inference Server, TensorFlow Serving, TorchServe).
  • Strong knowledge of LLM memory optimization strategies for long-context applications.
  • Experience with real-time LLM applications (chatbots, code generation, retrieval-augmented generation).
  • EnchargeAI is an equal employment opportunity employer in the United States.
  • The salary range for this position is $180,000 to $240,000 USD ($175,000 to $245,000 CAD) per year. Actual compensation offered will be determined based on job-related knowledge, skills, and experience.

Skills

  • EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing.

Compensation

  • The salary range for this position is $180,000 to $240,000 USD ($175,000 to $245,000 CAD) per year.
Apply directly at Enchargeai36 →Create a free account for alerts like thisView Enchargeai36 immigration profile

This listing is sourced directly from Enchargeai36's careers page and normalized into a canonical job model.