The Josef Group Inc.

Artificial Intelligence Engineer LLM

Chantilly, Virginia

No sponsorship$210k-$250kDetected 19 hours ago
TypeScriptPythonVector DatabasesAWSGCPAzureCloud PlatformsDockerKubernetesTerraformAnsibleHelmCI/CDLinuxPrometheusGrafanaSite Reliability EngineeringMachine LearningNLPLLMsRAGLLMOpsMLOpsIncident Response

About the role

  • Top Secret Clearance (TS/SCI) is required
  • We are seeking an experienced LLMOps Engineer to deploy, operate, and optimize self-hosted Large Language Models (LLMs) in production.

Responsibilities

  • Deploy, manage, and optimize self-hosted LLMs using vLLM on GPU infrastructure.
  • Optimize inference performance through quantization (AWQ, GPTQ, FP8) and benchmark latency, throughput, and GPU utilization.
  • Build and maintain scalable Kubernetes-based AI infrastructure.
  • Manage model versioning, deployments, rollbacks, and production releases.
  • Implement CI/CD pipelines, Infrastructure-as-Code, observability, and incident response for AI platforms.

Requirements

  • Strong understanding of LLM architecture, transformer models, tokenization, inference, and fine-tuning.
  • Experience with Infrastructure-as-Code (Terraform, Helm, Ansible) and CI/CD tools.

Compensation

  • $210k-$250k

Benefits

  • Monitor model health, performance, and production reliability.

This listing is sourced directly from The Josef Group Inc.'s careers page and normalized into a canonical job model.