Blueally

Blueally

Senior AI Engineer

Atlanta, , United States · Senior

Sponsorship not specifiedDetected 29 days ago
PythonCode ReviewVector DatabasesAWSAzureDockerKubernetesTerraformAnsibleHelmCI/CDLinuxMachine LearningLLMsRAGMLOpsIncident ResponseComplianceEmbedded SystemsTCP/IPDNSFirewallLoad BalancingHIPAA

About the role

  • From cloud to cybersecurity, infrastructure to application modernization, we thrive on cutting-edge technologies and services.
  • Turn complex decisions into clear opportunities with a trusted guide to technology that ensures the next digital advance will be your decisive advantage.

Responsibilities

  • Lead end-to-end design, build, and operation of AI systems on AI Factory platforms (HPE PCAI, Dell AI Factory, Nutanix Enterprise AI, and adjacent ecosystem layers) across multiple client engagements.
  • Design and engineer RAG applications on top of vector databases - chunking strategies, retrieval tuning, reranking, citation handling, and context-window management.
  • Build and tune prompt-engineering patterns at production scale - system prompts, structured output, tool and function calling.
  • Design and maintain LLM evaluation harnesses - golden sets, regression suites, and online quality metrics.
  • Build and maintain container images, registries, and CI/CD pipelines for AI/ML services.
  • Implement monitoring, alerting, logging, and capacity planning across the AI stack.
  • Lead troubleshooting across bare metal, BIOS/firmware, OS, containers, GPUs, frameworks, and models.
  • Author runbooks, reference architectures, and knowledge base content; lead client knowledge transfer and enablement sessions.
  • Contribute reusable patterns, tooling, and reference designs back to the practice.

Requirements

  • Elevate the impact of technology across your enterprise with world-class expertise that produces game-changing insights.
  • Trade IT complexity for capability with solutions that elevate possibilities, and advance with certainty, knowing you have BlueAlly as your ally in next.
  • Deep proficiency with Docker - image build, registry management, runtime tuning, and container security.
  • Working knowledge of multiple inference and model-serving frameworks beyond vLLM, with the ability to choose and tune the right tool for each workload.
  • Experience with GPU drivers, CUDA toolchains, GPU partitioning (MIG/vGPU), and GPU-level monitoring.
  • Deployment and operations experience with the NVAIE software stack.
  • Familiarity with Ray for distributed training and inference scaling.
  • Working knowledge of Kubernetes administration - Helm, ingress, RBAC, storage classes.
  • Familiarity with LoRA/QLoRA/PEFT and supervised fine-tuning workflows.

Nice to have

  • GPU operations: Experience with GPU drivers, CUDA toolchains, GPU partitioning (MIG/vGPU), and GPU-level monitoring.
  • NVIDIA AI Enterprise: Deployment and operations experience with the NVAIE software stack.
  • Ray: Familiarity with Ray for distributed training and inference scaling.
  • Kubernetes: Working knowledge of Kubernetes administration - Helm, ingress, RBAC, storage classes.
  • Identity and access: Integrating SSO and enterprise identity (LDAP, AD, OIDC/SAML), secrets management, tenant isolation.
  • Fine-tuning: Familiarity with LoRA/QLoRA/PEFT and supervised fine-tuning workflows.
  • Token economics: Experience optimizing inference cost - caching, prompt caching, model routing, and distillation.
  • MSP / multi-tenant operations: Service-provider experience including chargeback/showback and tenant isolation patterns.

Skills

  • Communication: Strong written and verbal communication - clear reference architectures, runbooks, and incident reports.
  • Networking fundamentals: TCP/IP, DNS, load balancing, VLANs, and firewall administration.
  • Multi-client delivery: Comfort working across multiple concurrent client environments and managing competing priorities under SLA.
  • SOC 2, HIPAA, FedRAMP, FISMA, or CMMC environments.
  • HPE, Dell Technologies, or Nutanix platform certifications.

Equal opportunity

  • BlueAlly is an Equal Opportunity Employer.
  • We are committed to building a diverse and inclusive workforce and to making employment decisions based on merit, qualifications, and business need.
  • BlueAlly does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy), national origin, age, disability, genetic information, sexual orientation, gender identity or expression, marital status, veteran status, or any other protected characteristic under applicable federal, state, or local law.
  • BlueAlly provides reasonable accommodations to qualified applicants and employees with disabilities.
Apply directly at Blueally →Create a free account for alerts like thisView Blueally immigration profile

This listing is sourced directly from Blueally's careers page and normalized into a canonical job model.