Ares Management

Ares Management

Principal, AI Engineer (Technical Lead)

New York, NY · Principal

Sponsorship not specified$300k-$350kDetected 1 hour ago
PythonJavaGoRustDistributed SystemsVector DatabasesAWSGCPAzureCloud PlatformsDockerKubernetesCI/CDDevOpsPlatform EngineeringRESTMachine LearningTensorFlowData EngineeringLLMsRAGMLOpsAI OrchestrationA/B Testing

About the role

  • This is a leadership role that combines deep technical expertise in AI systems architecture with the strategic vision to shape how our organization scales AI capabilities across all business domains.

Responsibilities

  • Platform Architecture & Design
  • Design and build a foundational AI platform that enables secure, scalable, and compliant generative AI across the enterprise
  • Architect multi-LLM gateway capabilities to support diverse model providers, allowing teams to leverage best-of-breed models for different use cases
  • Develop multi-LLM gateway: unified interface for accessing multiple LLM providers with load balancing, fallback handling, and cost optimization
  • Build RAG (Retrieval-Augmented Generation) retrieval services: enterprise search, semantic indexing, and document retrieval at scale
  • Create model registry and governance: centralized catalog of models, versions, fine-tuning metadata, performance metrics, and compliance tracking
  • Design prompt library and version control: organizational repository for prompts with testing, evaluation, and A/B testing capabilities
  • Implement Model Context Protocol (MCP) gateway: enable secure integration between AI applications and external tools, APIs, and data sources
  • Build FinOps infrastructure: cost tracking, optimization, and allocation across models, usage patterns, and business units
  • Design orchestration framework for complex, multi-step AI workflows across applications

Requirements

  • 3+ years of hands-on experience with generative AI, LLMs, RAG systems, or AI infrastructure-either in production systems or applied research
  • Deep expertise in one or more: Python, Go, Rust, or Java
  • Strong understanding of LLM architectures, prompting strategies, fine-tuning, and RAG design patterns
  • Demonstrated experience with: model serving (vLLM, Ollama, TensorFlow Serving), vector databases, and embedding models
  • Proficiency in cloud platforms (AWS, GCP, Azure) and containerization/orchestration (Docker, Kubernetes)
  • Demonstrated expertise in security: architecture, secure coding practices, authentication/authorization, encryption, and threat modeling
  • Experience with compliance frameworks and security certifications: SOC 2, ISO 27001, GDPR, or similar
  • Track record of leading technical initiatives from architecture through production deployment
  • ability to explain complex technical and security concepts to executives and cross-functional teams

Nice to have

  • Experience in financial services, private equity, or alternative assets technology environments
  • Familiarity with LangChain, LlamaIndex, or similar AI orchestration frameworks
  • Experience with MLOps tools and practices: model versioning, feature stores, experiment tracking
  • Reporting Relationships
  • $300,000 - $350,000
  • 401(k) program with company match
  • There is no set deadline to apply for this job opportunity.

Skills

  • Knowledge of eval frameworks, retrieval evaluation, or AI model benchmarking
  • Experience with data governance platforms or metadata management systems
  • Contributions to open-source AI/ML projects or publications in the AI/ML space
  • enable secure integration between AI applications and external tools, APIs, and data sources
  • Enable reliable, scalable execution of chained AI operations with state management and error recovery
  • Integrate with broader data ecosystem for workflow triggers and data pipelines
  • Enable secure, governed access to enterprise data and RAG and model training
  • Build metadata and lineage tracking for AI-consumed data
  • Establish disaster recovery and high-availability patterns
  • Work closely with Data Products team to align platform capabilities with data governance and analytics infrastructure
  • Build internal developer experience and platform adoption
  • role-based access control (RBAC), attribute-based access control (ABAC), and service-to-service authentication

Compensation

  • The anticipated base salary range for this position is listed below.
  • Total compensation may also include a discretionary performance-based bonus.
  • $300,000 - $350,000

Benefits

  • Note, the range takes into account a broad spectrum of qualifications, including, but not limited to, years of relevant work experience, education, and other relevant qualifications specific to the role.
  • The firm also offers robust Benefits offerings.

Visa & Work Authorization

  • Ares offers a number of additional benefits including access to a world-class medical advisory team, a mental health app that includes coaching, therapy and psychiatry, a mindfulness and wellbeing app, financial wellness benefit that includ
Apply directly at Ares Management →Create a free account for alerts like thisView Ares Management immigration profile

This listing is sourced directly from Ares Management's careers page and normalized into a canonical job model.