Afficiency

Afficiency

Generative AI Engineer

New York, NY, United States

Sponsorship not specifiedDetected 9 days ago
PythonFastAPIFlaskElasticsearchSnowflakeDatabricksAWSGCPAzureDockerKubernetesTerraformMachine LearningData EngineeringData ScienceLLMsRAGLLMOpsResearch

About the role

  • The company is experiencing rapid growth and is well-funded.
  • We need individuals who bring passion, curiosity, and a desire for excellence.
  • All your information will be kept confidential according to EEO guidelines.

Responsibilities

  • Deliver GenAI solutions end-to-end
  • Own technical design and implementation of GenAI applications from discovery through production handoff.
  • Build APIs/services that integrate with enterprise systems and analytics platforms.
  • Implement enterprise-grade RAG
  • Design ingestion pipelines for internal content (PDFs, policies, research, dashboards, ticketing, wikis).
  • Implement permission-aware retrieval aligned to entitlements and data access policies.
  • Create golden datasets, regression tests, and automated evaluation harnesses.
  • Instrument observability (latency, cost, token usage, error rates) and implement safe rollout patterns.
  • Implement caching, rate limiting, fallbacks, and incident-ready operational practices.
  • Partner across teams to land solutions

Requirements

  • Proven ability to work effectively as an IC consultant:

Nice to have

  • Fine-tuning experience (SFT, LoRA/QLoRA) and familiarity with preference optimization concepts (DPO/RLHF)
  • LLMOps tooling: MLflow/W&B, OpenTelemetry, prompt registries, evaluation frameworks
  • Cloud + platform: AWS/Azure/GCP, Docker/Kubernetes, Terraform
  • LLM frameworks: LangChain, LlamaIndex, Semantic Kernel (optional)
  • Observability: logging/tracing/metrics, dashboards, alerting
  • 3+ years in software engineering, data engineering, ML engineering, or applied AI, including recent GenAI delivery in production.
  • grounding/citations and hallucination mitigation patterns
  • Strong Python and backend engineering skills (FastAPI/Flask), plus strong SQL.

Skills

  • MLflow/W&B, OpenTelemetry, prompt registries, evaluation frameworks
  • AWS/Azure/GCP, Docker/Kubernetes, Terraform
  • Tools & Technologies
  • LangChain, LlamaIndex, Semantic Kernel (optional)

Benefits

  • Competitive salary with equity options
  • Robust health, dental, and vision benefits for employee and dependents
  • Generous PTO policy
  • Define metrics for retrieval quality and answer grounding (faithfulness, citation accuracy, coverage).
  • Afficiency is a rapidly growing Insurtech startup whose mission is to provide life insurance to everyone on the platforms they already trust.
  • Located in NYC, we design life insurance products that can be purchased entirely digitally and can be easily embedded into distribution platforms or with agents who sell insurance.
  • We are looking for new team members to join us on our journey to shake up the life insurance industry.

Equal opportunity

  • Equal Opportunity Employer.
Apply directly at Afficiency →Create a free account for alerts like thisView Afficiency immigration profile

This listing is sourced directly from Afficiency's careers page and normalized into a canonical job model.