Artificial Analysis, Inc.

Artificial Analysis, Inc.

Solutions Engineer — Media Generation

San Francisco (On-site)

Sponsorship not specifiedDetected 41 days ago
PythonGitData AnalysisResearchExperimental DesignCommunication

About the role

  • Artificial Analysis benchmarks leading image and video generation models, providing the AI industry with independent quality and performance comparisons.
  • Our media generation benchmarks rely on structured human preference evaluations to assess output quality across models.

Responsibilities

  • Set up and manage human preference evaluation studies, including study design, participant management, and quality control
  • Manage the end-to-end pipeline: from prompt execution through to published results
  • Maintain documentation of processes and configurations

Requirements

  • 3+ years of experience in a technical operations, data operations, or solutions engineering role
  • Detail-oriented with strong process management skills - you can run recurring workflows reliably without oversight

Nice to have

  • Experience with image or video generation models (Midjourney, DALL-E, Stable Diffusion, Runway, Sora, etc.)
  • Background in data analysis or research operations
  • Familiarity with human evaluation methodologies or preference-based ranking systems
  • Experience in B2B SaaS or developer tools
  • WHY ARTIFICIAL ANALYSIS?
  • Shape how AI gets built: The leading AI labs track our benchmarks and use them to guide their development priorities.
  • Your work will directly influence the direction of AI.
  • Become a world expert in AI: You will evaluate every major model, across every major capability, as they are released.

Compensation

  • Competitive compensation including equity

Benefits

  • Competitive compensation including equity

This listing is sourced directly from Artificial Analysis, Inc.'s careers page and normalized into a canonical job model.