Agencywithin

Agencywithin

AI Engineer

Long Island City, New York

Sponsorship not specified$200k-$500kDetected 50 days ago
TypeScriptPythonFull-Stack DevelopmentGitSQLBigQuerySnowflakeRedshiftAWSGCPAzureCloud PlatformsMachine LearningdbtData VisualizationLLMsRAGSEOGoogle AdsBrand StrategyExcelManual TestingCommunicationCollaboration

About the role

  • Improve retry logic, structured validation, and hallucination mitigation strategies.
  • Collaboration Work closely with Machine Learning Engineers, Product Managers, and Full-Stack Engineers to ensure AI systems are robust, maintainable, and aligned with business goals.

Responsibilities

  • LLM Application Development Design, build, and maintain AI-powered applications leveraging LLM APIs, tool calling, and structured outputs.
  • Agent & Tool Orchestration Develop and improve agent architectures that integrate tools such as SQL execution, Python code execution, and marketing platform APIs through MCP-style integrations.
  • Context & Memory Management Design and refine multi-turn context handling, session memory strategies, and prompt structures to improve response reliability and reduce hallucinations.
  • Reliability & Guardrails Implement safeguards for tool execution, SQL queries, and code execution. Improve retry logic, structured validation, and hallucination mitigation strategies.
  • Evaluation & Quality Assurance Contribute to building structured evaluation frameworks for LLM-powered systems, including multi-turn testing, regression testing, and task-based success metrics.
  • Product Expansion Support expansion of Rai into document generation, tables, slide decks, and potential Google Workspace integrations.

Requirements

  • Experience integrating external APIs into production systems.
  • Proficiency in SQL.
  • Experience working with cloud platforms (GCP, AWS, or Azure).
  • Strong problem-solving skills and ability to debug complex system behavior.
  • Experience designing evaluation frameworks for LLM-powered systems.
  • Experience with stateful execution environments or sandboxed code execution.
  • Experience with document automation (Google Docs, Slides, PDFs).
  • Required knowledge of:

Nice to have

  • Data Warehouses (BigQuery, Snowflake, Redshift)
  • Data Transformation (dbt)
  • Semantic Layers (Cube, Looker, dbt Metrics)
  • Excel and Typing Test
  • 401(K) plan with matching
  • Dog friendly office
  • Professional Development Program
  • Seamless allowance

Skills

  • Your work will directly impact 200-500 employees and potentially clients, making AI a core productivity multiplier across the organization.
  • Insurgentes Sur 1082, Piso (Floor) 2, Oficina 2008, Ciudad de México, CDMX 03100, México
  • AI-Assisted Screening Notice
  • It is not used to make hiring decisions.

Compensation

  • We offer a competitive salary and benefits based on ability level, including:

Company info

  • We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal AI-powered agent platform used across the organization.
Apply directly at Agencywithin →Create a free account for alerts like thisView Agencywithin immigration profile

This listing is sourced directly from Agencywithin's careers page and normalized into a canonical job model.