City of New York

City of New York

AI Project Lead

New York City, NY, United States · Full-time

Sponsorship not specifiedDetected 14 hours ago
PythonVector DatabasesAWSGCPAzureMachine LearningNLPLLMsRAGProject Management

> stay_score

odds of building a lasting career here

16Unrated
Cap-exempt (no lottery)0
Sponsors this role0
Entry-level history0
PERM / green-card track0
Lottery odds40
Fits your clock70

No strong sponsorship signal in the public record yet. In the full product we resolve the exact legal entity and show its filing history with a confidence score — treat as unverified until then.

Lottery odds assume a STEM candidate.

Personalize to your clock →

> community_outcomes

No reports yet — be the first to help the next applicant.

About the role

  • IT AUTOMATION AND MONITORING E - 95712 1.
  • Eight years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure; 3.

Responsibilities

  • Analyze, design, implement, maintain, and support AI applications and monitoring solutions for enterprise infrastructure systems and platforms.
  • Account for and mitigate risks during design and implementation regarding data security, data integrity, and AI veracity; implement AI audit logging, explainability mechanisms, and human-in-the-loop workflows.
  • Test local solutions; manage on-premises GPU infrastructure for AI inference and training.
  • Ability to train, upskill, and lead a team of developers.

Requirements

  • A successful candidate must have technical skills required for AI application development, project management experience, and a demonstrated ability for strategic planning.
  • Knowledge of infrastructure for AI/ML related tasks (Cloud and on-prem) is required.
  • Technical competency in Python is required.
  • A successful candidate must be proficient with AI application architecture scoping and design, and proficiency with LLM fine tuning using frameworks such as HuggingFace, LoRA, or PEFT.
  • A successful candidate will have proficiency with implementing LLM guardrails including hallucination mitigation, PII detection and output validation.
  • Experience with Azure, AWS, and/or GCP is required.
  • Experience with implementing confidentiality, data security and data integrity protocols
  • familiarity with government or legal sector data governance requirements including data residency and PII handling.
  • Experience with automated document processing or de-identification pipelines for sensitive information.
  • Experience with prompt engineering, retrieval-augmented generation, agent/tool-use frameworks, containerization and orchestration of AI workloads.

Nice to have

  • Preferred Skills:

Skills

  • Experience managing on-premises GPU infrastructure for AI inference and training workloads.
  • User training experience.
  • Proficiency with the implementation, deployment, and integration of AI applications.
  • Experience with speech-to-text pipelines and multilingual NLP or translation workflows.
  • Ability to effectively communicate AI planning with executive stakeholders.
  • Ability to provide technical guidance on internal AI policy.
  • Ability to assess and evaluate vendor-provided solutions.
  • IT AUTOMATION AND MONITORING E - 95712
  • Eight years of satisfactory full-time experience related to IT automation engineering, monitoring engineering, management of infrastructure;
  • Education and/or experience which is equivalent to "1" or "2" above.

This listing is sourced directly from City of New York's careers page and normalized into a canonical job model.