Morgan Stanley
Conversational AI Specialist, Vice President
Purchase, New York, United States of America · Exec
Stay score
odds of building a lasting career here
Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Green-card follow-through: 84%
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- This role will liaise with business teams across the Firm, technology, vendors, and centralized AI teams to accelerate the development and adoption of AI-based solutions.
Responsibilities
- Conversational Experiences: Develop and maintain differentiated conversational experiences for employee and client virtual assistant experiences that allow users to access knowledge, data and workflows.
- Prompt Solutioning: Develop and refine context-aware prompts tailored to different use cases, domains, and user intents with a view of improving the accuracy, relevance and efficiency of AI generated chatbot responses.
- Testing and Evaluation: Develop and maintain data driven methodologies for testing and evaluating Generative AI responses for coherence, bias, factual accuracy and user satisfaction.
- Create and manage human evaluations - manual and automated strategies such as LLM-as-a-judge - to ensure LLM Model outputs meet high standards.
- Risk Management: Identify potential risks and issues that may impact project delivery and develop mitigation strategies to address them proactively.
- Monitor project performance and implement corrective actions as necessary to ensure successful outcomes.
- Stakeholder Management: Establish and maintain effective communication channels with internal stakeholders such as tech partners and business product owners.
- Manage expectations and address any concerns or issues that arise.
- Collaboration: Collaborate with cross-functional teams, including internal stakeholders and vendor partners.
Requirements
- Experience with Conversational AI solutioning / product development / experimentation or Innovation.
- Experience with prompt engineering for using Commercial or Open Source LLMs such as GPT, Claude, Gemini, LLAMA.
- Experience with conversational AI evaluation techniques such as F1, RAGAS, and human feedback analysis.
- Strong understanding of artificial intelligence concepts and technologies.
- We do it in a way that's differentiated - and we've done that for 90 years.
- At Morgan Stanley, you'll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered.
Nice to have
- /Skills Required or Preferred: Experience with Conversational AI solutioning / product development / experimentation or Innovation.
Skills
- As a market leader, the talent and passion of our people is critical to our success.
Company info
- A philosophy that balances personal lifestyles, perspectives and needs is an important part of our culture.
This listing is sourced directly from Morgan Stanley's careers page and normalized into a canonical job model.