VP-Senior Analyst (Artificial Intelligence Model Risk and Evaluation)

At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are—with the freedom to exchange ideas, think innovatively, and listen to each other and customers in meaningful ways. Moody’s is transforming how the world sees risk. As a global leader in ratings and integrated risk assessment, we’re advancing AI to move from insight to action—enabling intelligence that not only understands complexity but responds to it. We decode risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence.

If you are excited about this opportunity but do not meet every single requirement, please apply! You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship, lead with curiosity, champion diverse perspectives, turn inputs into actions, and uphold trust through integrity. 

Skills & Competencies

• Overall 12+ years of experience with 7+ years’ experience in machine learning with strong expertise in GenAI, agentic AI, and associated risk and evaluation frameworks
• Skilled in NLP, prompt engineering, RAG, cloud deployment, and programming (Python, SQL, .NET)
• Strong analytical and problem‑solving abilities with experience reviewing complex processes
• Excellent communication skills, able to engage technical and non-technical stakeholders across global, cross‑functional teams
• Experience leading large-scale projects; able to work independently, prioritize, multitask, and adapt quickly
• Knowledge of cloud services (AWS/Azure) and prior experience in corporate finance or debt markets preferred

Education

• Master’s or Bachelor’s degree in data science, computer science, statistics, mathematics, or similar quantitative disciplines

Responsibilities
The VP-Senior Analyst leads independent validation, evaluation, and governance of advanced AI systems, including Machine Learning, Generative AI (GenAI), and Agentic AI models. This role is central to ensure use of AI in Moody’s Ratings is robust, reliable, and compliant with governance and regulatory standards

• Lead and mentor a small team responsible for evaluating and validating AI and machine learning models
• Design and execute robust evaluation frameworks for GenAI, Agentic AI, and traditional ML models, including prompt engineering and model benchmarking
• Develop and run systematic model evaluations to benchmark performance and safety, leveraging industry leaderboards, subject matter expert (SME) reviews, and LLM as a judge methodologies
• Independently test and validate ML models in line with best practices, including conceptual soundness, implementation integrity, and performance assessment
• Assess and manage AI system risks, with a focus on accuracy, bias, explainability, robustness, and operational integrity
• Collaborate cross functionally with technology, risk, compliance, and business stakeholders to ensure alignment with governance frameworks and regulatory standards
• Communicate complex validation findings and recommendations clearly to both technical and non technical audiences
• Maintain high standards of documentation and reporting, supporting transparency, auditability, and continuous improvement in model risk management processes
• Apply advanced quantitative and analytical skills, with experience in financial, credit, or equity analysis
• Leverage statistical techniques and software tools to analyze model outputs and evaluate performance distributions
• Demonstrate strong communication and documentation capabilities, including drafting requirements, technical documentation, and user guides
• Exhibit deep proficiency in AI and LLM technologies, with hands on experience evaluating LLM applications, strong awareness of AI risk management, and a commitment to responsible AI use

About the team

Digital Economy team at Moody’s Ratings focuses on assessing and managing risks emerging from digital finance, artificial intelligence, and cyber threats, which are reshaping global financial systems and credit markets. The team provides thought leadership and analytical insights into how technologies like blockchain, AI, and digital assets impact operational resilience.

Moody’s is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender expression, gender identity or any other characteristic protected by law.

Candidates for Moody's Corporation may be asked to disclose securities holdings pursuant to Moody’s Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy, including remediation of positions in those holdings as necessary.