AI Safety Checklist

Ensure your AI solutions are safe and reliable with our comprehensive checklist.

Anticipate AI-Related Errors

Evaluate AI Failure Impact

Design Mitigation Prompts

Interface & Usability

Test in Simulation

Monitor & Improve

Racial & Ethnic Equity

Language & Cultural Equity

Ability & Gender Equity

APP Medical Students

Residents

Fellows

References

IDTitleSourceDescription
1What’s the Worst That Could Happen? A Guide to AI RisksImmuta BlogOutlines various failure modes and risk factors in AI systems.
2Errors + Graceful FailureGoogle PAIR GuidebookDiscusses design strategies for managing AI errors and user mental models.
3Understanding and Avoiding AI Failures: A Practical GuidearXiv PaperFramework for understanding AI failures and mitigation methods.
4Analyzing AI Application Threat ModelsNCC Group BlogAnalysis of threat models critical for mapping user–AI interaction risks.
5Top Risks of Generative AI SystemsGoogle SAIFOverview of key risks, failure modes, and mitigation strategies for generative AI.
6Big Data and Machine Learning in Health CareBMJ ArticleHighlights how AI/ML are revolutionizing clinical decision-making.
7Artificial Intelligence in Healthcare: Opportunities, Challenges...AHRQ ReportFoundational insights into AI for healthcare quality and safety.
8The Role of Artificial Intelligence in Graduate Medical EducationAAMC ReportDiscusses AI in residency training, addressing safety and bias.
9Enhancing Patient Safety in the Era of Artificial IntelligenceJoint Commission PerspectiveEmphasizes patient safety standards for AI integration in clinical care.
10Competency-Based Medical Education in the Age of Artificial IntelligenceACGME GuidelinesOutlines integrating AI competencies into fellowship training.
11Leveraging Artificial Intelligence to Enhance Patient Safety...Stanford MedStar Safety CenterAdvanced strategies for using AI to improve patient safety.