Back to search

West Virginia University

Comparative Analysis of Safety, Accuracy, Comprehensiveness, and Organization in Endodontic Patient Education Material: American Association of Endodontics (AAE) vs. AI-Generated Content.

Abstract

dc:description.abstract

Comparative Analysis of Safety, Accuracy, Comprehensiveness, and Organization in Endodontic Patient Education Material: American Association of Endodontics (AAE) vs. AI-Generated Content. Fabiola Salgado Reyes, DMD Introduction: With patients increasingly using AI chatbots like ChatGPT4o and Copilot, it is essential to assess whether these tools can effectively support patient understanding of complex endodontic procedures. AI-generated responses may occasionally provide inaccurate, unsafe, disorganized, or content that is not comprehended. The purpose of this study is to examine if dental experts and patients can determine if patient education materials (PEMS) were 1) generated by AI; 2) medically safe; 3) accurate; 4) can be comprehended; and 5) organized. Secondarily, the PEMS were evaluated for their readability. Methods: AAE PEMs were compared to two AI-generated PEMs (ChatGPT4o and Copilot Premium accessed via subscription from Nov 13–Dec 14, 2024) by dental experts and patients. Content included information on diagnosis, symptoms, risk factors, treatment, and prognosis. Each dental expert evaluated all three PEM. Each patient receiving endodontic therapy at West Virginia School of Dentistry who agreed to participate evaluated one randomized PEM. Both groups evaluated the PEMs for safety, accuracy, comprehensibility, and organization (0–4 scale). They also determined if each PEM was AI generated or human generated. PEMs were also evaluated for readability. Results: Dental experts did not distinguish a quality difference in safety, accuracy, organization, or comprehensibility among the 3 PEM (p>0.05). Patients could not distinguish between AI and human generated PEM (p=0.666). However, Copilot PEM consistently was scored higher by patients in safety, accuracy, and comprehension (p < 0.05). Conclusion: AI-generated PEMs, especially from Copilot, demonstrate strong potential as accurate, readable, and well-received alternatives to traditional materials, supporting their integration into clinical patient education.

Degree

thesis:*
Name thesis:degree_name
MS
Level thesis:degree_level
Thesis

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Salgado Reyes, Fabiola M
Contributors dc:contributor
  • Samuel Dorn
  • R. Constance Wiener, D.M.D, PhD, MA
  • Steven B. Whitaker

Subjects

dc:subject × 8

Identifiers

dc:identifier.*
Identifier
<p><a href="https://orcid.org/0009-0000-9638-929X">https://orcid.org/0009-0000-9638-929X</a></p>
https://researchrepository.wvu.edu/etd/12933

Chain of custody

source
Harvested from
West Virginia University
Base URL
researchrepository.wvu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Salgado Reyes, Fabiola M. Comparative Analysis of Safety, Accuracy, Comprehensiveness, and Organization in Endodontic Patient Education Material: American Association of Endodontics (AAE) vs. AI-Generated Content.. Thesis thesis, https://doi.org/10.33915/etd.12933