An Evaluation of Current Trends in AI-Generated Text in Otolaryngology Publications.

Details

• Alternative Title:
  The Laryngoscope, 2025, v. 135, no. 10: An Evaluation of Current Trends in AI-Generated Text in Otolaryngology Publications.
• Journal Article:
  The Laryngoscope
• Personal Author:
  Kutler, Rachel B. ; Setzen, Sean A. ; Tsai, Samantha ; Rameau, Anaïs
• Description:
  Since the release of ChatGPT-4 in March 2023, large language models (LLMs) application in biomedical manuscript production has been widespread. GPT-modified text detectors, such as GPTzero, lack sensitivity and reliability and do not quantify the amount of AI-generated text. However, recent work has identified certain adjectives more frequently used by LLMs that can help identify and quantify LLM-modified text. The aim of this study is to utilize these adjectives to identify LLM-generated text in otolaryngology publications.
  
  Meta-research.
  
  Twenty-five otolaryngology journals were studied between November 2022 and July 2024, encompassing 8751 published works. Articles from countries where ChatGPT-4 is not available were removed, yielding 7702 articles for study inclusion. These publications were analyzed using a Python script to determine the frequency of the top 100 adjectives disproportionately generated by ChatGPT-4.
  
  A significant increase in the frequency of adjectives associated with GPT use was observed from November 2023 to July 2024 across all journals (p < 0.001), with a significant difference before and after the release of ChatGPT in March 2023. Journals with higher impact factors had significantly lower usage of GPT-associated adjectives than those with lower impact factors (p < 0.001). There was no significant difference in GPT-associated adjective use by first authors with a doctoral degree versus those without. Publications by authors from English-speaking countries demonstrated a significantly more frequent use of LLM-associated adjectives (p < 0.001).
  
  This study suggests that ChatGPT use in otolaryngology manuscript production has significantly increased since the release of ChatGPT-4. Future research should be aimed at further characterizing the landscape of AI-generated text in otolaryngology and developing tools that encourage authors' transparency regarding the use of LLMs.
  
  NA.
• Content Notes:
  Author manuscript
• Subjects:
  • Otolaryngology
  • Humans
  • Periodicals as Topic
  • Language
  • Natural Language Processing
• Keywords:
  • artificial intelligence
  • large language models
  • otolaryngology
• Source:
  The Laryngoscope, 2025, v. 135, no. 10
• DOI:
  https://doi.org/10.1002/lary.32202
• ISSN:
  0023-852X ; 1531-4995
• Pubmed ID:
  40277459
• Pubmed Central ID:
  PMC12353330
• Document Type:
  Text
• Funding:
  K76 AG079040/AG/NIA NIH HHSUnited States/ ; OT2 OD032720/OD/NIH HHSUnited States/ ; OT2 OD032720/CD/ODCDC CDC HHSUnited States/ ; OT2 OD032720/CD/ODCDC CDC HHSUnited States/ ; K76 AG079040/AG/NIA NIH HHSUnited States/
• Genre:
  Journal Article
• Pages in Document:
  3579-3587 (15 pdf pages)
• Volume:
  135
• Issue:
  10
• Download URL:
  https://stacks.cdc.gov/view/cdc/261456/cdc_261456_DS1.pdf
• File Type:
  [PDF - 549.11 KB]
• Collection(s):
  CDC Public Access
• Main Document Checksum:
  urn:sha-512:6a681e60b2ea1fa0fcb5d7c5c8a51bfc3c0a82dbae802dfcdd346ec51a70abd0b2e590ab49bae10bb8e47367e24384285170e14cb41168ed5aa32d37e0ef880c