Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text
Article Status
Published
Authors/contributors
- Elkhatat, Ahmed M. (Author)
- Elsaid, Khaled (Author)
- Almeer, Saeed (Author)
Title
Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text
Abstract
The proliferation of artificial intelligence (AI)-generated content, particularly from models like ChatGPT, presents potential challenges to academic integrity and raises concerns about plagiarism. This study investigates the capabilities of various AI content detection tools in discerning human and AI-authored content. Fifteen paragraphs each from ChatGPT Models 3.5 and 4 on the topic of cooling towers in the engineering process and five human-witten control responses were generated for evaluation. AI content detection tools developed by OpenAI, Writer, Copyleaks, GPTZero, and CrossPlag were used to evaluate these paragraphs. Findings reveal that the AI detection tools were more accurate in identifying content generated by GPT 3.5 than GPT 4. However, when applied to human-written control responses, the tools exhibited inconsistencies, producing false positives and uncertain classifications. This study underscores the need for further development and refinement of AI content detection tools as AI-generated content becomes more sophisticated and harder to distinguish from human-written text.
Publication
International Journal for Educational Integrity
Volume
19
Issue
1
Pages
17
Date
2023-9-1
Journal Abbr
Int J Educ Integr
Language
en
ISSN
1833-2595
Accessed
10/06/2024, 16:32
Library Catalogue
DOI.org (Crossref)
Extra
Citation Key: elkhatat2023
<标题>: 评估人工智能内容检测工具在区分人类与人工智能生成文本中的有效性
<AI Smry>: Investigation of the capabilities of various AI content detection tools in discerning human and AI-authored content reveals that the AI detection tools were more accurate in identifying content generated by GPT 3.5 than GPT 4.5.
Citation
Elkhatat, A. M., Elsaid, K., & Almeer, S. (2023). Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text. International Journal for Educational Integrity, 19(1), 17. https://doi.org/10.1007/s40979-023-00140-5
Link to this record