Turnitin AI writing detection
Turnitin is a AI writing detection tool that has been accused of being highly inaccurate and easily tricked to avoid detection, according to research studies and a media investigation.
Accuracy
An April 2023 Washington Post investigation found that Turnitin's AI writing detection tool is inaccurate over half the time, despite the company claim that its system is 98 percent confident of its assessments. The Post tested the system on five high school students, and discovered that it wrongly assessed most of a range of human-written, AI-generated, and mixed-source essays, even if it was good at identifying AI-generated text when the whole input had been created by ChatGPT.
A July 2023 study by a group of researchers led by Debora Weber-Wulff, professor of media and computing at the University of Applied Sciences, HTW Berlin, assessed 14 detection tools, including Turnitin, to identify words generated by ChatGPT. The researchers found that the tools were unable to detect text that had been slightly rearranged by humans and altered using paraphrasing 42% of the time. Weber-Wulff said the tools 'don't work' and 'don't do what they say they do.'
Transparency
It is unclear how Turnitin verifies the accuracy of its software or how it predicts text generated by different language models. Educators are unable to opt-out of using the software.
The company points out that the results of its tool should not be used to accuse students of cheating.
Operator: Turnitin
Developer: Turnitin
Country: USA
Sector: Professional/business services
Purpose: Detect AI writing
Technology: NLP/text analysis; Neural network; Deep learning; Machine learning
Issue: Accuracy/reliability
Transparency: Governance; Black box; Marketing
System
Turnitin (2023). AI writing detection update from Turnitin's Chief Product Officer
Turnitin (2023). Understanding false positives within Turnitin’s AI writing detection capabilities
Turnitin (2023). The launch of Turnitin’s AI writing detector and the road ahead
Research, advocacy
Weber Wulff D., et al (2023). Testing of Detection Tools for AI-Generated Text
News, commentary, analysis
https://futurism.com/software-schools-detect-cheating-flagging-real-essays-ai-generated
https://www.washingtonpost.com/technology/2023/04/01/chatgpt-cheating-detection-turnitin/
https://www.ft.com/content/d872d65d-dfd0-40b3-8db9-a17fea20c60c
https://www.theregister.com/2023/04/05/turntin_plagiarism_ai/
https://www.technologyreview.com/2023/07/07/1075982/ai-text-detection-tools-are-really-easy-to-fool/
Page info
Type: System
Published: April 2023
Last updated: July 2023