Study finds detectors struggle to accurately identify amount of AI content when papers have been partially human written - Georgia Luckhurst, Times Higher Education

For the study, published in Education and Information Technologies, researcher Lucky E. Atamhenwan fed 81 sample essays into Turnitin. The scripts ranged from those that were 100 per cent LLM-generated – either by ChatGPT, Copilot or Gemini – to those written solely by people. Turnitin did not flag any of the essays that were 100 per cent human written as being generated by AI. And in every instance in which the detector flagged AI-generated words, it was indeed due to the presence of LLM-generated work in those samples. But the software struggled with the scripts that were partially AI-written, consistently failing to identify the correct percentage of LLM-generated work included.

https://www.timeshighereducation.com/news/inconsistent-ai-detection-should-prompt-assessment-rethink