People gave the highest ratings to stories generated by AI that they were told had been written by a human, and were unable to tell the difference between human- and AI-created stories, according to new research published by Cambridge University Press.
The study, led by researchers at Villanova University, USA, and published in Judgement and Decision Making , adds to the growing body of evidence that many people’s ability to spot AI-generated content is limited.
For the study, adult participants aged 18-81 were tested to see whether they could tell the difference between human-written and AI-generated short stories, how they rated the quality and appeal of each, and whether they could spot AI-generated content.
The researchers used three fictional short stories written by human authors published in a reputable literary journal or short story collection, alongside three corresponding short stories generated by ChatGPT 1 .
In the first experiment, 1,682 participants were asked to read a story and were either correctly or incorrectly told that it was written by a human or AI. They then rated the story’s quality and how engaging they found it 2 .
In the second and third experiments, participants (424 and 481 respectively) received one human-written and one AI-generated story, but were not told the origin of the stories. After reading them, they were asked to identify the author of each story.
Participants were also asked to rate their experience with using AI platforms like Chat GPT, and their experience with fictional literature.
The results showed that:
Dr Deena Weisberg, senior author of the study from the Department of Psychological & Brain Sciences at Villanova University, said: “In our study, participants gave the highest ratings to stories that they had been told were written by humans but which were actually written by AI.
“I’d argue that this reveals a bias towards narratives written by real people. We assume creative writing requires uniquely human qualities, such as emotional understanding and lived experience, which leads people to underestimate AI's capabilities. I’d say that public assumptions about AI's capabilities are increasingly out of date.”
The researchers also found that participants who said they had greater AI literacy were better able to identify AI-written text, but participants who said they had greater expertise in literature were not.
In the second experiment, the findings showed that each one-point increase in participants’ self-reported AI expertise score was associated with a 14% increase in the odds of correctly guessing the story's author.
In the third experiment, which used a previously validated measure called the Artificial Intelligence Literacy Scale (AILS), a one-point increase in participants’ scores was associated with a 33% increase in the odds of correctly guessing the story's author.
Dr Weisberg said: “One thing to note was that familiarity with AI systems appeared to help people recognise the patterns typical of AI-generated writing, such as em dashes and sentence structures such as ‘it’s not just X, it’s Y’. That suggests that improving AI literacy would be one way to help people to navigate the new AI-enabled world that we’re living in.”
The study validates previous research that has shown that people often prefer AI-generated writing in various formats, including short stories, poetry and essays.
Speculating on why this might be, Dr Weisberg added: “AI writing tends to be clearer, more direct and easier to process. By contrast, human-written stories, are often more subtle and complex. For example, the AI versions of our stories usually stated their themes explicitly, rather than allowing readers to infer meaning from the characters’ words and actions.
“We hear a lot about the crisis in literacy, shrinking attention spans and the influence of platforms such as TikTok. But I don’t think we can say that our findings in this study can be entirely explained by contemporary media consumption. It’s more that these technologies amplify existing tendencies, rather than creating them.
“Perhaps people generally prefer predictability, because difficult or subtle material requires more brain power.”
Notes to Editors:
For more information, please contact:
Dr Matt Midgley
+44 (0)1223 342979
1 The stories used in the study are available to read here .
2 To determine how absorbed and engaged participants were, the researchers used an edited version of the Story World Absorption Scale that covers different aspects of story absorption, including attention, transportation, emotional engagement, and mental imagery.
Publication:
Sydney Sears and Deena Skolnick Weisberg. ‘Bot or not: Can people tell the difference between stories written by a human or by an AI system?’ is published in Judgement and Decision Making and is strictly embargoed until 5 August at 00:01 BST / 4 August at 19:01 ET.
DOI: https://doi.org/10.1017/jdm.2026.10042
Judgement and Decision Making is published by Cambridge University Press on behalf of the Society for Judgment and Decision Making (SJDM) and the European Association for Decision Making (EADM).
About Cambridge University Press
Cambridge University Press is the academic and Bibles publisher of Cambridge University Press & Assessment. It publishes books and journals, serving customers in higher education through research, education products and services. It is part of the University of Cambridge, delivering trusted research and learning materials that spread knowledge, spark curiosity and aid understanding of the world we live in.
cambridge.org/universitypress
Judgment and Decision Making
Experimental study
Not applicable
Bot or not: Can people tell the difference between stories written by a human or by an AI system?
4-Aug-2026