Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

How Emotions Can Help Detect Synthetic Text

Cowap, Alan (2025) How Emotions Can Help Detect Synthetic Text. PhD thesis, Dublin City University.

Abstract
Question: Can you tell whether any of this thesis was written by AI? Recent developments in generative AI have shone a spotlight on high performance synthetic text generation technologies. The wide availability and ease of use of such models highlights the urgent need to provide equally powerful technologies capable of identifying synthetic text. With this in mind, we draw inspiration from psychological studies which suggest that people can be driven by emotion and encode emotion in the text they compose. We hypothesise that pretrained language models (PLMs) have an affective deficit because they lack such an emotional driver when generating text and consequently may generate synthetic text which has affective incoherence i.e. lacking the kind of emotional coherence present in human-authored text. We subsequently develop an emo- tionally aware detector by fine-tuning a PLM on emotion. Experiment results indicate that our emotionally-aware detector achieves improvements across a range of synthetic text generators, various sized models, datasets, and domains. We compare our emotionally-aware synthetic text detector to ChatGPT in the task of identification of its own output and show substantial gains, reinforcing the potential of emotion as a signal to identify synthetic text. These findings support the hypothesis that PLMs may have an affective deficit. Next, we investigate the hypothesis that synthetic text may be affectively incoherent. We create a novel flexible evaluation framework and use it to select an emotion classifier to generate an affective profile for 10k human and synthetic news arti- cles. Our analysis of the human and synthetic affective profiles show that they are similar, but synthetic text is more affectively incoherent and less affectively coherent, than human text. Answer: AI wrote none of this thesis, but how do you know for certain? This lack of certainty motivates the task of synthetic text detection.
Metadata
Item Type:Thesis (PhD)
Date of Award:14 April 2025
Refereed:No
Supervisor(s):Foster, Jennifer and Graham, Yvette
Subjects:Computer Science > Artificial intelligence
Computer Science > Computational linguistics
Computer Science > Machine learning
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
DCU Faculties and Schools
Research Institutes and Centres
Research Institutes and Centres > ADAPT
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 License. View License
Funders:Science Foundation Ireland
ID Code:30935
Deposited On:21 Nov 2025 11:55 by Jennifer Foster . Last Modified 21 Nov 2025 11:55
Documents

Full text available as:

[thumbnail of 20250412_Thesis.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0
3MB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record