Cowap, Alan (2025) How Emotions Can Help Detect Synthetic Text. PhD thesis, Dublin City University.
Abstract
Question: Can you tell whether any of this thesis was written by AI? Recent developments in generative AI have shone a spotlight on high performance synthetic text generation technologies. The wide availability and ease of use of such models highlights the urgent need to provide equally powerful technologies capable of identifying synthetic text. With this in mind, we draw inspiration from psychological studies which suggest that people can be driven by emotion and encode emotion in the text they compose. We hypothesise that pretrained language models (PLMs) have an affective deficit because they lack such an emotional driver when generating text and consequently may generate synthetic text which has affective incoherence i.e. lacking the kind of emotional coherence present in human-authored text. We subsequently develop an emo- tionally aware detector by fine-tuning a PLM on emotion. Experiment results indicate that our emotionally-aware detector achieves improvements across a range of synthetic text generators, various sized models, datasets, and domains. We compare our emotionally-aware synthetic text detector to ChatGPT in the task of identification of its own output and show substantial gains, reinforcing the potential of emotion as a signal to identify synthetic text. These findings support the hypothesis that PLMs may have an affective deficit. Next, we investigate the hypothesis that synthetic text may be affectively incoherent. We create a novel flexible evaluation framework and use it to select an emotion classifier to generate an affective profile for 10k human and synthetic news arti- cles. Our analysis of the human and synthetic affective profiles show that they are similar, but synthetic text is more affectively incoherent and less affectively coherent, than human text. Answer: AI wrote none of this thesis, but how do you know for certain? This lack of certainty motivates the task of synthetic text detection.
Metadata
| Item Type: | Thesis (PhD) |
|---|---|
| Date of Award: | 14 April 2025 |
| Refereed: | No |
| Supervisor(s): | Foster, Jennifer and Graham, Yvette |
| Subjects: | Computer Science > Artificial intelligence Computer Science > Computational linguistics Computer Science > Machine learning |
| DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing DCU Faculties and Schools Research Institutes and Centres Research Institutes and Centres > ADAPT |
| Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 License. View License |
| Funders: | Science Foundation Ireland |
| ID Code: | 30935 |
| Deposited On: | 21 Nov 2025 11:55 by Jennifer Foster . Last Modified 21 Nov 2025 11:55 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0 3MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record