Hidalgo-Ternero, Carlos Manuel and Briva-Iglesias, Vicent
ORCID: 0000-0001-8525-2677
(2026)
ChatGPT vs. DeepL vs. Google Translate: a human evaluation of multiword expressions’ machine translation quality.
Monografías De Traducción E Interpretación, 18
.
ISSN 1889-4178
Abstract
Multiword expressions (MWEs) remain a persistent challenge in neural machine translation (NMT), particularly when they appear in discontinuous forms. In this context, the present study evaluates the ability of general-purpose large language models (LLMs) to address these limitations by systematically comparing the performance of Google Translate, DeepL, and GPT-4o in translating Spanish-to-English MWEs. A dataset of 600 examples—balanced between continuous and discontinuous MWEs—was machine translated and manually evaluated by two expert linguists. The results indicate that GPT-4o statistically significantly outperforms NMT systems in both forms of the MWEs, while DeepL and Google Translate exhibit substantial declines in performance for discontinuous MWEs. The results from this study show that general-purpose LLMs handle syntactic flexibility and idiomaticity more effectively than traditional NMT approaches. The study also contributes an open-source dataset and invites further research on LLM applications in MT.
Metadata
| Item Type: | Article (Published) |
|---|---|
| Refereed: | Yes |
| Subjects: | Computer Science > Artificial intelligence Computer Science > Computational linguistics Computer Science > Information retrieval Computer Science > Information technology Humanities > Linguistics Humanities > Translating and interpreting |
| DCU Faculties and Centres: | UNSPECIFIED |
| Publisher: | Universidad de Alicante |
| Official URL: | https://www.e-revistes.uji.es/index.php/monti/arti... |
| Copyright Information: | Authors |
| ID Code: | 32838 |
| Deposited On: | 01 Jul 2026 12:24 by Vicent Briva Iglesias . Last Modified 01 Jul 2026 12:24 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial 4.0 408kB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record