Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

ChatGPT vs. DeepL vs. Google Translate: a human evaluation of multiword expressions’ machine translation quality

Hidalgo-Ternero, Carlos Manuel and Briva-Iglesias, Vicent orcid logoORCID: 0000-0001-8525-2677 (2026) ChatGPT vs. DeepL vs. Google Translate: a human evaluation of multiword expressions’ machine translation quality. Monografías De Traducción E Interpretación, 18 . ISSN 1889-4178

Abstract
Multiword expressions (MWEs) remain a persistent challenge in neural machine translation (NMT), particularly when they appear in discontinuous forms. In this context, the present study evaluates the ability of general-purpose large language models (LLMs) to address these limitations by systematically comparing the performance of Google Translate, DeepL, and GPT-4o in translating Spanish-to-English MWEs. A dataset of 600 examples—balanced between continuous and discontinuous MWEs—was machine translated and manually evaluated by two expert linguists. The results indicate that GPT-4o statistically significantly outperforms NMT systems in both forms of the MWEs, while DeepL and Google Translate exhibit substantial declines in performance for discontinuous MWEs. The results from this study show that general-purpose LLMs handle syntactic flexibility and idiomaticity more effectively than traditional NMT approaches. The study also contributes an open-source dataset and invites further research on LLM applications in MT.
Metadata
Item Type:Article (Published)
Refereed:Yes
Subjects:Computer Science > Artificial intelligence
Computer Science > Computational linguistics
Computer Science > Information retrieval
Computer Science > Information technology
Humanities > Linguistics
Humanities > Translating and interpreting
DCU Faculties and Centres:UNSPECIFIED
Publisher:Universidad de Alicante
Official URL:https://www.e-revistes.uji.es/index.php/monti/arti...
Copyright Information:Authors
ID Code:32838
Deposited On:01 Jul 2026 12:24 by Vicent Briva Iglesias . Last Modified 01 Jul 2026 12:24
Documents

Full text available as:

[thumbnail of 3+Hidalgo-Ternero_Briva-Iglesias.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial 4.0
408kB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record