Sasamoto, Ryoko ORCID: 0000-0002-1644-6897, Doherty, Stephen ORCID: 0000-0003-0887-1049 and O'Hagan, Minako ORCID: 0000-0003-0870-0725 (2021) The ‘hookability’ of multimodal impact captions A mixed-methods exploratory study. Translation, Cognition & Behavior, 4 (2). pp. 253-280. ISSN 2542-5277
Abstract
The use of captions has grown in recent years in both traditional and new media, particularly in terms of the diversity of style, content, and function. Impact captions have emerged as a popular form of captions for hearing viewers and contain rich multimodal information which is employed to capture viewer attention and enhance engagement, particularly in situations where there is competition for viewer attention. Drawing upon relevance theory, we argue how impact captions could effectively attract and hold visual attention owing to their balance between processing effort and contextual effects. This exploratory study employs a dual-task paradigm and uses authentic materials and viewing situations to further examine the ability of multimodal impact captions to attract and retain overt visual attention amongst a small sample of TV viewers. Our results provide novel insight into the apparent highly individualised efficacy of impact captions, where we identify several variables of interest in participants’ viewing behaviours. We conclude with a discussion of the study’s contributions, limitations, and an outline for future work.
Metadata
Item Type: | Article (Published) |
---|---|
Refereed: | Yes |
Uncontrolled Keywords: | Impact; captions; subtitles; audiovisual translation; relevance theory; multimodal |
Subjects: | Humanities > Linguistics Humanities > Translating and interpreting |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Humanities and Social Science > School of Applied Language and Intercultural Studies Research Institutes and Centres > Centre for Translation and Textual Studies (CTTS) |
Publisher: | John Benjamins Publishing |
Official URL: | https://doi.org/10.1075/tcb.00055.sas |
Copyright Information: | © 2021 John Benjamins Publishing |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
ID Code: | 26630 |
Deposited On: | 21 Jan 2022 16:00 by Ryoko Sasamoto . Last Modified 21 Jan 2022 16:00 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
749kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record