Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

“Never The Same”: Systematic Analysis of the Methodological Issues in the Presence Studies That Employ Questionnaires

Kukshinov, Eugene, Tu, Joseph, Szita, Kata orcid logoORCID: 0000-0002-3177-9980, Nathan, Kaushall Sentil and Nacke, Lennart E. (2024) “Never The Same”: Systematic Analysis of the Methodological Issues in the Presence Studies That Employ Questionnaires. In: CHI '24: CHI Conference on Human Factors in Computing Systems, 11-16 May, 2024, Honolulu, USA. ISBN 9798400703317

Abstract
Presence is a psychological state that is usually measured via questionnaires. Many presence researchers assume self-report questionnaires are standardized. However, we do not know how reliable they are. This knowledge gap impacts the accuracy and validity of data collected through these questionnaires. Reliable and accurate data collection is crucial to trust findings in presence research. Inaccurate or unreliable data could lead to incorrect conclusions. This impacts theoretical understanding and practical applications. To address this, we conducted a comprehensive systematic review of 100 empirical quantitative presence studies. Our goal was to uncover the underlying issues with these self-report questionnaires. So, we explored the employment of these questionnaires and analyzed the specific reasons for measuring presence. We show patterns and inconsistencies in the current methodologies, as presence questionnaires are frequently utilized in a non-standardised manner. We will propose well-grounded improvements and constructive approaches based on our findings. These will improve the validity and effectiveness of these questionnaires and lead to more consistent and replicable results in presence research.
Metadata
Item Type:Conference or Workshop Item (Lecture)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Presence, Questionnaires, Methods, Reliability, Systematic Analysis
Subjects:Social Sciences > Communication
Social Sciences > Political science
Social Sciences > Sociology
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Humanities and Social Science
DCU Faculties and Schools > Faculty of Humanities and Social Science > School of Communications
Published in: CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. . Association for Computing Machinery. ISBN 9798400703317
Publisher:Association for Computing Machinery
Official URL:https://dl.acm.org/doi/10.1145/3613905.3651074
Copyright Information:Authors
ID Code:31829
Deposited On:13 Nov 2025 11:58 by Dr Kata Szita . Last Modified 13 Nov 2025 11:58
Documents

Full text available as:

[thumbnail of 2024_Systematic analysis of presence scales_CHI.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0
531kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record