Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

A proposal for the evaluation of adaptive information retrieval systems using simulated interaction

Mulwa, Catherine and Li, Wei B. and Lawless, Séamus and Jones, Gareth J.F. (2010) A proposal for the evaluation of adaptive information retrieval systems using simulated interaction. In: SimInt 2010 - Simulation of Interaction. SIGIR Workshop on the Automated Evaluation of Interactive Information Retrieval, 23 July 2010, Geneva, Switzerland.

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


The Centre for Next Generation Localisation (CNGL) is involved in building interactive adaptive systems which combine Information Retrieval (IR), Adaptive Hypermedia (AH) and adaptive web techniques and technologies. The complex functionality of these systems coupled with the variety of potential users means that the experiments necessary to evaluate such systems are difficult to plan, implement and execute. This evaluation requires both component-level scientific evaluation and user-based evaluation. Automated replication of experiments and simulation of user interaction would be hugely beneficial in the evaluation of adaptive information retrieval systems (AIRS). This paper proposes a methodology for the evaluation of AIRS which leverages simulated interaction. The hybrid approach detailed combines: (i) user-centred methods for simulating interaction and personalisation; (ii) evaluation metrics that combine Human Computer Interaction (HCI), AH and IR techniques; and (iii) the use of qualitative and quantitative evaluations. The benefits and limitations of evaluations based on user simulations are also discussed.

Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Subjects:Computer Science > Information retrieval
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Official URL:
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland
ID Code:15837
Deposited On:24 Nov 2010 12:55 by Shane Harper. Last Modified 08 Feb 2017 09:30

Download statistics

Archive Staff Only: edit this record