Improving the evaluation of web search systems
Gurrin, Cathal and Smeaton, Alan F. (2003) Improving the evaluation of web search systems. In: ECIR 2003 - 25th European Conference on Information Retrieval Research, 14-16 April 2003, Pisa, Italy. ISBN 978-3-540-01274-0
Full text available as:
Linkage analysis as an aid to web search has been assumed to be of significant benefit and we know that it is being implemented by many major Search Engines. Why then have few TREC participants been able to scientifically prove the benefits of linkage analysis over the past three years? In this paper we put forward reasons why disappointing results have been found and we identify the linkage density requirements of a dataset to faithfully support experiments into linkage analysis. We also report a series of linkage-based retrieval experiments on a more densely linked dataset culled from the TREC web documents.
Archive Staff Only: edit this record