Test collections for medical information retrieval evaluation
Goeuriot, Lorraine and Kelly, Liadh and Jones, Gareth J.F. (2013) Test collections for medical information retrieval evaluation. In: SIGIR 2013 Health Search and Discovery HSD workshop, 1 Aug 2013, Dublin, Ireland.
Full text available as:
The web has rapidly become one of the main resources for medical information for many people: patients, clinicians, medical doctors, etc. Measuring the effectiveness with which information can be retrieved from web resources for these users is crucial: it brings
better information to professionals for better diagnosis, treatment, patient care; and helps patients and relatives get informed on their condition. Several existing information retrieval (IR) evaluation campaigns have been developed to assess and improve medical IR methods, for example the TREC Medical Record Track  and TREC Genomics Track . These campaigns only target certain
type of users, mainly clinicians and some medical professionals: queries are mainly centered on cohorts of records describing a specific patient cases or on biomedical reports. Evaluating search effectiveness
over the many heterogeneous online medical information
sources now available, which are increasingly used by a diverse range of medical professionals and, very importantly, the general public, is vital to the understanding and development of medical IR. We describe the development of two benchmarks for medical IR evaluation from the Khresmoi project. The first of these has been developed using existing medical query logs for internal research within the Khresmoi project and targets both medical professionals and general public; the second has been created in the framework of a new CLEFeHealth evaluation campaign and is designed to evaluate patient search in context.
Archive Staff Only: edit this record