Creation of a new evaluation benchmark for information
retrieval targeting patient information needs
Goeuriot, LorraineORCID: 0000-0001-7491-1980, Kelly, LiadhORCID: 0000-0003-1131-5238, Jones, Gareth J.F.ORCID: 0000-0003-2923-8365, Zuccon, Guido, Suominen, Hanna, Hanbury, Allan, Mueller, Henning and Leveling, JohannesORCID: 0000-0003-0603-4191
(2013)
Creation of a new evaluation benchmark for information
retrieval targeting patient information needs.
In: The Fifth International Workshop on Evaluating Information Access (EVIA 2013), 18 Jun 2013, Tokyo, Japan.
Searching for health advice on the web is becoming increasingly common. Because of the great importance of this activity for patients and clinicians and the effect that incorrect information may have on health outcomes, it is critical to present relevant and valuable information to a searcher. Previous evaluation campaigns on health information retrieval (IR) have provided benchmarks that have been widely used to improve health IR and record these improvements. However, in general these benchmarks have targeted the specialised information needs of physicians and other healthcare workers. In this paper, we describe the development of a new collection for evaluation of effectiveness in IR seeking to satisfy the health information needs of patients. Our methodology features a novel way to create statements of patients’ information needs using realistic short queries associated with patient discharge summaries, which provide details of patient disorders. We adopt a scenario where the patient then creates a query to seek information relating to these disorders. Thus, discharge summaries provide us with a means to create contextually driven search statements, since they may include details on the stage of the disease, family history etc. The collection will be used for the first time as part of the ShARe/-CLEF 2013 eHealth Evaluation Lab, which focuses on natural language processing and IR for clinical care.
Metadata
Item Type:
Conference or Workshop Item (Paper)
Event Type:
Workshop
Refereed:
Yes
Uncontrolled Keywords:
Medical information retrieval; Evaluation; Query formation