A machine learning approach to determining tag relevance in geotagged Flickr imagery
Hughes, Mark, Jones, Gareth J.F.ORCID: 0000-0003-2923-8365 and O'Connor, Noel E.ORCID: 0000-0002-4033-9135
(2012)
A machine learning approach to determining tag relevance in geotagged Flickr imagery.
In: The 13th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2012), 23-25 May 2012, Dublin.
ISBN 978-1-4673-0789-5
We present a novel machine learning based approach to de- termining the semantic relevance of community contributed image annotations for the purposes of image retrieval. Cur- rent large scale community image retrieval systems typically rely on human annotated tags which are subjectively assigned and may not provide useful or semantically meaningful la- bels to the images. Homogeneous tags which fail to distin- guish between are a common occurrence, which can lead to poor search effectiveness on this data. We described a method to improve text based image retrieval systems by eliminating generic or non relevant image tags. To classify tag relevance, we propose a novel feature set based on statistical information available for each tag within a collection of geotagged images harvested from Flickr. Using this feature set machine learning models are trained to classify the relevance of each tag to its associated image. The goal of this process is to allow for rich and accurate captioning of these images, with the objective of improving the accuracy of text based image retrieval systems. A thorough evaluation is carried out using a human annotated benchmark collection of Flickr tags.
Metadata
Item Type:
Conference or Workshop Item (Paper)
Event Type:
Workshop
Refereed:
Yes
Uncontrolled Keywords:
Benchmark testing; Cities and towns; Image retrieval; Machine learning; Measurement; Semantics; Support vector machines