TRECVID 2010 – An overview of the goals, tasks, data, evaluation mechanisms, and metrics
Over, Paul, Awad, George M., Fiscus, Jon, Antonishek, Brian, Michel, Martial, Smeaton, Alan F., Kraaij, Wessel and Quénot, Georges
(2011)
TRECVID 2010 – An overview of the goals, tasks, data, evaluation mechanisms, and metrics.
In: TRECVid 2010, 15-17 November 2010, Gaithersburg, Md., USA.
The Text Retrieval Conference’s (TREC’s) Video Retrieval Evaluation (TRECVID) 2010 was a TREC-style video analysis and retrieval evaluation, the goal of which remains to promote progress in content-based exploitation of digital video via open, metrics-based evaluation. Over the last 10 years this effort has yielded a better understanding of how systems can effectively accomplish such processing and how one can reliably benchmark their performance. TRECVID is funded by the National Institute of Standards and Technology (NIST) and other US government agencies. Many organizations and individuals worldwide also contribute significant time and effort.
In 2010, TRECVID turned to new and different data and to some new tasks. 73 teams from various research organizations completed one or more of six tasks. In this overview paper we present a summary of the achievements of TRECVid 2010