The Tagging Task (Professional Version)
This task requires participants to assign semantic theme labels from a fixed list of subject labels to videos. It is a multilabel task, by which we mean that a given video may have more than one correct label. The task ran in VideoCLEF 2008 and 2009. Each year more data and more labels are added. The system can either be implemented as a subject classification system (tags are used as subject labels) or an information retrieval system (tags are used as queries). Both approaches have been used during VideoCLEF 2008 and VideoCLEF 2009.Target group
Researchers in the area of information retrieval, spoken content retrieval, video retrieval and automatic metadata generation
Data
The task uses the TRECVid data collection from the Netherlands Institute for Sound and Vision (Dutch language). The 2007 & 2008 sets are used as training development sets. The 2009 set is used as the test set. Note that the tagging task is completely different than the original TRECVid task since the relevance of the tags to the videos is not necessarily dependent on what is depicted in the visual channel. Participants are provided with speech recognition transcripts, archival metadata, and, if they wish to make use of it, the original video.
Groundtruth and Evaluation
The ground truth is the labels that have been assigned by the archivists to the data at the Sound and Vision archive.
Task coordinator: Martha Larson, Delft University of Technology
(m.a.larson at tudelft at nl)