The Tagging Task (Wild Wild Web Version)

Task
The Wild Wild Web Tagging Task requires participants to automatically assign tags to videos using features derived from speech, audio, visual content or associated textual or social information. Participants can chose which features they wish to use and are not obliged to use all features.

Note that relevant tags capture some aspect of a video related to aboutness or to tagger perceptions. Relevance of tags is thus determined by the intellectual content of the video as a whole and not by the visual channel alone. In this respect, the tagging task is significantly different than concept detection, as practiced, e.g., at TRECVid.

Target group
Researchers in the area of multimedia retrieval, spoken content search and social media.

Data
In 2010, we will use a collection of Internet video from blip.tv created by the PetaMedia Network of Excellence. For the tagging task, participants are provided with a video file for each episode along with metadata (e.g., title + description), speech recognition transcripts and social network information (gathered from Twitter, i.e., who twittered whom about which video). A development set will be released.

Check out these examples of blip.tv video episodes.

Groundtruth and Evaluation
The ground truth consists of tags that have been assigned to the videos by users.

Task coordinator: Martha Larson, Delft University of Technology
(m.a.larson at tudelft at nl)