• VideoCLEF 2010
  • Tagging Task Pro
  • Tagging Task WWW
  • Placing Task
  • Affect Task
  • Passage Task
  • Linking Task
• VideoCLEF 2009
• VideoCLEF 2008
• Why Participate?
• FAQs
• About us
• Acknowledgments

The Linking Task

Task
The linking task is also called "Finding Related Resources Across Languages." This task ran in the same form at VideoCLEF 2009 and is “back by popular demand.” Participants are supplied with a number of short segments (called multimedia anchors) in each Dutch-language Beeldenstorm episode and asked to link each anchor to a relevant article from the English language Wikipedia. Participants can make use of can make use of any/all of the available resources: video, audio track, ASR transcripts and/or ArchivalMetadata.

Note that this task is designed to go beyond a named-entity linking task. Although a multimedia anchor may contain a named entity (e.g., a person, place or organization) that is mentioned in the speech channel, it is not always the case. The topic being discussed in the video at the point of the anchor may not be explicitly named. Also, the representation of a topic in the video may be split between the visual and the speech channel. You should consider these aspects when designing your algorithm.

Target group
This task is of interest to researchers in: information retrieval, cross-language retrieval and multimedia retrieval

Data
The linking task uses the VideoCLEF 2009 "Beeldenstorm" dataset, which contains 50 episodes (ca. 8 minutes each) of “Beeldenstorm” (Eng. Iconoclasm), a Dutch-language documentary series on the visual arts featuring Prof. Henk van Os as the host and narrator. Of the 50 episodes, 45 comprise the testset and the other five are used as example episodes. Some test episodes can be found online. Try these links:

BG_36941 "Mark Rothko"
BG_37007 "Holland op zijn smalst" (Holland at its smallest)
BG_37016 "Tulpomanie"
BG_37111 "Maria Magdalena"

Groundtruth and evaluation
Assessors identified two levels of groundtruth. Primary links are defined as "highly relevant -- the page is the single page most relevant for supporting understanding of the video in the region of the anchor." There is only a single primary link per multimedia anchor representing the one best page to which that anchor can be linked. Secondary links are defined as "fairly relevant -- the page treats a subtopic (aspects) of the video in the region of the anchor." The list of secondary links is not exhaustive.

Task coordinator: Gareth Jones, Dublin City University
(Gareth dot Jones at computing dot dcu dot ie)