MediaEval is a benchmark evaluation sponsored by the PetaMedia Network of Excellence. It is a continuation (and expansion) of VideoCLEF. In 2010, the following tasks are being offered:
The Tagging Task (Professional Version): Prediction of semantic theme
Requires participants to automatically assign subject labels to Dutch-language television content using features derived from speech, audio, visual content or associated archival metadata. Read more...
The Tagging Task (Wild Wild Web Version): Prediction of user tags
Requires participants to automatically assign tags to Internet videos using features derived from speech, audio, visual content or associated textual or social information. Read more...
The Placing Task: Geo-tagging
Where in the world? Participants 'place Flickr videos on a map,' i.e., assign geo-coordinates to videos using one or more of: Flickr metadata, visual content, audio content, social information. Read more...
The Affect Task: Boredom Detection
Involves automatically identifying videos that viewers report are boring. Participants can make use of spoken, visual, and audio content as well as accompanying metadata. Read more...
The Passage Task: Passage-level video retrieval
Given a set of queries and a video collection, participants are required to automatically identify relevant jump-in points into the video based on the combination of modalities (audio, speech, visual, metadata). Read more...
The Linking Task (same as in 2009)
Participants are supplied with a set of videos (Dutch Language) in which segments (called multimedia anchors) have been marked. They are asked to link each anchor to a relevant article from the English language Wikipedia. Read more...
"Brave New Tasks" in MediaEval
The MediaEval 2010 workshop will feature a "Brave New Tasks" session. Groups are invited to submit a working notes paper and make a presentation on a task that they have carried out within the past year. The paper/presentation includes history and motivation of the task, approach taken and results achieved. Collaboration between multiple research sites on Brave New Tasks is encouraged. The session will conclude with a discussion of which "brave new tasks" should run as full tasks in MediaEval 2011. Contact the MediaEval coordinators if you would like to carry out a Brave New Task.
VideoCLEF 2010 Survey
The 2010 survey has concluded and results are available on the survey page.
PetaMedia
PetaMedia is a European Network of Excellence coordinated by Delft University of Technology. PetaMedia consists of a Europe-wide network of scientists carrying out research and development in the area of multimedia access and retrieval. The scientists work together to develop new technologies that exploit the "PetaMedia Triple Synergy", i.e., the work on techniques that combine user-based collaborative tagging, social network structures and multimedia content analysis. The tasks that are offered by MediaEval 2010 are based on the "Triple Synergy".