MediaEval 2018 Call for Task proposals

MediaEval 2018 Multimedia Evaluation Benchmark
Call for Task Proposals

Indication of Intent: Friday 22 December 2017
Full proposal deadline: Friday 26 January 2018

The Multimedia Evaluation Benchmark, MediaEval, offers challenges in the form of shared tasks. The goal of MediaEval is to develop and evaluate new algorithms and technologies for multimedia retrieval, access and exploration. MediaEval tasks are innovative, involving multiple modalities, (e.g., audio, visual, textual, and/or contextual) and focusing on the human and social aspects of multimedia. Our larger aim is to promote reproducible research that makes multimedia a positive force for society

MediaEval is now calling for proposals for tasks to run in the 2018 benchmarking season.The proposal should describe the motivation of the task and define the specific problem that task participants are required to solve. It should provide information on the data (including source and licensing), and on how the solutions developed by task participants will be evaluated. The proposal must also include a statement of how the task is related to MediaEval (i.e., the human or social component), and how it extends the state of the art in an area related to multimedia indexing, search or other technologies that support users in accessing multimedia content and collections.

If you plan to submit a task proposal, we request that you first to submit, by email, an “Indication of Intent” in the form of a short task summary (a blurb of 50-100 words). The description should include a clear statement of what participants are expected to do, which data is used, and how participant submissions are evaluated. The summary should finish with a statement of the motivation for the task.

More information to guide you in writing the full proposal will be added here shortly.

Dates:
Indication of Intent: Friday 22 December 2017
Full proposal deadline: Friday 26 January 2018

The MediaEval 2018 Workshop will be held in November 2018 at EURECOM, Sophia Antipolis, France.