Automatic Illustration with Cross-media Retrieval in Large-scale Collections

27 Julho 2011
Sem comentários

Filipe Coelho and Cristina Ribeiro

9th International Workshop on Content-based Multimedia Indexing (CBMI), June 2011, Madrid, Spain


In this paper, we approach the task of finding suitable images to illustrate text, from specific news stories to more generic blog entries. We have developed an automatic illustration system supported by multimedia information retrieval, that analyzes text and presents a list of candidate images to illustrate it. The system was tested on the SAPO-Labs media collection, containing almost two million images with short descriptions, and the MIRFlickr-25000 collection, with photos and user tags from Flickr. Visual content is described by the Joint Composite Descriptor and indexed by a Permutation-Prefix Index. Illustration is a three-stage process using textual search, score filtering and visual clustering. A preliminary evaluation using exhaustive and approximate visual searches demonstrates the capabilities of the visual descriptor and approximate indexing scheme used.

Download Presentation


Sem comentários