Interactive Video Search and Browsing Systems
0 likes222 views
The document summarizes an interactive video search and browsing system called Orione. It uses an ontology created from a lexicon and WordNet to provide automatic video annotations using visual features. The system has a web-based interface for simple or advanced searches and browsing video archives by concepts. It also allows manual annotations. The multitouch interface lets users browse the ontology to select concepts and search/organize results with gestures. Usability tests were conducted on the system.
Interactive Video Search and Browsing Systems
- 1. Interactive Video Search and Browsing Systems Marco Bertini, Alberto Del Bimbo, Andrea Ferracani, Daniele Pezzatini Universit` degli Studi di Firenze - MICC a The search engine The Orione search engine has different query modalities and visualizations, resulting in an advanced tool for retrieval and exploration of video archives. It uses an ontology created semi-automatically from a flat lexicon, using WordNet to create concept relations. Automatic video annotations are provided by a system based on the bag-of-words approach, that exploits SIFT, SURF and MSER visual features and the Pyramid Match Kernel. The web-based user interface • Simple or advanced search interface to build composite queries that may include Boolean and temporal operators, metadata and geo tag. • Integrated tool that allows to browse video archives navigating through the relations between the concepts of the ontology. • Manual annotation tool to provide free-text, ontology-based and geographical annotations that can be used for correcting and integrating automatic annotations. The multitouch user interface • Users can browse the ontology structure in order to select concepts and start the video retrieval process. • Users can inspect the results returned by the search engine and organize them according to their specific purposes by performing simple gestures. • The user interface adopts some visualization principles derived from the discipline of interaction design and is equipped with a set of interaction functionalities to improve the usability of the system. Usability test http://www.micc.unifi.it/ This work was partially supported by the EU IST IM3I project (contract FP7-222267). http://www.im3i.eu