• People
  • Research
  • Projects
  • Publications
  • Resources
ViCoS Lab

LeOParts
Learning a large number of visual object categories for content-based retrieval in image and video databases

basic research project
April 2010 - August 2013

Collaborating partners

  • University of Ljubljana
  • Faculty of Computer and Information Science

Funding

  • ARRS

Researchers

Aleš Leonardis, PhD
Aleš Leonardis, PhD
Sanja Fidler
Sanja Fidler
Marko Boben
Marko Boben
Domen Tabernik, PhD
Domen Tabernik, PhD
Matej Kristan, PhD
Matej Kristan, PhD
Luka Čehovin Zajc, PhD
Luka Čehovin Zajc, PhD

Mission

We are now witnessing a significant increase of digital image and video databases. To allow a human user to efficiently access the desired content, these images need to be semantically labeled. The classical low-level visual features at which the computers percieve the images are not directly linked to the high-level human visual interpretations, thus forming a semantic-gap. Our challenge is to develop a methodology that would bridge the gap between the computer-centered low-level image features and the high-level human-centered semantic meanings.

Within the EU project POETICON our group has developed a hierarchical object class model that is based on the intuitive principle of compositionality for the purpose of visual retrieval. Now we will focus on modeling and learning a larger number of visual object categories within a hierarchical compositional framework. Our approch will enable continuous learning of novel object categories through user interaction and autonomous indexing of object categories in image databases. We expect to shed new views of computer-user interaction in terms of continuous user-in-the-loop based semantic queries and queries at different levels of detail which retain their semantic meaning.

The project is the first holistic proposal of using hierarchical categorical representations for learning, indexing and querying in visual databases. For this reason, it has a very high relevance and scientific excellence within the area of computer as well as artificial cognitive vision. We foresee an immediate application of the project’s results to the media and telecommunications industries as well as in the emerging area of cognitive robotics.

Publications:

Faculty of Computer and Information Science

Visual Cognitive Systems Laboratory

University of Ljubljana

Faculty of Computer and Information Science

Večna pot 113
SI-1000 Ljubljana
Slovenia
Tel.: +386 1 479 8245