Nav: Home

In a new method for searching image databases, a hand-drawn sketch is all it takes

May 31, 2016

Computer scientists at the University of Basel have developed a new method for conducting image and video database searches based on hand-drawn sketches. The user draws a sketch on a tablet or interactive paper, and the system searches for a matching image in the database. The new method is free to access for researchers.

People today are increasingly confronted with the challenge of having to find their way around vast collections of photos and videos, both in their work lives and at home. Although search engines such as Google and Bing make it easy to find documents or websites quickly and efficiently using search terms, the options for searching collections of multimedia objects are more limited.

A broadly defined similarity concept

Researchers at the Department of Mathematics and Computer Science at the University of Basel have developed a system known as 'vitrivr', which allows a search for images and videos by means of a sketch. The user creates a sketch of the desired object on a tablet or interactive paper, and the program delivers the images and video clips that most resemble it. For videos, the user can even specify on the sketch in which direction an object is moving in the searched sequence.

In designing the system, the researchers deliberately set a very broad similarity concept and adapted it to different types of sketch; for example, similar colors, shapes or directions of movement.

Individual searches can then be augmented by a range of other query types - search terms, examples of images and videos, or combinations of all these. An important feature of the new system is its scalability, a feature that means it can be used even with very large multimedia collections.

Freely available system

The vitrivr system is entirely open source and is therefore freely available to the international research community. It is already being used for a wide range of purposes, from discerning patterns of movement in sports videos for the Federal Office of Sport to searching collections of digital watermarks in a collaboration with the Basel Paper Mill.

Researchers around the world are currently working on developing the system, often with the support of well-known programs, such as the Google Summer of Code. vitrivr is also the basis for the iMotion research project, which is funded by the EU and the Swiss National Science Foundation, and is set to be used as a search engine for large-scale video collections as part of a collaboration with Red Hen Labs in the US.
-end-


University of Basel

Related Collaboration Articles:

Leipzig primate researchers initiate global collaboration
In order to investigate evolutionary questions, scientists require the largest and most versatile samples possible.
Dynamic collaboration behind new research into best way of using biologging tags
Methods used to design F1 cars and spacecraft have played a crucial role in new research into the tags used to track animal movements.
Imaging collaboration sheds new light on cancer growth
Walter and Eliza Hall Institute researchers have uncovered new insights into how the normal controls on cell growth are lost in cancer cells, leading to rapid tumour expansion.
Working overtime linked to less collaboration between nurses and doctors
Working overtime may negatively influence nurses' collaboration with fellow nurses and physicians, finds a new study by researchers at NYU Rory Meyers College of Nursing.
An Arctic example: How scientific collaboration can foster international stability
In this Policy Forum, Paul Arthur Berkman et al. underscore how international scientific collaboration in the Arctic can help align common interests among countries experiencing geopolitical conflict.
Researchers 'drug the undruggable' through unique collaboration
A new study published in Nature, conducted by an alliance between industry and academia involving the University of Liverpool, highlights a new approach to targeting key cancer-linked proteins, thought to be 'undruggable'.
Collaboration of therapists and clients may improve family therapy
A new article addresses ongoing conversations about bridging the gap between practice and research within the field of family therapy.
Russian scientists and Chinese business collaboration development
On March 16, 2017, Peter the Great Saint-Petersburg Polytechnic University signed an agreement with Chinese companies Inner Mongolia Carbon Valley Technology Co. with participation of Suzhou Dade Carbon Nanotechnology Co.
Osaka University and Otsuka tie up for comprehensive collaboration
Osaka University and Otsuka Pharmaceutical Co., Ltd. signed a comprehensive collaboration agreement for advanced research in immunology between the Osaka University Immunology Frontier Research Center (IFReC) and Otsuka.
International science collaboration growing at astonishing rate
Even those who follow science may be surprised by how quickly international collaboration in scientific studies is growing, according to new research.
More Collaboration News and Collaboration Current Events

Top Science Podcasts

We have hand picked the top science podcasts of 2019.
Now Playing: TED Radio Hour

Risk
Why do we revere risk-takers, even when their actions terrify us? Why are some better at taking risks than others? This hour, TED speakers explore the alluring, dangerous, and calculated sides of risk. Guests include professional rock climber Alex Honnold, economist Mariana Mazzucato, psychology researcher Kashfia Rahman, structural engineer and bridge designer Ian Firth, and risk intelligence expert Dylan Evans.
Now Playing: Science for the People

#540 Specialize? Or Generalize?
Ever been called a "jack of all trades, master of none"? The world loves to elevate specialists, people who drill deep into a single topic. Those people are great. But there's a place for generalists too, argues David Epstein. Jacks of all trades are often more successful than specialists. And he's got science to back it up. We talk with Epstein about his latest book, "Range: Why Generalists Triumph in a Specialized World".
Now Playing: Radiolab

Dolly Parton's America: Neon Moss
Today on Radiolab, we're bringing you the fourth episode of Jad's special series, Dolly Parton's America. In this episode, Jad goes back up the mountain to visit Dolly's actual Tennessee mountain home, where she tells stories about her first trips out of the holler. Back on the mountaintop, standing under the rain by the Little Pigeon River, the trip triggers memories of Jad's first visit to his father's childhood home, and opens the gateway to dizzying stories of music and migration. Support Radiolab today at Radiolab.org/donate.