Nav: Home

In a new method for searching image databases, a hand-drawn sketch is all it takes

May 31, 2016

Computer scientists at the University of Basel have developed a new method for conducting image and video database searches based on hand-drawn sketches. The user draws a sketch on a tablet or interactive paper, and the system searches for a matching image in the database. The new method is free to access for researchers.

People today are increasingly confronted with the challenge of having to find their way around vast collections of photos and videos, both in their work lives and at home. Although search engines such as Google and Bing make it easy to find documents or websites quickly and efficiently using search terms, the options for searching collections of multimedia objects are more limited.

A broadly defined similarity concept

Researchers at the Department of Mathematics and Computer Science at the University of Basel have developed a system known as 'vitrivr', which allows a search for images and videos by means of a sketch. The user creates a sketch of the desired object on a tablet or interactive paper, and the program delivers the images and video clips that most resemble it. For videos, the user can even specify on the sketch in which direction an object is moving in the searched sequence.

In designing the system, the researchers deliberately set a very broad similarity concept and adapted it to different types of sketch; for example, similar colors, shapes or directions of movement.

Individual searches can then be augmented by a range of other query types - search terms, examples of images and videos, or combinations of all these. An important feature of the new system is its scalability, a feature that means it can be used even with very large multimedia collections.

Freely available system

The vitrivr system is entirely open source and is therefore freely available to the international research community. It is already being used for a wide range of purposes, from discerning patterns of movement in sports videos for the Federal Office of Sport to searching collections of digital watermarks in a collaboration with the Basel Paper Mill.

Researchers around the world are currently working on developing the system, often with the support of well-known programs, such as the Google Summer of Code. vitrivr is also the basis for the iMotion research project, which is funded by the EU and the Swiss National Science Foundation, and is set to be used as a search engine for large-scale video collections as part of a collaboration with Red Hen Labs in the US.
-end-


University of Basel

Related Collaboration Articles:

Russian scientists and Chinese business collaboration development
On March 16, 2017, Peter the Great Saint-Petersburg Polytechnic University signed an agreement with Chinese companies Inner Mongolia Carbon Valley Technology Co. with participation of Suzhou Dade Carbon Nanotechnology Co.
Osaka University and Otsuka tie up for comprehensive collaboration
Osaka University and Otsuka Pharmaceutical Co., Ltd. signed a comprehensive collaboration agreement for advanced research in immunology between the Osaka University Immunology Frontier Research Center (IFReC) and Otsuka.
International science collaboration growing at astonishing rate
Even those who follow science may be surprised by how quickly international collaboration in scientific studies is growing, according to new research.
MIT and Eni extend energy collaboration
Following a stream of research successes in breakthrough technologies in the energy space, MIT President L.
New tool promotes collaboration and productivity
Pair Research simplifies the process of asking and receiving help.
Collaboration between Schaeffler and FAU
SHARE at FAU is the name of the new scientific collaboration project between Schaeffler and the Friedrich-Alexander Universität of Erlangen-Nürnberg.
BluePen Biomarkers announces collaboration with the University of Pennsylvania
The University of Pennsylvania has co-founded and structured BluePen Biomarkers in collaboration with BluePrint Bio, Inc. and Emerald Logic, Inc. to conduct biomarker research and identification.
Historic university collaboration launched to discover new medicines
A newly launched $80 million enterprise marks a unique collaboration between Monash University and the University of Melbourne in the field of biomedical research.
Which free web apps for collaboration are the most user-friendly?
Free doesn't always mean usable or useful. This study rated the apps on the basis of visibility and feedback, user control and freedom, error prevention, flexibility and efficiency, and aesthetics.
The DZNE and Orion Corporation start strategic collaboration
The German Center for Neurodegenerative Diseases (DZNE) and Orion Corporation, a Finnish pharmaceutical and diagnostics company, have agreed to start a strategic collaboration.

Related Collaboration Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Digital Manipulation
Technology has reshaped our lives in amazing ways. But at what cost? This hour, TED speakers reveal how what we see, read, believe — even how we vote — can be manipulated by the technology we use. Guests include journalist Carole Cadwalladr, consumer advocate Finn Myrstad, writer and marketing professor Scott Galloway, behavioral designer Nir Eyal, and computer graphics researcher Doug Roble.
Now Playing: Science for the People

#530 Why Aren't We Dead Yet?
We only notice our immune systems when they aren't working properly, or when they're under attack. How does our immune system understand what bits of us are us, and what bits are invading germs and viruses? How different are human immune systems from the immune systems of other creatures? And is the immune system so often the target of sketchy medical advice? Those questions and more, this week in our conversation with author Idan Ben-Barak about his book "Why Aren't We Dead Yet?: The Survivor’s Guide to the Immune System".