Intelligent cameras enhance human perception

November 02, 2020

Intelligent cameras are the next milestone in image and video processing A team of researchers at the Chair of Multimedia Communications and Signal Processing at Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU) has developed an intelligent camera that achieves not only high spatial and temporal but also spectral resolution. The camera has a wide range of applications that can improve environmental protection and resource conservation measures as well as autonomous driving or modern agriculture. The findings of the research have been publishedas an open access publication.

'Research up to now has mainly focused on increasing spatial and temporal resolution, which means the number of megapixels or images per second,' explains lecturer Dr. Jürgen Seiler. 'Spectral resolution - the wavelength and thus the perception of colours - has largely been adjusted to match human sight during the development of cameras, which merely corresponds to measuring the colours red, green, and blue. However, much more information is hidden in the light spectrum that can be used for a wide range of tasks. For example, we know that some animals use additional light spectra for hunting and searching for food.'

Three resolutions in one camera

Seiler, who is an electrical engineer, has therefore developed a high-resolution multi-spectral camera that enhances human perception with his team at the Chair of Multimedia Communications and Signal Processing (LMS) led by Prof. Dr. Kaup at FAU. It combines all three resolutions - spatial, temporal and spectral - in a cost-efficient solution. 'Up to now, there were only extremely expensive and complex methods for measuring the ultraviolet or infrared ranges of light or individual spectral bands for special industrial applications,' says Seiler. 'We looked for a cost-efficient model and we were able to develop a very cost-effective multi-spectral camera.'

The researchers connected several inexpensive standard cameras with various spectral filters to form a multi-spectral camera array. 'We then calculated an image in order to combine the various spectral information from each sensor,' explains Nils Genser, research associate at LMS. 'This new concept enables us to precisely determine the materials of each object captured using just one single image.'

At the same time, the new camera is greatly superior to existing systems in terms of its spatial, temporal and spectral resolution. As the surroundings are recorded by several 'eyes' as is the case with human sight, the system also provides a precise indication of depth. This means that the system not only precisely determines the colour and certain material properties of objects it captures, but also the distance between them and the camera.

Ideal for autonomous driving and environmental technology

Autonomous driving is a potential application for these new intelligent cameras. 'A whole range of solutions to various problems has now opened up thanks to our new technology,' says Seiler. 'In the infrared range, for example, we can differentiate between real people and signposts using the thermal signature. For night driving, we can detect animals crossing the road with sufficient warning.'

The high-resolution multi-spectral cameras could also be used for protecting the environment and conserving resources. 'Several plastics differ significantly from each other in various ranges of the spectrum, which is something the new intelligent camera can reliably detect,' Genser emphasises. 'Large amounts of plastics are simply burned instead of separated for recycling as they have a similar appearance. We can now separate them reliably.'
-end-


University of Erlangen-Nuremberg

Related Perception Articles from Brightsurf:

Intelligent cameras enhance human perception
A team of FAU researchers has developed an intelligent camera that achieves not only high spatial and temporal but also spectral resolution.

New perception metric balances reaction time, accuracy
Researchers at Carnegie Mellon University have developed a new metric for evaluating how well self-driving cars respond to changing road conditions and traffic, making it possible for the first time to compare perception systems for both accuracy and reaction time.

Sweet-taste perception changes as children develop
While adults prefer levels of sweetness similar to typical soft drinks, children and adolescents are less sensitive to the taste and prefer concentrations that are 50% sweeter, according to research by professor of food science and human nutrition M.

Optogenetic odors reveal the logic of olfactory perception
Using optogenetic control, researchers have created an electrical signature that is perceived as an odor in the brain's smell-processing center, the olfactory bulb, even though the odor does not exist.

Vision loss influences perception of sound
People with severe vision loss can less accurately judge the distance of nearby sounds, potentially putting them more at risk of injury.

Why visual perception is a decision process
A popular theory in neuroscience called predictive coding proposes that the brain produces all the time expectations that are compared with incoming information.

How the heart affects our perception
When we encounter a dangerous situation, signals from the brain make sure that the heart beats faster.

Changing how we think about warm perception
Perceiving warmth requires input from a surprising source: cool receptors.

Rhythmic perception in humans has strong evolutionary roots
So suggests a study that compares the behaviour of rodents and humans with respect to the detection rhythm, published in Journal of Comparative Psychology by Alexandre Celma-Miralles and Juan Manuel Toro, researchers at the Center for Brain and Cognition.

Approaching the perception of touch in the brain
More than ten percent of the cerebral cortex are involved in processing information about our sense of touch -- a larger area than previously thought.

Read More: Perception News and Perception Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.