New technology makes artificial intelligence more private and portableNovember 14, 2017
Technology developed at the University of Waterloo is paving the way for artificial intelligence (AI) to break free of the internet and cloud computing.
New deep-learning AI software produced with that technology is compact enough to fit on mobile computer chips for use in everything from smartphones to industrial robots.
That would allow devices to operate independent of the internet while using AI that performs almost as well as tethered neural networks.
"We feel this has enormous potential," said Alexander Wong, a systems design engineering professor and Waterloo and co-creator of the technology. "This could be an enabler in many fields where people are struggling to get deep-learning AI in an operational form."
The use of stand-alone deep-learning AI could lead to much lower data processing and transmission costs, greater privacy and use in areas where existing technology is impractical due to expense or other factors.
Deep-learning AI, which mimics the human brain by processing data through layers and layers of artificial neurons, typically requires considerable computational power, memory and energy to function.
Researchers took a page from evolutionary forces in nature to make that AI far more efficient by placing it in a virtual environment, then progressively and repeatedly depriving it of resources.
The deep-learning AI responds by adapting and changing itself to keep functioning each time computational power and memory are taken away.
"These networks evolve themselves through generations and make themselves smaller to be able to survive in these environments," said Mohammad Javad Shafiee, a systems design engineering research professor at Waterloo and the technology's co-creator.
In work recently presented during the International Conference on Computer Vision in Venice, Italy, the researchers achieved a 200-fold reduction in the size of deep-learning AI software used for a particular object recognition task.
When put on a chip and embedded in a smartphone, such compact AI could run its speech-activated virtual assistant and other intelligent features, greatly reducing data usage and operating without internet service.
Other potential applications range from use in low-cost drones and smart grids, to surveillance cameras and manufacturing plants, where there are significant issues around streaming sensitive or proprietary data to the cloud.
Wong and Shafiee, who have co-founded a company called DarwinAI to commercialize their efficient AI software, were "amazed" at the results when they first attempted their approach to evolving deep-learning AI about three years ago.
"We are researchers, so we explore many different things," said Shafiee. "And if it works, we keep going and push harder."
University of Waterloo
Related Memory Articles:
A quick glance at any social media platform will tell you that people love taking photos of their experiences -- whether they're lying on the beach, touring a museum, or just waiting in line at the grocery store.
Research from Katherine Duncan at the University of Toronto suggests we may have to rethink how we improve memory.
The ability to remember sounds, and manipulate them in our minds, is incredibly important to our daily lives -- without it we would not be able to understand a sentence, or do simple arithmetic.
In the battle of the sexes, women have long claimed that they can remember things better and longer than men can.
A collaboration between Universitat Autònoma de Barcelona and Harvard University pioneers the increase of memory using optogenetics in mice in Spain.
Peppermint tea can improve long-term and working memory and in healthy adults.
MIT study finds bursts of neural activity as the brain holds information in mind, overturns a long-held model.
For over forty years, neuro-scientists have been interested in the biological mechanisms underlying the storage of the information that our brain records every day.
Why is it that some people have richly detailed recollection of past experiences (episodic memory), while others tend to remember just the facts without details (semantic memory)?
Neuroscientists at Rosalind Franklin University of Medicine and Science have discovered a novel mechanism for memory formation.
Related Memory Reading:
Memory Rescue: Supercharge Your Brain, Reverse Memory Loss, and Remember What Matters Most
by Dr. Daniel G. Amen (Author)
A proven program from #1 New York Times bestselling author and brain researcher Dr. Daniel Amen to help you change your brain and improve your memory today!
Brain imaging research demonstrates that memory loss actually starts in the brain decades before you have any symptoms. Learn the actions you can take to help not just prevent memory loss later in life . . . but to begin restoring the memory you may have already lost.
Expert physician Dr. Amen reveals how a multipronged strategy―including dietary changes, physical and mental exercises, and spiritual... View Details
Unlimited Memory: How to Use Advanced Learning Strategies to Learn Faster, Remember More and be More Productive
by Kevin Horsley (Author)
Kevin Horsley Broke a World Memory Record in 2013...
And You're About to Learn How to Use His Memory Strategies to Learn Faster, Be More Productive and Achieve More Success
Most people never tap into 10% of their potential for memory. In this book, you're about to learn:
How the World's Top Memory Experts Concentrate and Remember Any Information at Will, and How You Can Too
Do you ever feel like you're too busy, too stressed or just too distracted to concentrate and get work done? In Unlimited Memory, you'll learn how the world's best memory masters... View Details
The Memory Book: The Classic Guide to Improving Your Memory at Work, at School, and at Play
by Harry Lorayne (Author), Jerry Lucas (Author)
Unleash the hidden power of your mind through Harry Lorayne and Jerry Lucas's simple, fail-safe memory system, and you can become more effective, more imaginative, and more powerful, at work, at school, in sports and play. Discover how easy it is to: file phone numbers, data, figures, and appointments right in your head; learn foreign words and phrases with ease; read with speed--and greater understanding; shine in the classroom--and shorten study hours; dominate social situations, and more.
From the Paperback edition. View Details
Moonwalking with Einstein: The Art and Science of Remembering Everything
by Joshua Foer (Author)
The blockbuster phenomenon that charts an amazing journey of the mind while revolutionizing our concept of memory
An instant bestseller that is poised to become a classic, Moonwalking with Einstein recounts Joshua Foer's yearlong quest to improve his memory under the tutelage of top "mental athletes." He draws on cutting-edge research, a surprising cultural history of remembering, and venerable tricks of the mentalist's trade to transform our understanding of human memory. From the United States Memory Championship to deep within the author's own mind, this is an... View Details
by Alan Baddeley (Author), Michael W. Eysenck (Author), Michael C. Anderson (Author)
This best-selling textbook presents a comprehensive and accessible overview of the study of memory. Written by three of the world’s leading researchers in the field, it contains everything the student needs to know about the scientific approach to memory and its applications.
Each chapter of the book is written by one of the three authors, an approach which takes full advantage of their individual expertise and style, creating a more personal and accessible text. This enhances students’ enjoyment of the book, allowing them to share the authors’ own fascination with human... View Details
Memory (Miles Vorkosigan Adventures)
by Lois McMaster Bujold (Author)
Dying is easy. Coming back to life is hard. At least that's what Miles Vorkosigan thinks and he should know, having done both once already. That was when he last visited the planet of Jackson's Whole, while rescuing his brother. Thanks to quick thinking on the part of his staff, and incredible artistry on the part of the specialist who revived him, his first death won't be his last. But his next one might be, a realization he finds profoundly unsettling. Even after he returns to military duty, his late death seems to be having a greater effect than he's willing to admit. Unfortunately, his... View Details
Memory Man (Memory Man series)
by David Baldacci (Author)
With over 110 million copies of his novels in print, David Baldacci is one of the most widely read storytellers in the world. Now he introduces a startling, original new character: a man with perfect memory who must solve his own family's murder.
Amos Decker's life changed forever--twice.
The first time was on the gridiron. A big, towering athlete, he was the only person from his hometown of Burlington ever to go pro. But his career ended before it had a chance to begin. On his very first play, a violent helmet-to-helmet collision knocked him off the... View Details
How to Develop a Brilliant Memory Week by Week: 50 Proven Ways to Enhance Your Memory Skills
by Dominic O'Brien (Author)
Written by eight times World Memory Champion, Dominic O'Brien this book is a complete course in memory enhancement. Dominic takes you step-by-step through an ingenious program of skills, introducing all his tried and tested techniques on which he has built his triumphant championship performances. Pacing the course in line with his expert understanding of how the brain responds to basic memory training, Dominic offers strategies and tips that will expand your mental capacities at a realistic but impressive rate. View Details
The Memory Illusion: Remembering, Forgetting, and the Science of False Memory
by Dr. Julia Shaw (Author)
Memories make us who we are—yet the truth is they are far from being the accurate record we like to think they are. We can all admit to occasional memory lapses, but what if we have the potential for more profound errors of memory, even verging on outright fabrication and self-deception? Forensic psychologist and memory expert Dr. Julia Shaw uses the latest research to show the astonishing variety of ways in which our brains can be led astray. She shows why we can misappropriate other people's memories, believing them to be our own. She explains how police officers can imprison an innocent... View Details
In Search of Memory: The Emergence of a New Science of Mind
by Eric R. Kandel (Author)
“A stunning book.”―Oliver SacksMemory binds our mental life together. We are who we are in large part because of what we learn and remember. But how does the brain create memories? Nobel Prize winner Eric R. Kandel intertwines the intellectual history of the powerful new science of the mind―a combination of cognitive psychology, neuroscience, and molecular biology―with his own personal quest to understand memory. A deft mixture of memoir and history, modern biology and behavior, In Search of Memory brings readers from Kandel's childhood in... View Details