Nav: Home

Now your phone can become a robot that does the boring work

June 18, 2019

WEST LAFAYETTE, Ind. -- If any factory worker could program low-cost robots, then more factories could actually use robotics to increase worker productivity.

This is because workers would be able to shift to taking on more varied and higher-level tasks, and factories could produce a greater variety of products.

That's the idea behind a prototype smartphone app Purdue University researchers have developed that allows a user to easily program any robot to perform a mundane activity, such as picking up parts from one area and delivering them to another.

The setup could also take care of household chores - no more plants dying because you forgot to water them.

Purdue researchers present their research on the embedded app, called VRa, on June 23 at DIS 2019 in San Diego. The platform is patented through the Purdue Research Foundation Office of Technology Commercialization, with plans to make it available for commercial use.

"Smaller companies can't afford software programmers or expensive mobile robots," said Karthik Ramani, Purdue's Donald W. Feddersen Professor of Mechanical Engineering. "We've made it to where they can do the programming themselves, dramatically bringing down the costs of building and programming mobile robots," he said.

Using augmented reality, the app allows the user to either walk out where the robot should go to perform its tasks, or draw out a workflow directly into real space. The app offers options for how those tasks can be performed, such as under a certain time limit, on repeat or after a machine has done its job.

After programming, the user drops the phone into a dock attached to the robot. While the phone needs to be familiar with the type of robot it's "becoming" to perform tasks, the dock can be wirelessly connected to the robot's basic controls and motor.

The phone is both the eyes and brain for the robot, controlling its navigation and tasks.

"As long as the phone is in the docking station, it is the robot," Ramani said. "Whatever you move about and do is what the robot will do."

To get the robot to execute a task that involves wirelessly interacting with another object or machine, the user simply scans the QR code of that object or machine while programming, effectively creating a network of so-called "Internet of Things." Once docked, the phone (as the robot) uses information from the QR code to work with the objects.

The researchers demonstrated this with robots watering a plant, vacuuming and transporting objects. The user can also monitor the robot remotely through the app and make it start or stop a task, such as to go charge its battery or begin a 3D-printing job. The app provides an option to automatically record video when the phone is docked, so that the user can play it back and evaluate a workflow.

Ramani's lab made it possible for the app to know how to navigate and interact with its environment according to what the user specifies through building upon so-called "simultaneous localization and mapping." These types of algorithms are also used in self-driving cars and drones.

A YouTube video is available at https://www.youtube.com/watch?v=_VCIHPDbcLk.

"We don't undervalue the human. Our goal is for everyone to be able to program robots, and for humans and robots to collaborate with each other," Ramani said.

Since creating the prototype, Ramani's lab has been testing it in real factory settings to evaluate user-driven applications. Ultimately, the app is a step toward creating future "smart" factories, powered by artificial intelligence and augmented reality, that complement and increase worker productivity rather than replacing them, Ramani said.
-end-
The work aligns with Purdue's Giant Leaps celebration, acknowledging the university's global advancements made in artificial intelligence as part of Purdue's 150th anniversary. This is one of the four themes of the yearlong celebration's Ideas Festival, designed to showcase Purdue as an intellectual center solving real-world issues.

A grant from the National Science Foundation's Future of Work at the Human-Technology Frontier program is supporting the lab's continued research in enabling humans to more easily create, program and collaborate with robots.

ABSTRACT

V.Ra: An In-Situ Visual Authoring System for Robot-IoT Task Planning with Augmented Reality

Yuanzhi Cao1, Zhuangying Xu1, Fan Li2, Wentao Zhong1, Ke Huo1, Karthik Ramani1

1Purdue University, West Lafayette, IN, USA

2Tsinghua University, Beijing, China

doi: 10.1145/3322276.3322278

We present V.Ra, a visual and spatial programming system for robot-IoT task authoring. In V.Ra, programmable mobile robots serve as binding agents to link the stationary IoTs and perform collaborative tasks. We establish an ecosystem that coherently connects the three key elements of robot task planning, the human, robot and IoT, with one single mobile AR device. Users can perform task authoring with the Augmented Reality (AR) handheld interface, then placing the AR device onto the mobile robot directly transfers the task plan in a what-you-do-is-what-robot-does (WYDWRD) manner. The mobile device mediates the interactions between the user, robot, and the IoT oriented tasks, and guides the path planning execution with the embedded simultaneous localization and mapping (SLAM) capability. We demonstrate that V.Ra enables instant, robust and intuitive room-scale navigatory and interactive task authoring through various use cases and preliminary studies.

Purdue University

Related Robots Articles:

How many jobs do robots really replace?
MIT economist Daron Acemoglu's new research puts a number on the job costs of automation.
Robots popular with older adults
A new study by psychologists from the University of Jena (Germany) does not confirm that robot skepticism among elder people is often suspected in science.
Showing robots how to do your chores
By observing humans, robots learn to perform complex tasks, such as setting a table.
Designing better nursing care with robots
Robots are becoming an increasingly important part of human care, according to researchers based in Japan.
Darn you, R2! When can we blame robots?
A recent study finds that people are likely to blame robots for workplace accidents, but only if they believe the robots are autonomous.
Robots need a new philosophy to get a grip
Robots need to know the reason why they are doing a job if they are to effectively and safely work alongside people in the near future.
How can robots land like birds?
Birds can perch on a wide variety of surfaces, thick or thin, rough or slick.
Soft robots for all
Each year, soft robots gain new abilities. They can jump, squirm, and grip.
The robots that dementia caregivers want: robots for joy, robots for sorrow
A team of scientists spent six months co-designing robots with informal caregivers for people with dementia, such as family members.
Faster robots demoralize co-workers
A Cornell University-led team has found that when robots are beating humans in contests for cash prizes, people consider themselves less competent and expend slightly less effort -- and they tend to dislike the robots.
More Robots News and Robots Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: Meditations on Loneliness
Original broadcast date: April 24, 2020. We're a social species now living in isolation. But loneliness was a problem well before this era of social distancing. This hour, TED speakers explore how we can live and make peace with loneliness. Guests on the show include author and illustrator Jonny Sun, psychologist Susan Pinker, architect Grace Kim, and writer Suleika Jaouad.
Now Playing: Science for the People

#565 The Great Wide Indoors
We're all spending a bit more time indoors this summer than we probably figured. But did you ever stop to think about why the places we live and work as designed the way they are? And how they could be designed better? We're talking with Emily Anthes about her new book "The Great Indoors: The Surprising Science of how Buildings Shape our Behavior, Health and Happiness".
Now Playing: Radiolab

The Third. A TED Talk.
Jad gives a TED talk about his life as a journalist and how Radiolab has evolved over the years. Here's how TED described it:How do you end a story? Host of Radiolab Jad Abumrad tells how his search for an answer led him home to the mountains of Tennessee, where he met an unexpected teacher: Dolly Parton.Jad Nicholas Abumrad is a Lebanese-American radio host, composer and producer. He is the founder of the syndicated public radio program Radiolab, which is broadcast on over 600 radio stations nationwide and is downloaded more than 120 million times a year as a podcast. He also created More Perfect, a podcast that tells the stories behind the Supreme Court's most famous decisions. And most recently, Dolly Parton's America, a nine-episode podcast exploring the life and times of the iconic country music star. Abumrad has received three Peabody Awards and was named a MacArthur Fellow in 2011.