Nav: Home

UT Arlington patent allows real-time learning based on previous decisions

September 01, 2015

UT Arlington electrical engineers have patented an innovative method that improves a controller's ability to make real-time decisions.

Frank Lewis, a professor in the Electrical Engineering Department and at the UT Arlington Research Institute, along with Draguna Vrabie, a senior scientist at United Technologies, and Kyriakos Vamvoudakis, a faculty project research scientist at the University of California, Santa Barbara, were recently issued a patent entitled, "Control Methodology for Online Adaptation to Optimal Feedback Controller Using Integral Reinforcement Learning."

Lewis and his collaborators developed Integral Reinforcement Learning, which is a process by which a device learns and makes control decisions in reaction to a set of variables that changes based on each previous decision. IRL learns by a batch process that requires taking of a set of data prior to updating the control law. This patent develops a new technology for IRL by which decisions can be made continuously in real time, online, allowing greater autonomy and faster response.

"Optimal feedback controllers allow a device to use the minimum energy necessary while saving time and fuel," Lewis said. "They are often seen in aircraft autopilots, emission controls in vehicles, and other similar technologies. The advantage of using adaptive integral reinforcement learning is that a device now can have optimal controls by looking within the system and calculating changes in real time, rather than offline where changes cannot be made until the device is no longer in use."

Vamvoudakis added that adaptive integral reinforcement may eventually allow machines to work in increasingly difficult situations.

"Efficiency will be defined by the potential to adapt autonomously in decentralized, unknown and complex environments to enable capabilities beyond human limits," Vamvoudakis said.

Khosrow Behbehani, dean of the UT Arlington College of Engineering, said the patent could have many financial and environmental benefits.

"By increasing the efficiency of various modes of transportation with the IRL smart controller, we make it possible to move goods and deliver services less expensively and with less negative impact on our environment," he said.
-end-
About The University of Texas at Arlington

The University of Texas at Arlington is a comprehensive research institution of more than 51,000 students in campus-based and online degree programs and is the second largest institution in The University of Texas System. The Chronicle of Higher Education ranked UT Arlington as one of the 20 fastest-growing public research universities in the nation in 2014. U.S. News & World Report ranks UT Arlington fifth in the nation for undergraduate diversity. The University is a Hispanic-Serving Institution and is ranked as a "Best for Vets" college by Military Times magazine. Visit http://www.uta.edu to learn more, and find UT Arlington rankings and recognition at http://www.uta.edu/uta/about/rankings.php.

University of Texas at Arlington

Related Engineering Articles:

Engineering a new cancer detection tool
E. coli may have potentially harmful effects but scientists in Australia have discovered this bacterium produces a toxin which binds to an unusual sugar that is part of carbohydrate structures present on cells not usually produced by healthy cells.
Engineering heart valves for the many
The Wyss Institute for Biologically Inspired Engineering and the University of Zurich announced today a cross-institutional team effort to generate a functional heart valve replacement with the capacity for repair, regeneration, and growth.
Geosciences-inspired engineering
The Mackenzie Dike Swarm and the roughly 120 other known giant dike swarms located across the planet may also provide useful information about efficient extraction of oil and natural gas in today's modern world.
Engineering success
Academically strong, low-income would-be engineers get the boost they need to complete their undergraduate degrees.
HKU Engineering Professor Ron Hui named a Fellow by the UK Royal Academy of Engineering
Professor Ron Hui, Chair Professor of Power Electronics and Philip Wong Wilson Wong Professor of Electrical Engineering at the University of Hong Kong, has been named a Fellow by the Royal Academy of Engineering, UK, one of the most prestigious national academies.
Engineering a better biofuel
The often-maligned E. coli bacteria has powerhouse potential: in the lab, it has the ability to crank out fuels, pharmaceuticals and other useful products at a rapid rate.
Pascali honored for contributions to engineering education
Raresh Pascali, instructional associate professor in the Mechanical Engineering Technology Program at the University of Houston, has been named the 2016 recipient of the Ross Kastor Educator Award.
Scaling up tissue engineering
A team at the Wyss Institute for Biologically Inspired Engineering at Harvard University and the Harvard John A.
Engineering material magic
University of Utah engineers have discovered a new kind of 2-D semiconducting material for electronics that opens the door for much speedier computers and smartphones that also consume a lot less power.
Engineering academic elected a Fellow of the IEEE
A University of Bristol academic has been elected a Fellow of the world's largest and most prestigious professional association for the advancement of technology.

Related Engineering Reading:

Engineering: An Illustrated History from Ancient Craft to Modern Technology (100 Ponderables)
by Tom Jackson (Editor) (Author), Tom Jackson (Editor)

Mechanical Engineering Reference Manual for the PE Exam, 13th Ed
by Michael R. Lindeburg PE (Author)

Materials Science and Engineering: An Introduction
by William D. Callister Jr. (Author), David G. Rethwisch (Author)

Engineering Mechanics: Dynamics (14th Edition)
by Russell C. Hibbeler (Author)

Engineering Economic Analysis
by Donald G. Newnan (Author), Ted G. Eschenbach (Author), Jerome P. Lavelle (Author)

Control Systems Engineering
by Norman S. Nise (Author)

Principles of Geotechnical Engineering
by Braja M. Das (Author), Khaled Sobhan (Author)

The Engineering Design of Systems: Models and Methods (Wiley Series in Systems Engineering and Management)
by Dennis M. Buede (Author), William D. Miller (Author)

SE Structural Engineering Reference Manual
by Alan Williams PhD SE FICE C Eng (Author)

Shigley's Mechanical Engineering Design (McGraw-Hill Series in Mechanical Engineering)
by Richard G Budynas (Author), Keith J Nisbett (Author)

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Approaching With Kindness
We often forget to say the words "thank you." But can those two words change how you — and those around you — look at the world? This hour, TED speakers on the power of gratitude and appreciation. Guests include author AJ Jacobs, author and former baseball player Mike Robbins, Dr. Laura Trice, Professor of Management Christine Porath, and former Danish politician Özlem Cekic.
Now Playing: Science for the People

#509 Anisogamy: The Beginning of Male and Female
This week we discuss how the sperm and egg came to be, and how a difference of reproductive interest has led to sexual conflict in bed bugs. We'll be speaking with Dr. Geoff Parker, an evolutionary biologist credited with developing a theory to explain the evolution of two sexes, about anisogamy, sexual reproduction through the fusion of two different gametes: the egg and the sperm. Then we'll speak with Dr. Roberto Pereira, research scientist in urban entomology at the University of Florida, about traumatic insemination in bed bugs.