Nav: Home

UT Arlington patent allows real-time learning based on previous decisions

September 01, 2015

UT Arlington electrical engineers have patented an innovative method that improves a controller's ability to make real-time decisions.

Frank Lewis, a professor in the Electrical Engineering Department and at the UT Arlington Research Institute, along with Draguna Vrabie, a senior scientist at United Technologies, and Kyriakos Vamvoudakis, a faculty project research scientist at the University of California, Santa Barbara, were recently issued a patent entitled, "Control Methodology for Online Adaptation to Optimal Feedback Controller Using Integral Reinforcement Learning."

Lewis and his collaborators developed Integral Reinforcement Learning, which is a process by which a device learns and makes control decisions in reaction to a set of variables that changes based on each previous decision. IRL learns by a batch process that requires taking of a set of data prior to updating the control law. This patent develops a new technology for IRL by which decisions can be made continuously in real time, online, allowing greater autonomy and faster response.

"Optimal feedback controllers allow a device to use the minimum energy necessary while saving time and fuel," Lewis said. "They are often seen in aircraft autopilots, emission controls in vehicles, and other similar technologies. The advantage of using adaptive integral reinforcement learning is that a device now can have optimal controls by looking within the system and calculating changes in real time, rather than offline where changes cannot be made until the device is no longer in use."

Vamvoudakis added that adaptive integral reinforcement may eventually allow machines to work in increasingly difficult situations.

"Efficiency will be defined by the potential to adapt autonomously in decentralized, unknown and complex environments to enable capabilities beyond human limits," Vamvoudakis said.

Khosrow Behbehani, dean of the UT Arlington College of Engineering, said the patent could have many financial and environmental benefits.

"By increasing the efficiency of various modes of transportation with the IRL smart controller, we make it possible to move goods and deliver services less expensively and with less negative impact on our environment," he said.
-end-
About The University of Texas at Arlington

The University of Texas at Arlington is a comprehensive research institution of more than 51,000 students in campus-based and online degree programs and is the second largest institution in The University of Texas System. The Chronicle of Higher Education ranked UT Arlington as one of the 20 fastest-growing public research universities in the nation in 2014. U.S. News & World Report ranks UT Arlington fifth in the nation for undergraduate diversity. The University is a Hispanic-Serving Institution and is ranked as a "Best for Vets" college by Military Times magazine. Visit http://www.uta.edu to learn more, and find UT Arlington rankings and recognition at http://www.uta.edu/uta/about/rankings.php.

University of Texas at Arlington

Related Engineering Articles:

Engineering a new cancer detection tool
E. coli may have potentially harmful effects but scientists in Australia have discovered this bacterium produces a toxin which binds to an unusual sugar that is part of carbohydrate structures present on cells not usually produced by healthy cells.
Engineering heart valves for the many
The Wyss Institute for Biologically Inspired Engineering and the University of Zurich announced today a cross-institutional team effort to generate a functional heart valve replacement with the capacity for repair, regeneration, and growth.
Geosciences-inspired engineering
The Mackenzie Dike Swarm and the roughly 120 other known giant dike swarms located across the planet may also provide useful information about efficient extraction of oil and natural gas in today's modern world.
Engineering success
Academically strong, low-income would-be engineers get the boost they need to complete their undergraduate degrees.
HKU Engineering Professor Ron Hui named a Fellow by the UK Royal Academy of Engineering
Professor Ron Hui, Chair Professor of Power Electronics and Philip Wong Wilson Wong Professor of Electrical Engineering at the University of Hong Kong, has been named a Fellow by the Royal Academy of Engineering, UK, one of the most prestigious national academies.
Engineering a better biofuel
The often-maligned E. coli bacteria has powerhouse potential: in the lab, it has the ability to crank out fuels, pharmaceuticals and other useful products at a rapid rate.
Pascali honored for contributions to engineering education
Raresh Pascali, instructional associate professor in the Mechanical Engineering Technology Program at the University of Houston, has been named the 2016 recipient of the Ross Kastor Educator Award.
Scaling up tissue engineering
A team at the Wyss Institute for Biologically Inspired Engineering at Harvard University and the Harvard John A.
Engineering material magic
University of Utah engineers have discovered a new kind of 2-D semiconducting material for electronics that opens the door for much speedier computers and smartphones that also consume a lot less power.
Engineering academic elected a Fellow of the IEEE
A University of Bristol academic has been elected a Fellow of the world's largest and most prestigious professional association for the advancement of technology.

Related Engineering Reading:

Engineering: An Illustrated History from Ancient Craft to Modern Technology (100 Ponderables)
by Tom Jackson (Editor) (Author), Tom Jackson (Editor)

From ancient aqueducts to soaring skyscrapers, explore engineering milestones over the centuries.

Combining engaging text with captivating images and helpful diagrams, renowned science writer Tom Jackson guides readers through the history of Engineering in the 7th installment of the groundbreaking PonderablesTM series.

Engineering is all around us. From our bridges, tunnels and skyscrapers, to our cars, computers and smartphones, engineering shapes our world and influences just about everything we see and do. And it s been that way for longer than you might think. From the... View Details


Basic Machines and How They Work
by Naval Education And Training Program (Author)

This revised edition of an extremely clear Navy training manual leaves nothing to be desired in its presentation. Thorough in its coverage of basic theory, from the lever and inclined plane to internal combustion engines and power trains, it requires nothing more than an understanding of the most elementary mathematics.
Beginning with the simplest of machines — the lever — the text proceeds to discussions of the block and tackle (pulleys and hoists), wheel and axle, the inclined plane and the wedge, the screw, and different types of gears (simple, spur, bevel, herringbone, spiral,... View Details


101 Things I Learned® in Engineering School
by John Kuprenas (Author), Matthew Frederick (Author)

Providing unique, accessible lessons on engineering, this title in the bestselling 101 Things I Learned® series is a perfect resource for students, recent graduates, general readers, and even seasoned professionals.
  
An experienced civil engineer presents the physics and fundamentals underlying the many fields of engineering. Far from a dry, nuts-and-bolts exposition, 101 Things I Learned® in Engineering School uses real-world examples to show how the engineer's way of thinking can illuminate questions from the simple to the profound: Why shouldn't soldiers... View Details


Engineering: A Very Short Introduction
by David Blockley (Author)

Engineering is part of almost everything we do--from the buildings we live in and the roads and railways we travel on, to the telephones and computers we use to communicate and the X-ray machines that help doctors diagnose diseases. In this Very Short Introduction, David Blockley explores the nature and practice of engineering--its history, its scope, and its relationship with art, craft, science, and technology. He begins with its early roots, ranging from Archimedes to some of the great figures of engineering such as Brunel and Marconi, right up to the modern day, describing the... View Details


Practical Electronics for Inventors, Fourth Edition
by Paul Scherz (Author), Simon Monk (Author)

A Fully-Updated, No-Nonsense Guide to Electronics

Advance your electronics knowledge and gain the skills necessary to develop and construct your own functioning gadgets. Written by a pair of experienced engineers and dedicated hobbyists, Practical Electronics for Inventors, Fourth Edition, lays out the essentials and provides step-by-step instructions, schematics, and illustrations. Discover how to select the right components, design and build circuits, use microcontrollers and ICs, work with the latest software tools, and test and tweak your creations. This... View Details


The Beginner's Guide to Engineering: Mechanical Engineering
by Mark Huber (Author)

The Beginner’s Guide to Engineering series is designed to provide a very simple, non-technical introduction to the fields of engineering for people with no experience in the fields. Each book in the series focuses on introducing the reader to the various concepts in the fields of engineering conceptually rather than mathematically. These books are a great resource for high school students that are considering majoring in one of the engineering fields, or for anyone else that is curious about engineering but has no background in the field. Books in the series: 1. The Beginner’s Guide to... View Details


Civil Engineering Reference Manual for the PE Exam, 15th Ed
by Michael R. Lindeburg PE (Author)

New for 2018. Choose the new edition of PE Civil Reference Manual, Sixteenth Edition and receive the eTextbook for free. This offer is only available at ppi2pass.com.​

Comprehensive Civil PE Exam Coverage

The Civil Engineering Reference Manual is the most comprehensive textbook for the NCEES Civil PE exam. This book's time-tested organization and clear explanations start with the basics to help you quickly get up to speed with common civil engineering concepts. Together, the 90 chapters provide an in-depth review of all of the topics,... View Details


Studying Engineering: A Road Map to a Rewarding Career (Fourth Edition)
by Raymond B. Landis (Author)

About the Book
Since Studying Engineering: A Road Map to a Rewarding Career exploded onto the market in 1995, it has become the best selling Introduction to Engineering textbook of all time. Adopted by over 300 U.S. institutions, and reaching more than 150,000 students, the book has made major inroads into the "sink or swim" paradigm of engineering education. Armed with the book as a powerful tool for "student development," large numbers of engineering programs have implemented Introduction to Engineering courses to improve the academic performance and retention rates of their... View Details


Mechanical Engineering Reference Manual for the PE Exam, 13th Ed
by Michael R. Lindeburg PE (Author)

Only available at PPI2PASS.com, updated to the 2018 exam specs the new edition of Mechanical Engineering Reference Manual for the PE Exam, 13th Edition with free eTextbook and free Index included.

Get your PE Mechanical Study Schedule and PE Mechanical Reference Manual index at ppi2pass.com/downloads.

** New Practice Exams and Six-Minute Problem Books Now Available for New PE Mechanical Exams**
The following new titles are available from the Publisher PPI on AmazonFree study schedules to support the new exams are available on... View Details


Unwritten Laws of Engineering: Revised and Updated Edition
by W. J. King (Author), James G. Skakoon (Author)

This fully revised and updated edition of the 1944 classic serves as a crucial compilation of 'house rules' or a professional code. This new edition keeps the style of the original and much of its content. Changes reflect shifted societal values, changed employment laws and evolved corporate structures. Packed with contemporary examples, this new volume is a must for those entering the engineering field or for those interested in improving their professional effectiveness. View Details

Best Science Podcasts 2018

We have hand picked the best science podcasts for 2018. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Inspire To Action
What motivates us to take up a cause, follow a leader, or create change? This hour, TED speakers explore stories of inspirational leadership, and what makes some movements more successful than others. Guests include high school history teacher Diane Wolk-Rogers, writer and behavioral researcher Simon Sinek, 2016 Icelandic presidential candidate Halla Tómasdóttir, professor of leadership Jochen Menges, and writer and activist Naomi Klein.
Now Playing: Science for the People

#474 Appearance Matters
This week we talk about appearance, bodies, and body image. Why does what we look like affect our headspace so much? And how do we even begin to research a topic as personal and subjective as body image? To try and find out, we speak with some of the researchers at the Centre for Appearance Research (CAR) at the University of the West of England in Bristol. Psychology Professor Phillippa Diedrichs walks us through body image research, what we know so far, and how we know what we know. Professor of Appearance and Health Psychology Diana Harcourt talks about visible...