Editor’s note: Links to videos and high-resolution images for download appear at the end of this release.

David Ruth
713-348-6327
david@rice.edu

Mike Williams
713-348-6728
mikewilliams@rice.edu

Helping hands guide robots as they learn

Rice University engineers refine method to instruct robots to collaborate through demonstration

HOUSTON – (Dec. 4, 2017) – Like toddlers, robots can use a little help as they learn to function in the physical world. That’s the purpose of a Rice University program that gently guides robots toward the most helpful, human-like ways to collaborate on tasks.

Rice engineer Marcia O’Malley and graduate student Dylan Losey have refined their method to train robots by applying gentle physical feedback to machines while they perform tasks. The goal is to simplify the training of robots expected to work efficiently side by side with humans.

A paper on their study appears in IEEE Explore.

“Historically, the role of robots was to take over the mundane tasks we don’t want to do: manufacturing, assembly lines, welding, painting,” said O’Malley, a professor of mechanical engineering, electrical and computer engineering and computer science. “As we become more willing to share personal information with technology, like the way my watch records how many steps I take, that technology moves into embodied hardware as well.

Rice University researchers led by graduate student Dylan Losey want to help humans and robots collaborate by enabling interactive tasks like rehabilitation, surgery and training programs in which environments are less predictable. In early studies, Losey and colleagues at the University of California, Berkeley, used gentle feedback to train a robot arm to manipulate a coffee cup in real time. Photo by Andrea Bajcsy

“Robots are already in our homes vacuuming or controlling our thermostats or mowing the lawn,” she said. “There are all sorts of ways technology permeates our lives. I already talk to Alexa in the kitchen, so why not also have machines we can physically collaborate with? A lot of our work is about making human-robot interactions safe.”

According to the researchers, robots adapted to respond to physical human-robot interaction (pHRI) traditionally treat such interactions as disturbances and resume their original behaviors when the interactions end. The Rice researchers have enhanced pHRI with a method that allows humans to physically adjust a robot’s trajectory in real time.

At the heart of the program is the concept of impedance control, literally a way to manage what happens when push comes to shove. A robot that allows for impedance control through physical input adjusts its programmed trajectory to respond but returns to its initial trajectory when the input ends.

The Rice algorithm builds upon that concept as it allows the robot to adjust its path beyond the input and calculate a new route to its goal, something like a GPS system that recalculates the route to its destination when a driver misses a turn.

Losey spent much of last summer in the lab of Anca Dragan, an assistant professor of electrical engineering and computer sciences at the University of California, Berkeley, testing the theory. He and other students trained a robot arm and hand to deliver a coffee cup across a desktop, and then used enhanced pHRI to keep it away from a computer keyboard and low enough so that the cup wouldn’t break if dropped. (A separate paper on the experiments appears in the Proceedings of Machine Learning Research.)

Marcia O’Malley and Dylan Losey.

The goal was to deform the robot’s programmed trajectory through physical interaction. “Here the robot has a plan, or desired trajectory, which describes how the robot thinks it should perform the task,” Losey wrote in an essay about the Berkeley experiments. “We introduced a real-time algorithm that modified, or deformed, the robot’s future desired trajectory.”

In impedance mode, the robot consistently returned to its original trajectory after an interaction. In learning mode, the feedback altered not only the robot’s state at the time of interaction but also how it proceeded to the goal, Losey said. If the user directed it to keep the cup from passing over the keyboard, for instance, it would continue to do so in the future. “By our replanning the robot’s desired trajectory after each new observation, the robot was able to generate behavior that matches the human’s preference,” he said.

Further tests employed 10 Rice students who used the O’Malley lab’s rehabilitative force-feedback robot, the OpenWrist, to manipulate a cursor around obstacles on a computer screen and land on a blue dot. The tests first used standard impedance control and then impedance control with physically interactive trajectory deformation, an analog of pHRI that allowed the students to train the device to learn new trajectories.

The results showed trials with trajectory deformation were physically easier and required significantly less interaction to achieve the goal. The experiments demonstrated that interactions can program otherwise-autonomous robots that have several degrees of freedom, in this case flexing an arm and rotating a wrist.

One current limitation is that pHRI cannot yet modify the amount of time it takes a robot to perform a task, but that is on the Rice team’s agenda.

“The paradigm shift in this work is that instead of treating a human as a random disturbance, the robot should treat the human as a rational being who has a reason to interact and is trying to convey something important,” Losey said. “The robot shouldn’t just try to get out of the way. It should learn what’s going on and do its job better.”

The National Science Foundation supported the research.

-30-

Read the abstract at http://ieeexplore.ieee.org/document/8115323/

Learning robot objectives from physical human interaction: http://proceedings.mlr.press/v78/bajcsy17a/bajcsy17a.pdf

Follow Rice News and Media Relations via Twitter @RiceUNews

Videos:

https://www.youtube.com/watch?v=I2YHT3giwcY

https://www.youtube.com/watch?v=9xGBaM6ZlOE

Related materials:

Mechatronics and Haptic Interfaces Lab (O’Malley group): http://mahilab.rice.edu

Rice Department of Mechanical Engineering: https://mech.rice.edu

George R. Brown School of Engineering: https://engineering.rice.edu

Images for download:

http://news.rice.edu/files/2017/11/1204_ROBOT-1-WEB-zi4mk7.jpg

Marcia O’Malley and Dylan Losey. (Credit: Rice University)

http://news.rice.edu/files/2017/12/1204_ROBOT-3-WEB-s3irta.jpg

Rice University researchers led by graduate student Dylan Losey want to help humans and robots collaborate by enabling interactive tasks like rehabilitation, surgery and training programs in which environments are less predictable. In early studies, Losey and colleagues at the University of California, Berkeley, used gentle feedback to train a robot arm to manipulate a coffee cup in real time. (Credit: Andrea Bajcsy)

Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation’s top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 3,879 undergraduates and 2,861 graduate students, Rice’s undergraduate student-to-faculty ratio is 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for quality of life and for lots of race/class interaction and No. 2 for happiest students by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger’s Personal Finance. To read “What they’re saying about Rice,” go to http://tinyurl.com/RiceUniversityoverview.