Editor’s note: Links to a video and images for download appear at the end of this release.

David Ruth
713-348-6327
david@rice.edu

Mike Williams
713-348-6728
mikewilliams@rice.edu

How do you feel? Video of your face may tell all

Rice technique compensates for skin tone, light, movement to monitor vital signs 

HOUSTON – (April 6, 2015) – Rice University researchers are developing a highly accurate, touch-free system that uses a video camera to monitor patients’ vital signs just by looking at their faces. The technique isn’t new, but engineering researchers in Rice’s Scalable Health Initiative are making it work under conditions that have so far stumped earlier systems.

The Rice version, DistancePPG, can measure a patient’s pulse and breathing just by analyzing the changes in one’s skin color over time. Where other camera-based systems have been challenged by low-light conditions, dark skin tones and movement, DistancePPG relies on algorithms that correct for those variables.

The team of Rice graduate student Mayank Kumar and professors Ashok Veeraraghavan and Ashutosh Sabharwal created the system that will let doctors diagnose patients from a distance with special attention paid to those in low-resource settings. The lab’s research appeared in the Optical Society journal Biomedical Optics Express.

Kumar, the project’s lead graduate researcher, said DistancePPG will be particularly helpful to monitor premature infants for whom blood pressure cuffs or wired probes can pose a threat. In fact, they were his inspiration.

“This story began in 2013 when we visited Texas Children’s Hospital to talk to doctors and get ideas,” Kumar said. “That was when we saw the newborn babies in the neonatal ICU. We saw multiple wires attached to them and asked, ‘Why?'”

The wires monitored the babies’ pulses, heart rate “and this and that,” he recalled. “And the wires weren’t a problem. The problem was that the babies would roll, or their mothers needed to take care of them, and the wires would be taken off and put back on.” That, Kumar said, could potentially damage the infants’ delicate skin.

Kumar and his colleagues were aware of an emerging technique that used a video camera to detect nearly imperceptible changes in a person’s skin color due to changes in blood volume underneath the skin. Pulse and breathing rates can be determined from these minute changes.

That worked just fine for monitoring Caucasians in bright rooms, he said. But there were three challenges. The first was the technique’s difficulty in detecting color change in darker skin tones. Second, the light was not always bright enough. The third and perhaps hardest problem was that patients sometimes move. The Rice team solved these challenges by adding a method to average skin-color change signals from different areas of the face and an algorithm to track a subject’s nose, eyes, mouth and whole face.

“Our key finding was that the strength of the skin-color change signal is different in different regions of the face, so we developed a weighted-averaging algorithm,” Kumar said. “It improved the accuracy of derived vital signs, rapidly expanding the scope, viability, reach and utility of camera-based vital-sign monitoring.”

By incorporating tracking to compensate for movement — even a smile — DistancePPG perceived a pulse rate to within one beat per minute, even for diverse skin tones under varied lighting conditions.

Kumar said he expects the software to find its way to mobile phones, tablets and computers so people can reliably measure their own vital signs whenever and wherever they choose.

Veeraraghavan is an assistant professor of electrical and computer engineering. Sabharwal is a professor of electrical and computer engineering.

The National Science Foundation, the Texas Instruments Fellowship, the Texas Higher Education Coordinating Board and a Rice University Graduate Fellowship supported the research.

-30-

Watch a video about the project here: http://youtu.be/-jwGlLBxuH8

Read the abstract at http://www.opticsinfobase.org/boe/abstract.cfm?uri=boe-6-5-1565

Follow Rice News and Media Relations via Twitter @RiceUNews

Related Materials:

Scalable Health Initiative: http://sh.rice.edu

DistancePPG: http://sh.rice.edu/distancePPG

Ashutosh Sabharwal: http://www.ece.rice.edu/~ashu/

Ashok Veeraraghavan: http://www.ece.rice.edu/~av21/

Images for download:

https://news2.rice.edu/files/2015/04/0406_FACE-1-web.jpg

Doctors can monitor their patients’ vital signs through video by analyzing subtle changes in skin color. New software by Rice University engineers improves the technique by keying on regions of the face to help compensate for different skin tones, changes in lighting and movement. (Credit: Mayank Kumar/Rice University)

https://news2.rice.edu/files/2015/04/0406_FACE-2-web.jpg

Rice University graduate student Mayank Kumar is leading a project to refine video monitoring of vital signs by compensating for a patient’s skin tone, ambient lighting and movement. (Credit: Jeff Fitlow/Rice University)

https://news2.rice.edu/files/2015/04/0406_FACE-3-web.jpg

An algorithm created at Rice University helps a technique that uses video to monitor a patient’s vital signs to adjust for skin tones, lighting and movement. Rice’s Ashok Veeraraghavan, an assistant professor of electrical and computer engineering, sits in front of a webcam to have his pulse and breathing analyzed by the program. (Credit: Jeff Fitlow/Rice University)

https://news2.rice.edu/files/2015/04/0406_FACE-4-web.jpg

Rice University researchers are developing a touch-free system that monitors patients’ vital signs via video while compensating for skin tone, lighting and movement.

From left, researchers Ashutosh Sabharwal, Mayank Kumar and Ashok Veeraraghavan. (Credit: Jeff Fitlow/Rice University)

Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation’s top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 3,888 undergraduates and 2,610 graduate students, Rice’s undergraduate student-to-faculty ratio is 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked among some of the top schools for best quality of life by the Princeton Review and for best value among private universities by Kiplinger’s Personal Finance. To read “What they’re saying about Rice,” go to http://tinyurl.com/AboutRiceU.