Rice engineers design single-pixel camera that takes high-resolution images

A pixel’s worth 1,000 words
Rice engineers design single-pixel camera that takes high-resolution images

BY JADE BOYD
Rice News staff

For all their ease and convenience, few things are more wasteful and inefficient than digital cameras. They’re loaded with pricey microprocessors that chew through batteries at a breakneck pace, crunching millions of numbers per second in order to throw out up to 99 percent of the information flowing through the lens.

Using some new mathematics and a silicon chip covered with hundreds of thousands of mirrors the size of a single bacterium, engineers at Rice University have come up with a more efficient design. Unlike a one-megapixel camera that captures one million points of light for every frame, Rice’s camera creates an image by capturing just one point of light, or pixel, several thousand times in rapid succession. The new mathematics comes into play in assembling the high-resolution image — equal in quality to the one-megapixel image — from the thousands of single-pixel snapshots.

The research will be presented Oct. 11 at the Optical Society of America’s 90th annual meeting, “Frontiers in Optics 2006,” in
Rochester, N.Y.

The oddest part about Rice’s camera might be that it works best when the light from the scene under view is scattered at random and turned into noise that looks like a television tuned to a dead channel.

“White noise is the key,” said Richard Baraniuk, the Victor E. Cameron Professor of Electrical and Computer Engineering. “Thanks to some deep new mathematics developed just a couple of years ago, we’re able to get a useful, coherent image out of the randomly scattered measurements.”

Baraniuk’s collaborator, Kevin Kelly, assistant professor of electrical and computer engineering, built a working prototype camera using a digital micromirror device, or DMD, and a single photodiode, which turns light into electrical signals. Today’s typical retail digital camera has millions of photodiodes, or megapixels, on a single chip.

DMDs, which are fabricated by Texas Instruments and used today primarily in digital televisions and projectors, are devices capable of converting digital information to light and vice versa. Built on a microchip chassis, a DMD is covered with tiny mirrors, each about the size of a microbe, that are capable of facing only two directions. They appear bright when facing one way and dark when facing the other, so when a computer views them, it sees them as ones or zeros.

In a regular camera, a lens focuses light for a brief instant onto a piece of film or a photodiode array. In the single-pixel camera, the image from the lens is shone onto the DMD and bounced from there though a second lens that focuses the reflected light onto a single photodiode. The mirrors on the DMD are shuffled at random for each new sample. Each time the mirrors shift, a new pixel value is recorded by the photodiode. In effect, the lens and DMD do what the power-hungry microchip in the digital camera usually does: They compress the data from the larger picture into a more compact form. This is why the technique is called “compressive sensing.”

Today, it takes about five minutes to take a picture with Rice’s prototype camera, which fills an entire corner of one of the tables in Kelly’s laboratory. So far, only stationary objects have been photographed, but Kelly and Baraniuk said they should be able to adapt the photographic technique to produce images similar to a home snapshot. However, their initial efforts are aimed at developing the camera for scientific applications where digital photography is unavailable.

“For some wavelengths outside the visible spectrum, it’s often too expensive to produce large arrays of detectors,” Kelly said. “One of the beauties of our system is that it only requires one detector. We think this same methodology could be a real advantage in terahertz imaging and other areas.”

The research is funded by the Defense Advanced Research Projects Agency, the Office of Naval Research, the National Science Foundation, the Air Force Office of Scientific Research and Texas Instruments’ Leadership University Program.