No lens? No problem for FlatCam

Editor’s note: A video and links to images for download appear at the end of this release.

David Ruth
713-348-6327
david@rice.edu

Mike Williams
713-348-6728
mikewilliams@rice.edu

No lens? No problem for FlatCam

Flat camera invented at Rice University looks into the future 

HOUSTON – (Nov. 23, 2015) – How thin can a camera be? Very, say Rice University researchers who have developed patented prototypes of their technological breakthrough.

FlatCam, invented by the Rice labs of electrical and computer engineers Richard Baraniuk and Ashok Veeraraghavan, is little more than a thin sensor chip with a mask that replaces lenses in a traditional camera.

Making it practical are the sophisticated computer algorithms that process what the sensor detects and converts the sensor measurements into images and videos.

The research team will deliver a talk about its work at the Extreme Imaging Workshop Dec. 17 in Santiago, Chile, and have published a paper available via the online service ArXiv.

Traditional cameras are shrinking, driven by their widespread adoption in smartphones. But they all require lenses – and the post-fabrication assembly required to integrate lenses into cameras raises their cost, according to the researchers.

FlatCam does away with those issues in a camera that is also thin and flexible enough for applications that traditional devices cannot serve. FlatCams can be fabricated like microchips, with the precision, speed and the associated reduction in costs, Veeraraghavan said. Without lenses, he said, the most recent prototype is thinner than a dime.

“As traditional cameras get smaller, their sensors also get smaller, and this means they collect very little light,” he said. “The low-light performance of a camera is tied to the surface area of the sensor. Unfortunately, since all camera designs are basically cubes, surface area is tied to thickness.

“Our design decouples the two parameters, providing the ability to utilize the enhanced light-collection abilities of large sensors with a really thin device,” he said.

FlatCams may find use in security or disaster-relief applications and as flexible, foldable wearable and even disposable cameras, he said.

The researchers are realistic about the needs of photographers, who are far more likely to stick with their lens-based systems. But for some applications, FlatCam may be the only way to go, Baraniuk said.

“Moving from a cube design to just a surface without sacrificing performance opens up so many possibilities,” he said. “We can make curved cameras, or wallpaper that’s actually a camera. You can have a camera on your credit card or a camera in an ultrathin tablet computer.”

FlatCam shares its heritage with lens-less pinhole cameras, but instead of a single hole, it features a grid-like coded mask positioned very close to the sensor. Each aperture allows a slightly different set of light data to reach the sensor. Raw data sent to the back-end processor – for now, a desktop computer – is sorted into an image. Like much larger light field cameras, the picture can be focused to different depths after the data is collected.

Rice’s hand-built prototypes use off-the-shelf sensors and produce 512-by-512 images in seconds, but the researchers expect that resolution will improve as more advanced manufacturing techniques and reconstruction algorithms are developed. The FlatCam team is working with the Rice lab of Jacob Robinson, an assistant professor of electrical and computer engineering, to develop next-generation, directly fabricated devices.

The prototypes do not have viewfinders. Many applications won’t need one, said co-author Aswin Sankaranarayanan, but a cellphone screen may eventually serve the purpose. “Smart phones already feature pretty powerful computers, so we can easily imagine computing at least a low-resolution preview in real time,” he said.

Lead author of the paper is Rice postdoctoral researcher Salman Asif. Rice graduate student Ali Ayremlou is a co-author. Sankaranarayanan is a Rice alumnus and is now an assistant professor of electrical and computer engineering at Carnegie Mellon University. Baraniuk is the Victor E. Cameron Professor of Electrical and Computer Engineering, and Veeraraghavan is an assistant professor of electrical and computer engineering at Rice.

The National Science Foundation supported the research.

-30-

Read the paper at http://arxiv.org/abs/1509.00116

Follow Rice News and Media Relations via Twitter @RiceUNews

Video:

 

 

 

 

 

 

 

https://youtu.be/BdgwO_i5p54 

Related Materials:

Richard Baraniuk: http://web.ece.rice.edu/richb/

Ashok Veeraraghavan: http://www.ece.rice.edu/~av21/

Aswin Sankaranarayanan: http://users.ece.cmu.edu/~saswin/

George R. Brown School of Engineering: http://engr.rice.edu

Images for download:

 

 

 

 

https://news2.rice.edu/files/2015/11/1123_FLATCAM-1-WEB.jpg

Rice University’s FlatCam, thinner than a dime, is a new technology that shows promise to turn flat, curved or flexible surfaces into cameras. The device is based on a standard imaging sensor paired with a mask and decoding software. (Credit: Jeff Fitlow/Rice University)

 

 

 

 

https://news2.rice.edu/files/2015/11/1123_FLATCAM-2-WEB.jpg

Jesse Adams, left, and Vivek Boominathan, both Rice University graduate students, set up a test shot with a recent FlatCam prototype. The lens-less camera platform uses sophisticated algorithms to record images and videos and may enable such novel applications as large format, flexible and curved sensors. (Credit: Jeff Fitlow/Rice University)

 

 

 

 

https://news2.rice.edu/files/2015/11/1123_FLATCAM-3-WEB.jpg

Rice University’s FlatCam – the tiny chip attached to the circuit board — is a lens-less camera that may someday turn large or small surfaces into cameras. (Credit: Jeff Fitlow/Rice University)

 

 

 

 

https://news2.rice.edu/files/2015/11/1123_FLATCAM-4-WEB.jpg

The Rice University team developing FlatCam, from left to right: front, postdoctoral researcher Salman Asif and faculty members Richard Baraniuk, Ashok Veeraraghavan and Jacob Robinson; rear, graduate students Fan Ye, Vivek Boominathan and Jesse Adams. (Credit: Jeff Fitlow/Rice University)

Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation’s top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 3,910 undergraduates and 2,809 graduate students, Rice’s undergraduate student-to-faculty ratio is 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for best quality of life and for lots of race/class interaction by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger’s Personal Finance. To read “What they’re saying about Rice,” go http://tinyurl.com/AboutRiceUniversity.

About Mike Williams

Mike Williams is a senior media relations specialist in Rice University's Office of Public Affairs.