6 March 2014 Joint estimation of high resolution images and depth maps from light field cameras
Author Affiliations +
Proceedings Volume 9011, Stereoscopic Displays and Applications XXV; 90111B (2014); doi: 10.1117/12.2042627
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States
Abstract
Light field cameras are attracting much attention as tools for acquiring 3D information of a scene through a single camera. The main drawback of typical lenselet-based light field cameras is the limited resolution. This limitation comes from the structure where a microlens array is inserted between the sensor and the main lens. The microlens array projects 4D light field on a single 2D image sensor at the sacrifice of the resolution; the angular resolution and the position resolution trade-off under the fixed resolution of the image sensor. This fundamental trade-off remains after the raw light field image is converted to a set of sub-aperture images. The purpose of our study is to estimate a higher resolution image from low resolution sub-aperture images using a framework of super-resolution reconstruction. In this reconstruction, these sub-aperture images should be registered as accurately as possible. This registration is equivalent to depth estimation. Therefore, we propose a method where super-resolution and depth refinement are performed alternatively. Most of the process of our method is implemented by image processing operations. We present several experimental results using a Lytro camera, where we increased the resolution of a sub-aperture image by three times horizontally and vertically. Our method can produce clearer images compared to the original sub-aperture images and the case without depth refinement.
© (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Kazuki Ohashi, Keita Takahashi, Toshiaki Fujii, "Joint estimation of high resolution images and depth maps from light field cameras", Proc. SPIE 9011, Stereoscopic Displays and Applications XXV, 90111B (6 March 2014); doi: 10.1117/12.2042627; https://doi.org/10.1117/12.2042627
PROCEEDINGS
7 PAGES


SHARE
KEYWORDS
Image resolution

Cameras

Super resolution

Image processing

Spatial resolution

Lawrencium

Image sensors

RELATED CONTENT

Optical performance analysis of plenoptic camera systems
Proceedings of SPIE (September 25 2014)
Correlation plenoptic imaging
Proceedings of SPIE (June 26 2017)
Super-resolution PMD camera for applied metrology
Proceedings of SPIE (March 03 2016)
Spatial analysis of discrete plenoptic sampling
Proceedings of SPIE (January 24 2012)
Super-resolved refocusing with a plenoptic camera
Proceedings of SPIE (February 07 2011)
Superresolution with the focused plenoptic camera
Proceedings of SPIE (February 07 2011)

Back to Top