6 March 2014 Joint estimation of high resolution images and depth maps from light field cameras
Author Affiliations +
Light field cameras are attracting much attention as tools for acquiring 3D information of a scene through a single camera. The main drawback of typical lenselet-based light field cameras is the limited resolution. This limitation comes from the structure where a microlens array is inserted between the sensor and the main lens. The microlens array projects 4D light field on a single 2D image sensor at the sacrifice of the resolution; the angular resolution and the position resolution trade-off under the fixed resolution of the image sensor. This fundamental trade-off remains after the raw light field image is converted to a set of sub-aperture images. The purpose of our study is to estimate a higher resolution image from low resolution sub-aperture images using a framework of super-resolution reconstruction. In this reconstruction, these sub-aperture images should be registered as accurately as possible. This registration is equivalent to depth estimation. Therefore, we propose a method where super-resolution and depth refinement are performed alternatively. Most of the process of our method is implemented by image processing operations. We present several experimental results using a Lytro camera, where we increased the resolution of a sub-aperture image by three times horizontally and vertically. Our method can produce clearer images compared to the original sub-aperture images and the case without depth refinement.
© (2014) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Kazuki Ohashi, Kazuki Ohashi, Keita Takahashi, Keita Takahashi, Toshiaki Fujii, Toshiaki Fujii, "Joint estimation of high resolution images and depth maps from light field cameras", Proc. SPIE 9011, Stereoscopic Displays and Applications XXV, 90111B (6 March 2014); doi: 10.1117/12.2042627; https://doi.org/10.1117/12.2042627


Regularized super resolution methods for light field images
Proceedings of SPIE (December 18 2013)
Spatial analysis of discrete plenoptic sampling
Proceedings of SPIE (January 24 2012)
Super-resolved refocusing with a plenoptic camera
Proceedings of SPIE (February 07 2011)
Superresolution with the focused plenoptic camera
Proceedings of SPIE (February 07 2011)

Back to Top