The 3D display using super high-density multi-view images is expected as a display that enables to reproduce natural stereoscopic view. In this super multi-view display system, viewpoints are sampled at an interval narrower than the diameter of a pupil of an eye. With the parallax produced by the single eye, this system has a possibility to pull out the accommodation of an eye to an object image. This research aims at a real-time view interpolation system for the super multi-view 3D display. We have developed an evaluation system. Multi-view images of the object are captured by multi-view camera by convergence capturing in order to prevent resolution degradation. The main processing of the data processing is view interpolation and rectification. View interpolation is implemented on a high- speed image processing board using DSP chips or SIMD parallel processor chips. As for the view interpolation algorithm, we adopted an adaptive filtering technique on EPI. By this technique, multi-view images are interpolated adaptively by the most suitable filters on the EPIs. Rectification is a preprocessing and changes the multi-view images of the multi-view camera in convergence capturing into the ones in parallel capturing. By using rectified multi-view images, it is enabled to attain improvement in the processing speed that the view interpolation processing should be performed in only horizontal line.
The 3D display using super multi-view images is expected as a display that enables to reproduce natural stereoscopic view. This 3D display needs about 100 views ideally, but actually available view sources from cameras are 10 - 20. So real-time view interpolation is needed. This research aims at a real- time view interpolation system. We have developed a prototype system that inputs four video images and generates several views. The system consists of two parts: acquisition part and data processing unit. The acquisition part has a multi-view camera that has four video cameras on the X-theta mechanical stage. It captures four view images and multiplexes them into digital signal stream. The data processing unit has four DSP chips and performs camera calibration and view interpolation, so that various processing algorithms can be examined. As for the view interpolation, we adopted an adaptive filtering technique on EPI. By this technique, multi-view images are interpolated on the EPIs adaptively by the most suitable filters. And, in order to perform view interpolation with high accuracy, camera calibration is studied. The details of the prototype system, examination of view interpolation and camera calibration are described.
The 3D research project has been developing the 3D display system in which natural obserbation is realized in Telecommunication Advancement Organization (TAO) in Japan. Here, recent results are mentioned. <p> </p> The researches are mainly classified in three parts. The first research is the development of 3D display apparatus that realizes super-multi-view condition. The second one is the development of image processing system which generates the super-multi-view video signals. The third is the research to measure the eye control states when super-multi-view 3D images are observed, and the development of the measuring system.
We have developed a new contact-type color image sensor for personal use. Three color light emitted diodes are used, for illuminating source of document. The photodiode MOS image sensor chips are used for the photodetector element, which has superior linearity characteristic. It scans an A-size document in 25 seconds at 300 dots per inch. This color image sensor is compact and very low power, so its is most suitable to sheetfed color scanner.
We have developed a contact-type color image sensor for use in color scanners and color copy machines. This sensor features a high-precision array of phototransistor chips fitted with RGB color filters. It scans an A4-size document in 10 seconds with a high resolution 400 DPI. This sensor is compact and easy to use, and does not require special sensor drivers, a read-position compensation memory or spurious color suppression circuit. A color image sensor, rod lens array, fluorescent lamp, and drive circuit board are built in.