This paper describes an arbitrary viewpoint 3D display system that is a new concep of a 3D display. This system consists of a multivie camera system for 3D data capturing and a real-time color autostereoscopic display system to show an arbitrary viewpoint 3D image. This 3D display system is based on the reconstruction of parallax rays, and it is one of real-time integral imaging systems. To reconstruct a 3D image, the ray-space method is used. By using similarities between the reference plane in the ray-space representation and the screen of the 3D display system, the ray data to display a real 3D object can be obtained with multiview images. Moreover, an arbitrary ray data can be synthesized from captured multiview images. Therefore, an arbitrary viewpoint 3D image can be reconstructed by the 3D display system. This paper describes the principle of an arbitrary viewpoint 3D display system, and also describes the experimental results.