We propose a new ray-space interpolation scheme using an adaptive filter. Unlike the previous works related to view interpolation, which detect disparities, our scheme adopts a simple signal processing method; adaptive filtering to Epipolar Plane Image (EPI). First, the original EPI is up- sampled. Then, for each pixel to be interpolated, the block surrounding the pixel is analyzed and the best filter is selected according to the analysis. The filter set includes various interpolation filters with different directionality. Finally, we apply the filter to up-sampled EPI and generate the intermediate ray-space data. Since our scheme does not need pattern matching, it requires less computation cost than the conventional interpolation schemes, and therefore, it is very fast and suitable for hardware implementation. Experimental results show that the proposed scheme interpolates ray-space data with higher PSNR than other interpolation methods, such as nearest neighbor interpolation, the linear interpolation and block matching interpolation.