An algorithm for multiview images captured by a parallel multicamera array is presented. An ergodic method is proposed for tracing the ideal rotation matrix and the preferred locations of the optical centers. Moreover, the camera’s intrinsic parameters are optimized in order to obtain the ideal projection matrix from which the image rectifying transform matrix (IRTM) is further derived. Then, the multiview image is rectified based on the IRTM. Experimental results show that this proposed algorithm dramatically improves accuracy. Moreover, the robustness of this algorithm is superior to the robustness of the previous method.