This research studied the effect of cross-talk and three-dimensional (3-D) cues upon viewers’ visual fatigue and image quality evaluation in both mirror-type 3-D displays and barrier-type autostereoscopic displays. The experiment included three parts. First, the effect of system cross-talk, shadow, and linear perspective of 3-D pictures, in a mirror-type 3-D display, was discussed. Second, an acceptable threshold level of system cross-talk was sought. Third, the fitting system cross-talk level, in barrier-type autostereoscopic displays corresponding to that in mirror-type 3-D displays, was determined. The results showed that system cross-talk, shadow, and linear perspective, which were chosen from the various depth cues to study in this research, were significantly affecting image quality evaluation when watching 3-D displays. The acceptable system cross-talk level in mirror-type 3-D displays ranged from 18% to 23%. The content of a 3-D picture was critical to influence perceived image quality of autostereoscopic displays. In this experiment, viewers did not get visual fatigue and visual discomfort when watching 3-D pictures for 10 min. Moreover, experts ranked higher than novices in evaluating 3-D image quality. The outcomes of this study could be served as a reference for the design of 3-D displays. As for future work, an interesting direction to explore will be the effect of the dynamic 3-D films on viewing experience.