Anaglyph stereo provides a portable and inexpensive way to view stereoscopic images. Rendering anaglyph, however, often suffers from ghosting which results from the viewer’s one eye receiving a weaker version of the image aimed for the other eye. In this paper, we present a novel approach to reduce ghosting in anaglyph that does not rely on power spectra of a monitor or on transmission spectra of anaglyph glasses. First, we measure the ghosting effect by the red lightness difference between a stereo pair and visual saliency estimate. Then, we formulate ghosting reduction as an energy minimization problem, which can be efficiently solved using a standard linear solver. Experimental results show that our method not only successfully reduces ghosting in anaglyph but also produces images that appear almost ordinary to the naked eye which improves the backward-compatibility of anaglyph.