A stereoscopic approach for 3D terrain reconstruction from IR aerial image sequences is presented. The image sequence is captured in the so-called push-broom mode in which the same terrain is viewed by the aircraft from two different locations with two opposite viewing angles. Furthermore, a high frame rate IR imaging system mounted on a relatively slow speed aircraft allows the acquisition of a sub-pixel resolution image sequence, in which one physical point in the scene appears in several consecutive images at the same location. The proposed terrain reconstruction is carried out in three steps: first, two superimages (SI), representing an extended area of the viewed scene, are constructed from the forward and backward sequences. Each line of a SI is a weighted combination of a series of lines, each one extracted from a different image, at locations corresponding to the same scene elements. The determination of the set of lines in consecutive images to be combined into one line of the SI is accomplished through a correlation-based global matching procedure between images. In the second step, a multiresolution matching technique is applied on pairs of images extracted from the SIs, using a matching approach which relies on multiple matching cues in the infrared images. The final step consists of the absolute depth map computation, making use of the previous matching results and the prior knowledge about the geometrical configuration of the sensor at the two viewing locations.