In this paper, the utilization of morphological pyramids for object tracking is detailed. Image pyramids, constructed via morphological operations and subsampling, have been previously applied to the image compression and progressive transmission problems. We extend the application of the morphological pyramid to the video tracking problem—following the position of a previously identified moving object in a sequence of video frames. Morphological pyramids allow both a considerable tolerance of noise and a saving in computational time for video tracking. Experimental results from the application of the morphological pyramid to noisy IR image sequences are presented. Our results show that the computational efficiency of the morphological pyramid for tracking significantly improves upon the traditional fixed resolution approach by organizing a search from coarse to fine. Furthermore, the morphological pyramid significantly enhances performance over the comparable linear pyramid methods.