This paper describes the measuring and modeling of jitter effects for a manportable missile system. We present a tracking approach which reduces sensitivity to jitter induced image degradations. The tracking approach described consists of small and large target tracking algorithms. The small target algorithm reduces interlace effects by extracting target features which are relatively insensitive to interlace errors. Adaptive threshold selection and target feature extraction will be described. A sparse correlation large target tracking algorithm will also be described.