The vast majority of structured light applications are dedicated to range measurement of non-moving objects. In this paper we present a method for obtaining 3D information from a complex scene with moving objects using a simple structured light pattern, namely a dot matrix. The major problem of structured light techniques - the correspondence problem - is usually solved either by involving a sophisticated pattern (color, thickness, code) or by taking advantage of the spatial properties of the pattern and the scene (rotation of the pattern, restricting the working volume, ordering constraint). Our approach enhances the spatial methods by involving the temporal properties of the scene by tracking the projected dot pattern over a sequence of images. Due to this combination of spatial and temporal information, the method solves the correspondence problem very robustly and up to 10 times faster than an algorithm based on spatial information only. Dot splitting, dot disappearance and dot occlusions are detected. We demonstrate our method on several real sequences. In order to evaluate the performance of the method, we performed extensive evaluation on simulated data. The presented method for obtaining coarse temporal 3D information is very simple and fast, which makes it attractive for various surveillance applications.