A novel video tracking system based on fringe tracking and camera tracking is developed to simultaneously measure the spatial position and the body deformation of a swimming fish. The system control module consists of a fringe pattern tracking system that includes one rotating tracking mirror and a fringe pattern projector, and a video tracking system that includes another rotating tracking mirror and a high-speed camera. The two mirrors are mounted on two step-motors respectively. In the control module, a tracking gate technique based on the target trajectory identification and prediction algorithm is developed. The control module, through the two tracking mirrors, drives the fringe pattern projector and a high-speed camera to track the swimming fish. The rotating angles of tracking mirrors are recorded simultaneously. Body position and deformation are measured from the distorted fringes by the triangulation. We successfully apply the system to a swimming fish.