Background change ,shape change and target covering will all cause target tracking failure. Real-time and accuracy in target tracking is the problem that must be considered. This paper first presents the Mean Shift algorithm, then the Mean Shift algorithm iterative weight is modified with main information more prominent, secondary information suppressed, avoiding the tedious root, improving the real-time and effectiveness of target tracking：The target template updating algorithm is present to solve change of background and target shape change. Then a Kalman filter in the horizontal position and the vertical position is established to solve the problem of target tracking completely covered. Simulation results show that target tracking algorithm on the condition of target template update has higher tracking accuracy , higher real-time property and at the same time is robust than the traditional Mean Shift tracking algorithm .