A Vibe improved algorithm based on HIS color space and a watershed algorithm are used to obtain the smoke contours. The Vibe algorithm is used to extract smoke anomalies and smoke inaccuracies. In this paper, the classical Vibe algorithm is described, and the existing problems in the smoke detection are analyzed. A Vibe algorithm is proposed to change the gray color space and the HIS color space by using the color feature information and Vibe. The influence of light and shadow on the smoke extraction noise is reduced by using the difference of pixel value based on Euclidean distance. The problem of imprecision of smoke caused by Vibe algorithm is analyzed by using the watershed algorithm. Finally, the proposed method is evaluated by Barnich experiment standard. The experimental results show that the proposed method can extract the smoke profile more accurately and has good robustness.