Due to inclement weather caused frequently, such as clouds, fog , rain etc. The light intensity on the illuminated objects falls sharply, it make the scenes captured unclear, poor visual quality and low contrast degree. To improve the overall quality of these images, especially the bad illuminated images, the paper propose a new color image enhancement algorithm which is based on multi-scale Retinex theory with color recovering factor (MSRCR) and the human visual system (HVS). It can effectively solve the problem of the color balance of digital images by removing the influence of light and obtain component images reflected the reflex of the object surface, meanwhile, reduce the impact of non-artificial factors and overcome the Ringing effect and human interference. Through comparison and contrast among experiments, that combined evaluated parameters on enhancement image, such as variance, average gradient, sharpness and so forth with the traditional image enhancement methods, such as histogram enhancement, adaptive histogram enhancement, the MSRCR algorithm is proved to be effective in image contrast, detail enhancement and color fidelity, etc.