The infrared video image pseudo-color processing system, emphasizing on the algorithm and its implementation for measured object’s 2D temperature distribution using pseudo-color technology, is introduced in the paper. The data of measured object’s thermal image is the objective presentation of its surface temperature distribution, but the color has a close relationship with people’s subjective cognition. The so-called pseudo-color technology cross the bridge between subjectivity and objectivity, and represents the measured object’s temperature distribution in reason and at first hand. The algorithm of pseudo-color is based on the distance of IHS space. Thereby the definition of pseudo-color visual resolution is put forward. Both the software (which realize the map from the sample data to the color space) and the hardware (which carry out the conversion from the color space to palette by HDL) co-operate. Therefore the two levels map which is logic map and physical map respectively is presented. The system has been used abroad in failure diagnose of electric power devices, fire protection for lifesaving and even SARS detection in CHINA lately.