We propose an integral infrared scene simulation system. The proposed system, which is based on the parameters of the thermal physical property and optical property, computes the radiation distribution of the scenery on the focus plane of the camera according to the scene of the geometrical parameter, the position and intensity of the light source, the location and direction of the camera and so on. Then the radiation distribution is mapped to the space of gray, and we finally obtain the virtual image of the scene. The proposed system includes eight modules namely basic data maintaining, model importing, scene saving, geometry parameters setting and infrared property parameters of the scene, data pre-processing, infrared scene simulation, and scene loading. The proposed system organizes all the data by the mode of database lookup table that stores all relative parameters and computation results of different states to avoid repetitive computation. Experimental results show that the proposed system produces three dimension infrared images in real time to some extent, and can reach 60 frames/second in simple scene drawing and 20 frames/second in complex scene drawing. Experimental results also show that the simulated images can represent infrared features of the scenery to a certain degree.