Compared with the visible light imaging system, the infrared imaging system is more uncertain and unstable. Visible system is stable and mature, and the image quality less affected by ambient light, temperature, and other factors. The infrared detectors have a more complex process, there are many non-uniformity problems. The image quality has great influence from the environment, and the effect of temperature on the image is most serious. Especially with a closed infrared system, deterioration of image is very obvious with the temperature. The infrared detectors are vastly different, not only do the various manufacturers have different detector performance, but also detectors from the same batch by the same manufacturer; the image changes with the ambient temperature are not the same. In this case, calibration and debug of the image system is very difficult. Even when you get a better result in one system, it’s difficult to apply to another system. This paper presents a real-time temperature-based correction algorithm for infrared image, and encapsulate it to configurable parameters, reusable IP core, which is based on Altera’s Qsys platform, and use the Avalon-MM and Avalon-ST bus. The image data stream via the IP core by Avalon-ST bus, and the image correction parameters configured by controller through Avalon-MM bus. The IP core read from temperature chip to get ambient temperature, and correct image according to the parameters. The IP core has such a high degree of reusability and portability because compatibility for Qsys platform and using Avalon interface. And people can see the system output results in real time through the adjustable parameters. So this IP core can accelerate the development of product.