In order to make small infrared cloud measuring device can be well in a wide temperature range and day-night environment, a design idea using catadioptric infrared panoramic imaging optical system and simple mechanical structure for realizing observation clode under all-weather conditions was proposed. Firstly, the optical system of cloud measuring device was designed. An easy-to-use numerical method was proposed to acquire the profile of a catadioptric mirror, which brought the property of equidistance projection and played the most important role in a catadioptric panoramic lens. Secondly, the mechanical structure was studied in detail. Overcoming the limitations of traditional primary mirror support structure, integrative design was used for refractor and mirror support structure. Lastly, temperature adaptability and modes of the mirror support structure were analyzed. Results show that the observation range of the cloud measuring device is wide and the structure is simple, the fundamental frequency of the structure is greater than 100 Hz, the surface precision of the system reflector reaches PV of λ/10 and RMS of λ/40under the load of temperature range - 40 ~ 60°C, it can meet the needs of existing meteorological observation.