Passive millimeter-wave (PMMW) imaging offers advantages over visible and IR imaging in having better all weather
performance. However the PMMW imaging sensors are state-of-the-art to date, sometimes it is required to predict and
evaluate the performance of a PMMW sensor under a variety of weather, terrain and sensor operational conditions. The
PMMW scene simulation is an efficient way. This paper proposes a framework of the PMMW simulation for ground
scenes. Commercial scene modeling software, Multigen and Vega, are used to generate the multi-viewpoint and
multi-scale description for natural ground scenes with visible images. The background and objects in the scene are
classified based on perceptive color clusters and mapped with different materials. Further, the radiometric temperature
images of the scene are calculated according to millimeter wave phenomenology: atmospheric propagation and emission
including sky temperature, weather conditions, and physical temperature. Finally, the simulated output PMMW images
are generated by applying the sensor characteristics such as the aperture size, data sample scheme and system noise.
Tentative results show the simulation framework can provide reasonable scene's PMMW image with high fidelity.