With the increasing of human space activities, space debris increases sharply, and this will seriously threaten the safety of spacecraft in orbit. In order to meet the requirements of spacecraft on-orbit service, space detectors can be used to identify and detect non-cooperative objects such as space debris around orbit, which will reduce the impact probability of spacecraft on-orbit and ensure the sustainable use of orbital resources. In order to improve the probability of on-orbit detection, it is necessary to conduct sufficient simulation and verification tests on the ground to ensure the effectiveness of on-orbit detection. On the basis of large cryogenic radiometric calibration optical system, a set of optical hardware-in-the-loop simulation and verification system is proposed in this paper, including large space environment simulator, large cryogenic projection system, optical target simulation system, target attitude simulator, central control system, etc. At present, the technology has been applied to the ground performance test of a space camera, which verifies the influence of target jitter on the image detection effect, and obtains a large number of experimental data, and achieves satisfactory results. In the future, this technology will be studied in depth, mainly to improve the accuracy of target simulation, expand the types of simulation targets and increase the joint validation function of the system. It will continue to be applied in the system-level performance verification of space detectors, and it will have broad application prospects and important practical significance in space on-orbit service tasks.