Although some progresses have been achieved by the traditional diagnostic methods, such as X mammography, computer tomography (CT) imaging and magnetic resonance imaging (MRI) etc, their applications are limited by some drawbacks to some extent. As a more promising alternative method, the breast tumor diagnosis method based on infrared spectrometer was introduced. According to the theory of spectral unique characteristics for matter, i.e. the spectrums are different for the matter with different properties, so the spectrums are different between the tumor and normal tissues. Therefore, a spectrometer system was developed to diagnose the breast tumor in this paper. Meanwhile, a spectrophotometer for breast tumor diagnostic spectrometer was designed, and the plane holography concave (PHV) grating was used as the dispersion device in this spectrophotometer because of excellent performances. In this system, linear CCD detector combined with PCI data acquisition card was used as the spectral detector, and the virtual instruments (VI) technique was used to control the data acquisition and data processing. In experiments, the spectral calibration based on mercury lamp was performed. Experimental results illustrated that the construction of the spectrophotometer system is available, the spectral range is from 300-850nm, its wavelength resolution reached 2nm. The simulation experimental result proved that the design of the diagnostic system was very satisfied and diagnostic method was also feasible.