Korea Astronomy and Space Science Institute (KASI) successfully developed the Near-infrared Imaging Spectrometer for Star formation history (NISS), which is a scientific payload for the next-generation small satellite-1 (NEXTSat-1) in Korea and is expected to be launched in 2018. The major science cases of NISS are to probe the star formation in local and early Universe through the imaging spectroscopic observations in the near-infrared. The off-axis catadioptric optics with 150mm aperture diameter is designed to cover the FoV of 2x2 deg with the passband of 0.95-2.5μm. The linear variable filter (LVF) is adopted as a disperse element with spectral resolution of R~20. Given the error budgets from the optical tolerance analysis, all spherical and non-spherical surfaces were conventionally polished and finished in the ultraprecision method, respectively. Primary and secondary mirrors were aligned by using interferometer, resulting in residual wave-front errors of P-V 2.7μm and RMS 0.61μm, respectively. To avoid and minimize any misalignment, lenses assembled were confirmed with de-centering measurement tool from Tri-Optics. As one of the key optical design concepts, afocal beam from primary and secondary mirrors combined made much less sensitive the alignment process between mirrors and relay lenses. As the optical performance test, the FWHM of PSF was measured about 16μm at the room temperature, and the IR sensor was successfully aligned in the optimized position at the cryogenic temperature. Finally, wavelength calibration was executed by using monochromatic IR sources. To support the complication of optical configuration, the opto-mechanical structure was optimized to endure the launching condition and the space environment. We confirmed that the optical performance can be maintained after the space environmental test. In this paper, we present the development of optical system of NISS from optical design to performance test and calibration.