We presented the digital holography (DH) system with enhanced image quality. While conventional DH uses highcoherence laser for illuminations, the speckle noise included in the image degrades the quality of the reconstructed data. To reduce the noise regards to the light source, lower-coherence light source could be applied in DH system. In this paper, the quantum dot (QD) based wavelength converter is utilized as the light source. Compared with light-emitting diode (LED), QD-based light source could be applied to versatile system, including dual-wavelength DH. Due to the low coherence both temporally and spatially, spatial filtering and collimation is presented. Also, numerical processes including noise reduction and aberration compensation is described to enhance the quality of the image. By experimental verifications, the proposed DH system shows better quality compared with conventional system, which is enough to utilize the quantitative measurement.