We will discuss the prototype of Head Mounted Display using Holographic Optical Element in this paper. It is obvious that a single HOE can record the multiple optical images by the characteristic in itself, that is angular selectivity and wavelength selectivity. Therefore, it is very easy to understand the HOE has the function which can separate the stereoscopic images onto the left and right eyes, like as the conventional HMD. In this report, we propose the prototype of HMD using a single HOE, and we will extract the problem in application of the real industrial field, especially manufacturing and designing. Consequently, we proved that the HMD using Lippmann hologram has the potentiality of miniaturization, lightening, wide field of vision. This HMD can be suitable in the Virtual Reality field. But it is necessary to adjust the pupil distance and the incident angle of conjugate beam precisely.