18 November 2013 Review and analysis of avionic helmet-mounted displays
Author Affiliations +
Optical Engineering, 52(11), 110901 (2013). doi:10.1117/1.OE.52.11.110901
Abstract
With the development of new concepts and principles over the past century, helmet-mounted displays (HMDs) have been widely applied. This paper presents a review of avionic HMDs and shows some areas of active and intensive research. This review is focused on the optical design aspects and is divided into three sections to explore new optical design methods, which include an off-axis design, design with freeform optical surface, and design with holographic optical waveguide technology. Building on the fundamentals of optical design and engineering, the principles section primarily expounds on the five optical system parameters, which include weight, field of view, modulation transfer function, exit pupil size, and eye relief. We summarized the previous design works using new components to achieve compact and lightweight HMDs. Moreover, the paper presents a partial summary of the more notable experimental, prototype, fielded, and future HMD fixed-wing and rotary-wing programs.
Li, Zhang, Shi, Qu, Wu, and Zhang: Review and analysis of avionic helmet-mounted displays

1.

Introduction

The performance of a fire-control system is an important index used to characterize the performance of modern fighter planes. If fighter pilots depend only on their eyes when flying over a battlefield, they would not have the advantage in rapidly changing modern warfare. If the fire-control radar that was developed in the 1950s is a milestone in the history of fighter aircraft, then the helmet-mounted display (HMD) is another. HMDs can cross-link short-range air-to-air missiles, the seeker head of which is constantly on alert, to truly realize “first look, first shoot.” Therefore, HMDs allow the pilots to focus only on data displayed on the goggles and frees them from complex instrumentation operations. Since aircraft speeds are faster than ever, traditional onboard aiming devices cannot suit the needs of modern air warfare. Thus, the advent of the HMDs solved this difficult problem. According to a study by the Israeli Research Institute, operational capacities of fighter planes armed with HMDs have increased by three times.

An HMD is a device used in some modern aircraft, especially combat aircraft. HMDs project information in a manner similar to head-up displays (HUDs) on an aircrew’s visor or reticle. HMDs allow pilots to obtain situational awareness and/or cue weapon systems to the direction their head is pointing. Applications that allow cuing of weapon systems are referred to as helmet-mounted sight and display or helmet-mounted sights (HMS).

According to the U.S. Army rotary-wing aviation standards of 2000, for a system to be classified as an HMD it must consist of at least an image source, collimating optics in a head mount, and a head-directed sensor.1 Figure 1 shows a block diagram showing the four elements of the U.S. Army rotary-wing aviation HMD: image source, display optics, helmet, and head/eye tracker.

Fig. 1

Block diagram of a basic U.S. army rotary-wing aviation helmet-mounted display (HMD).

OE_52_11_110901_f001.png

In 2007, Manning and Rash2 provided a more generalized description of HMDs that is pertinent to both military and commercial applications. The same basic four elements are employed, but the scopes are expanded.

  • 1. A mounting platform, which can be a simple headband or complicated full flight helmet.

  • 2. An image source for generating the information images that is optically presented to user’s eyes. There have been some dramatic recent advances in the sources since the emergence of light-emitting diodes (LEDs). Organic LEDs (OLEDs), which could become an ideal display for HMDs, are still not as bright as they could be. Similar to other displays, they suffer from the lack of a viable supply chain.

  • 3. Relay optics, which transfer information to the eyes at the image source, typically consist of a sequence of optical elements.

  • 4. A head-tracker, which is optional if HMD is only used to show the status information using nonspatially referenced symbols.

There are several HMD classification schemes3 that can be employed, including those based on an image source, image display technology, imagery presentation mode, and optical design approach. For example, Shontz and Trumm3 defined three HMD categories: one-eye, occluded; one-eye, see-through; and two-eye, see-through. This classification scheme was based on the mode by which the imagery is presented to the eyes. The classification of HMDs by optical design is even more complicated. The simpler and more predominant types of HMDs use optical designs based on the reflective and refractive lens elements that relay the HMD image to the eye. There are many other optical design approaches. For example, in 1994, Cameron and Steward4 provided an HMD type that is based on a visor projection. Vos and Brandt gave another approach that allows for low weight and provides a compact design using holographic optical elements.5 Meanwhile, in 1995, Johnston and Willey proposed a different design6 that used lasers to scan and relay an image directly onto the retina of the user’s eye. Finally, an optical design approach,7 which uses wave-guide technology, was recently reported by BAE Systems.

2.

Brief Historical Overview Since 1916

The official history of HMDs starts nearly a century ago with Albert Bacon Pratt of Lyndon, Vermont.8 During the height of World War I, between 1915 and 1917, Albert was awarded a series of U.S. and U.K. patents for an “Integrated helmet mounted aiming and weapon delivery system,” which is shown in Fig. 2. The concept and the potential applications9,10 of HMDs have fascinated military strategists for decades. As a result, various militaries from across the world have actively pursued the research, development, application, and fleet introduction of many helmet-mounted technologies for over 40 years. One of the earliest HMD sighting systems to be fielded was the electromechanical linkage head-tracked sight that was used to direct the fire of a gimbaled gun in the U.S. Army’s AH-1G Huey Cobra attack helicopter during the 1970s.11 The first aircraft containing simple HMD devices appeared for experimental purposes to aid in targeting heat seeking missiles in 1975.

Fig. 2

Albert Pratt’s helmet-mounted display.

OE_52_11_110901_f002.png

After the Cobra head tracker system, the Navy introduced an electro-optical head-tracking system into the Phantom F-4J and F-4N fixed-wing jet aircraft and coupled it with the radar and AIM-9H Sidewinder missiles12 in 1973 to 1979. Honeywell Corporation introduced the visual target acquisition system (VTAS)13 that consisted of photodiodes on either side of a halo assembly, which was mounted on the standard fixed-wing flight helmet. The VTAS was the first generation of HMDs whose performance was simple and could only display the azimuth of the signals. The field of view (FOV) was only 3 to 6 deg.

VTAS received praise for its effectiveness in targeting off-boresight missiles; however, the United States did not attempt to field it; it was integrated into late-model Navy F-4 Phantoms equipped with the AIM-9 Sidewinder. HMDs were also introduced in helicopters during this time. VTAS was discontinued in the 1970s because of its technological limitations.

The first complete visually coupled system to achieve operational use was the integrated helmet and display sight system (IHADSS)14 introduced by the U.S. Army in the AH-64 Apache attack helicopter in 1984. It was a new helmet concept in which the role of the helmet was expanded to provide a visually coupled interface between the aviator and aircraft. The head tracking electro-optical technology in the IHADSS was similar to the Navy’s VTAS. However, the HMD technology was much more capable and provided higher-resolution dynamic video imagery by using a miniature 1 in cathode ray tube (CRT) with relay optics.15

The Honeywell IHADSS is a monocular system used in all current Apache and Mangusta attack helicopters.16 A recent major upgrade makes the IHADSS compatible with the Apache’s Arrowhead PNVS thermal imager. The CRT-based display unit attaches to the side of the helmet and feeds the pilotage, navigation, and weapon-aiming symbology and imagery from the nose-mounted infrared camera to the crewmember’s right eye via a half-mirror optical combiner. The helmet, designed for use with night vision goggles (NVG), features a 40 deg horizontal (H) by 30 deg vertical (V) FOV and an electro-optical head tracker, and it may be upgraded by adding a plug-and-play night HUD module.

The Israeli display and sight helmet (DASH) III was the first modern Western HMD to achieve operational service. The development of DASH began during the mid-1980s when the Israeli Air Force issued a requirement for F-15 and F-16 aircraft. The first design entered production around 1986, while the current GEN III helmet entered production during the early-to-mid 1990s. The DASH GEN III featured a completely embedded design in which the complete optical and position sensing coil package was built into the helmet, either the United States Air Force standard HGU-55/P or the Israeli standard HGU-22/P, using a spherical visor to provide a collimated image to the pilot.17 A quick-disconnect wire powered the display and carried the video drive signals to the helmet’s CRT. DASH was closely integrated with the aircraft’s weapon system via an MIL-STD-1553B bus.

The DASH HMS system by Elbit Systems was the second generation of HMDs that could display the azimuth of the signals as well as the customary flight and navigation data. Its FOV reached 20 deg; however, the majority of the second-generation HMD systems18 were monocular. Therefore, the scope of its applicability was limited. The DASH III has been exported and integrated into various legacy aircrafts, including the MIG-21. It also forms the baseline technology for the U.S. joint helmet-mounted cueing system (JHMCS).

After the U.S. withdrawal from the advanced short range air-to-air missile, the U.S. pursued and fielded the JHMCS in conjunction with the Raytheon AIM-9 X for the 12th and 19th Fighter Squadrons at Elmendorf AFB, Alaska. The Navy conducted a research development test and evaluation on the F/A-18C as the lead JHMCS platform, but instead fielded it first on the F/A-18 Super Hornet E and F aircraft in 2003. The USAF is also integrating the JHMCS into its F-15E and F-16 aircrafts.

The JHMCS utilizes magnetic head tracker technology and provides a monocular visor-projected display of stroke-written dynamic symbology from a ½-inch miniature CRT and relay optics.19 The JHMCS provides a daytime air-to-air and air-to-ground off-boresight targeting capability, which is valuable when used with the high off-boresight missile seeker technology.

The third generation of HMDs, led by the JHMCS of the U.S. Air Force, has >40deg FOV, can display all the HUD data on the goggles, and can display an image or video signal from the night vision or infrared imaging equipment.

3.

Optical Design for HMD

The HMD optical system delivers image or video information, which comes from the source images to the pilot’s sight.20,21 It is not only relevant to the image quality, but also interrelated with weight and comfort of HMDs. Thus, a key question is how to design an HMD optical system.

The idea of a single optimal HMD design is an unobtainable goal because of the many variations in user tasks and the users themselves.22 For example, the specifications for an HMD designed for the pilot of a fighter jet flying at 10,000 feet will not meet the needs of a helicopter pilot flying close to the ground. Therefore, many of the performance requirements and tradeoffs are based on the applications of the user and environment.

There are a number of important parameters23 in an HMD optical design. These include (1) FOV, (2) exit pupil (eye box) size and shape, (3) optical eye relief, (4) transmission (optical throughput), (5) beamsplitter transmission/reflection coefficients for see-through HMDs, (6) modulation transfer function (MTF), (7) distortion, (8) weight, (9) center-of-mass (CM), and (10) volume or the space required.

While it may be tempting to identify only a select few of these parameters as being universally important, the intended use of the HMD is, in fact, the deciding factor for which parameters should push the optical design. Nonetheless, there are a few optical system parameters that are fundamentally important to the vast majority of designs, especially for avionic HMDs. These include weight, FOV, MTF, exit pupil size, and eye relief.

The weight of the optics comes from the optical elements themselves, such as lenses, mirrors, prisms, beamsplitters, and the housing for these optical elements. We can control the weight of the optics by choosing all kinds of materials used for the optical elements. Optical designers have begun to explore ways of replacing traditional optical devices that had rotational symmetry in the late 1980s. Sweatt, who pioneered the holographic optical element field,24 had a student named Chen who made great progress in reducing the weight of optical system.25 Since 1996, diffractive optical elements26 have been used in HMDs to reduce the weight, axial distortion, transverse distortion, and chromatic aberration. In addition, holographic elements offer additional weight savings. In 1992, Wood determined the use of holographic beamsplitters (combiners) in the refractive optics of the HMD optical designs,27 which utilized their wavelength-selective characteristics and did not introduce any additional optical power.

A lightweight HMD is important for reducing wearable fatigue. The weight associated with the optics is important from both the ergonomic and safety perspectives. The additional head-supported weight of the HMD can produce neck muscle fatigue, which can degrade performance and increase the potential of injury due to dynamic loading during crashes. Thus, it is desirable to minimize the head-supported weight in HMD designs.

In most cases, image source makes up a portion of the weight. The image source is a display device which uses a small high-resolution CRT28 or liquid-crystal display (LCD).29,30 However, the CRT is bulky and heavy. Moreover, it has high power consumption and requires a high voltage. Thus, these deficiencies constrain its HMD application. A new revolutionary technology, OLED displays,31 took the place of LED displays and liquid crystal on silicon displays, which replaced the mini-CRTs during the past decade. The first generation high-definition OLED displays have been integrated and they have reduced the weight, power consumption, and operating voltage.32

Another fundamental optical parameter is the FOV,33 which describes how extensive the image appears to the user. The FOV can be formally defined as the maximum image angle of the view that can be seen through an optical device. The FOV is affected by the magnification and image source size in which a greater magnification and/or image source size results in a larger FOV. Typically, HMDs present an FOV to the viewer that matches one-to-one (conformally) with the FOV of the sensor that is used to capture the original image of the outside world. In principle, a larger FOV allows for more information to be made available, assuming that the image source and sensor have the resolution to properly support the increased FOV. Consequently, HMDs designed for pilotage attempt to maximize the FOV and match the human visual system. The human eye34,35 has an instantaneous FOV that is roughly oval and typically measures 120 deg vertically by 150 deg horizontally. Considering both eyes together, the overall binocular FOV measures 200deg (H) by 120 def (V).36 Figure 3 shows the human visual system’s binocular FOV.

Fig. 3

Human visual system’s binocular field of view.

OE_52_11_110901_f003.png

If our goal is to create an opaque fully immersive visual environment for gaming, simulation, or training, a large FOV would be desirable to stimulate the ambient visual mode and provide a more compelling immersion. One example of a wide-FOV HMD is the U.S. Army’s Aviation Combined Arms Tactics Trainer, which is a mobile reconfigurable training system for helicopter pilots that relies on the HMDs for all the out-the-window visuals.37 This system uses a Rockwell Collins’s HMD that provides a 100 deg (H) by 52 deg (V) FOV, which was recently upgraded to SXGA resolution. Conversely, if the goal is a safety-of-flight-qualified HMD, then the head-supported weight and CM become important, and a more moderate FOV of 40 deg (H) by 30 deg (V) is acceptable. The IHADSS is an example of a 40 deg (H) by 30 deg (V) FOV that has been successfully used in the U.S. Army’s AH-64 Apache helicopter since the early 1980s.38

The MTF39 is a metric that defines how well an optical system transfers the modulation contrast from its input to its output as a function of spatial frequency, which is a measure of detail in a scene and is usually defined as how rapidly the luminance changes within a region. Figure 4 shows a plot of such a transfer, which is called an MTF curve.

Fig. 4

Typical modulation transfer function (MTF) curve.

OE_52_11_110901_f004.png

Within an HMD system, every major component, e.g., sensor, image source, optics, has its own MTF. If the system is linear, its total MTF can be obtained by multiplying the MTFs of the system’s individual components.40 To accurately predict the image quality of an HMD system, it is necessary to determine how the overall system will affect the resolution and contrast. The MTF performs this function. The MTF of an optical system is perhaps the most widely accepted metric for the image quality seen through the optical system. It defines the fidelity to which an outside scene is reproduced in the final viewed image. A perfect system would have an MTF of one across all spatial frequencies.41 The degradation that is present in a practical HMD optical system’s MTF is a result of the residual (uncorrected) aberrations in the system and is limited by the diffraction effects.

The exit pupil and eye relief presented in Fig. 5 are closely related. The exit pupil is the volume in space where the eye must be placed in order to see the full image. An exit pupil has three characteristics: size, shape, and location. Tsou42 suggests that the minimum exit pupil size should include the eye pupil (3mm), an allowance for eye movements that scan across the FOV (5mm), and an allowance for helmet slippage (±3mm). This would set a minimum exit pupil diameter of 14 mm. A large exit pupil is important for a flight HMD, so the user does not lose the image if the HMD shifts on his head. A value of 12 to 15 mm has been deemed an acceptable value for these applications.

Fig. 5

Diagrams showing the optical (a) and physical (b) eye relief. The optical eye relief is defined as the distance from the last optical element to the exit pupil, where the eye would be placed. The physical eye relief can be less than the optical eye relief if additional structures are present.

OE_52_11_110901_f005.png

The exit pupil is located at a distance called the optical eye relief, which is defined as the distance from the last optical element to the exit pupil. The HMD needs sufficient eye relief in order to allow the user to wear spectacles. This produces a minimum value of 25 mm.43 However, care must be taken with this terminology because in classical optical design the eye relief is measured as the distance along the optical axis from the last optical surface to the actual exit pupil. In most HMDs, the final optical surface in front of the eye may be an angled combiner, which will fold the optical path to get the rest of the optics away from the front of the face. Thus, the actual eye clearance distance (ECD), measured from the face to the closest point of the combiner, may be considerably less. Therefore, it is important that the useable distance from the eye to the first contact point of the HMD optics, the ECD, provides a minimum of 25 mm separation.44

There are a number of HMD optical designs45,46 that have been used over the decades of HMD development. The following descriptions encompass three optical design approaches which are popular and are only representative of the many varied designs that have been implemented.

3.1.

Off-Axis Design

Compared to the coaxial HMD system, the off-axis HMD47 can increase the exit pupil and eye relief, be built for an optimal man-machine configuration, simplify the system structure, improve the lighting proportion of the system, and eliminate the ghost image. Similar to other off-axis optical systems, the off-axis HMD involves many complex technical problems. At present, the aberration theory based on the coaxial optical system is difficult to competently guide work of designing an off-axis optical system. Nodal aberration theory has brought fresh hope and new opportunity to design off-axis optical systems.4849.50.51.52

According to the nodal aberration theory, the wave aberration expansion through third order is

(1)

W=ΔW20(ρ.ρ)+ΔW11(H.ρ)+jΔW040j(ρ.ρ)2+jW131j[(Hσj).ρ](ρ.ρ)+jW222j[(Hσj).ρ]2+jW220j[(Hσj).(Hσj)](ρ.ρ)+jW311j[(Hσj).(Hσj)][(Hσj).ρ],
where the subscript j is the surface number, Wklm are the wave aberration coefficients, H is the vector that locates the image point of interest in the focal plane, ρ is the aperture vector in the exit pupil, and σj is the surface by surface location of the center of the aberration field for each surface, which is a vector residing in the Gaussian image plane.53 In the decentered/tilted optical system, there is a leveraging binodal astigmatism given by54

(2)

WAST=12jW222j[(Hσj)2.ρ2].
If W2220, them

(3)

WAST=12W222[(Ha222)2+b2222].ρ2,

(4)

a222A222W222=1W222j(W222j(sph)σj(sph)+W222j(asph)σj(asph)),

(5)

b2222B2222W222a2222=1W222j(W222j(sph)σj(sph)2+W222j(asph)σj(asph)2)a2222.

Off-axis catadioptric systems are usually referred to as reflective off-axis systems and may or may not require combiners. As the off-axis angle to the power combiner increases, the induced distortions and aberrations increase rapidly.55 An example56 of an off-axis catadioptric design with a combiner is shown in Fig. 6. This catadioptric design achieves a 50 deg (H) by 38.5 deg (V) FOV with a 10 mm exit pupil and 60.46 mm eye relief. The display apparatus enables the observation of an image that is flat and clear with visual field at a view angle of 40 deg or more, which ensures a large exit pupil diameter and eye relief. Not only are the lenses tilted, but also there is an asymmetric aspheric element that is used to help correct the asymmetric aberrations caused by the combiner, which is an anamorphic asphere surface and ocular concave mirror.

Fig. 6

Visual display apparatus comprising a decentered correcting optical system.

OE_52_11_110901_f006.png

For the design of compact optics for HMDs, optical designers have determined that DOEs57 may be used in place of doublets for the correction of chromatic aberrations because of the strong negative chromatic dispersion of DOEs. The concept is an improvement which utilizes one or more diffractive optical surfaces to provide a system that operates with fewer elements. This makes them simper, lighter, and easier to assemble than the previous systems. Figure 7 shows a head-mounted display utilizing DOEs.58 With the diffraction surfaces 58 and 59, the system is simplified further to one having only three spherical and centered lenses.

Fig. 7

Head-mounted display utilizing diffractive optical elements.

OE_52_11_110901_f007.png

Due to the advances in the optical design and manufacturing technology, plastic lenses have been used in HMD design. Chen et al. designed a lightweight HMD59 that includes a group of plastic lenses, which is shown in Fig. 8. It is possible to reduce the weight and cost of the display device by using optical-quality plastic elements. Compared with a conventional design, the weight of the relay group is reduced by 60%, which in turn reduces the moment of inertia of the display device. In addition, the plastic elements are located between the glass optical wedge and glass positive-power lens module, which protects them from scratching and other damage.

Fig. 8

Lightweight HMD with plastic lenses.

OE_52_11_110901_f008.png

The primary advantage6061.62 of the off-axis reflective HMD design is that it provides the highest theoretical luminance transfer from the display with the highest see-through vision and increased eye clearances for a given FOV. The primary disadvantages are very complex optical designs, shape distortions, as well as low structural integrity and stability of the reflective surfaces.

3.2.

Design with Freeform Optical Surface

A freeform optical surface is typically defined as a surface that is complicated, irregular, and nonrotationally symmetric.63 These surfaces provide additional degrees of freedom that can lead to improved performances compared to systems that only use conventional optics.64 Because of the fabrication possibility of freeform surfaces, the use of freeform optics is becoming more widespread in the optical system design, which has opened new avenues of modern optical research and development.65

There is no single universal equation that can describe the geometry of the freeform surfaces and can be described by a myriad of equations including x-y polynomials, Zernike polynomials, and φ-polynomials. There is a new way to describe freeform surfaces with radial basis functions (RBF): a meshless surface description, which was first applied to optical system design by Cakmakci et al.66 They performed research on an off-axis magnifier configuration that can be used in HMDs, which is shown in Fig. 9. The study gives a comparison between a 10th-order anamorphic sphere, x-y polynomial, 10th-order Zernike polynomial, and linear combination of Gaussians for a system containing the same parameters: >15mm eye relief, 3 mm exit pupil, and 24 deg (H) by 14.7 deg (V) FOV.

Fig. 9

Optical layout of the off-axis magnifier represented using a linear combination of Gaussians.

OE_52_11_110901_f009.png

If the theory and promotion of application in this field is improved, then the field of optical engineering will benefit. Thus, we design an HMD with a large FOV, large pupil size, and long exit pupil relief through the use of freeform surface described by Gaussian RBF.67 An off-axis see-through HMD that is composed of a tilted combiner with an RBF surface representation is achieved. The system, which is shown in Fig. 10, has a 100 mm eye relief, 15 mm pupil, 45 deg (H) by 32 deg (V) FOV, and 60 deg combiner tilt angle.

Fig. 10

An off-axis HMD using freeform surface described by radial basis functions: (a) optical layout and (b) polychromatic MTF plot of the HMD.

OE_52_11_110901_f010.png

The HMD was designed, analyzed, and compared to existing shape descriptors such as an asphere and Zernike polynomial in this paper. From the results, we discovered that the use of a linear combination of Gaussian surfaces on one hand could reduce the number of optical elements, simplify the structure of optical system, and reduce weight. Conversely, it also exhibits higher levels of MTF performances. Specifically, there was one less optical element in the relay lens group compared to an asphere and a 12.1% gain at the spatial frequency of 33line pairs/mm compared to a Zernike polynomial. The comparison of the properties between the linear combination of Gaussian surfaces and other surface types is listed in Table 1.

Table 1

Comparison between the average tangential and sagittal modulation transfer function (MTF) values and number of relay lens between surface types of asphere, Zernike polynomial, and a linear combination of Gaussians.

Surface typeAverage MTF (at 33  cyc/mm)Number of relay lens
Asphere40.8%5
Zernike polynomial55.1%4
Linear combination of Gaussians67.2%4

Compact constraints are the primary motivation for optical designers to use freeform surfaces in HMDs and many astronomical applications.68 Togino et al. provided a design69 with freeform surfaces, which is shown in Fig. 11. In this design, the first, second, and third surfaces, 3, 4, and 5, are all three-dimensional surfaces defined by

(6)

Z=C2+C3y+C4x+C5y2+C6yx+C7x2+C8y3+C9y2x+C10yx2+C11x3+C12y4+C13y3x+C14y2x2+C15yx3+C16x4+C17y5+C18y4x+C19y3x2+C20y2x3+C21yx4+C22x5+C23y6+C24y5x+C25y4x2+C26y3x3+C27y2x4+C28yx5+C29x6+C30y7+C31y6x+C32y5x2+C33y4x3+C34y3x4+C35y2x5+C36yx6+C37x7
where Z is the amount of deviation from a plane tangent to the origin of the surface configuration, and Ci(i=2,3) are coefficients.

Fig. 11

Olympus HMD apparatus comprising a rotationally asymmetric surface.

OE_52_11_110901_f011.png

This design achieves a 40 deg (H) by 30.5 deg (V) FOV with an 8 mm exit pupil. It is very compact and lightweight so that when it is combined with a head-mounted support structure to hold the display in proximity to the eye, only several ounces are added to the total weight. One particular advantageous feature of this design is that a given FOV may be obtained with a relatively small thickness associated with the optical system, thereby producing a lightweight and small volume HMD. Such a display is achieved with excellent optical properties.

As a complicated and nonrotationally symmetric surface, freeform optics can break through the concept of the conventional optical system and be used in a new optical system design.70 The benefits of using freeforms in an optical system design are as follows:65,71,72

  • 1. Less optics can be used in the optical system, which decreases the amount of optical surfaces. Since every surface is a reduction of light intensity, e.g., by scattering, a higher throughput for the optical system occurs.

  • 2. Less optics also means a reduction in weight and size.

  • 3. An improvement in optical quality, e.g., spherical aberration, coma, distortion.

  • 4. A more favorable position of the optical components is possible.

Conversely, the disadvantages that come with using freeforms are as follows:73,74

  • 1. Difficulty in determining the optimal freeform representation and location in the optical train.

  • 2. Optical tolerance analyses are not yet common practice in optical design packages.

  • 3. Difficulty in manufacturing with classical production technologies.

  • 4. Difficulty in validating the surface shape.

  • 5. Higher difficulty in aligning because of increased degrees of freedom.

  • 6. More expensive to manufacture.

3.3.

Design with Holographic Waveguide Technology

In recent years, the rapid development of integrated optics and microelectronics technology has made holographic waveguide technology widely used in image displays,75 LCD illumination,76,77 and optical interconnection.78 Holographic waveguide technology is a revolutionary way of designing HMDs. In this method, HMDs can obtain a compact structure, light weight, large exit pupil, and excellent real-world transmission.79 Optical waveguide technology relies on two fundamental optical principles:80,81

  • 1. Total internal reflection (TIR): The ability of an optical medium such as glass to completely contain rays of light under certain conditions, thereby allowing the light to propagate freely and efficiently through the medium.

  • 2. Diffraction: The ability of regular structures with a periodicity comparable to the wavelength of light to modify the direction of light passing through them.

The holographic optical waveguide display consists of three important parts: the input coupler, waveguide, and hologram as shown in Fig. 12.82 The input coupler is the mechanism that conducts the light from a source into the waveguide through TIR. This function can be achieved using a prism, grating, or edge-lighting mechanism. The waveguide for the holographic optical waveguide display is a sheet of transparent material with two surfaces, which are locally parallel and optically polished. The refractive index of a waveguide must be higher than the index of its environment to achieve waveguiding. The coupled wave is confined inside the waveguide through TIR on the waveguide surfaces and propagates along following a zigzag path. The hologram is placed parallel to and immediately in contact with the waveguide. When the hologram is illuminated with the guided wave, the previous recorded holographic image is reconstructed.

Fig. 12

The basic structure of a holographic optical waveguide display.

OE_52_11_110901_f012.png

A basic holographic optical waveguide display configuration for expanding light beams from a small source in two dimensions is shown in Fig. 13.8384.85 It comprises three laterally displaced linear holographic gratings (HGs) that are recorded on a single transparent substrate. The first HG H1 couples the input incident light from the display source into the substrate, traps it through TIR, and directs it toward the second HG H2, which expands the light in one dimension. The second HG H2 intermediate redirects the light distribution toward the much larger third HG H3, which expands light in the other orthogonal direction and decouples it from the substrate outward toward the viewer who can obtain a large uniform light beam.

Fig. 13

Simplified diagram of a holographic optical waveguide display. Holographic waveguide displays use this combination of total internal reflection and diffraction to take a small exit pupil image from a display and expand the exit pupil in the vertical and horizontal axes to produce a large exit pupil display.

OE_52_11_110901_f013.png

Another basic holographic optical waveguide display configuration, which is also suitable for displays, is shown in Fig. 14.8687.88 The configuration comprises two holographic elements: a linear grating (LG) and holographic lens (HL), both of which are recorded on one substrate. The first holographic lens diffracts the incident light from the display source so it will be trapped inside the substrate through TIR, while the second hologram, which is just a linear grating, diffracts the light out from the substrate toward the observer.

Fig. 14

A basic holographic optical waveguide display configuration.

OE_52_11_110901_f014.png

Holographic optical waveguide technology has been applied to provide radically new types of HMDs and HUDs. The first HMD products were the Q-Sight™ family89 of HMDs specifically designed for rotary-wing applications, which were developed by BAE Systems, London, Britain. Using patented technology, the Q-Sight™ family employs a revolutionary means of moving light using holographic waveguides. It offers a modular approach to providing pilots with a heads-up/eyes-out capability, while at the same time delivering mission-critical situational awareness with significant improvements in weight, cost, flexibility, simplicity, and optical performance. The basic configuration is shown in Fig. 15, which highlights how the waveguide concept has eliminated the need for complex optics assemblies, while also integrating into standard aviator helmets. Furthermore, Sony Corporation, Tokyo, Japan developed a see-through full color eyewear display using holographic planar waveguides,90 which is shown in Fig. 16. Using a 20 deg diagonal FOV, a 120% National Television Systems Committee color gamut, <0.008Δuv color uniformity, and >2500cd/m2 brightness were achieved.

Fig. 15

Q-Sight™ 100 display with holographic optical waveguide technology.

OE_52_11_110901_f015.png

Fig. 16

A basic structure of the holographic planar waveguide from Sony Corporation.

OE_52_11_110901_f016.png

We have designed HMDs with holographic optical waveguide technology. The HMDs with 14 deg (H) by 14 deg (V), 4 mm pupil, 30 mm eye relief, and 550 nm operating wavelength were designed. An MTF close to the diffraction limit over the entire FOV was achieved. The maximum RMS spot radius value is 2.9 μm at (x=7deg, y=7deg). The magnitude of the maximum distortion occurs at (x=7deg, y=2.8deg) in the field and is simulated to be 2.62%. The simulation results show that the optical system of HMDs has a low aberration and can provide user clear symbols or video. This HMD, which has good image quality, small volume, and a light weight, can be applied to the next-generation HMD technology. The configuration, MTF curves, and distortion of the HMDs are shown in Fig. 17.

Fig. 17

An HMD based on the holographic planar waveguide. (a) Configuration and (b) MTF curves of the HMD.

OE_52_11_110901_f017.png

4.

Current and Future Avionic Helmet-Mounted Displays

The various militaries across the world have actively pursued the research, development, application, and fleet introduction of a variety of helmet-mounted technologies for over 40 years. There are many types of HMD programs91,92 that have achieved at least limited fielding and some are still in their research and development phase. While the HMDs have been used by both vehicular-mounted and dismounted warfighters recently, they are predominantly used in rotary- and fixed-wing aircraft platforms.

The next few paragraphs will provide a summary93 of some of the HMDs that are used in rotary- and fixed-wing aircraft platforms and are being fielded today or in the next few years. Table 2 presents a partial summary of the more notable experimental, prototype, fielded, and future HMD fixed-wing programs. Many of these HMDs are depicted in Fig. 18. Many of the programs involve a number of contracts with various commercial HMD developers that play different roles and are also multinational in scope. The country of development listed in Table 2 and ensuing program descriptions is generally based on the initial developmental phase.

Table 2

Summary of selected fixed-wing helmet-mounted display (HMD) programs.

Time frameProgramCountryPlatformDeveloperProgram statusNotes
1970sDash1IsraelFixed-wing F-15, F-16Elbit SystemsFieldedMark 1 through 5(VCATS)
1970sZH-3YM-1RussianFixed-wing Mig 29, Su 27/30ArsenalFielded
1970sTK-2AChinaFixed-wing miscellaneousFielded
Early to mid 1980sAgile EyeUSAFixed-wing miscellaneousKaiser ElectronicsExperimental
Early 1990sDash 3IsraelFixed-wing F-15, F-16Elbit SystemsFielded
1990sViper 1-3UKFixed-wing miscellaneousGEC-Marconi Avionics Ltd (Delft Instrument)Experimental
Mid 1990sCrusaderUS/UKFixed- & rotary-wingGentex/BAE Systems/Thales, Valence, Drome, FranceExperimentalTechnology demonstrator
Late 1990sTopSightFranceFixed-wing miscellaneousThales, Valence, Drome, France (Sextant Avionoque)FieldedDay mission
Late 1990sTopNightFranceFixed-wing miscellaneousThales, Valence, Drome, France (Sextant Avionoque)FieldedNight mission
1999JHMCSUSAFixed-wing F-15, F-16, F-18VSIFielded
2008ScorpionUSAFixed-wingGentexOperational testing
2008Typhoon IHDUKFixed-wing EurofighterBAE SystemsDevelopment
2010HMDSUSAFixed-wing F-35VSIDevelopment

Fig. 18

Selected current and future fixed-wing HMD programs.

OE_52_11_110901_f018.png

Table 3 presents a partial summary of the more notable experimental, prototype, fielded, and future HMD rotary-wing programs. Many of these HMDs are shown in Fig. 19. Many of the programs involve a number of contracts with various commercial HMD developers that play different roles and are also multinational in scope. The country of development listed in Table 3 and ensuing program descriptions is generally based on the initial developmental phase.

Table 3

Summary of selected rotary-wing HMD programs.

Time frameProgramCountryPlatformDeveloperProgram statusNotes
1970sIHADSSUSARotary-wing ApacheHoneywellFieldedFirst integrated HMD
Early to mid 1980sWide-EyeUSARotary-wing variousRockwell CollinsExperimental
Mid to late 1980sEagle EyeUSARotary-wingNight Vision CorporationPrototype
Late 1980sAN/AVS-6 ANVISMultipleRotary-wing variousITTFielded
Late 1980sMONARCUSARotary-wingHoneywellPrototype
1990sHIDSSUSARotary-wing ComancheRockwell CollinsPrototypesThe Comanche program was cancelled in 2004
1990sMiDASHIsraelRotary-wing variousElbit SystemsFielded
Late 1990sKnighthelmUKRotary-wing variousBAE SystemsFielded
Mid 1990sCrusaderUS/UKFixed- & rotary-wingGentex/BAE Systems/Thales, Valence, Drome, FranceExperimentalTechnology demonstrator
Late 1990sTopOwlFranceRotary-wing Euro helicopterThales, Valence, Drome, FranceFieldedSelected for the AH-1Z Cobra
Mid 1990sANVIS/HUD-7IsraelRotary-wing variousElbit SystemsFielded
Mid 1990sANVIS/HUD-24IsraelRotary-wing variousElbit SystemsFielded
Late 1990s/early 2000sVCOPUSARotary-wing variousMicrovisionExperimentalTechnology demonstrator
Early 2000sHeliDashIsraelRotary-wing miscellaneousElbit SystemsFielded
Mid 2000sMIHDS Air Warrior Block 3USARotary-wing variousMicrivisionDevelopmentSpectrum SD 2500
Late 2000sQ-sightUKRotary-wing variousBAE SystemsExperimentalTechnology demonstrator

Fig. 19

Selected current and future rotary-wing HMD programs.

OE_52_11_110901_f019.png

A complete overview of the HMD would be difficult as there have been hundreds of head tracker and HMD development efforts. This paper introduces three representative HMDs, which include the JHMCS, TopOwl®, and Q-sight™.

4.1.

Joint Helmet-Mounted Cueing System

The JHMCS94,95 is a multirole system that enhances the pilot’s situational awareness and provides a head-out control of aircraft targeting systems and sensors. It was developed between 1996 and 1999 by Vision Systems International, which was formed in 1996 as a joint venture between Rockwell Collins (San Jose, California) and Elbit Systems (Haifa, Israel) to address HMD opportunities for fixed-wing applications.

The JHMCS is a modified HGU-55/P helmet that incorporates a visor-projected HUD to cue weapons and sensors to the target. This new cueing system improves the effectiveness of both air-to-air and air-to-ground missions. In close combat, a pilot must currently align the aircraft to shoot at a target. JHMCS allows the pilot to simply look at a target to shoot. This system projects visual targeting and aircraft performance information on the back of the helmet’s visor, thereby enabling the pilot to monitor this information without interrupting his FOV through the cockpit canopy.96 The system uses a magnetic transmitter unit fixed to the pilot’s seat and magnetic field probe mounted on the helmet to define the helmet pointing positioning. A helmet vehicle interface interacts with the aircraft system bus to provide a signal for the helmet display. This provides a significant improvement for close combat targeting and engagement.

The JHMCS system will be employed in the FA-18C/D/E/F, F-15C/D, and F-16 Block 40/50 with a design that is nearly common to all three platforms. The U.S. Air Force has stopped funding for JHMCS in the F/A-22. When used in conjunction with an AIM-9X missile, JHMCS allows a pilot to effectively designate and engage targets in a cone >80deg to either side of the nose of the aircraft, or high-off-boresight.

As a cueing system, JHMCS is a two-way interface that comprises the following capabilities:97

  • 1. Sensors aboard the aircraft can cue pilots to potential targets. Conversely, pilots can cue weapons and sensor systems to areas of interest, aiming radar, air­to­air missiles, infrared sensors, and air­to­ground weapons by pointing their heads at the targets.

  • 2. The system graphically displays critical information and symbols, such as the targeting cues, threat warnings, and aircraft performance parameters, directly on the pilot’s visor. This significantly improves pilot situational awareness during all mission elements.

  • 3. The system can be used without requiring the aircraft to be maneuvered, thereby significantly reducing the time needed to execute an attack, which also minimizes the time spent in the threat environment.

  • 4. Since targets may be located at high­off­boresight line­of­sight locations in relation to the shooter, the system delivers a short­range intercept envelope that is significantly larger than any other air-to-air weapon in use.

4.2.

TopOwl® (France)

TopOwl® is the HMD system for helicopters designed and manufactured by Thales, Valence, Drome, France. It has a fully overlapped 40 deg visor projection system that is capable of presenting both intensified and forward-looking infrared (FLIR) images as well as image-intensified (I2) and synthetic imagery.98 The visor projection approach improves the viewing of the outside world over the standard HMD designs that require optical beamsplitters. This approach also allows for an increased physical eye relief [>70mm (>2.75 in.)], which reduces the potential interference with the wearing of corrective spectacles and nuclear, biological, and chemical masks. Dual I2 sensors are located on the sides of the helmet with a separation distance of 286mm (11.25 in.), which has an effective interpupillary distance of more than 4X normal. The I2 imagery is optically coupled to the visor. The FLIR imagery from a nose-mounted thermal sensor is reproduced on miniature CRTs (current production version) or LCDs (prototype) and is then projected onto the visor. In the I2 mode, it presents a 40 deg circular FOV. Meanwhile, for FLIR imagery presentation, the FOV is 40 deg (H) by 30 deg (V).

The production CRT version is currently fielded on various models of the Eurocopter Tiger and Denel AH-2 Rooivalk helicopters and is used in 15 countries. It has been selected for use on the U.S. Marine Corps AH-1W Super Cobra attack helicopter.99

The total weight of a fully configured production CRT-version of a TopOwl® is 4 lbs for day-only operations and 4.8 lbs for the nighttime configuration.

TopOwl® has been designed to meet the demands of all-weather as well as day and night operations on both attack and tactical transport helicopters with an emphasis placed on flight safety.

TopOwl® provides the pilot with the following major functions: increased operational efficiency, reduced crew workload, increased crew safety and comfort, and reduced cost of ownership.

4.3.

Q-Sight™ (United Kingdom)

The Q-Sight™ is being developed by BAE Systems.7 Its design uses holographic waveguide technology. It weighs <4 ounces and contains no bulky projection optics and undesirable center-of-gravity issues, thereby offering the maximum safety and comfort for pilots. The lightweight miniature display clips to any standard helmet, thereby allowing the pilot plug-and-play capabilities.

Q-Sight™ technology features a larger exit pupil for pilot viewing and seamless transitions between day and night, thereby increasing the pilot’s situational awareness and mission capability. The increased visibility and lightweight design minimizes eye and neck strain, which are common problems for pilots. As a result, the demands of longer missions and increasingly complex rules of engagement are met. The decreased size and weight of the display allow the pilot a complete freedom of movement within the cockpit.

Q-Sight™ attaches to all standard in-service aviators’ helmets with minimal modifications. The combiner lens is placed 15 to 50 mm from the eye, thereby providing eye relief and allowing for the operation with pilots’ eyewear and with chemical, biological, radiological, and nuclear equipment. Symbology and/or video can be displayed to provide the user with eyes-out operation. In high-ambient-light conditions, a dark visor can be deployed to improve the contrast of the imagery. Q-Sight™ is designed to be compatible with the Aviator’s Night Vision Imaging System (ANVIS) NVG.81 Operation at night can be achieved by simply clipping on the NVG and deploying in the normal manner. The sight is located in its own mount and positioned behind the goggle’s eyepiece.100

The major performance specifications for the Q-Sight™ are as follows:

  • 1. FOV: 30 deg, monocular.

  • 2. Luminance: 1800 fL.

  • 3. Contrast ratio: 1.2:1.

  • 4. Exit pupil: >35mm.

  • 5. Eye relief: >25mm.

  • 6. Power consumption: <5W, head-mounted.

  • 7. Head-supported weight: <4 ounces.

5.

Conclusion and Future Research Directions

We presented a review of HMDs focusing on the optical design aspects. Based on the user’s characteristics and applications, we summarized a few optical system parameters that are fundamentally important to the vast majority of designs, especially for avionic HMDs. These include weight, FOV, MTF, exit pupil size, and eye relief.

With the constant requirements for high performance, a greater number of new techniques and components have been applied to the design of HMDs. We gave descriptions that encompass three popular optical design approaches that are only representative of the many varied designs that have been implemented.

Next, we presented a brief synopsis of the more significant HMD programs. The summary lists some of the HMDs that are used in rotary- and fixed-wing aircraft platforms and are being fielded today as well as in the next few years.

The main task of an embedded optical system in avionic HMDs is to provide a clear and bright aiming symbol or video images that can be superimposed on the real world. Further, the main demands of the optical system are a large FOV, large pupil size, long exit pupil relief, clear image, low profile package, lightweight, and small barycenter offset. Thus, the purpose of the optical design is to solve the conflict and seek balance through the use of all kinds of feasible techniques. According to the main demands of an optical system that is incorporated into avionic HMDs, several performance parameters will be prime drivers of future see-through HMD designs.

We believe that the potential use of freeform optics for avionic HMDs is very promising. There are some opportunities for research in terms of determining the optimal freeform representation and location in the optical train. Besides, further foreseeable opportunities in avionic HMD design also include the holographic waveguide technology, which is a novel and exciting approach. It can provide aircrews as well as other users with an enhanced situational awareness in a compact, lightweight, and low-cost product that is simple to install and use. Future developments of the holographic waveguide technology include a large FOV >40deg, high-resolution displays, full color capability, low color crosstalk, and very low profile.

Acknowledgments

The authors would like to thank Michael M. Bayer, Clarence E. Rash, James H. Brindle, Thomas H. Harding, and William E. McLean for providing some of the material. Any opinions, findings, and conclusions expressed in this paper are those of the authors and do not necessarily reflect those of the manufacturers.

References

1. 

E. C. Rash, Helmet-Mounted Displays: Design Issues for the Rotary-Wing Environment, pp. 60–67, SPIE Press, Bellingham, Washington (2000).Google Scholar

2. 

S. D. ManningC. E. Rash, “A moveable view,” J. Flight Safety Foundation 2(8), 41–44 (2007).Google Scholar

3. 

W. D. ShontzG. A. Trumm, “Perceptual processes and current helmet-mounted display concepts,” Technical Note TN-1, Honeywell Inc., Minneapolis, Minnesota (1969).Google Scholar

4. 

A. A. CameronD. G. Steward, “The Viper HMD-form design concept to flight test,” Proc. SPIE 2218, 137–148 (1994).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.177382Google Scholar

5. 

G. D. VosG. Brandt, “Use of holographic optical elements in HMDs,” Proc. SPIE 1290, 70–80 (1990).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.20973Google Scholar

6. 

R. S. JohnstonS. R. Willey, “Development of a commercial retinal scanning displays,” Proc. SPIE 2465, 2–13 (1995).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.209726Google Scholar

7. 

BAE Systems, “The Q-sightTM family of helmet display products,” http://www.baesystems.com/BAEProd/groups/public/documents/bae_publication/bae_pdf_eis_q-sight.pdf (2 March 2008).Google Scholar

8. 

A. B. Pratt, “Weapon,” U.S. Patent 1 183 492 (1916).Google Scholar

9. 

J. H. BrindleJ. Marano-GoycoP. M. Tihansky, “Helmet-mounted sight/display system (HMS/DS) technology development status/ vision,” NAWCADWAR Advanced Helmet Vision System Development Program, Report No. 1 (1995).Google Scholar

10. 

C. Casey, “Helmet mounted displays on the modern battlefield,” Proc. SPIE 1456, 175–178 (1991).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.45441Google Scholar

11. 

R. Braybrook, “Looks can kill,” Armada Int. 4, 44 (1998).Google Scholar

12. 

P. J. Klass, “Navy pilots to use helmet sight,” Aviat. Week Space Technol. 37–40 (1972).AWSTAV0005-2175Google Scholar

13. 

M. Dornheim, “VTAS sight fielded, shelved in the 1970’s,” Aviat. Week Space Technol. 143(17), 52–103 (1995).AWSTAV0005-2175Google Scholar

14. 

C. E. Rash, “A 25-year retrospective review of visual complaints and illusions associated with a monocular helmet-mounted display,” Displays 29(2), 70–80 (2008).DISPDP0141-9382http://dx.doi.org/10.1016/j.displa.2007.09.011Google Scholar

15. 

S. HaleD. Poccione, “Pilot assessment of the AH-64 helmet-mounted display system,” in Proc. 5th Int. Symp. on Aviation Psychology, Vol. 1, pp. 307–312 (1989).Google Scholar

16. 

K. L. Hiattet al., “Apache aviator visual experiences with the IHADSS helmet-mounted display in Operation Iraqi Freedom,” USAARL Report No. 2004–18, U.S. Army Aeromedical Research Laboratory, Fort Rucker, Alabama (2004).Google Scholar

17. 

K. KellerD. Colucci, “Perception in HMDs: what is it in head-mounted displays (HMDs) that really make them all so terrible?,” Proc. SPIE 3362, 46–53 (1998).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.317454Google Scholar

18. 

J. Seemanet al., “Advanced helicopter pilotage visual requirements,” in Proc. of the American Helicopter Society, Washington, Vol. 48, pp. 233–252 (1992).Google Scholar

19. 

D. N. Marticello Jr.M. S. Spillman, “Joint helmet-mounted cueing system accuracy testing using celestial references,” Proc. SPIE 3689, 126–134 (1999).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.352822Google Scholar

20. 

J. E. MelzerK. Moffit, Head Mounted Displays, McGraw Hill, New York (1997).Google Scholar

21. 

M. Velger, Helmet-Mounted Displays and Sights, Artech House, Boston (1998).Google Scholar

22. 

J. E. MelzerK. Moffitt, Head Mounted Displays: Designing for the User, McGraw-Hill, New York (1997).Google Scholar

23. 

M. Kidger, Fundamentals of Optical Design, SPIE Press, Bellingham, Washington (2001).Google Scholar

24. 

W. C. Sweatt, “Describing holographic optical elements as lenses,” J. Opt. Soc. Am. 67(6), 803–808 (1977).JOSAAH0030-3941http://dx.doi.org/10.1364/JOSA.67.000803Google Scholar

25. 

C. W. Chen, “Helmet visor display employing reflective, refractive, and diffractive optical elements,” U.S. Patent 5 526 183 (1996).Google Scholar

26. 

F. P. Shvartsman, “Replication of diffractive optics,” in Diffractive and Miniaturized Optics, S. H. Lee, Ed., Vol. CR49, pp. 165–186, SPIE Press, Bellingham, Washington (1993).Google Scholar

27. 

R. B. Wood, “Holographic head-up displays,” in Electro-Optical Displays, M. Karim, Ed., pp. 70–80, Dekker, New York (1992).Google Scholar

28. 

P. Keller, The Cathode Ray Tube Technology: History and Applications, Palisades Press, New York (1991).Google Scholar

29. 

S. T. Wu, Reflective Liquid Crystal Displays, Wiley, Hoboken, New Jersey (2001).Google Scholar

30. 

J. Rabin, “Dynamic visual performance: comparison between helmet-mounted CRTs and LCDs,” J. Soc. Inf. Disp. 3(3), 97–100 (1995).JSIDE80734-1768http://dx.doi.org/10.1889/1.1984947Google Scholar

31. 

J. Kalinowski, Organic Light-Emitting Diodes: Principles, Characteristics and Processes, Marcel Dekker, New York (2004).Google Scholar

32. 

A. N. Krasnov, “Electroluminescent displays: history and lessons learned,” Displays 24(2), 73–79 (2003).DISPDP0141-9382http://dx.doi.org/10.1016/S0141-9382(03)00015-5Google Scholar

33. 

V. Mahajan, Optical Imaging and Aberrations, SPIE Press, Bellingham, Washington (2001).Google Scholar

34. 

D. Williamson, “The eye in optical systems,” Proc. SPIE 0531, 136–147 (1985).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.946507Google Scholar

35. 

G. A. Fry, “The eye and vision,” in Applied Optics and Optical Engineering, R. Kingslake, Ed., 2nd ed., Vol. II, pp. 2–26, Academic, New York (1965).Google Scholar

36. 

J. Zuckerman, Perimetry, Loppincott, Philadelphia (1954).Google Scholar

37. 

R. SimonsJ. E. Melzer, “HMD-based training for the U.S. Army’s AVCATT—a collective aviation training simulator,” Proc. SPIE 5079, 1–6 (2003).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.487192Google Scholar

38. 

R. S. McCannD. C. FoyleJ. C. Johnson, “Attentional limitations with head-up displays,” in Proc. of the 7th Int. Symp. on Aviation Psychology, Columbus, pp. 70–75 (1993).Google Scholar

39. 

W. J. Smith, Modern Lens Design, 2nd ed., McGraw-Hill, New York (2005).Google Scholar

40. 

M. Kidger, Fundamentals of Optical Design, pp. 26–27, SPIE, Bellingham, Washington (2001).Google Scholar

41. 

J. Schott, Remote Sensing, Oxford University Press, New York (1997).Google Scholar

42. 

B. H. Tsou, “System design considerations for a visually coupled system. Emerging systems and technologies,” in The Infrared and Electro-Optics Systems Handbook, S. R. Robinson, Ed., Vol. 8, pp. 515–540 (1993).Google Scholar

43. 

J. A. Castellano, Handbook of Display Technology, Academic Press, New York (1992).Google Scholar

44. 

R. L. NewmanK. W. Greeley, Helmet-Mounted Display Design Guide, pp. 157–162, DTIC, San Marcos, Texas (1997).Google Scholar

45. 

D. J. Rotier, “Optical approaches to the helmet mounted displays. Head-mounted displays,” Proc. SPIE 1116, 14–18 (1989).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.960892Google Scholar

46. 

J. RollandO. Cakmakci, “Head-worn displays: the future through new eyes,” Opt. Photonics News 20(4), 20–27 (2009).OPPHEL1047-6938http://dx.doi.org/10.1364/OPN.20.4.000020Google Scholar

47. 

O. CakmakciJ. Rolland, “Design and fabrication of a dual-element off-axis near-eye optical magnifier,” Opt. Lett. 32(11), 1363–1365 (2007).OPLEDP0146-9592http://dx.doi.org/10.1364/OL.32.001363Google Scholar

48. 

J. R. Rogers, “Design techniques for systems containing tilted components,” Proc. SPIE 3737, 286–300 (1999).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.360019Google Scholar

49. 

J. R. Rogers, “Techniques and tools for obtaining symmetrical performance from tilted component systems,” Opt. Eng. 39(7), 1776–1787 (2000).OPEGAR0091-3286http://dx.doi.org/10.1117/1.602557Google Scholar

50. 

J. Y. WangD. E. Silva, “Wave-front interpretation with Zernike polynomials,” Appl. Opt. 19(9), 1510–1518 (1980).APOPAI0003-6935http://dx.doi.org/10.1364/AO.19.001510Google Scholar

51. 

G. Conforti, “Zernike aberration coefficients from Seidel and higher-order power-series coefficients,” J. Opt. Soc. Am. A 8(7), 407–408 (1983).JOAOD60740-3232Google Scholar

52. 

O. Cakmakciet al., “Application of radial basis functions to shape description in a dual-element off-axis magnifier,” Opt. Lett. 33(11), 1237–1239 (2008).OPLEDP0146-9592http://dx.doi.org/10.1364/OL.33.001237Google Scholar

53. 

T. Schmidet al., “Separation of the effects of astigmatic figure error from misalignments using nodal aberration theory (NAT),” Opt. Express 18(16), 17433–17447 (2010).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.18.017433Google Scholar

54. 

K. P. ThompsonT. SchmidJ. P. Rolland, “The misalignment induced aberrations of TMA telescopes,” Opt. Express 16(25), 20345–20353 (2008).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.16.020345Google Scholar

55. 

R. A. Buchroeder, “Helmet-mounted displays, Tutorial Short Course Notes T2,” presented at SPIE Technical Symp. Southeast on Optics, Electro-optics, and Sensors, Orlando, Florida (1987).Google Scholar

56. 

T. Togino, “Visual display apparatus comprising a decentered correcting optical system,” U.S. Patent 5 513 041 (1996).Google Scholar

57. 

T. Levola, “Diffractive optical components for near to eye displays,” in 2006 SID Int. Symp. Digest, pp. 64–67 (2006).Google Scholar

58. 

J. A. CoxT. Fritz, “Head mounted display utilizing diffractive optical elements,” U.S. Patent 5 537 253 (1996).Google Scholar

59. 

W. C. ChenR. G. HeggW. B. King, “Light-weight head-mounted display,” U.S. Patent 6 462 882 B2 (2002).Google Scholar

60. 

J. P. Rolland, “Wide-angle, off-axis, see-through head-mounted display,” Opt. Eng. 39(7), 1760–1767 (2000).OPEGAR0091-3286http://dx.doi.org/10.1117/1.602555Google Scholar

61. 

Z. R. Zhenget al., “Design and fabrication of an off-axis see-through head-mounted display with an x-y polynomial surface,” Appl. Opt. 49(19), 3661–3668 (2010).APOPAI0003-6935http://dx.doi.org/10.1364/AO.49.003661Google Scholar

62. 

O. CakmakciJ. Rolland, “Head-worn displays: a review,” J. Disp. Technol. 2(3), 199–216 (2006).JDTEDS0193-2691http://dx.doi.org/10.1109/JDT.2006.879846Google Scholar

63. 

W. B. LeeS. ToC. F. Cheung, “Design and advanced manufacturing technology for freeform optics,” Ph.D. Thesis, Hong Kong Polytechnic University (2005).Google Scholar

64. 

J. M. RodgersK. P. Thompson, “Benefits of freeform mirror surfaces in optical design,” presented at ASPE Proc., Chapel Hill, North Carolina (4–5 February 2004).Google Scholar

65. 

K. Garradet al., “Design tools for freeform optics,” Proc. SPIE 5874, 58740A (2005).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.617680Google Scholar

66. 

O. Cakmakciet al., “Optimal local shape description for rotationally non-symmetric optical surface design and analysis,” Opt. Express 16(3), 1583–1589 (2008).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.16.001583Google Scholar

67. 

H. Liet al., “Design of an off-axis helmet-mounted display with freeform surface described by radial basis functions,” Opt. Commun. 309, 121–126 (2013).OPCOB80030-4018http://dx.doi.org/10.1016/j.optcom.2013.06.054Google Scholar

68. 

G. W. Forbes, “Shape specification for axially symmetric optical surfaces,” Opt. Express 15, 5218–5226 (2007).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.15.005218Google Scholar

69. 

T. ToginoJ. Takahashi, “Head-mounted display apparatus comprising a rotationally asymmetric surface,” U.S. Patent 5 959 780 (1999).Google Scholar

70. 

H. Chase, “Optical design with rotationally symmetric NURBS,” Proc. SPIE 4832, 10–24 (2002).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.486490Google Scholar

71. 

M. D. NijkerkO. E. van der Togt-MarinescuG. P. H. Gubbels, “Freeform design and fabrication: where the proof of the pudding is in verification,” presented at Int. Conf. on Space Opt. 2010, ESA and CNES, Rhodes, Greece (4–8 October 2010).Google Scholar

72. 

S. Yamazakiet al., “Thin wide-field-of-view HMD with freeform surface prism and applications,” Proc. SPIE 3639, 453–462 (1999).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.349411Google Scholar

73. 

O. Cakmakciet al., “Design of a free-form single-element head-worn display,” Proc. SPIE 7618, 761803 (2010).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.840716Google Scholar

74. 

X. JiangP. ScottD. Whitehouse, “Freeform surface characterization—a fresh strategy,” Ann. CIRP 56(1), 553–556 (2007).CIRAAT0007-8506http://dx.doi.org/10.1016/j.cirp.2007.05.132Google Scholar

75. 

Y. AmitaiS. ReinhomA. A. Friesem, “Visor-display design based on planar holographic optics,” Appl. Opt. 34(8), 1352–1356 (1995).APOPAI0003-6935http://dx.doi.org/10.1364/AO.34.001352Google Scholar

76. 

A. N. PutilinY. P. BorodinA. V. Chernopiatov, “Waveguide holograms in LCD illumination units,” Proc. SPIE 4511, 144–148 (2001).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.431276Google Scholar

77. 

A. PutilinI. Gustomiasov, “Application of holographic elements in displays and planar illuminators,” Proc. SPIE 6637, 66370N (2007).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.742913Google Scholar

78. 

M. M. Liet al., “Multiple diffraction of massive fan out optical interconnects based on multiplexed waveguide holograms,” Proc. SPIE 2153, 278–287 (1994).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.174518Google Scholar

79. 

I. Kasaiet al., “Actually wearable see-through display using HOE,” Int. Conf. ODF 2, 117–120 (2000).Google Scholar

80. 

M. M. Liet al., “Multiple diffraction of massive fan out optical interconnects based on multiplexed waveguide holograms,” Proc. SPIE 2153, 278–287 (1994).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.174518Google Scholar

81. 

A. Cameron “The application of holographic optical waveguide technology to the Q-Sight™ family of helmet-mounted displays,” Proc. SPIE 7326, 73260H (2009).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.818581Google Scholar

82. 

Q. HuangH. J. Caulfield, “Waveguide holography and its application,” Proc. SPIE 1461, 303–312 (1991).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.44741Google Scholar

83. 

L. Eisenet al., “Planar configuration for image projection,” Appl. Opt. 45, 4005–4011 (2006).APOPAI0003-6935http://dx.doi.org/10.1364/AO.45.004005Google Scholar

84. 

R. ShechterY. AmitaiA. Friesem, “Compact beam expander with linear gratings,” Appl. Opt. 41(7), 1236–1240 (2002).APOPAI0003-6935http://dx.doi.org/10.1364/AO.41.001236Google Scholar

85. 

I. Gurwichet al., “Design and experiments of planar optical light guides for virtual image displays,” Proc. SPIE 5182, 212–221 (2003).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.509330Google Scholar

86. 

R. Shechteret al., “Planar holographic elements with uniform diffraction efficiency,” Appl. Surf. Sci. 106, 369–373 (1996).ASUSEE0169-4332http://dx.doi.org/10.1016/S0169-4332(96)00434-5Google Scholar

87. 

R. ShechterY. AmitaiA. A. Friesem, “Planar holographic configuration for efficient imaging,” Opt. Commun. 132(3–4), 221–226 (1996).OPCOB80030-4018http://dx.doi.org/10.1016/0030-4018(96)00379-3Google Scholar

88. 

Y. AmitaiS. ReinhornA. A. Friesem, “Visor-display design based on planar holographic optics,” Appl. Opt. 34(8), 1352–1356 (1995).APOPAI0003-6935http://dx.doi.org/10.1364/AO.34.001352Google Scholar

89. 

A. Cameron, “Optical waveguide technology & its application in head mounted displays,” Proc. SPIE 8383, 83830E (2012).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.923660Google Scholar

90. 

H. Mukawaet al., “A full color eyewear display using holographic planar waveguides,” J. Soc. Inf. Display 17(3), 185–193 (2009).Google Scholar

91. 

C. Casey, “Helmet mounted displays on the modern battlefield,” Proc. SPIE 3689, 270–277 (1999).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.352839Google Scholar

92. 

F. W. ChapmanG. N. Clarkson, “The advent of helmet-mounted devices in the combat aircraft cockpit—an operator viewpoint,” Proc. SPIE 1695, 26–37 (1992).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.131948Google Scholar

93. 

D. Francket al., “Current and future helmet mounted displays for piloted systems,” Proc. SPIE 7326, 73260C (2009).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.820204Google Scholar

94. 

G. W. Orf, “Joint helmet mounted cueing system (JHMCS) helmet qualification testing requirements,” Proc. SPIE 3362, 118–123 (1998).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.317425Google Scholar

95. 

G. Bairdet al., “Joint helmet mounted cueing system (JHMCS) hangar accuracy test report for USAF F-16,” Lockheed Martin under contract to U. S. Government (2004).Google Scholar

96. 

T. Lucas, “Advances in helmet-mounted displays,” Avionics 20–27 (1994).Google Scholar

97. 

G. StuartP. FlanaganP. Gibbs, “Hyperstereopsis in helmet-mounted NVDs: slope perception,” Proc. SPIE 6557, 65570K (2007).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.719116Google Scholar

98. 

O. Lemoineet al., “TopOwl® night vision improvements,” Proc. SPIE 6955, 695506 (2008).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.776830Google Scholar

99. 

S. A. Jenningset al., “Flight performance using a hyper stereo helmet-mounted display: aircraft handling,” Proc. SPIE 7326, 732604 (2009).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.819496Google Scholar

100. 

F. J. Ferrin, “An update on optical systems for military head mounted displays,” Proc. SPIE 3689, 178–185 (1999).PSISDG0277-786Xhttp://dx.doi.org/10.1117/12.352829Google Scholar

Biography

OE_52_11_110901_d001.png

Hua Li received his BS degree in optics from Guizhou University, China, in 2010 and is currently working toward his PhD degree in optical engineering from Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, China; Graduate School of Chinese Academy of Sciences, China. His current research areas include imaging theory and optical design, particularly freeform optics and holographic optics.

OE_52_11_110901_d002.png

Xin Zhang received his BS degree in precision instrument from Tsinghua University, China, in 1991 and his MS and PhD degrees in optics from Changchun Institute of Optics in 1994 and 2005, respectively. He is a research fellow in Changchun Institute of Optics. He was also a senior visiting scholar at Optical Sciences Center at Arizona State University from 2005 to 2006. Since 2009, he has been the deputy director of Key Laboratory of Optical System Advanced Manufacturing Technology, Changchun Institute of Optics. He has received many awards on optical design, frontier optical technology, imaging theory, and photoelectric measurement. Since 2001, he has enjoyed the special allowance of the State Council. He is a fellow of SPIE.

OE_52_11_110901_d003.png

Guangwei Shi received his BS degree in physics from Harbin Normal University, China, in 2006 and his PhD degree in optics from Changchun Institute of Optics in 2011. He is an associate research fellow in Changchun Institute of Optics. He is concerned with optical design and aberration theory.

OE_52_11_110901_d004.png

Hemeng Qu received his BS degree in applied physics from Changchun University of Science and Technology, China, in 2007 and his PhD degree in optics from Changchun Institute of Optics in 2012. He is an assistant research fellow in Changchun Institute of Optics. His main field of research is optical design.

OE_52_11_110901_d005.png

Yanxiong Wu received his BS degree in applied physics and his MS degree in optics, both from Nankai University, China, in 2004 and 2007, respectively, and is currently working toward his PhD degree in optics from Changchun Institute of Optics; Graduate School of Chinese Academy of Sciences, China. He is an assistant research fellow in Changchun Institute of Optics. His current research interests include optical design and star sensors.

OE_52_11_110901_d006.png

Jianping Zhang received her BS degree in optics from Changchun Institute of Optics in 1998. She is an associate research fellow in Changchun Institute of Optics. She has been performing research on optical design.

Hua Li, Xin Zhang, Guangwei Shi, Hemeng Qu, Yanxiong Wu, Jianping Zhang, "Review and analysis of avionic helmet-mounted displays," Optical Engineering 52(11), 110901 (18 November 2013). http://dx.doi.org/10.1117/1.OE.52.11.110901
Submission: Received ; Accepted
JOURNAL ARTICLE
15 PAGES


SHARE
KEYWORDS
Head-mounted displays

Optical design

Eye

Holography

Waveguides

Modulation transfer functions

Optical components

Back to Top