VIRTUAL RETINAL DISPLAY

Introduction
The Virtual Retinal Display (VRD) is a personal display device under development at the University of Washington's Human Interface Technology Laboratory in Seattle, Washington USA. The VRD scans light directly onto the viewer's retina. The viewer perceives a wide field of view image. Because the VRD scans light directly on the retina, the VRD is not a screen based technology. There are no liquid crystal displays or cathode ray tubes (CRTs) in the system. The Human Interface Technology Laboratory (HITL) of the Washington Technology Center at the University of Washington is developing a novel display device in which a coherent light source is utilized to scan an image directly on the retina of the viewer's eye. A prototype of this device, the Virtual Retinal Display (VRD), has been developed and is being perfected under a four-year project.

Characteristics
Using the VRD technology, the long-range project goal is to build a display with the following characteristics: * Very small and lightweight, mountable on eye glasses * High resolution, approaching that of human vision * Large field of view, greater than 100 degrees per eye * Full color with superior color resolution as compared to standard displays * Capable of fully inclusive or see-through display modes * Brightness sufficient for outdoor use * Very low power consumption * True stereo display with depth modulation

Working of EYE
A brief review of how the eye forms an image will aid in understanding the VRD. A point source emits waves of light which radiate in ever-expanding circles about the point. The pupil of an eye, looking at the source, will see a small portion of the wavefront. The curvature of the wavefront as it enters the pupil is determined by the distance of the eye from the source. As the source moves farther away, less curvature is exhibited by the wavefronts. It is the wavefront curvature which determines where the eye must focus in order to create a sharp image

If the eye is an infinite distance from the source, plane waves enter the pupil. The lens of the eye images the plane waves to a spot on the retina. The spot size is limited by the aberrations in the lens of the eye and by the diffraction of the light through the pupil. It is the angle at which the plane wave enters the eye that determines where on the retina the spot is formed. Two points focus to different spots on the retina because the wavefronts from the points are intersecting the pupil at different angles If the eye is an infinite distance from the source, plane waves enter the pupil. The lens of the eye images the plane waves to a spot on the retina. The spot size is limited by the aberrations in the lens of the eye and by the diffraction of the light through the pupil. It is the angle at which the plane wave enters the eye that determines where on the retina the spot

is formed. Two points focus to different spots on the retina because the wavefronts from the points are intersecting the pupil at different angles If we assume a 2 mm pupil diameter (the size in a bright light situation) and light near the center of the visible spectrum at 550 nm, the minimum angular separation required to resolve two points is 1.15 arc minutes. Thus, to approach the resolution of the eye, the VRD must be capable of scanning with angular resolution of less than 2 arc minutes.

VRD system
In a conventional display a real image is produced. The real image is either viewed directly or, as in the case with most head-mounted displays, projected through an optical system and the resulting virtual image is viewed. The projection moves the virtual image to a distance that allows the eye to focus comfortably. No real image is ever produced with the VRD. Rather, an image is formed directly on the retina of the user's eye. A block diagram of the VRD is shown in Figure

To create an image with the VRD a photon source (or three sources in the case of a color display) is used to generate a coherent beam of light. The use of a coherent source (such as a laser diode) allows the system to draw a diffraction limited spot on the retina. The light beam is intensity modulated to match the intensity of the image being rendered. The modulation can be accomplished after the beam is generated. If the source has enough modulation bandwidth, as in the case of a laser diode, the source can be modulated directly. The resulting modulated beam is then scanned to place each image point, or pixel, at the proper position on the retina. A variety of scan patterns are possible. The scanner could be used in a calligraphic mode, in which the lines that form the image are drawn directly, or in a raster mode, much like standard computer monitors or television. Our development focuses on the raster method of image scanning and allows the VRD to be driven by

standard video sources. To draw the raster, a horizontal scanner moves the beam to draw a row of pixels. The vertical scanner then moves the beam to the next line where another row of pixels is drawn. After scanning, the optical beam must be properly projected into the eye. The goal is for the exit pupil of the VRD to be coplanar with the entrance pupil of the eye. The lens and cornea of the eye will then focus the beam on the retina, forming a spot. The position on the retina where the eye focuses the spot is determined by the angle at which light enters the eye. This angle is determined by the scanners and is continually varying in a raster pattern. The brightness of the focused spot is determined by the intensity modulation of the light beam. The intensity modulated moving spot, focused through the eye, draws an image on the retina. The eye's persistence allows the image to appear continuous and stable. Finally, the drive electronics synchronize the scanners and intensity modulator with the incoming video signal in such a manner that a stable image is formed.

VRD Features
The following sections detail some of the advantages of using the VRD as a personal display.

1.

Size and weight:

The VRD does not require an intermediate image on a screen as do systems using LCD or CRT technology. The only required components are the photon source (preferably one that is directly modulatable), the scanners, and the optical projection system. Small photon sources such as a laser diode can be used

2.

Resolution:

Limited only by diffraction and optical aberration in the optical components, limits in scanning frequency and modulation b/w of photon source. SLD is a coherent source and offer high modulation b/w to give resolutions well over a million pixels. State of the art scanners can scan over a1000 lines per frame which is comparable to 3. Power Consumption:

Light sources consume very less power in order of milli watts. Scanning is done with a resonant device (MRS) with high figure of merit. Exit pupil of VRD has very small aperture allowing generated light to enter eyes almost completely. Hence high power efficiency.

4.

Brightness:

Perceived brightness is only limited by power of the light source. SLD sources can provide very good brightness levels even for see through mode in day light.

5.

Field of view:

Inclusive systems provide horizontal field of view b/w 60-100 degrees. See through mode systems have it slightly over 40 degrees. These figures are far better than existing HMD systems. 6. Stereoscopic display: Supports stereoscopic display as both eyes can be separately addressed. Thus provides a good approximation to natural vision.

VRD Development
Using seed funds from the Washington Technology Center the first VRD prototype was developed in the HITL by Dr. Tom Furness, Joel Kollin, and Bob Burstein . The project's initial goal was to prove the viability of forming an image on the retina using a scanned laser. This development work began in November 1993.

Prototype #1
The original prototype had very low effective resolution, a small field of view, limited gray scale, and was difficult to align with the eye. One objective

of the current development effort was to quickly produce a bench-mounted system with improved performance. This new system is Prototype #1

Prototype #1 uses a directly modulated red laser diode at a wave length of 635 nanometers as the light source. The required horizontal scanning rate of 73,728 Hertz could not be accomplished with a simple galvanometer or similar commercially available moving mirror scanner. The use of a rotating polygon was deemed impractical because of the polygon size and rotational velocity required. It was thus decided to perform the horizontal scan with an

acousto-optical scanner. The vertical scanning rate of 72 Hertz is within the range of commercially available moving mirrors and is accomplished with a galvanometer. The use of the acousto-optical scanner comes with a number of drawbacks: * It requires optics to shape the input beam for deflection and then additional optics to reform the output beam to the desired shape. Figure 4 is a schematic of the optical path for Prototype #1. Total optical path length for this system is 45 centimeters. * It requires complex drive electronics that operate at frequencies between 1.2 GHz and 1.8 GHz

Prototype #2
To overcome the limitations of the acousto-optical scanner, HITL engineers have developed a miniature mechanical resonant scanner. This scanner, in conjunction with a conventional galvanometer, provides both horizontal and vertical scanning with large scan angles, in a compact package. The estimated recurring cost of this scanner will allow the VRD system to be priced competitively with other displays. Prototype #2 of the VRD uses the mechanical resonant scanner. The VGA resolution images produced are sharp and spatially stable. A schematic of the optical path of Prototype #2 is shown in Figure . The total optical path length for this system is 8 centimeters.

The mechanical resonant scanner has many unique features. Foremost among these is the fact that the device has neither a moving magnet nor a moving coil. Instead, it uses a flux circuit whose only moving part is the torsional spring/mirror

combination. Eliminating moving coils or magnets greatly lowers the rotational inertia of the device, thus raising the potential operating frequency

Prototype #3
The third prototype system developed uses the same scanning hardware as Prototype #2 but uses three light sources to produce a full color image. In addition the eyepiece optics have been modified to allow for see through operation. In the see through mode the image produced by the VRD is overlaid on the external world.

VRD Applications

Application industries for the VRD range from medicine to manufacturing, from communications to traditional virtual reality helmet mounted displays (HMD's). The VRD provides high luminance and high resolution and can also be configured as see-through or inclusive (non-see-through), head mounted or hand held, making it adaptable to a number of applications. Some specific applications in the aforementioned industries are described in subsequent sections. Radiology One examination performed by radiologists is the fluoroscopic examination. During a fluoroscopic examination, the radiologist observes the patient with real-time video x-rays. The radiologist must continually adjust the patient and the examination table until the patient is in a desired position. When the patient is in a desired position, the radiologist takes a film copy of the x-ray image. The positioning process can be difficult and cumbersome because the radiologist must visually keep track of a patient, a video monitor, and an examination table simultaneously. Because the VRD can operate in a see-through mode at high luminance levels, it is an ideal display to replace the bulky video monitor in a fluoroscopic examining room. The radiologist could see through the x-ray display and see the patient as well. Other features such as a display luminance control or on/off switch could easily be included for this application. Surgery Surgery to remove a cancerous growth requires knowledge of the growth's location. Computed tomographic or magnetic resonant images can locate a tumor inside a patient. A high luminance see-through display, such as the VRD, in conjunction with head tracking, could indicate visually where a tumor lies in the body cavity. In the case that a tumor lies hidden behind, say, an organ, the tumor location and a depth indicator could be visually laid

over the obstructing organ. An application in surgery for any display would clearly require accurate and reliable head tracking.

Manufacturing The same characteristics that make the VRD suitable for medical applications, high luminance and high resolution, make it also very suitable for a manufacturing environment. In similar fashion to a surgery, a factory worker can use a high luminance display, in conjunction with head tracking, to obtain visual information on part or placement locations. Drawings and blueprints could also be more easily brought to a factory floor if done electronically to a Virtual Retinal Display (with the option of see-through mode). Operator interface terminals on factory floors relay information about machines and processes to workers and engineers. Thermocouple temperatures, alarms, and valve positions are just a few examples of the kind of information displayed on operator interface terminals. Eyeglass type see-through Virtual Retinal Displays could replace operator interface terminals. A high luminance eyeglass display would make the factory workers and engineers more mobile on the factory floor as they could be independent of the interface terminal location. Communications The compact and light weight nature of the mechanical resonant scanner (MRS) make an MRS based VRD an excellent display for personal communication. A hand held monochrome VRD could serve as a personal video pager or as a video FAX device. The display could potentially couple to a telephone. The combination of telephone services and video capability would constitute a full service personal communication device. Virtual Reality The traditional helmet display is an integral part of virtual reality today. The VRD will be adapted for this application. It can then be used for educational and architectural applications in virtual reality as well as long distance virtual conference communications. Indeed it can be utilized in all applications of virtual reality. The theoretical limits of the

display, which are essentially the limits of the eye, make it a promising technology for the future in virtual reality HMD's.

Refrences [1] www.edutalks.org

[2] www.google.com [3] E. Hecht and A. Zajac, Optics, 1979, Addison-Wesley, pp. 353-354. [4] R. H. Webb, G. W. Hughes,, and O. Pomerantzeff, "Flying spot TV ophthalmoscope", Applied Optics, Vol. 19, pp. 2991, 1980. [5] R. H. Webb, "Optics for laser rasters", Applied Optics, Vol. 23, pp. 3680, 1984. [6] R. H. Webb, G. W. Hughes, F. C. Delori, "Confocal scanning laser ophthalmoscope", Applied Optics, Vol. 26, pp. 1492, 1987. [7] J. Kollin, "A Retinal Display for Virtual-Environment Applications", Proceedings of the Society for Information Display, Vol. 24, pp. 827, 1993. [8] G. F. Neumark, R. M. Park, and J. M. DePuydt, "Blue-Green Diode Lasers", Physics Today, June 1994, pp. 26.