Artificial Eye
Artificial Eye
intended to partially restore lost vision or amplify existing vision. It usually takes the
nerve, or in the visual cortex, in order to produce perceptions in the visual cortex.
processing that occurs without the intervention of one's consciousness. While this is a
definitions of ideas like the "self," the converse is equally interesting to me. In this
modern era of exploding technological ingenuity, the sum of which is a product of the
conscious brain, increasingly more opportunities exist for the brain to design the input
it receives. One method by which this occurs is observable in the treatment of visual
devices in the treatment of some forms of progressive blindness. Research in this area
raises numerous conflicts within the realm of bioengineering, but promises, at least, to
Implant Project," spanning the knowledge bases of Harvard Medical School, the
Massachusetts Eye and Ear Infirmary, and the Massachusetts Institute of Technology's
Department of Electrical Engineering and Computer Science, was formed with the
explicit goal of creating an intraocular retinal prosthetic device to combat the effects
of certain types of progressive blindness. The prostheses are intended to stimulate
retinal ganglion cells whose associated photoreceptor cells have fallen victim to
but widespread conditions. Their most recent work has been to orchestrate short -term
implant and undergo a series of tests to determine the quality of visual percepts
experienced over a two- to three-hour period . The leaders of the Retinal Implant
Project, while enthusiastic about their progress, do not anticipate the realization of a
underlying ganglion cells. The ganglion cell axons compose the optic nerve, which
travels from the eye and terminates in various regions of the brain, where the
combined input is processed along multiple routes and ultimately results in the
silicon-microchip system onto the surface of the retina, which will be powered by a
specially designed laser mounted on a pair of glasses worn by the patient . This laser
will also be receiving visual data input from a small, charge-coupled camera, whose
output will dictate the pattern intensity of the laser beam . The laser's emitted radiation
will be collected by the first microchip within the eye on an array of photo diodes and
transferred to the second chip, which will be responsible for electrically stimulating a
set of retinal ganglion cells via fine microelectrodes . Because the ganglion cells in a
stimulus, with the hope that some measure of sight can be restored to individuals with
faulty photoreceptors.
after careful consideration of the effects of the target diseases and the successes and
limitations of electrical excitation at various regions along the visual pathway. Dr. T.
Hambrecht of the National Institutes of Health and Dr. R. Normann of the University
various regions of the visual cortex, a portion of the brain believed to be involved in
the visual cortex of a blind patient, the patient identified spots of light, called
phosphenes, which varied in color and depth, depending on the location of the
stimulus. While this is exciting in its implications for elucidating the physical
arrangement of the neuronal cells involved in the visual pathway, it fails to replicate
the experience of sight because the stimuli are independent of external factors. Also,
the visual percept is the product of neuronal activity in more than one brain region, a
fact that renders the proposition that artificial stimulation in any single cortical area
(or small collection of cortical areas) could recreate the elaborate perception of vision
rather dubious.
hypothesize that higher quality visual perceptions will be experienced with retinal
than with intracortical stimulation. Joseph Wyatt and John Rizzo, III, the co-heads of
the Retinal Implant Project write, ". . . in principle, the earlier the electronic input is
fed into the nerves along the visual pathway, the better, inasmuch as neural signals
farther down the pathway are processed and modified in ways not entirely well
the sole neurons decimated by macular degeneration and retinitis pigmentosa, leaving
the remaining cells involved in the visual process unharmed. Therefore, with the
without drawbacks and complications. While the prosthetic's design offsets many
potential biological problems by having most of its functional parts external to the
body, this fails to solve every obstacle attendant upon the insertion of an inorganic and
electrically active device into a living eye. Rizzo and Wyatt explain,
prosthesis".
sequestered from all intraocular fluids, which could corrode the thin metal of the
diodes and ruin the chips' ability to transmit electrical impulses from the laser t o the
through metallic electrodes are toxic to living cells, and must be diminished in order
to insure minimal chemical devastation of the retina. The electrodes themselve s must
also be anchored to the retina with sufficient strength to accommodate physical
agitation due to daily activity. This promises to be a trying procedure. The retina is a
slim 0.25 millimeters thick, a dauntingly thin fabric onto which to stitch a complex,
albeit tiny, piece of machinery. As in all retinal surgical procedures, the implantation
membranes, both of which would exacerbate, rather than prevent, vision loss. These
concerns have not been seriously addressed in this stage of the research, because no
restoring sight with chronic implantation. Although short-term tests of the photodiode
array have been undertaken, their success was only measured in the ability of the
diodes to generate output once inserted into the eye. While this was a necessary
apparatus to fluids of the inner eye, the diodes have never been attached to the retinal
tissue, and therefore, their viability as conduits of visual information has not been
examined. The data the researchers cite in their preliminary investigations and those
of their colleagues report that the single visual percept accomplished by artificial
sight, and certainly falls short of the lofty goal claimed by its spearheads: to "improve
quality of life by providing gross perception with some geometric detail that would
increase independence by making it easier for a blind person to walk down the street,
for instance".
THE BIONIC EYE SYSTEM
area of scientific research, with new devices going into clinical trials at a breakneck
pace. A bionic arm allows amputees to control movements of the prosthesis with their
thoughts. A training system called BrainPort is letting people with visual and balance
disorders bypass their damaged sensory organs and instead send information to their
brain through the tongue. Now, a company called Second Sight has received FDA
approval to begin U.S. trials of a retinal implant system that gives blind people a
detection of light -- to people who have gone blind from degenerative eye diseases
like macular degeneration and retinitis pigmentosa. Ten percent of people over the age
inherited disease that affects about 1.5 million people around the globe. Both diseases
damage the eyes' photoreceptors, the cells at the back of the retina that perceive light
patterns and pass them on to the brain in the form of nerve impulses, where the
impulse patterns are then interpreted as images. The Argus II system takes the place of
these photoreceptors.
The second incarnation of Second Sight's retinal prosthesis consists of five main parts:
A digital camera that's built into a pair of glasses. It captures images in
implanted wire
mm by 1 mm
The entire system runs on a battery pack that's housed with the video
processing unit. When the camera captures an image -- of, say, a tree -- the image is in
the form of light and dark pixels. It sends this image to the video processor, which
converts the tree-shaped pattern of pixels into a series of electrical pulses that
represent "light" and "dark." The processor sends these pulses to a radio transmitter on
the glasses, which then transmits the pulses in radio form to a receiver implanted
underneath the subject's skin. The receiver is directly connected via a wire to the
electrode array implanted at the back of the eye, and it sends the pulses down the wire.
When the pulses reach the retinal implant, they excite the electrode
array. The array acts as the artificial equivalent of the retina's photoreceptors. The
electrodes are stimulated in accordance with the encoded pattern of light and dark that
represents the tree, as the retina's photoreceptors would be if they were working
(except that the pattern wouldn't be digitally encoded). The electrical signals
generated by the stimulated electrodes then travel as neural signals to the visual center
of the brain by way of the normal pathways used by healthy eyes -- the optic nerves.
In macular degeneration and retinitis pigmentosa, the optical neural pathways aren't
damaged. The brain, in turn, interprets these signals as a tree and tells the subject,
It takes some training for subjects to actually see a tree. At first, they
see mostly light and dark spots. But after a while, they learn to interpret what the brain
is showing them, and they eventually perceive that pattern of light and dark as a tree.
The first version of the system had 16 electrodes on the implant and is still in clinical
trials at the University of California in Los Angeles. Doctors implanted the retinal
chip in six subjects, all of whom regained some degree of sight. They are now able to
perceive shapes (such as the shaded outline of a tree) and detect movement to varying
degrees. The newest version of the system should offer greater image resolution
because it has far more electrodes. If the upcoming clinical trials, in which doctors
will implant the second-generation device into 75 subjects, are successful, the retinal
electrodes on the retinal implant, which they believe could allow for facial-recognition
capabilities
HISTORY
electronics at the level of the retina, optic nerve, thalamus, and cortex. Visual
prosthetics, which have been implanted in patients around the world both acutely and
chronically, have demonstrated proof of principle, but do not yet offer the visual
ARTIFICIAL VISION
exclusive to diseases such as retinitis pigmentosa and age related related macular
which could provide form vision to this subset of blind patients. This visual prosthesis
would be situated in the eye cavity on the retinal surface. It would create the sensation
of seeing light by electrical stimulation of the remaining retinal cells which remain
into pixels and then electrically stimulating the retina by a pattern of electrodes, this
the devices that use either ultrasonic sound or a camera to sample the environment
ahead of an individual and render the results into either a series of sounds or a tactile
display. From this the person is supposed to be able to discern the shape and
proximity of objects in their path. The second major form is retina enhancers. These
machines supplement functions of the retina by stimulating the retina with electrical
signals which in turn causes the retina to send the results through the optic nerve to the
brain. The third major category of visual prosthetic is a digital camera that samples an
image and stimulates the brain with electrical signals--either by penetrating into or
The ability to give sight to a blind person via a bionic eye depends
on the circumstances surrounding the loss of sight. For retinal prostheses, which are
the most prevalent visual prosthetic under development (due to ease of access to the
best candidate for treatment. Candidates for visual prosthetic implants find the
procedure most successful if the optic nerve was developed prior to the onset of
blindness. Persons born with blindness may lack a fully developed optical nerve,
TECHNOLOGICAL CONSIDERATIONS
for individuals with visual degradation. The visual prosthetic in humans remains
investigational.
DEVICE
retina with a microtack the width of a human hair. A wireless microprocessor and
The camera on the glasses captures an image and sends the information
to the video processor, which converts the image to an electronic signal and sends it to
the transmitter on the sunglasses. The implanted receiver wirelessly receives this data
and sends the signals through a tiny cable to the electrode array, stimulating it to emit
electrical pulses. The pulses induce responses in the retina that travel through the optic
nerve to the brain, which perceives patterns of light and dark spots corresponding to
the electrodes stimulated. Patients learn to interpret the visual patterns produced into
meaningful images.
electrode array and a relatively large implanted receiver implanted behind the ear. The
second generation Argus II is designed with a 60 electrode array and a much smaller
WORKING
Normal vision begins when light enters and moves through the eye to
strike specialized photoreceptor (light-receiving) cells in the retina called rods and
cones. These cells convert light signals to electric impulses that are sent to the optic
nerve and the brain. Retinal diseases like age-related macular degeneration and
(worn on a belt) that converts the data to an electronic signal and transmits it to a
receiver on the eye. The receiver sends the signals through a tiny, thin cable to the
microelectrode array, stimulating it to emit pulses. The artificial retina device thus
bypasses defunct photoreceptor cells and transmits electrical signals directly to the
retina’s remaining viable cells. The pulses travel to the optic nerve and, ultimately, to
the brain, which perceives patterns of light and dark spots corresponding to the
TECHNOLOGY OVERVIEW:
PATHWAY :
how information about the outside world is encoded in the neuronal activity in
the central nervous system. The effects of a continuous exogenous input (the
visual world) are manifest through discrete electrical events in the early visual
pathway. The basic anatomy is shown in Figure 1, where light entering the eye
falls onto the photoreceptors of the retina and is transduced into electrical
signals that are processed through layers in the retina, and then passed through
the lateral geniculate nucleus (LGN) to the visual cortex. Individual neurons in
each of these areas respond to light within a restricted region of visual space,
encoded in these stages of the early visual pathway, so that we may, in turn,
situations where function has been lost to trauma or disease. Note that current
attempts at visual prosthetics are still in the nascent stages, and there are major
signal processing, estimation, prediction, and control-related problems that must
be overcome before such technology becomes truly viable. Despite the fact that
the anatomy and physiology of the visual pathway have been studied for some
time, much is still not known about the true nature of the neural code that
visual pathway encode information about the outside visual world in a causal
manner, but the task of higher centers in the brain is to somehow interpret the
outside world from the spiking activity of neurons that project to them.
intermediate stage of processing between the retina and cortex) (Stanley et al.,
1999), providing a description of the information about raw light intensity being
encoded in specific cell types within the early pathway. Figure 1 shows the
left, and a reconstruction of a much larger region of visual space on the right
the next several years. The large majority of experimental work on the
functional aspects of coding in the visual pathway has utilized artificial classes
of visual stimuli. To understand the true functionality of the visual pathway and
surprising amount of detail that was extracted from the ensemble neuronal
activity in the LGN, as shown in Figure 2, there are many unresolved issues.
questions are raised concerning the role of adaptation in the transient natural
information carrying properties of the pathway, and the role of the early visual
point in visual space for natural vs. artificial (white noise) visual stimuli, along
with the corresponding second order statistics (power spectra) in both temporal
the early visual pathway has (at least) two distinct roles in processing of
Figure 4.
Figure 4. The early visual pathway serves to detect changes in the outside visual world, and to transmit
transmit fine details concerning features of the outside visual world. We may
question: is something of interest there or not? The fast and robust detection of
changes in the external environment may be critical for the survival of the
organism. The startling aspect of this dichotomy is that the seemingly disparate
time. One of the most striking properties of the visual system is that it can
effectively shift the neuronal sensitivity in response to changes in the light level.
The adaptive mechanisms are continually active in all but the most artificial of
laboratory conditions, as we move our eyes across the visual field, and objects
move in and out of our view. These aspects of encoding are ignored in many
studies, and are the subject of much controversy as to what the functional
(Stanley, 2002; Lesica et al., 2003; Lesica and Stanley, 2005a; Lesica and
Stanley 2005b), testing in the retina, LGN, and visual cortex. A block diagram
of the encoding framework is shown in Figure 5, along with the evolution of a
spatial receptive field (RF) of an LGN X cell over several seconds of exposure
Meister). The left column demonstrates that the gain and offset (theta) of the
process.
collect data from the early visual pathway that specifically address issues
DETECTION:
The lateral geniculate nucleus (LGN) of the thalamus is the
gateway to the visual cortex, controlling the flow of visual information from the
retina [for a review of LGN function, see Sherman (2001a)]. Understanding the
neural code of the LGN is an essential first step in characterizing the proc essing
action potentials. It has been suggested that bursts serve to signal the
features of the stimulus (transmission) (Crick, 1984; Guido et al., 1995). Bursts
may serve as a wake-up call, alerting the visual cortex to the presence of a
stimulus in the receptive field (RF) and signaling the beginning of tonic relay
(Sherman, 2001b).
bursting was observed during natural scene stimulation (relative to white noise
stimulation).
The stimulus features preceding burst events and tonic spikes
were characterized, revealing that the type of visual stimulus evoking a burst
was fundamentally different from that evoking tonic activity, and was in fact a
together, our results support the detect/transmit framework described above, and
suggest that LGN bursts may be an important part of the neural code of the
according to behavioral state, from its lowest level during sleep to its highest
level during active waking (Hirsch et al., 1983). We hypothesized that the
resting potential would affect the particular features of the visual stimulus that
characterized the visual features that evoke bursts at different resting potentials
using simulated and experimental LGN responses to natural scene movies, and
our results support this claim. To investigate the functional consequences of the
different visual features (Guido et al., 1995; Sherman, 2001a; Smith and
Sherman, 2002). Although comparing the LGN response with and without
bursts in vivo is not possible (Porcello et al., 2003), these experiments can be
accurately reproduce the LGN response during both tonic and burst firing
(Smith et al., 2000; Lesica and Stanley, 2004). We simulated the LGN response
to different visual features at different resting potentials with and without the
burst mechanism, and compared the results using signal detection theory. Our
results show that bursts enhance detection of the onset of excitatory features at
low resting potentials and the offset of inhibitory features at high resting
potentials, suggesting that bursts may play a dynamic role in visual processing
constraints on bandwidth.
INFORMATION TRANSMISSION :
For decades, the visual receptive field (RF) has served as the
fundamental building block for our current understanding of the visual pathway
linear spike generation, has been shown to be a good predictor of firing rate for
many neurons in the early visual pathway (Dan et al., 1996; Stanley, 2002).
the photoreceptor transduction process and takes place over a time course of
based description of the firing rate to this relatively coarse temporal scale.
order of one millisecond (Reinagel and Reid, 2000; Liu et al., 2001). The
response has been the seed of a far ranging debate concerning temporal
neural coding of dynamic stimuli (e.g., de Ruyter van Steveninck et al. (1997);
Warzecha and Egelhaaf (1999)). Figure 8 shows the ability of a simple linear-
(middle).
Figure 8. Raster of the spike times of a simulated LGN neuron to full-field Gaussian white noise, with the
resulting instantaneous spike rate (below, solid line) and LN prediction (dashed line), at a binsize of 0.3
ms. Dashed horizontal line shows the mean firing rate. Bottom, actual (solid) and LN model prediction
properties by incorporating elements that capture finer time resolutions into the
total information about the stimulus. As a result, two neurons with subtle
differences in their receptive fields could produce distinct responses that would
ONGOING PROJECTS:
Institute (USC) were the original inventors of the active epi-retinal prosthesis
University in the early 90s. In the late 90s the company Second Sight was formed
implant had 16 electrodes and was implanted in 6 subjects between 2002 and
2004. Five of these subjects still use the device in their homes today. These
subjects, who were all completely blind prior to implantation, can now perform
a surprising array of tasks using the device. More recently, the company
announced that it has received FDA approval to begin a trial of its second
and National Science Foundation) have supported the work at Second Sight and
USC.
MICROSYSTEM-BASED VISUAL PROSTHESIS
(MIVIP):
spiral cuff electrode around the optic nerve at the back of the eye. It is
translated into electrical signals that stimulate the optic nerve directly.
Telescope is one type of visual implant that has met with some success in the
implanted in the eye's posterior chamber and works by increasing (by about three
times) the size of the image projected onto the retina in order to overcome a
prosthesis. The chip is located behind the retina and utilizes microphotodiode
arrays (MPDA) which collect incident light and transform it into electrical
current stimulating the retinal ganglion cells. As natural photoreceptors are far more
efficient than photodiodes, visible light is not powerful enough to stimulate the
evoked cortical potentials were measured from Yucatan micropigs and rabbits.
animals tested. The thresholds identified in this study were similar to those
required in epiretinal stimulation. The latest reports from this group concern the
results of a clinical pilot study on eight participants suffering from RP. The
Lauderdale.
Joseph Rizzo and John Wyatt at MIT and the Massachusetts Eye
and Ear Infirmary have developed a stimulator chip that sits on the retina and is
microchip containing 3500 solar cells, which detect light and convert it into
electrical impulses, which stimulate healthy retinal ganglion cells. The ASR
image is projected onto the retina via natural eye optics, and activates
photodiodes in the subretinal implant that convert light into pulsed bi-phasic
electrodes and neural cells necessary for high resolution stimulation can be
stimulator chip sits in the primary visual cortex, rather than on the retina. Many
subjects have been implanted with a high success rate and limited negative
effects. Still in the developmental phase, upon the death of Dr. Dobelle, selling
the eye for profit was ruled against in favor of donating it to a publicly funded
research team.
Iridium Oxide (AIROF) electrodes arrays. These arrays will be implanted on the
occipital lobe. External hardware will capture images, process them and
wearable external image capture and processing system. Studies on animals and
CONCLUSION:
science field. It’s good news for patients who suffer from retinal diseases. A
bionic eye implant that could help restore the sight of millions of blind people
could be available to patients within two years. Retinal implants are able to
partially restore the vision of people with particular forms of blindness caused
million people worldwide have retinitis pigmentosa, and one in 10 people over