Finding the place where the brain creates illusory shapes and surfaces

Cox and Maier superimposed over illusion
Vanderbilt neuroscientists Michele Cox and Alexander Maier (Donna Pritchett, John Russell / Vanderbilt)

The logo of the 1984 Los Angeles Olympics includes red, white and blue stars, but the white star is not really there: It is an illusion. Similarly, the “S” in the USA Network logo is wholly illusory.

Both of these logos take advantage of a common perceptual illusion where the brain, when viewing a fragmented background, frequently sees shapes and surfaces that don’t really exist.

“It’s hallucinating without taking drugs,” said Alexander Maier, assistant professor of psychology at Vanderbilt University, who headed a team of neuroscientists who has pinpointed the area of the brain that is responsible for these “illusory contours.”

In the Sept. 30 online early edition of the Proceedings of the National Academy of Sciences, Maier’s team reported that they have discovered groups of neurons in a region of the visual cortex called V4 that fire when an individual is viewing a pattern that produces such an illusion and remain quiescent when viewing an almost identical pattern that doesn’t.

Studies have shown that a diverse range of species, including monkeys, cats, owls, goldfish and even honeybees perceive these illusory contours. This has led scientists to propose that they are the byproduct of methods that the brain has evolved to spot predators or prey hiding in the bushes, a capability with considerable survival value.

Although scientists discovered illusory contours more than a century ago, it is only in the last 30 years that they have begun studying them because they reveal the internal mechanisms that the brain uses to interpret sensory input.

brain diagram
The gold square marks the location in the V4 region of a macaque's visual cortex, where the neurons respond to visual contours. (Alex Maier, Donna Pritchett / Vanderbilt)

In mammals, visual stimuli is processed in the back of the brain in an area called the visual cortex. Efforts to map this area have found that it is made up of five different regions at the back of brain (labeled V1 to V5.)

The primary visual cortex, V1, takes the stimuli coming from the eyes and sorts it by a variety of basic properties, including orientation, color and spatial variation. It also splits the information into two pathways, called the dorsal and ventral streams.

From V1, both streams are routed to the second major area of the visual cortex. V2 performs many of the same functions as V1 but adds some more complex processing, such as recognizing the disparities in the signals coming from the two eyes that produce binocular vision.

From V2, one pathway, sometimes called the “Where Pathway,” goes to V5 and is associated with object location and motion detection. The other pathway, sometimes called the “What Pathway,” goes to V4 and is associated with object representation and form recognition.

“Studies have shown that V4 is involved in both object recognition and visual attention, so we thought it might also be involved with illusory contours,” said Michele Cox, the Vanderbilt graduate student who is first author on the study.

Kanzias square
A Kanizsa square (Courtesy of D. Alan Stubbs, University of Maine)

First, the researchers searched for the neurons in V4 that were associated with different locations in the retinas of macaque monkeys. Once these maps were complete, they rewarded the monkeys for staring at a screen containing an example of an illusory contour called a Kanizsa square. This consists of four “Pac-Man” figures with their “mouths” oriented to form the corners of a square. When black Pac-Men are placed on a white background, the brain creates a bright white square connecting them.

While the monkeys were looking at the Kanizsa square, the researchers discovered that the neurons that represented the area in the middle of the Pac-Men, the area covered by the illusory square, began firing. However, when the monkeys viewed the same four Pac-Men with their mouths facing outward – an orientation that doesn’t produce the illusion – these central neurons remained silent.

“Basically, the brain is acting like a detective,” said Maier. “It is responding to cues in the environment and making its best guesses about how they fit together. In the case of these illusions, however, it comes to an incorrect conclusion.”

Chart comparing V4 activity
Two graphs show the activity of neurons in V4 associated with the position of the illusory Kanizsa square. The percentage of neurons firing more than doubles when the monkey views pac-men with their mouths facing inward to produce the illusion (left) compared to their activity level when the monkey is viewing pac-men with their mouths facing outward (right). (Michelle Cox and Alex Maier / Vanderbilt)

 

Richard Saunders and David Leopold from the National Institute of Mental Health, Michael Schmid from Max Planck Institute in Frankfort and Andrew Peters from the University of California, San Diego also contributed to the study, which was funded by the Intramural Program of the National Institutes of Health, National Eye Institute grant P30-EY08126, National Science Foundation Graduate Research Fellowship DGE-0909667, a research grant from the Whitehall Foundation and a Alfred P. Sloan Foundation Fellowship.