Transcript
The following content is provided under a Creative Common License. Your support will help MIT Open Courseware continue to offer highquality educational resources for free. To make a donation or view additional materials from hundreds of MIT courses, visit MIT Open Courseware at ocw.mmit.edu. Okay, good afternoon. Uh, today we're going to go beyond the way we've spoken about before. We talked about how psychologists measure the mind. Uh, how neuroscientists interrogate the brain. And so now we'll talk about the first human faculty that we'll consider in a series of faculties through the course, vision, how we see.
Um, and for today's lecture, I got help from Melissa Troyer, one of your teaching assistants. So, one of the things we can think about is what are the purposes of vision? What do we use site for? Uh, and we'll talk about that. Problems that the visual system has to overcome, what are the obstacles for vision to work accurately and efficiently and how does the brain organization of vision subserve the human capacity to see. So, human perceptual abilities are amazing as are uh uh perceptual abilities of many species in different areas. But humans can detect a candle 30 miles away on a dark clear night.
They can detect colear displacement that's in your ear equal to the width of a hydrogen atom. You can taste one teaspoon of sugar even when it's mixed in two gallons of water. You can smell a drop of perfume diffused into the space of a threebedroom apartment. So the human capacity to perceive the world in a highly sensitive way is remarkable. We're going to focus on vision specifically today and think what do we use vision for? What what's how does it serve us in dealing with the world? And uh researchers have thought about two major reasons that we see two purposes of vision. One of them is object recognition.
recognizing things in the world, people we know, words we can read, chairs, tables, animals, all kinds of things that we see out there. We need to know who they are, what they are, uh, in order to operate in the world. And the second one is a little bit different. Navigation, getting around in the world. When you're running, when you're jumping, when you're reaching to grab something, you're not usually so interest much interested in what something is as where you're moving, where you need to move to avoid something being thrown at you. So, two big purposes of vision. what things are and where they are so you can navigate around quickly in the world.
And when we think about purposes of vision uh in this sort of for what things are or where they are uh psychologists and people working on computer vision have recognized a series of problems that our visual problem system has to solve. We have to link unique images because when we see something it almost always look different from one perceptual moment to the next. We can see the same person for example but under different conditions of illumination, darkness or lightness or shadows. The angle we see them at, the distance we see them at, the expression on their face, a smile or a frown, uh shadows that might be being cast, occlusion, a thing blocking part of their face.
And yet we can recognize a person very well under all these circumstances. So what arrives in our eye is different from all of these views, but what we interpret them is all the same. That's a person I know. The same thing with letters. We can see letters in all kinds of fonts and all kinds of handwriting and yet we can interpret what they are in a uniform way or body. We can see bodies in all kinds of different positions, but our visual system lets us know right away that it's a person. And so psychologists have tried to formalize these kinds of problems to ones of equivalence. So something is the same thing at different views, generalization, something has a very different shape or impoverished input where there's poor lighting or something's complicated and you still figure out what it is.
for getting around in the world, aware things are in the world. Uh you you're moving through space and tracking things and there's many sources of movement. Your eyes are constantly moving, your head is moving, your body is moving, things in the world moving. And you have to sort all those out. Run quickly, jump world spatially. And so here's some examples. Here's a shape constancy problem uh that where here's two different versions of a cat. It's trivial for you to know that even though these things have different shapes, they represent the same thing. But that's an achievement of your visual system to easily make that equivalence across two very different shapes.
And we know from computer vision how hard these problems are. Uh no computer vision system sees with anything like the generalized ability of a very young child. So our our visual systems are are so brilliant that psychologists and vision scientists really interrogate our visual system to figure out how do we do it? If people didn't do this, we'd think it'd be impossible to accomplish at all. Here's another example that's easily solved by people, not so easily solved by machines. Uh if you see a something like a car at different angles, we know that's the same thing pretty easily, even though again the information that arrives to our eyes is radically different.
And the same thing can be said of something like all these different versions of the letter C. Radically different shapes. Uh but we can readily interpret almost all of them. This one too tough. Uh as a letter C. So our visual system does this kind of brilliantly. And also you can get very impoverished views. A key might be covered by something closed on a hook. There might be a book over here. There might be a fire hydrant over here or a person. And yet, even though only get only partial information, it's relatively trivial to discover for you what it is you're looking at. Or you can see things like you've never seen before.
The the pink elephant, this odd picture, the this uh striped apple, you've never seen them before, but it's not really a problem for you. So again, your visual system is just so brilliant at matching what it sees with what you know to figure out what's in front of you. So today we're going to talk about how uh our minds and brains allow us to see the world vision. And we'll talk about it in three parts. How philosophers and psychologists have thought about the idea of seeing. How when information first enters your uh your eye, your retina which are the layer cell of layers in the back of the eye, how that retina is already organized to help you see the world and how that information is then transported uh into the cortex uh where higher level processing lets you know where you are and what you're looking at.
So uh uh the ideas about how we learn to see the world have have their roots in philosophy. For example, John Lockach is associated with the idea of the blank rate, blank slate or tabular rosa. He said, "Let us suppose the mind to be a white paper void of any characters without any ideas. How comes it to be furnished when it comes the vast door which the busy and boundless fancy of man has painted on it with an almost endless variety? Where do we get the information for how the world works when we look at it?" And his answer to that was experience. that we notice things around us and experience drives our understanding of the world.
And that position that there's a blank slate and we sort of learn objectively from the world around us has been called the objectivist view and maybe that we see the world because we build up through experience knowledge about how accurately represent what's around us. The alternative view has emphasized uh the how much our mind organizes what we see instead of what's out there itself. And so the Gestalt psychologist or Gestalt views on perception say it's not what's out there in the world but the way our mind organizes and believes what's out there. Um and these two things can come together. So for example when you think about how you listen to a piano uh music comes from piano uh and the same way a pianist strikes chords.
There's things out there in the world that you see. The piano has certain limitations. Uh it can sound like some things but not others. It can't be a clarinet. there's constraints in the world on what's possible uh to see or what's out there, but that our per and our percepts are evoked by nature in this way, but they are personal and not a copy of nature. In other words, we each individually figure out what's going on there by our own experiences and interpretation. And they're exactly that, an interpretation, not a simple mirroring or copy of nature. So, I'm going to try to convince you of something that might not be obvious to people when they first think about it.
That vision is an interpretation of the world around us. is not simply a video camera or a mirror. It's an active uh calculation of what's out there. And we see through inference what we believe that what we see. And that visual illusions, and you've seen some before, I'll show you some again, are not just illusions to trick people and confuse them. Uh but they're demonstrations of the gap between what's actually out there in the world and how we interpret it. Uh most of the time, uh we don't have illusions. We don't walk into walls. We don't uh misidentify people we know commonly. Because illusions are rare because our minds and brains have evolved to interpret the world that's out there and the system uh works so brilliantly coupled with the environment that we actually live in that we don't think about it.
So the person on the street says well what do I need to uh see I open my eyes but that's because our visual system works so brilliantly effortlessly and automatically as such a calculating machine that that's why it feels so simple. So, uh, here's a one small example, and I'll show you a number of of visual illusions that show us how we're constantly interpreting even the most simple thing. So, for example, here's two people, and we're not worried that this is one of the shortest uh, men you've ever seen because we know through perspective, this person's standing back there, even though if they were standing right next to somebody, you'd worry about the size of that person.
But, so, we're constantly interpreting information by the context in which we see it. Here's another example of the choice of interpretation. So you can see a vase or you can see two faces here. Usually it's hard for people to see them both simultaneously. They tend to flip back and forth, but you can choose the interpretation of what you see. Um so let me pick one example where people uh have studied a lot which is the issue of brightness constancy. So here's the here's the problem for the visual system. The ambient brightness, the brightness around us varies in staggering ratios when we're outdoors in the sun and some even that's not constant, right?
Sometimes it's a bright day, sometimes is a cloudy day. Sometimes we're indoors under bright conditions or less bright conditions. So huge changes in the ambient illumination or in shadows will make it even more complicated. That means in a purely measurement sense, in a purely physics sense, a piece of coal in sunlight reflects 10 times as much light as snow in the shade. So, think about that for a moment. You're not disturbed if you see a piece of coal inside or outside. They both look to you like black, dark pieces of coal. And snow looks pretty much the same to you if it's inside or outside.
But if your visual system worked like a simple objective light meter, you would conclude uh that the piece of coal in the sunlight is a much brighter thing in an objective sense than snow in the shade. And yet you never make that conclusion because you're constantly automatically without effort adjusting mentally for the ambient light condition. So we use brightness all the time to help us figure out is it a piece of coal or sunlight. But that brightness perception is constantly adjusted to interpret brightness in the context we're sitting in. And uh perceptual psychologists have worked on how people uh calculate this.
So here's an example of a dark letter T. Again, the black tea would be 10 times brighter outdoors than white paper is indoors. Okay? So, so you would uh and yet you're never bothered by that. You can read a a newspaper or something else indoors that are outdoors with equal ease because people are calculating the ratio of the ambient lighting uh lower inside, much brighter outside from the sun. Uh and using that information to make inferences about the relative brightness of a stimulus they're looking at. And there's all kinds of examples or illusions that show us this. So, for example, here you you detect a white tile in the shade and a gray tile in brightness.
And that's how you interpret it. But that's because you're taking already into account without even thinking about it for a moment the fact that this is in the shadow and this is in the bright light. You're right in your interpretation. But if we if it was something if we show a constant background, you could see that those two are actually identical in brightness. Um the same thing you could take a look at uh uh this cube and uh this cube as part of these Rubik's cubes. This looks orange. This looks brown. Uh you're adjusting for light as you make those interpretations. And if you make the background constant, you can see those are identical in color and luminance.
So this is shows you that we're constantly making these interpretations. Only these tricks of visual illusion make us uh realize that our inferences are occasionally wrong. uh but they're incredibly right almost all the time. So here's another example here of taking a local luminance into account. So you're deciding this is typically people see this as a lighter gray and this is a darker gray. Again they're using the contrast that surrounds it to make that interpretation because if we give it a constant background you can see that in an objective sense the two are identical. People use edges as a very powerful source of information to make these inferences and you can see that in one moment because this boundary here is used to make judgments about the relative uh uh brightness around an object.
So you just do this uh that boundary disappears and the two things look uh equally gray one above the other. Or in a less spectacular but measured example uh here's two different uh uh shades of gray. And if you run a light meter, objectively looking at how much light is reflected from this here, that changes. This looks almost the same as this, but really there's just a manipulation at the boundary. So again, here's a light meter. Here's the boundary. So these two sides are really identical. Uh it's just been manipulated by the boundary. And you can see that because if you get rid of that boundary, now you can see that these two sides are equally bright.
Another example again of how we're constantly using local information about brightness to make judgments about objects is here you see a picture of a woman. Here's her forehead. Here's her darker hair. But in fact, that's a judgment and interpretation because if we cover up the surrounding information, the hair is identical to the face. Here's some other illusions. uh uh not all about brightness, but again they're just reminders uh that we're what we see is constantly a calculation and interpretation of many factors. So here's a fun spiral. You can see it zooming around going from inner tightness and unwinding peripherally.
And so we can add a uh dot to that. And now we can let this travel around to the middle. But you can see it's not quite making the middle. uh and we can try that again because in fact in this uh picture every line every circle is a circle and none of them are connected one to the other. They just appear that way. This uh illusion that Richard Gregory describes uh he was inspired because he saw a wall in a cafe that looked like it had not been well assembled by the person building it as if they had been you know consuming something from the cafe as they built the wall. uh uh and you know, bizarrely having all kinds of uh uh uh lines that are not lined up as you would expect on a well- constructed tiles on a wall, but in fact, every line here is perfectly straight, and you're interpreting the black and white uh edges to to confuse you about the lining up across the horizontal.
This is very striking. Here's a a Rubik's cubes um uh that again now they're adding one more story into this which is colored but just we use that often in everyday site of course to make conclusions about things. Um and here you can see the difference between for example uh this yellow cube and this brown cube. Um this what did I want to do? Okay, you can't you can see the difference between this brown cube. Sorry, let me get my illusion correct. uh and this uh uh darker cube, lighter brown and darker brown. But if we cover those up, uh those are identical and they're gray. Um here's another one that shows you it's not just the color itself, but the spatial location.
So here's a pink circle uh near the middle of this uh display. And here's a sort of more orange one. So we're just simp simply going to expand those out and get it bigger and bigger. And as it's moving across uh your eye, even though objectively it's remains pink and orange or the things that led you to interpret that, as it gets big enough, the color difference disappears uh to your perception. And sometimes you can get, and this is a very complicated one, uh illusions uh I don't know if it's working for you, but uh uh that these things are actually turning um even though none of them are moving at all.
Okay. Okay. And one last simple example. Uh you know, here's yellow on gray. Here's sort of a light gray on yellow. But in fact, these X's are identical. And you can see that when they meet here. So again, we're constantly interpreting color, shape, uh uh brightness by things that are surrounding it. And sort of everything is being the product of an interpretation, not what's out there in an objective sense itself. And so if we think about the subjectivist view that that can't be right at the limit the subjectivist view would be that everybody sees everything differently all the time. That'd be a confusing world of of hallucinations.
We don't live there either mostly. So we think it's because there's a relationship between the two. Sort of a synthesis. We perceive only within the limits of our nervous system. There's a way that we see the world. Um but the way that our nervous system computes and makes inferences about the world reflects many properties of the world that are efficient and accurate. So how do we get information into our brains uh to to see? So if you were to uh design a system that was hopelessly failed, uh the first thing you would do is think the visual system is going to fail. I mean one the first thing it does is it takes objects in the world and it flips them upside down and how they're perceived in the eye, the front of the eye, the back of the eye.
Here's the retina. And the first place in your uh brain that sees something is in the back of your eye. You think you would put it in the front of your eye and the information bounces back into the deepest part of the eye, then comes out and leaves through through the optic nerve. You also know from prior classes that the world is organized by left and right visual fields instead of the way we intuitively think about the world. Um, let's take a look closer look at the retina. These layers of cells uh in your eye that begin vision. So, light comes in and bounces through the back. And here are the rods and cones where vision begins.
The cones uh are primarily near the phobia. The rods are primarily peripheral. Uh and I'm reminding you again that as as the as the optic nerve leaves uh it goes to the optic cayazm the fibers get sorted out by whether they're having information from the left or right side of the world and then enter the cortex that way within the retina within your eye. Uh here are the sort of a graphic of the of of the different kinds of cells. Here's an actual what the cells actually look like. And here's a a blowup of these remarkable cones, these larger uh uh uh entities and the and the neuron and the con and the rods um that you can see are very small but many of them.
And a big thing difference between rods and cones that the rods are receptive to information at only one wavelength. uh they're effectively colorblind. We'll come back to that, but that's a good wavelength to pick up information uh for example in low light. The cones are selective for blue or red or green. That's a stuff of seeing color, but it doesn't operate too well unless you have a pretty well illuminated situation. And the rods and cones have a striking uh uh physical uh sep organization. So here's the distribution of cones for color. pretty much all of them in the phobia in the middle part uh of of the retina and then the rods are spread out uh peripherally.
So there's this big difference in where they're located. And another big difference is that the cones, the ones that respond to color and that are in in the middle of the phobia are uh have an almost onetoone relationship between the receptors for color information and the neurons that leave the eye with information that will go into the brain. The rods have a many toone relationship. Many rods are contributing for a combined calculation of some kind to a single neuron that leaves the brain. So you can already see at the very first moment of reception from the rods and from the cones very different kinds of processes are being begun as you begin to see.
Now two ideas that have been very helpful for understanding how vision is organized in the brain are receptive fields and retinopathy. Receptive fields are simply an area of external space. It's a physical spot in space uh in which a stimulus activates a neuron. So neurons early in vision will respond to specific locations in space when you're looking straight forward. One neuron might cover this area, another neuron might cover that area and so forth. Retintopy refers to topographic or spatial maps of visual space across a restricted region of the brain. And so retinopathy keeps these receptive fields lined up.
So if a neuron is seeing this spot, this a retinopic map means the next spot stays next to it and the next spot stays next to it. So you can reconstruct what you see based on a lot of very local uh glances at the environment and then it travels into uh from the eye through the optic nerve into something called the lateral genicate nucleus. That nucleus is simply a collection of cells. This is part of the phalamus and from there the fibers will travel into the cortex to begin conscious visual perception. And you have one on the left and one on the right of the lateral genic nuclei. And if you look at this blown up, and this is a sample from a monkey, but the human one looks very similar.
You can see one, two, three, four, five, six layers of cells in each lateral geniculate nucleus. The first two look a little bit different. If you look carefully, uh they're comprised of larger cells. The other four are comprised of smaller cells. So people describe the cell layers made up of larger cells as magnosellular big cells and the other four layers as parvocellular or small cells. The magnosellular two cell layers tend to have large cells. Mo a lot of their information comes from the rods, the black and white elements good uh for seeing and low vision. They have large receptive fields.
They cover relatively large patches of the world for each neuron. Three times larger than the parocellular ones. The neurons fire rapidly, transiently, are colorblind. They're good in low contrast, low lighting. Um, the parvo cellular ones are smaller. They get a lot of their input from the cones. They have smaller receptive fields. They have slow sustained uh responses. They don't turn on and off very quickly. They're wavelength sensitive, so they can respond to color. They operate best when things are very bright. They're unique to primates, and there 10 times more of them. But again, even before you get to the cortex, there's this huge organization between two modes or pathways of perception to construct the world as you see it.
And then uh we've gone over before that as you leave the nuclei, the lateral genocid nuclei, then the next fiber pathway takes you into the uh primary visual cortex in the back of your brain. Now vision is so important for primates and people um that when people estimate how much of the neoortex is is devoted to different modalities. A common estimate is that about half of the brain is primarily devoted to vision 11% to touch 3% of audition. Uh these are ballpark estimates but it shows you that how how visual we are uh with our fellow primates. There's many specialized areas uh within the human visual cortex estimated uh some years ago as 32 distinct areas each performing a different task.
Lots of specialization and another fascinating sort of aspect of vision is proliferation as we go up into higher stations of of visual processing. So in one lateral genetic nucleus in your brain and you have two of them one on the left and one on the right you have about a million neurons. They will send information that will be interpreted by about 250 million neurons in your visual cortex. Those will communicate to about 400 million neurons in the next level of processing. And then finally, there'll be something like 1.3 billion visual cortical neurons in the brain overall in a gross estimate.
So it's as if to discover what you're seeing, you're having larger and larger populations of neurons unpacking the mystery of what initially came into the brain. very impoverished information that's expanded to begin to understand what you need to perceive a face or a word or a physical movement. So a single lateral genicate neuron it could be estimated will take 600 cortical neurons to interpret what this uh lateral genicate neuron has been exposed to. Here's this area in the visual cortex where the information arrives first into your brain and primary visual cortex. And when we think about cortex in perception and uh in several modalities, one of the striking things is how it's organized to achieve certain goals.
So here's we're going to switch for a moment to the parts of your brain that move your body motor cortex or that have your sense of touch. And when people uh stimulate these and look about what they're related to, for example, in patients undergoing treatment for epilepsy or and animal studies support this uh where you can do much more extensive experimentation, a very striking thing occurs, which is the number of neurons devoted to different parts of your body are radically different than your actual body size. So this funny looking what's so-called homunculus represents how many neurons for example in your motor cortex are devoted to different parts of your body.
So it turns out, you know, that we do incredible things with our hands. So we devote it seems like a tremendous amount of this area to the hand. That's why that looks so large. We don't tend to do uh there's a reason we do hand shaking and handwriting and typing with our hands and not with our hips because although our hips are physically larger than our hand, we devote incredibly small number of neurons to do that. So it's a trick of the brain given a certain limited size to blow up its representation of what needs to be done brilliantly and to reduce its representation of parts of the body that it doesn't have to do too much with.
So what's blown up? Your hand, uh things to do with your face so that you can speak. Um your tongue because that has to accomplish a lot in terms of speech, in terms of eating. Um and things like your toes and ankle are jipped of representation because you don't do that much. That's brilliant. So, it's a very clever strategy by the brain to devote the amount of neural resources to make that part of your body accomplish either very complicated things or very simple things. Um, and if people on the outside looked like this, uh, this is what they would look like. Giant hands, giant head, and a very shriveled up trunk.
So, uh, so that's not what we look like, but that's the way our brain represents us, our our our bodies, so that we can have fantastically complicated control of our hands and things having to do with speech uh around our mouth. Uh, it's different for different modalities. For hearing, things are organized by uh frequency, tonotopy. For vision, things are organized in two ways. The spatial relations are maintained. They have to be. So you know as you as different neurons saw different receptive fields how is that all kept? So here's a kind of a rough experiment where a monkey saw before it was uh as they politely say sacrificed a display like this.
This is the brain of the monkey flattened out and you can see it has this representation like this. Now you could say well that's how we see. We line everything up but this is not the part of our brain that we associate with conscious perception at all. But if you didn't keep the spatial information aligned correctly, you could never interpret things in the end correctly that go together like different parts of a hand or different letters within a word. In humans, uh it's also in the back of the brain. It also keeps spatial information. But what do humans do and other primates? They greatly expand uh the central part of vision.
So here's a central part of vision, the so-called phobia, uh which is a small part of the of the visual display. Here's the everything else that's in peripheral vision. So this dark green, dark purple, but but when it comes to the representation in the visual cortex, this small area of what we see becomes pretty large. It's way over represented. So just as the motor cortex over represents the hand, the visual cortex over represents the cone fovial part of of of the brain. uh so they can do much more examination much more computation on that small phed. So that's why it matters tremendously where people put their eyes.
Where they put their eyes is where neural machinery is dedicated to do its most brilliant analysis. And peripheral regions which are large in vision get relatively small representation. All we do in the periphery is kind of notice if something is whizzing at our head. Um uh and for that we don't need to be that sophisticated. Now what do neurons uh communicate in primary visual cortex? Well, this is a sort of seminal Nobel prizew winning work from Hubble and Weasel at Harvard who discovered that what neurons respond to in primary visual cortex are uh is the orientation of a piece of of something like this.
So here's a neuron that loves a little bit of a stimulus that's at this orientation. Here's each of these lines is a neuron is the neuron firing. It generalizes. If a if a bar is close in orientation, it will still like it somewhat. And if the bar moves away from its preferred orientation, it won't respond at all. So these neurons are coding something about local orientation of little lines, those little lines will be assembled later on in the brain to represent a letter, a word, a book, a face, a chair, and so on. But this part, these neurons simply know they're seeing a line of this angle or that angle that will be assembled later on for an entire conscious percept.
And then that information will go from primary visual cortex in two pathways uh that have two quite different properties but turn out to be the sort of superin information processing pathways of your brain and my brain. So where do we first learn about this fundamental organization of how we see into two giant highways of information processing? Well, the first studies were lesion studies in monkeys and I'll show you work in humans as well. And the major discovery was this that in our brains there's a so-called wear pathway that goes up in the brain into the parietal cortex and a wet pathway that goes into temporal lobe or lower cortex and if you make lesions on these in in these different regions one form of vision is spared and one is impaired in selective ways.
So how did they discover this? So again, here's the big picture. Early visual processing information, a what pathway to know what objects are, a face, a word, a chair, or where things are uh that you might run to, grab, or jump over. So here was the experiment. It was pretty simple. Here were two food wells, and monkeys that were eager to get food uh would get rewarded if they would pick the correct food well. uh they wouldn't they didn't see where the the food was that was hidden, but they would get to pick one or the other. And in one task, they would have to pick uh which food well is closer to this stimulus.
That's a wear task. Where is this located? That's the piece of information that will tell me where to get my food. And you can see here's the performance of the animal. These are errors. So, it's good to be low. They're eager to get their food. But look at the if the animal had a a surgical lesion in the parietal cortex, the wear pathway, they were very poor performing this task as if they couldn't appreciate the spatial relation between where the cylinder was located and the food well. On the other hand, monkeys who were had lesions made in the temporal cortex were poor. When they to make this task, they would see two different objects and they were taught that one always meant that's where the food is.
Let's pretend it's the cylinder. So that in order to know the correct answer, they would have to say, okay, is it next to this object or this object? That's a what discrimination. Is it a cylinder or a cube? And now the temporal lobe lesions were the ones that affected performance. So as if one part of your brain tells you where things are in vision, parietal lobe, and one tells you what they are, the temporal lobe. So that's lesion studies in monkeys. But there's very interesting things about uh uh uh when we look at the what cells communicate in these two pathways that make sense in what we understand to be the goals of these systems.
So for example in the wear pathway in the parietal cortex many neurons pick up information from the phobia the central part of vision but the majority are sensitive to stimula in the periphery. So if you imagine a good thing to know if you're running is in the periphery are there things coming at your head you know things to avoid you might grab something here if you need to grab it there you would want to have a lot of peripheral information for spatial things around you and in fact if if a monkey was looking at this spot which is away entirely from the stimulus it would respond to both a large and a small stimulus in the periphery quite strongly.
So these neurons are responding to a pretty broad range of space where things could happen. Neurons in the what pathway have almost their entire responsiveness uh in the phobia because you know what something is if you're reading a word and looking at it if you're looking at a face that figuring out who the person is. So it's not it's only responding these kinds of neurons to information in the center. But it has some very interesting properties even at the level of singer neurons. So here's a sort of a depiction of an experiment now from a monkey. You're looking at a a single neuron or a small group of neurons and you present something like a hand and you can see that those neurons really like the hand.
Now don't forget for a primary visual cortex, it just sees lines. It doesn't think of an entire object. But by the time you get to the higher levels of vision, it's encoding an entire object. And then you can do experiments that basically interrogate what does this neuron discover in the world? What is it interested in? So you take the turn the hand over, it's still very interested. You show it a less detailed hand, it's still very interested. Maybe a bit less, but it's still very interested. A hand this way where all the spatial relations have changed, still recognizes a hand. Still necroizes a handle with a bit less enthusiasm, but now a mitten, which kind of looks like a hand, right?
That barely counts as a hand at all. That neuron has lost interest in coding that as a hand. And then you showed other things that have some similarity in shape like four because these all have four elements in them like four fingers. This neuron is not responding at all. It's not that it has four things or lines. It's a hand. And then you could even worry about things. Well, maybe this because it's from a person, but if they see the face, the this neuron doesn't care. Okay? So, it's nothing about the gross shape or that it's a person. This neuron is specialized uh fovially for spotting a hand.
And not only that, these kinds of neurons already have the properties we described that are big problems for vision. So here's a neuron that's responding to an upright face. Um, but it's still having then it's responding if the face is turned on its side pretty well. Face is turned upside down a little less well, but it's still responding to a face. If the face is distant, it's still responding. If the face changes expression, it's still responding. uh and if you put a green filter on it, so you have a Martian person is still responding. So all kinds of ways that a face changes in the world, this neuron is still firing.
And interestingly, uh this neuron was firing for one of the experimenters, but it wasn't too interested in the other experimentter. So it's a neuron that's generalizing all the different views that you might have of a person, but it's responding to one neuron versus another. And there's been a lot of fun uh in in monkey neurohysiology stuff. There's a so-called Jennifer Aniston cell uh where monkey where researchers have discovered neurons in monkeys that seem to respond to Jennifer Aniston for whatever reason uh and other specific uh you know famous people although not particularly meaningful to the primates and of course uh in human brain imaging you can do tasks that emphasize what an object is or where it is and corresponding to the monkey work we see activation in this where pathway towards the parietal cortex if you have to make a spatial judgment where things are or in the sort of lower temporal lobe what pathway if you have to make an a judgment about what object you're looking at.
So that lines up in intact humans very much with what we see in primates with invasive studies. So um we're going to end today by discussing two kinds of lesions uh in humans and some spectacular uh impairments in the what or where pathway. So let me get you ready for these films for a moment. So uh uh one film you're going to see is a patient who has a great uh injury to the parts of in the brain in the parietal cortex that subserve our wear system. So this is so-called balance syndrome in the neurology. These are bilateral injuries that means on both sides of the brain in the parietal region.
uh they're pretty good at knowing what something is because the temporal lobe pathway, the what pathway is intact, but they have problems in knowing where things are, reaching for things, where to put their gaze, estimating distances, and navigation in general. So, I'll show you an example of a patient like this. And then the converse, a patient who has big problems in the what system. And we'll we'll we'll uh we'll start with that. And I'll tell you just one last uh bit of information to think about that the what and where distinction sometimes is not as complete in every way as you might imagine.
Uh but and so sometimes people have said really the wear system is better described uh as not where things are but the information you need for physical action in the world. Uh which is very close to where but it's a little bit different. And let me give you the kind of what type of information that the wear system still seems to have in it. So here's a patient with extensive uh damage uh in the what system in the lower parts of the brain and posteriorly for vision. Terrible perception of shapes and orientation of shapes. Very bad what ability uh but and she was asked then to reach with with like an envelope to a slot uh at different orientations.
And what's striking is even though if her hand was a distance away so she would have to think you know what is the angle I would need to approach it with she was terrible when she actually moved her hand towards the slot she was surprisingly good. So let me show you just the feeling. So if this patient would have to put her hand so that this uh letter would fit into this slot. you know, she was very good at spatial relations uh and uh uh you so sorry knowing what things were and so she couldn't line them up at all. But now they said, "Well, please put your hand out and just stick it in." And as her hand approaches it, she uh changes orientation and is correct because she need to do things like to grab something.
Think about it. When you grab something like a pencil or a cup, you need a little bit of knowledge to know what it is. you wouldn't grab things similarly whether they could spill easily or be pointy or painful. A little bit of what information helps you guide even something like a simple reaching which is a spatial task. So it's not so much maybe that the wear system uh is is only wear but it has just enough information to guide actions in the world uh which has a tiny bit of information about what things are that you're jumping over. Or if you're going to run into something, is it likely to be soft or hard?