Skip to main content

Are We All Living in the Same Reality?

I have written before about the constructivist viewpoint that each person creates their own reality. This is sometimes illustrated by the philosophical argument that I don't know whether the way you perceive the color "red" is exactly the same as what I see when I look at something red. Maybe the visual experience that you have in that situation is one that I would call "blue" if it were happening to me, but we have both learned to call the experience by the same word "red." 

There's a famous thought experiment in philosophy, called the "knowledge argument" about personal experience, from Australian scholar Frank Jackson (1982). In this story, a scientist named Mary has lived her entire life in a black-and-white room with no opportunity to see colors. (If that's too big a stretch for you, alternate versions of the story posit a neurological problem of some sort to account for her lack of color perception). Nevertheless, color is Mary's area of scientific expertise. She uses detailed measures of wavelength characteristics and retinal cells to understand everything there is to know about color perception by the human brain -- yet she has never herself experienced color. The story posits that Mary literally knows everything it is possible to know based on physical characteristics. Mary then gains the ability to see color, either through release from her monochrome prison or by means of neurosurgery. The question is whether Mary learns anything by finally seeing colors. If so, then her knowledge of color was actually not complete beforehand. Jackson uses this to argue for an element of existence separate from physical reality -- our experiences, what philosophers often call qualia.

Qualia are the level at which people might have different ideas of "red" even though a red apple has the same physical characteristics. Technically, the idea that everyone might have a different experience of color arises from the problem of intersubjectivity -- we can never get fully inside of another person's mind. Philosophers dating back at least to John Locke in 1689 have argued that someone could have a completely different subjective experience of color, but as long as they used the same words in the same situations as we did, we would have no way of knowing that to be the case.

But researchers this year apparently found evidence for shared reality at the neural level, using AI tools to data-mine fMRI data. They found that by knowing only the neural firing pattern in someone’s brain, they could predict what color the person was looking at with slightly better than chance accuracy (34-40%, in a task where chance accuracy was 33%). That means that to at least a slight degree that's not attributable to chance, we do all see red in the same way, or at least with the same firing pattern of neurons in our brains. 

Is the problem of intersubjectivity therefore solved? Are 350 years of philosophy rendered obsolete by modern neuroscience? Now for the caveats ... First of all, you will notice that the researchers' model was accurate about 40% of the time, compared to a 33% base rate. A 7% improvement (maximum) is statistically significant in this context, but it's not all that impressive in practical terms. Perhaps we can say that there are some commonalities across people in their experience of the color red, but those commonalities are outweighed by (a) chance -- the initial 33% base rate, and (b) unique and unexplained variability in people's brains -- the 60% of neural activity not predicted by the model. Instead of saying that everyone sees the color red in the same way, it might be more accurate to say there is some common neural substrate to color perception, which each individual brain builds on in vastly different and individualized ways.

Second, even in the same person’s brain, knowing the person's prior neural responses only gave the researchers 42-67% accuracy in predicting the color that was being reviewed (again, compared to a base rate of 33%). This is consistent with some of the neuroscience research that I summarized in my post on mind-uploading: Not only are the same concepts encoded differently across different brains, they are also encoded differently over time within the same brain. AI models can pick up just enough consistency to correctly identify what a person is thinking about, for example allowing for gross motor control of robotic arms. But they don't account for all the nuances of thought. Instead, they gloss over them in models that are just good enough to be functional. 

Finally, it's worth noting that the commonalities across participants were in areas of the primary visual cortex -- the large area in the back of the brain where input from the eyes is converted to interpretable signals for the rest of the brain to work with. The fact that some of the same brain areas were lighting up in response to the same stimulus is not necessarily surprising. These are not the areas of the brain that assign labels to colors (the Narrative Mind -- generally language is localized in the left temporal lobe), and they are not the parts of the brain most strongly associated with subjective conscious experiences (generally connected to midbrain areas like the cingulate cortex). One might think, therefore, that the common brain activation across participants in this study was connected to perception or differentiation of color stimuli, but not to the subjective experience of color. In other words, the AI model can predict (to a degree that's modestly better than chance) which color word a person is going to use when they see an apple. But they can't tell us whether all of the participants actually mean the same thing when they say that same word, "red."

Comments

Popular posts from this blog

What You Believe about Beliefs is Probably Wrong

The Stanford Encyclopedia of Philosophy  defines a "belief" as "the attitude we have, roughly, whenever we take something to be the case or regard it as true. ... Most contemporary philosophers characterize belief as a 'propositional attitude,' [where] propositions are generally taken to be whatever it is that sentences express. For example ... 'snow is white.'" Beliefs, then, (a) are expressed in language, (b) refer to some specific contents such as "snow," and (c) express some truth about those contents. The truth need not be an empirical statement about the world -- propositions such as "x is the square root of x-squared" are also beliefs under this definition even when there is no empirical referent for "x." Beliefs can be about a single thing, or about the relationships between things, in which case they might or might not be expressed as formal rules: e.g., "every bird has wings." Language, representation...

Some Things That AI Probably Shouldn't Do

  I'm on record endorsing the use of AI by students to improve the quality of their writing and their thinking, but also expressing concern about the potential for autonomous AI to end civilization! So what's the deal here? Am I for AI or against it? As in many areas of life, the answer is "it depends ...". In this blog post, I will look at some things that AI probably should not  be doing for us, which might help to delineate the areas in which it can be more beneficial. Let's start with ethics. Although some techno-futurists have argued that AI will eventually be better at knowing what's good for us than we are ourselves, a recent report showed that a "robo-ethicist" using large language models (LLM) showed notable flaws in its reasoning. LLMs' ethics were consistently more influenced by utilitarian thinking (do what causes the least harm or the most benefit in this specific situation) than by reasoning from first principles (Kant's id...

In Pursuit of Digital Badges

  What's the appeal of digital badges? I used to think that only a crazy person would be motivated to exercise just to move some electrons around on their smartphone screen. My phone would notify me that a new challenge was available each month, and I would routinely ignore it. I felt no pain or consternation about this -- in fact, I never gave it a second thought, or never notice the challenge at all. But for the past few months it seems that I'm among those who increase their activity level just because their iPhone tells them to (my latest badges shown above). Why does this seemingly stupid behavior-change strategy work, and why did it start working for me when it didn't help me before? First, it's important to know that rewards do motivate behavior. In a previous post on behaviorism I provided some background on how this works by training the Intuitive Mind. Two Minds Theory posits that the final stage before a behavior is produced by the Intuitive Mind (after proc...