Phil 101: Other Minds and the Turing Test

The next question we want to discuss is how we know whether various creatures other than ourselves think, feel, and enjoy other mental states:

  1. In each of these cases, our aim is not to find a way to prove with certainty that they have mental states. It’s unlikely we can even prove with certainty that other adult humans exist, much less that they have the mental states we think they do. Our goal is the more modest one of determining whether there are at least reasonable grounds for thinking that different creatures on this list have mental states.

    Also, it’s one thing to figure out what we do have good reasons to think, and another thing to figure out how to answer philosophical challenges from skeptics about how it could be possible to have such reasons. If this were an epistemology class, we would spend time on the second issue, but it’s not. I take it we agree we do have good reasons to think other adult humans have thoughts and feelings, even if we haven’t yet figured out what’s the best philosophical response to give to skeptics who challenge those reasons.

  2. Our aim here is also not to settle whether creatures on the list have exactly all of the same kinds of mental states that we do. Perhaps we don’t have all the same kinds of mental states as each other: maybe I see colors and hear music and taste food somewhat differently than you do. If dolphins and octopuses have mentality, it wouldn’t be surprising if some kinds of experiences or feelings they have are completely alien to human experience, and vice versa. This point is especially important to keep in mind when we think about the mentality of extraterrestrials and machines/AIs.

    It may be an interesting question whether there are fundamental differences between human thought and feeling, on the one hand, and whatever mental states machines/AIs will ever be capable of. But that’s not what we want to focus on. Our question is rather: Will machines/AIs ever be able to genuinely think or feel at all? Will they ever really be able to have genuine perspectives, opinions, preferences, self-consciousness, a real mental life — even if it may be different in some ways from our own?

    For any disanalogy you think there is between humans and machines — whenever you’re tempted to say “Machines will never be able to X” — ask yourself:

    1. Is having feature X something that’s really necessary, if you’re to genuinely think or feel at all? Or is it just an idiosyncrasy of the way we humans happen to think?
    2. Would it be in principle impossible for a machine to be programmed to have feature X? Why? Why would it be harder to program a machine to have X than to program it to do other things?
    3. Why do you think you have better reason to believe other adult humans have feature X than you could ever have that a machine has it?
  3. Considerations that seem relevant to whether other creatures have mentality divide into facts about their behavior and facts about their physical makeup. As we move further down our list of candidates, the physical makeup diverges more and more from our own. It’s not clear how important a role this should have in our thinking though. Some aspects of our own physical makeup — our eye color, whether we’re right- or left-handed, how healthy our legs are, what we look like — we take to have little to do with what kinds of thoughts and feelings we have. (Even if it did take us unconscionably long to acknowledge this with respect to the last aspect.) What persuaded us that these aspects of our makeup were less relevant to what thoughts and feelings we’re capable of having, than how healthy our brains are? Presumably it was facts about behavior that led us to think that. People with different eye colors, or differently functioning legs, can still behave in ways that make it seem they’re planning, reasoning, reflecting on their decisions and capacities, avoiding some stimuli and seeking out others. So presumably these kinds of behavioral considerations should take the lead when we’re trying to figure out how good our reasons are to attribute mentality to other kinds of creatures — even if their physical makeup is very different from our own.

    One notable kind of behavior adult humans engage in is using language. Even if we don’t always understand someone else’s language, we can often tell that they’re using one, and this plays an important role in our willingness to count them as thinking and reasoning in ways akin to ourselves. With animals, this is the kind of intelligent behavior most differing from our own. Chimps, dolphins, some birds and other animals have some kinds of language-like communication. But there are theoretically important differences between what they do and what humans do. With some kinds of extraterrestrials and with machines/AIs there may be fewer differences on this score. (With machines/AIs, though, some will argue that they can consume and produce language but never really understand it.)

  4. On the face of it, the issues we’re considering now are independent of what stand you take on the materialism/dualism debate. Whether you think mentality is a matter of what’s happening physically or what’s happening in a soul, it seems open to you to take any stance about which creatures on our list have mentality and which don’t. If you’re a dualist, then the question whether spiders have mentality is a question of whether spiders have souls. So too with extraterrestrials and machines/AIs. I don’t know how to figure out whether a spider has a soul, but I don’t know how to figure out whether you do, either. If you can have a soul, then for all I know, perhaps a spider can too, or a machine/AI. When we make human babies in the usual way, on the dualist picture somehow they end up with souls. Perhaps if we make human babies by genetic engineering, they’ll end up with souls too. Perhaps when we program AIs they’ll end up with souls too. I don’t know how it works. I don’t think the dualists do either.

  5. Some interesting issues come up in the Leiber dialogue that aren’t central to the discussion we’ll be having now. One of these is his list of three questions: (a) do the chimp and/or AI have thoughts and feelings; (b) if so, are their thoughts/feelings enough to make them persons — that is, creatures with certain kinds of rights, protections, responsibilities to others; and (c) if they are persons, do they have a right to not have the space station shut down? Our discussion will be focused only on the first of these.

    Another idea that comes up in that dialogue is the Buddhist idea that nothing is a person, that the division between a self and the rest of reality is an illusion or a matter of perspective. We may encounter this idea again later in the course, but we’re not going to be able to discuss or think about it except in passing. It’s an interesting view, that some academic philosophical discussions do engage with seriously. But it’s not going to play a central role in the discussion we’re exploring.

The rest of these notes will focus on the question whether we can ever have good reasons to attribute mentality to machines/AIs.

The Turing Test

In the 1950 article Computing Machinery and Intelligence, the philosopher Alan Turing puts forward a test for determining whether machines are genuinely thinking. The test works like this. A human judge carries on remote conversations with a machine and another human, and has to guess which is the machine and which the human. If the machine is often able to fool the human judge into thinking it’s human, then that machine passes the test, and Turing claims we should regard it as genuinely thinking, and having genuine intelligence. This has come to be known as the Turing Test for machine intelligence.

Note that Turing is only claiming that passing his test is enough for being intelligent, or reasonably being counted as intelligent. Turing’s test may be very hard; it may set the bar too high. Perhaps chimps are intelligent, though they can’t pass the test. Perhaps someday there really will be intelligent machines, that also aren’t intelligent enough to pass Turing’s Test. Turing acknowledges this; he doesn’t want to say that being able to pass his test is a necessary condition for being intelligent. He’s only saying that the machines which are able to pass his test are intelligent, or should reasonably be so counted.

Naive judges and Simple Chatbots

Turing doesn’t say very much about who’s supposed to be judging these tests. But that’s important, because it’s very easy to fool computer neophytes into thinking that some program is really intelligent, even if the program is in fact totally stupid. One early computer program called ELIZA pretended to be a psychotherapist holding “conversations” with its patients. ELIZA was a very simple program. (You can nowadays get a version of ELIZA even for bargain-level smartphones.) Nobody who understands the program is at all tempted to call it intelligent. What the program does is this. It searches the user’s input for keywords like the word “father.” If it finds a keyword, it issues back some canned response, like “Do you often think about your father?” Here is more background about this program.

More links on chatbots:

As I said, no one who really understands ELIZA wants to claim that this program is intelligent. If we’re ever going to construct a real artificial intelligence, it will take a much more sophisticated approach than was used to make ELIZA.

When Turing Tests are set up at public computing exhibitions, and the judges are just people taken off the street, people who aren’t very familiar with computer programs of this sort, then chatbot programs using programs using the same underlying structure as ELIZA turn out to be able to fool those judges about 1/2 the time. Here is an article about a chatbot that has successfully used such a strategy. Here is another more recent example.

Hence, if you want to say that passing the Turing Test really is a good test for intelligence, than it’s going to make a difference who’s judging the Turing Test. We’d have to use better judges than just ordinary people off the street.

Failure Just Around the Corner?

As I mentioned in class, when I was young I loved Spider-Man comics. Before he gained his superpowers, Peter Parker was a stereotypical weak clumsy nerdy kid. The school jock Flash Thompson bullied him around. After Peter became Spider-Man, he was in fact no longer so weak or clumsy. But he went to great efforts to keep up that appearance, so that no one would figure out his secret identity. Thus when Flash bullied him, he went through the motions, pretended to be hurt. But what his schoolmates were seeing was misleading. The illusion was fragile; it was liable to fall apart any moment, and in the comics it several times did.

A second case to consider. Suppose you end up somehow turning your mother’s delicate crystal vase into something that looks the same but is really indestructible. For some reason you want to keep this a secret. You go through a complex dance trying to give everybody else the impression that the vase is still fragile. But really it’s not. Its real disposition is to be indestructible. But with effort you might get people not to see that. You might manage to make it seem fragile, at least for a while.

One thought that comes up with the Turing Test is that even if machines/AIs turn out to do really well at the test, maybe their successes would be unstable in these same kinds of ways. Maybe failure would be just around the corner, just as soon as someone thought up the right question to ask.

I mention this thought just to acknowledge it and be able to refer back to it. I don’t have anything useful to say to address it. Peter/Spider-Man’s schoolmates might have good reasons to think he’s still weak and clumsy, even though he’s not. Your mother might have good reasons to think her vase is still fragile, even though it’s not. We might have good reason to think a machine/AI’s performance on the Turing Test will continue to impress, even though it’s going to break down after the next question. We can’t rule these possibilities out.

Let’s suppose for the sake of argument, though, that this isn’t what’s going to happen. Let’s suppose some machine/AI has so far acted quite flexibly and apparently intelligently, and that its ability to do so is robustly reliable. It’s no more likely to break down after the next question than adult humans are. What should we think in that case? Should we agree with Turing that this would be a good reason to count the machine as having real intelligence, thoughts, preferences, and so on?

What Would Reliably Passing the Turing Test Establish?

So some machine/AI turns out to pass Turing’s Test, even when the test is administered by sophisticated, trained and knowledgeable judges. And we suppose it can do this in a way that’s robustly reliable. There’s no trick question we just haven’t figured out yet that’s going to make it break down or go into an infinite loop.

Some theorists think that even if that happens, we still wouldn’t have good reasons to attribute mentality to the machine/AI. I’ll call this the anti-machine camp. The opposing, pro-machine camp thinks we would.

Some people are so pro-machine, they’d say that some currently existing machines/AIs already have mentality. GPT-3 has been in headlines recently; here is an impressive transcript of a conversation with this algorithm. But let’s keep our focus on imagined future machines/AIs, who are able to do much better on the Turing Test, and be much more reliable and flexible, than anything currently out there.

We’ll talk more about the anti-machine view below. For the moment, let’s sort out different ways of holding the pro-machine view.

  1. One strong form of this view is called behaviorism. This view says that if a machine can reliably behave intelligently and flexibly in the ways we’re imagining, that’s all there is to really having thoughts, intelligence, feelings, and other mental states. There’s never any more than that going on, even in the case of adult humans. It’d be impossible, it’d make no sense, for machines/AIs to behave as we’re imagining but still lack some extra mentality that humans really have.

  2. A more moderate view would agree with the behaviorist about some mental states, like thinking, reasoning, planning. But for other mental states like pains, feelings, emotions, this view would say there is a gap between how the creature acts and what’s really going on inside its mind. For example, it’d at least be possible for a machine/AI to act angry but not really feel anger. So for such mental states, the machine/AI’s behavior doesn’t constitute or guarantee that the mental states are really there. It may or may not provide reasonable grounds for thinking the mental states are there. That we’d still have to figure out.

  3. Going even more moderate, we could take this stance even about mental states like thinking, reasoning, and planning. In all of these cases, we could say, the machine’s behavior may provide reasonable grounds for thinking it has these mental states. But it doesn’t guarantee it. This is the perspective of most contemporary pro-machine theorists (and may also have been Turing’s own view).

    What more would it take for a machine/AI to really have these mental states?

    On these views, it turns on the structure of the machine’s internal algorithms or programming. One way a machine might manage to pass the Turing Test is by having a giant lookup table of all the possible inputs and what output to give for each response. Like an ELIZA program on steroids. If the lookup table were large enough, perhaps such a machine/AI would be able to fool us reliably. We might not be able to find any trick question that would expose its limitations. Even if so, this camp of pro-machine theorists wouldn’t want to count such a machine/AI as really thinking. The program it’s using is too simple and direct.

    On the other hand, if the machine’s programming analyzes the meanings of the questions we put to it, and does something like the kind of processing on those meanings that our human brains do, then these theorists would want to say the machine is thinking.

    So some kinds of programs count as thinking, and others don’t, and in principle a machine’s external behavior — what outputs it gives to different inputs — might not guarantee it has the one programming rather than the other. This is why I hedged Turing’s proposal earlier, and said if a machine passes the test, that might just make it reasonable to count it as being intelligent. Whether it really is intelligent could turn on issues like what the internal algorithms are, that the Turing Test by itself might not give us access to.

I’ll assume we’re dealing with a pro-machine theorist of this third sort.

One way to get a machine/AI with the right kind of programming might be to build it to run the same kind of “program” as human brains run. Our hardware would be different, but the machine might for all that be processing information in the same abstract ways our brains do.

In the Lycan reading from last week, we heard about Henrietta, who has her neurons replaced one-by-one with synthetic digital substitutes. Eventually her brain has no more organic parts left. If the substitutes do the same causal work that the neurons they’re replacing did, then from the outside, we won’t see any difference in Henrietta. She’ll keep walking and talking, processing information and making plans, the same as she always did. Lycan argues that Henrietta herself wouldn’t notice any difference either. When she has just one neuron replaced, none of its neighboring neurons “notice” any difference. And over the process of gradually replacing all her neurons, there doesn’t seem to be any point at which she’d lose her ability to think or feel. Her new brains would keep working the same way they always have.

So why should the difference in what they’re physically made of matter? Shouldn’t any hardware that runs the same “program” as her original brain have the same mental life as the original?

This perspective is taken up in many places in fiction and film — such as the jewel computer in Egan’s story from last week. In more limited ways, the characters in The Matrix

and Doctorow’s story from last week get to acquire certain abilities or memories, or have certain experiences, by loading new “programs” into their brains. All of this speaks to the intuitive force of the idea that our mental lives are driven by what “programs” our brains are running.

Anti-Machine Arguments

The anti-machine theorists think that machines/AIs will never have real thoughts or mental states of their own. They can at best simulate thought and intelligence. All that passing the Turing Test would show is that a machine is a good simulation of a real thinker.

This is the position of the opposing attorney in the Leiber dialogue. He admits that a machine might be “creative” in some sense, such as when it discovers new solutions to math problems, but he argues that the machine never really understands what its doing. Whereas when humans work on problems, they genuinely have insights, and realize what’s going on. Humans genuinely experience their thoughts, the meanings of their sentences, and what’s happening in their environment.

Near the end of the dialogue, the machine/AI they’re arguing about comes on stage itself, and responds to this attorney that it seems to it (the AI) that it also has inner experiences. It asks the attorney, what makes him so sure that other adult humans really have genine thoughts and other mental states. Presumably the most important reasons for thinking so is how they act and behave. And doesn’t the machine/AI also behave in the same flexible and apparently intelligent ways?

If the attorney thinks he has better reasons for thinking that other humans have real mentality, what are those reasons?

  1. One difference that anti-machine theorists often allege between humans and machines is that the latter can’t make mistakes. (Hofstadter discusses this in his dialogue when they talk about predicting the weather.)

    Turing spends some time discussing this allegation in his article. He introduces an important distinction, between what he calls errors of functioning and errors of conclusion. Examples of errors of functioning would be mechanical or electrical faults that prevent a machine from doing what it’s designed to do. We can also include “bugs” in the machine’s programming as errors of functioning. These prevent the machine from working as it’s intended to work. Errors of conclusion, on the other hand, would be mistakes like saying “19” in response to the question “What is 8+9?” Now it is true that humans make many errors of this second sort; but Turing points out that there’s no reason why machines shouldn’t also make errors of this second sort. Whether a machine will make certain errors of conclusion really depends on the nature of its programming. If we program the machine to add in the ways calculators do, and the machine executes its program perfectly, then it will always give the right answer to addition problems. But if we instead program the machine to do math in the ways that humans actually reason mathematically, then it might very well answer some addition problems incorrectly.

    You might protest: But won’t some low-level part of the machine still need to be adding and multiplying correctly, in order for the machine to run any program? Yes, but it’s equally true that your low-level neurons need to add and process electrochemical signals properly, for you to be doing any thinking. That doesn’t make you a perfect adder. You don’t know what your neurons are doing. That neural activity might constitute your making an arithmetic mistake. Why can’t the same be true for the machine?

    People often assume that if we ever succeed in constructing a real artificial intelligence, it will be much more “rational” and “logical” and “unemotional” than human beings are. I don’t see why that’s so. Why couldn’t the AI be running programming that makes it much less logical, and much more emotional, than human beings?


    sam brown, explodingdog

    What tends to happen is we think of the machine running smoothly and perfectly in the sense of not breaking down, suffering no errors of functioning. So we naturally assume that the machine won’t make any errors of conclusion either. We naturally assume that it will always “do the rational thing.” But that doesn’t really follow. Whether the machine makes mistakes, and whether it “acts rational” or “acts emotional,” will depend on the nature of its programming…

  2. Another objection that Turing discusses in his article has to do with the thought that machines only have fixed patterns of behavior; they can only do what we program them to do.

    In a sense this might be true. What the machine does depends on what its program tells it to do. But that doesn’t mean that the machine’s behavior will always be fixed and rigid, in the way the ELIZA program and other simple chatbots’ responses seem fixed and rigid.

    Here are some lines of thought pushing back against that inference.

A difficult passage

When re-reading Turing’s article, I noticed this passage:

It is not possible to produce a set of rules purporting to describe what a man should do in every conceivable set of circumstances… To attempt to provide rules of conduct to cover every eventuality, even those arising from traffic lights, appears to be impossible. With all this I agree.

From this it is argued that we cannot be machines. I shall try to reproduce the argument, but I fear I shall hardly do it justice. It seems to run something like this, “If each man had a definite set of rules of conduct by which he regulated his life he would be no better than a machine. But there are no such rules, so men cannot be machines.” The undistributed middle is glaring.

What the heck does that last sentence mean? I can’t expect you to know. I hope when you come across passages like this you will at least be able to work out from context what the author must in general be getting at. I hope it was clear that Turing doesn’t approve of the argument he’s reporting here, and that the passages that come next in his article—where he distinguishes between “rules of conduct” and “laws of behavior”—are meant to be part of a reply to the argument. Some of you may have been industrious enough to google the term “undistributed middle” to try to figure out more specifically what Turing was saying. (If so, great. That disposition will serve you well.)

What you will find is that this is a term from an older logical system. We don’t use the expression so much anymore—in fact I myself had to look up specifically which fallacy this is. An example of the fallacy of undistributed middle would be the argument “All newts are gross. Harry is gross. So Harry is a newt.” I hope that even without the benefit of any formal training in logic, you’ll be able to see that this is not a good form of argument. (Of course there can be instances of this form whose premises and conclusion are all true, but that doesn’t make this a good form of argument.)

Now I have to scratch my head and speculate a bit to figure out why Turing thought the argument he was discussing displayed this form. I don’t think it’s fair for him to say that the presence of this fallacy in the argument he reports is “glaring.” Here’s my best guess at what Turing is thinking.

We begin with the claim:

  1. If you had a definite set of rules of conduct by which you regulated your life — rules that prescribed and guided all your choices — you would be a machine.

As we discussed in connection with Leibniz’s Law, claims of the form “If D, then M” are always equivalent to “contrapositive” claims of the form “If not-M, then not-D.” (Compare: if Fido is a dog, then Fido is mortal. Equivalent to: if Fido is immortal, then Fido is not a dog.) So 1 is equivalent to:

  1. If you are not a machine (or as Turing puts it, if you are “better than” a machine), then you don’t have a definite set of rules that prescribe and guide all your conduct.

Now Turing is imagining that his opponents continue the argument like this:

  1. I don’t have a definite set of rules that prescribe and guide all my conduct.

  2. Therefore, I am not (or: I am “better than”) a machine.

The argument from 2 and 3 to 4 does display the fallacy of undistributed middle that we described above. Turing’s text doesn’t make this as clear as it might have, though, since it has the beginning premise in form 1 rather than the (equivalent) form 2.

But what fundamentally is Turing thinking his opponents get wrong?

He’s imagining that even if some machines may have definite rules that explicitly script their conduct in every situation they encounter, others may not. The point of the passages that come next in his article are to distinguish between the idea of having such complete and explicit “rules of conduct” and there being low-level “laws of behavior” that settle in advance how the machine (or the human being) will respond to any given stimulus. Turing would agree that there are low-level laws of behavior strictly governing what the machine does, but there may be such laws for us too. He’d agree that humans don’t have complete and explicit rules of conduct telling us what to do in every situation, but he’d say machines won’t necessarily have that either. Machines and we might both have to figure out what to do, rather than follow some high-level recipe already explicitly written out in advance.

I think I understand the distinction Turing is making, but I’m not entirely sure that I do. How about you? Can you make sense of the idea that there may be some low-level laws of behavior (say your genes, and everything that’s happened to you up until this point in your life) that govern how you will act, even though you don’t have rules you consult that explicitly guide every choice you make? What more would you say to better explain this distinction? Can you make sense of the idea that some machine might also lack such high-level complete and explicit rules of conduct?

There’s a lot here for us to wrestle with. Hopefully though this will help you better track how the words Turing actually wrote here are supposed to fit into his larger argument.

For reference, here again are some related readings I assigned in the class:

And some optional links I also gave you:

Here are some more optional links:

Turing is an interesting character who made huge contributions to several areas of thought, beyond what we’re looking at in class. If you read about his life, you’ll see he also had a hard time for being homosexual, and may have committed suicide as a result. Or his death may have been a tragic accident; from what I’ve read it seems to be unclear. In any event, much of our contemporary life has been profoundly shaped by his contributions.

Among Turing’s other important contributions were: the notion of an (abstract) Turing Machine and other ideas in the foundations of logic and computer science; breaking the German ENIGMA code during World War II; and being part of the development of early computers. If (like me) you find the last topic interesting and want to read more, here are some links: