Mind: A Brief Introduction (John R. Searle) / quote 81 of 138
The Chinese room
An argument explicitly directed against Strong AI was put forth by the present author.5 The strategy of the argument is to appeal to one’s first person experiences in testing any theory of the mind. If Strong AI were true, then anybody should be able to acquire any cognitive capacity just by implementing the computer program simulating that cognitive capacity. Let us try this with Chinese. I do not, as a matter of fact, understand any Chinese at all. I cannot even tell Chinese writing from Japanese writing. But, we imagine that I am locked in a room with boxes full of Chinese symbols, and I have a rule book, in effect, a computer program, that enables me to answer questions put to me in Chinese. I receive symbols that, unknown to me, are questions; I look up in the rule book what I am supposed to do; I pick up symbols from the boxes, manipulate them according to the rules in the program, and hand out the required symbols, which are interpreted as answers. We can suppose that I pass the Turing test for understanding Chinese, but, all the same, I do not understand a word of Chinese. And if I do not understand Chinese on the basis of implementing the right computer program, then neither does any other computer just on the basis of implementing the program, because no computer has anything that I do not have. You can see the difference between computation and real understanding if you imagine what it is like for me also to answer questions in English. Imagine that in the same room I am given questions in English, which I then answer. From the outside my answers to the English and the Chinese questions are equally good. I pass the Turing test for both. But from the inside, there is a tremendous difference. What is the difference exactly? In English, I understand what the words mean, in Chinese I understand nothing. In Chinese, I am just a computer.