Jump to content

ELIZA effect

From Wikipedia, the free encyclopedia
A conversation with ELIZA

In computer science, the ELIZA effect is a claimed tendency to project human traits—such as experience, semantic comprehension or empathy—onto rudimentary computer programs. ELIZA was a symbolic AI chatbot developed in 1966 by Joseph Weizenbaum that imitated a psychotherapist. Many early users were supposedly convinced of ELIZA's intelligence and understanding, despite its basic text-processing approach and the explanations of its limitations.

History

[edit]

In the 19th century, the tendency to understand mechanical operations in psychological terms was already noted by Charles Babbage. In proposing what would later be called a carry-lookahead adder, Babbage remarked that he found such terms convenient for descriptive purposes, even though nothing more than mechanical action was meant.[1]

In 1966, a chatbot named ELIZA was developed by MIT computer scientist Joseph Weizenbaum.[2] When executing Weizenbaum's DOCTOR script, ELIZA simulated a Rogerian psychotherapist, largely by rephrasing the "patient"'s replies as questions:[3]

Human: Well, my boyfriend made me come here.
ELIZA: Your boyfriend made you come here?
Human: He says I'm depressed much of the time.
ELIZA: I am sorry to hear you are depressed.
Human: It's true. I'm unhappy.
ELIZA: Do you think coming here will help you not to be unhappy?

Though designed strictly as a mechanism to support "natural language conversation" with a computer,[4] according to Weisenbaum, ELIZA's DOCTOR script was surprisingly successful in eliciting emotional responses from users who, in the course of interacting with the program, began to ascribe understanding and motivation to the program's output.[5] As Weizenbaum later wrote, "I had not realized ... that extremely short exposures to a relatively simple computer program could induce powerful delusional thinking in quite normal people."[6] Indeed, ELIZA's code had not been designed to evoke this reaction in the first place. Weizenbaum interpreted users as unconsciously assuming that ELIZA's questions implied interest and emotional involvement in the topics discussed, even when they consciously knew that ELIZA did not simulate emotion.[7]

Over time, Weizenbaum became a staunch proponent of the notion that ELIZA had been deceiving users into thinking it was more than it was and creating powerful emotional bonds. While ELIZA / DOCTOR raised for many the prospect of automated psychotherapy available to all (including noted astronomer Carl Sagan, who imagined a network of computer psychotherapeutic terminals), Weizenbaum was repulsed by the "obscene idea" of computerized psychotherapy, which he detested. In the small, parochial research community, Weizenbaum found the rupture over the issue to be very personal, and feuded with his colleagues (AI pioneer John McCarthy called his stance "moralistic and incoherent” and accused Weizenbaum of adopting a "more-human-than-thou" attitude). Weizenbaum's political views were also charged by the use of computers for bombing target selection during the Vietnam War, with target selectors having no clue why a given hamlet was being selected beyond "the computer says so". For Weizenbaum, the notion that his program was harmfully deceiving people into believing it was more intelligent and human than it was became a key argument against an uncontrolled proliferation of AI into daily life.[8]

Characteristics

[edit]

In its specific form, the ELIZA effect refers only to "the susceptibility of people to read far more understanding than is warranted into strings of symbols—especially words—strung together by computers".[9] A trivial example of the specific form of the Eliza effect, given by Douglas Hofstadter, involves an automated teller machine which displays the words "THANK YOU" at the end of a transaction. A naive observer might think that the machine is actually expressing gratitude; however, the machine is only printing a preprogrammed string of symbols.[9]

More generally, the ELIZA effect describes any situation[10][11] where, based solely on a system's output, users perceive computer systems as having "intrinsic qualities and abilities which the software controlling the (output) cannot possibly achieve"[12] or "assume that [outputs] reflect a greater causality than they actually do".[13] In both its specific and general forms, the ELIZA effect is notable for occurring even when users of the system are aware of the determinate nature of output produced by the system.

From a psychological standpoint, the ELIZA effect is the result of a subtle cognitive dissonance between the user's awareness of programming limitations and their behavior towards the output of the program.[14]

Significance

[edit]

The ELIZA effect has been argued to be an important development in artificial intelligence, demonstrating the principle of using social engineering rather than explicit programming to pass a Turing test.[15]

ELIZA supposedly convinced some users into thinking that a machine was human. This marked a shift in human-machine interaction, wherein technologies were programmed to imitate human behavior. Two groups of chatbots are distinguished by William Meisel as "general personal assistants" and "specialized digital assistants".[16] General digital assistants have been integrated into personal devices, with skills like sending messages, taking notes, checking calendars, and setting appointments. Specialized digital assistants "operate in very specific domains or help with very specific tasks".[16] Weizenbaum considered that not every part of the human thought could be reduced to logical formalisms and that "there are some acts of thought that ought to be attempted only by humans".[17]

Critique

[edit]

Interpretation as 'play'

[edit]

Noah Wardrip-Fruin, professor of Computational Media at the University of California, has argued that the illusion initially presented by ELIZA is paper-thin, and rather than the ELIZA effect involving the human being "deceived" into accepting the humanity of the software, prolonged interactions typically devolve into play. Users typically adopt one of two approaches: either deliberately trying to get the bot to say ridiculous things, or to try to help the bot stay coherent. In effect, the user role-plays a "digital fiction" with the bot – that is, a willful suspension of disbelief, similar to that of a media experience.[18]

Sociologist Sherry Turkle, who popularized the term "ELIZA effect", also noted this phenomenon, writing: "Some people embark on an all-out effort to 'psych out' the program, to understand its structure in order to trick it and expose it as a 'mere machine'. Many more do the opposite... They didn’t ask questions that they knew would 'confuse' the program, that would make it 'talk nonsense'." She attributed this to a desire to "maintain the illusion that Eliza was able to respond to them."[19]

Misinterpreting humanity as delusion

[edit]

In an interview with Roman Mars and Delaney Hall, Weizenbaum's daughter, Miriam Weizenbaum, had much positive to say about her father, but criticized his story about his secretary being tricked by ELIZA:

I always heard that just really kind of soaked in arrogance. Like, how could she be so stupid to think that this is actually a meaningful communication? Here you have somebody who so needs a landing pad for her feelings that she’s willing to embrace it, right? And he totally misses that, he totally misses the human need and instead speaks of just evidence of this person’s stupidity rather than evidence of their humanity.[20]

See also

[edit]

References

[edit]
  1. ↑ Green, Christopher D. (February 2005). "Was Babbage's Analytical Engine an Instrument of Psychological Research?". History of Psychology. 8 (1): 35–45. doi:10.1037/1093-4510.8.1.35. PMID 16021763.
  2. ↑ Berry, David (2023). "The Limits of Computation: Joseph Weizenbaum and the ELIZA Chatbot". Weizenbaum Journal of the Digital Society. 3 (3). doi:10.34669/WI.WJDS/3.3.2. ISSN 2748-5625.
  3. ↑ Güzeldere, Güven; Franchi, Stefano. "dialogues with colorful personalities of early ai". Archived from the original on 2011-04-25. Retrieved 2007-07-30.
  4. ↑ Weizenbaum, Joseph (January 1966). "ELIZA--A Computer Program For the Study of Natural Language Communication Between Man and Machine". Communications of the ACM. 9. Massachusetts Institute of Technology: 36. doi:10.1145/365153.365168. S2CID 1896290. Retrieved 2008-06-17.
  5. ↑ Suchman, Lucy A. (1987). Plans and Situated Actions: The problem of human-machine communication. Cambridge University Press. p. 24. ISBN 978-0-521-33739-7. Retrieved 2008-06-17.
  6. ↑ Weizenbaum, Joseph (1976). Computer Power and Human Reason: From Judgement to Calculation. W. H. Freeman. p. 7. ISBN 978-0716704645.
  7. ↑ Billings, Lee (2007-07-16). "Rise of Roboethics". Seed. Archived from the original on 2009-02-28. (Joseph) Weizenbaum had unexpectedly discovered that, even if fully aware that they are talking to a simple computer program, people will nonetheless treat it as if it were a real, thinking being that cared about their problems – a phenomenon now known as the 'ELIZA Effect'.
  8. ↑ Uenuma, Francine (January 15, 2026). "Why the Computer Scientist Behind the World's First Chatbot Dedicated His Life to Publicizing the Threat Posed by A.I." Smithsonian. Retrieved November 11, 2026.
  9. 1 2 Hofstadter, Douglas R. (1996). "Preface 4 The Ineradicable Eliza Effect and Its Dangers, Epilogue". Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought. Basic Books. p. 157. ISBN 978-0-465-02475-9.
  10. ↑ Fenton-Kerr, Tom (1999). "GAIA: An Experimental Pedagogical Agent for Exploring Multimodal Interaction". Computation for Metaphors, Analogy, and Agents. Lecture Notes in Computer Science. Vol. 1562. Springer. p. 156. doi:10.1007/3-540-48834-0_9. ISBN 978-3-540-65959-4. Although Hofstadter is emphasizing the text mode here, the "Eliza effect" can be seen in almost all modes of human/computer interaction.
  11. ↑ Ekbia, Hamid R. (2008). Artificial Dreams: The Quest for Non-Biological Intelligence. Cambridge University Press. p. 8. ISBN 978-0-521-87867-8.
  12. ↑ King, W. (1995). Anthropomorphic Agents: Friend, Foe, or Folly (Technical report). University of Washington. M-95-1.
  13. ↑ Rouse, William B.; Boff, Kenneth R. (2005). Organizational Simulation. Wiley-IEEE. pp. 308–309. ISBN 978-0-471-73943-2. This is a particular problem in digital environments where the "Eliza effect" as it is sometimes called causes interactors to assume that the system is more intelligent than it is, to assume that events reflect a greater causality than they actually do.
  14. ↑ Ekbia, Hamid R. (2008). Artificial Dreams: The Quest for Non-Biological Intelligence. Cambridge University Press. p. 156. ISBN 978-0-521-87867-8. But people want to believe that the program is "seeing" a football game at some plausible level of abstraction. The words that (the program) manipulates are so full of associations for readers that they CANNOT be stripped of all their imagery. Collins of course knew that his program didn't deal with anything resembling a two-dimensional world of smoothly moving dots (let alone simplified human bodies), and presumably he thought that his readers, too, would realize this. He couldn't have suspected, however, how powerful the Eliza effect is.
  15. ↑ Trappl, Robert; Petta, Paolo; Payr, Sabine (2002). Emotions in Humans and Artifacts. Cambridge, Mass.: MIT Press. p. 353. ISBN 978-0-262-20142-1. The "Eliza effect" — the tendency for people to treat programs that respond to them as if they had more intelligence than they really do (Weizenbaum 1966) is one of the most powerful tools available to the creators of virtual characters.
  16. 1 2 Dale, Robert (September 2016). "The return of the chatbots". Natural Language Engineering. 22 (5): 811–817. doi:10.1017/S1351324916000243. ISSN 1351-3249.
  17. ↑ Weizenbaum, Joseph (1976). Computer power and human reason : from judgment to calculation. San Francisco, Cal.: W. H. Freeman and Company. ISBN 0-7167-0464-1. OCLC 1527521.
  18. ↑ Wardrip-Fruin, Noah (February 1, 2008). "EP 2.3: Revisiting the Eliza effect". Grand Text Auto. University of California, Santa Cruz. Retrieved July 7, 2026.
  19. ↑ Turkle, Sherry (1984). The Second Self: Computers and the Human Spirit. New York: Simon & Schuster. p. 40. ISBN 978-0-671-46848-4.
  20. ↑ Roman Mars (December 10, 2019). "The ELIZA Effect" (Podcast). 99% Invisible. Retrieved November 11, 2026.

Further reading

[edit]
  • Hofstadter, Douglas. Preface 4: The Ineradicable Eliza Effect and Its Dangers. (from Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought, Basic Books: New York, 1995)
  • Turkle, S., Eliza Effect: tendency to accept computer responses as more intelligent than they really are (from Life on the screen- Identity in the Age of the Internet, Phoenix Paperback: London, 1997)