Turing Test Project: Draft

In the classic 1982 science fiction movie Blade Runner, Deckard is a police officer who serves as a type of AI “judge.” In the future, blade runners test for and identify potentially homicidal human “replicants” (androids). Watch this clip to get a better understanding of what exactly a blade runner like Deckard does in this envisioning of the future:

https://www.youtube.com/embed/Yk3yQ5ktvWw

In essence, the officers in Blade Runner perform Turing Tests, but have access to physiological responses for analysis (like the “Voight-Kampff Test" in the movie). Of course, Turing Tests today rely only on text-based chat, as computers have no physiology.

Turing Test strategies

The following are strategies that may be helpful in designing an effective Turing Test:

  1. Use memory-dependent language.
    • Example: “Do you know Barack?”
      “Would you like to meet him?”
  2. Refer to activities normally considered as outside of the realm of “pure thought,” such as emotions, experience, physicality.
    • Example: “Does painting a picture make you happy?”
      “What style of painting do you like to paint?”
  3. Refer to aspects of consciousness (qualia)—Imagine you teach a computer all there is to know physically about colors. Would it then experience “red” in the same way you do?
    • Example: “Describe the color red.”
  4. Give computationally difficult tasks.
    • Example: “What’s the square root of 1729?”
  5. Elicit reasoning.
    • Example: After completing Example 1, follow with “Why would you like to meet him?”

Assignment

Your job is to write a draft protocol for a Turing Test that can distinguish human from artificial intelligence using only text-based chat. The protocol should include the following:

  1. An introduction that states the purpose of the test and its underlying principles.
  2. At least 10 detailed directives for someone to complete in order to identify artificial intelligence only through text-based chat.
    1. These steps should be so detailed that any two people performing the Turing Test would do so in exactly the same way.
    2. Use quotations as necessary to indicate exact text that must be used (e.g., questions to ask).
    3. Describe in detail how text responses should be analyzed (e.g., differences in expected and actual output for a given input).
  3. An analysis of the strengths and weaknesses of the protocol.