So, they give answers that individually seem excellent, but that are clearly incorrect when taken together. The AI bots don’t know this and don’t understand that context. Further, it may not be possible to tell from the picture which is correct.

Either the person just hit the ball, OR they are just about to hit the ball. However, as humans, we know that while the picture may be ambiguous, only one answer is possible. When shown a picture of a person swinging a tennis racquet next to a ball, both models will with very high confidence claim to see what they are looking for. The other is taught to determine if someone has just hit a tennis ball. One is taught to determine if someone is just about to hit a tennis ball.

I often use the example of two AI processes that are taught to identify two different scenarios from a photo. An equally big issue is that AI is only accurate in the exact context in which it is trained. Bias can accidentally be built into AI models through skewed training data. See hereand here for two discussions on this topic. There are already many examples of AI processes that initially seem quite smart but that have some major issues. In the world of AI, context is everything. For all the success of Duplex in scheduling restaurant reservations, it would fail miserably in this more general test. To me, the spirit of the Turing test is having an AI bot hold a typical, rambling, somewhat random conversation with a human and pulling it off. But I don’t believe that it did in the spirit of the rules. The crux of the test is the ability for an AI process to seem human to a human.īy the precise letter of the rules, one could argue that the Turing test was passed. You can find information on the Turing test here.

The Turing test is a famous set of criteria that assess whether or not AI has become realistic enough to fool humans into thinking that they are really interacting with another person. Instead, let’s focus on whether or not Duplex has successfully passed the Turing test as some have suggested. We’re going to save for another day the potential ethical issues raised by AI bots fooling people into believing they are talking to a person. The voice is totally realistic, and in test cases, the humans receiving the call were not aware that they had been talking to an AI bot. It does this by actually having a conversation with the human on the other end of the line. The Duplex bot calls businesses, such as a restaurant, on your behalf and makes a reservation. Recently, a lot of press was given to Google’s Duplex Artificial Intelligence ( AI) bot.

Free download passing the turing test