Confederate effect
In Turing tests, which are part of artificial intelligence studies, for example within Loebner Prize, the chatbots and humans are tested by other humans to establish their nature. In such a context, the confederate effect is the phenomenon of the tested human being falsely considered a machine by the tester.
It is the reverse of the ELIZA effect, which Sherry Turkle states is "our more general tendency to treat responsive computer programs as more intelligent than they really are": that is, anthropomorphism.
The phenomenon was seen in the University of Surrey 2003 Loebner Prize for Artificial Intelligence, when both confederate humans, one male and one female, were each ranked as machine by at least one judge. More precisely, Judge 7 and Judge 9 ranked the female 'Confederate 2' as "1.00=definitely a machine"; the male 'Confederate 1' was ranked "1.00=definitely a machine" by Judge 4 and Judge 9. Also, the gender of these two hidden-humans were incorrectly identified in independent transcript analysis.
