(Rev 2004-9-23)
The 2004 Loebner Prize Contest, the 14th annual Loebner Prize contest, was held:
Sunday, September 19, 2004
220 W 98th St
New York NY 10025
The Loebner Prize Medal and a cash award is awarded annually to the designer of the computer system that best succeeds in passing the Turing Test. In 2004, $2,000 and a bronze medal was awarded to Richard Wallace and the Alice AI Foundation, designer of the Most Human Computer as rated by a panel of 4 judges. However, in no case did a judge mistake a program for a human. Mr. Precedo's entry was disqualified because of transmission problems between the confederates and the judges.
Computer entries are scored in the cells with borders.
Terminal Pair
Pair 1 - Rollo Carpenter A Entry, B Confederates transcripts
Pair 2 - John Precedo A Confederates, B Entry transcripts
Pair 3 - Steven Watkins A Confederates, B Entry transcripts
Pair 4 - Richard Wallace A Entry, B Confederates transcripts
|
Loebner Prize 2004 Score Matrix
|
|||||||||
| Judge 1 | Judge 2 | ||||||||
| A | B | A | B | ||||||
| Pair 1 | 10 | 90 | 100 | Pair 1 | 25 | 75 | 100 | ||
| Pair 2 | 98 | 2 | 100 | Pair 2 | 52 | 48 | 100 | ||
| Pair 3 | 99 | 1 | 100 | Pair 3 | 90 | 10 | 100 | ||
| Pair 4 | 15 | 85 | 100 | Pair 4 | 40 | 60 | 100 | ||
| 222 | 178 | 400 | 207 | 193 | 400 | ||||
| Judge 3 | Judge 4 | ||||||||
| A | B | A | B | ||||||
| Terminal 1 | 5 | 95 | 100 | Terminal 1 | 5 | 95 | 100 | ||
| Terminal 2 | 90 | 10 | 100 | Terminal 2 | 85 | 15 | 100 | ||
| Terminal 3 | 99 | 1 | 100 | Terminal 3 | 95 | 5 | 100 | ||
| Terminal 4 | 0 | 100 | 100 | Terminal 4 | 15 | 85 | 100 | ||
| 194 | 206 | 400 | 200 | 200 | 400 | ||||
| Combined | |||||||||
| A | B | ||||||||
| Pair 1 | 45 | 355 | 400 | Rollo Carpenter | |||||
| Pair 2 | John Procedo | ||||||||
| Pair 3 | 383 | 17 | 400 | Steven Watkins | |||||
| Pair 4 | 70 | 330 | 400 | Richard Wallace | |||||
| 823 | 777 | 1600 | |||||||