(Rev 2004-9-23)

2004 Loebner Prize Contest Results

The 2004 Loebner Prize Contest, the 14th annual Loebner Prize contest, was held:

Sunday, September 19, 2004
220 W 98th St
New York NY 10025

The Loebner Prize Medal and a cash award is awarded annually to the designer of the computer system that best succeeds in passing the Turing Test. In 2004, $2,000 and a bronze medal was awarded to Richard Wallace and the Alice AI Foundation, designer of the Most Human Computer as rated by a panel of 4 judges. However, in no case did a judge mistake a program for a human. Mr. Precedo's entry was disqualified because of transmission problems between the confederates and the judges.

Results:

Computer entries are scored in the cells with borders.

Terminal Pair

Pair 1 - Rollo Carpenter A Entry, B Confederates transcripts
Pair 2 - John Precedo A Confederates, B Entry transcripts
Pair 3 - Steven Watkins A Confederates, B Entry transcripts
Pair 4 - Richard Wallace A Entry, B Confederates transcripts

Loebner Prize 2004 Score Matrix
  Judge 1     Judge 2  
  A B     A B  
       
Pair 1 10 90 100 Pair 1 25 75 100
       
Pair 2 98 2 100 Pair 2 52 48 100
       
Pair 3 99 1 100 Pair 3 90 10 100
       
Pair 4 15 85 100 Pair 4 40 60 100
  222 178 400   207 193 400
  Judge 3     Judge 4  
  A B     A B  
       
Terminal 1 5 95 100 Terminal 1 5 95 100
       
Terminal 2 90 10 100 Terminal 2 85 15 100
       
Terminal 3 99 1 100 Terminal 3 95 5 100
       
Terminal 4 0 100 100 Terminal 4 15 85 100
  194 206 400   200 200 400
Combined  
  A B  
   
Pair 1 45 355 400 Rollo Carpenter  
   
Pair 2 325 75 400 John Procedo  
   
Pair 3 383 17 400 Steven Watkins  
   
Pair 4 70 330 400 Richard Wallace  
  823 777 1600        


Financial and technical support was provided by

Crown Industries, Inc. 155 North Park St., East Orange NJ, 07017


Loebner Prize Home Page

Hugh Loebner's Home page


Last Update: 23 September 2004