next up previous contents
Next: IRENA system at Kyutech Up: Human/machine interface Previous: A human/machine dialogue system

The competition DIALEAGUE organized by ETL

The evaluation of automatic dialogue systems is difficult as it is not a problem with one single good answer. Doctor Hasida's team at the Electrotechnical Laboratories (ETL) therefore organizes a competition between different dialogue systemsgif. The goal of the competition is measure the capacity of each system to progress in a dialogue with volunteers through Internet, where the problem is to find a path between two points that would be common to two different subway maps shown to the machine and to the user. The criterion used to judge good dialogues is the its length, i.e. the number of words used.

More than 700 internauts participated in the last version of this tournament in 1997, which enabled a better classification of automatic dialogue systems as well as a classification of users depending on their capacities to test such systems...



Jean-Philippe Vert
Sun Dec 6 11:05:42 MET 1998