[robotics-worldwide] Statement of Interest

Dr.-Ing. Catherina Burghart burghart at ira.uka.de
Tue Sep 11 05:43:10 PDT 2007

[Apologies if you receive multiple copies]

Dear Colleagues,

We are proposing to HRI 2008 (March 12-15) a workshop on "Metrics for
Human-Robot Interaction" to be held on March 12 2008 (see draft proposal

 To convince the HRI program committee of the need for the workshop,
 we would like to get a count of the number of tentatively interested 

 If you feel that you or your student may find this workshop 
interesting, and
 may wish to attend or actively participate, please let us know at

        burghart at ira.uka.de or steinfeld at cmu.edu

Thank you!
Catherina Burghart and Aaron Steinfeld
 Workshop Proposal:

Metrics for Human-Robot Interaction

Catherina R. Burghart
Institute of Process Control and Robotics
University of Karlsruhe
Engler-Bunte-Weg 8
76131 Karlsruhe, Germany

E-mail: burghart at ira.uka.de

Aaron Steinfeld
Robotics Institute
Carnegie Mellon University
5000 Forbes Avenue
Pittsburgh, PA 15213
E-mail: steinfeld at cmu.edu

Catherina Burghart studied computer science at the University of 
Karlsruhe and received her doctoral degree on "Robot assisted osteotomy 
in craniofacial surgery" in July 1999. Since then she has been assistant 
professor at the Institute of Process Control and Robotics. Her present 
research focuses on human-robot interaction and robot cognition. She 
organized a workshop on "Evaluating architectures for intelligence" in 
the AAAI'07 annual conference.

Aaron Steinfeld got his PhD at the University of Michigan at Ann Arbor, 
Industrial & Operations Engineering focusing on human factors. He then 
was a post doc at University of California, Berkeley focusing on 
Transportation Human Factors. Since 2001 he performs his research at the 
Robotics Institute, School of Computer Science, at Carnegie Mellon 
University. He specializes in human-robot interaction, constrained user 
interfaces, and operator assistance systems. He is interested in how to 
enable timely and appropriate interaction when interfaces are restricted 
through tasks, the environment, time pressures, design, and/or user 
abilities. He has a strong interest and extensive experience with the 
design and execution of evaluation experiments for complex 
human-in-the-loop systems.

The evaluation of interactions between robots and humans in field 
studies as well as the comparison of different types of interaction, 
robot and human behaviour, and results require adequate measures and 
guidelines. These measures have to take into account objective robot 
characteristics on the one hand as well as metrics for social 
interaction on the other hand. These metrics could code behaviours, ways 
of interaction and many more. There are metrics that can be acquired 
using objective measuring tools, others depend on the personal 
interpretation of the staff conducting and analysing experiments. When 
human beings are concerned metrics for social human-robot interaction 
are of utmost interest in order to achieve robotic systems that can be 
intuitively handled by people without causing frustration and despair.

The following key questions are to be addressed by the intended 
workshop: Which guidelines have to be followed for careful 
experimentation in HRI? Are there objective metrics applicable to HRI? 
Are there social metrics applicable to HRI? What is the relevance of 
subjective criteria for evaluation? Can subjectively categorized 
criteria be used to form objective metrics for social HRI? How can 
benchmarks (standardized tasks) be used to evaluate human-robot 

The goal of the workshop is to propose guidelines for the analysis of 
human-robot experiments and to create a handbook of metrics, that would 
be acceptable to the HRI community, and allow researchers both to 
evaluate their own work, and to better assess the progress of others. To 
achieve these goals the intended workshop is to last a whole day; its 
format will combine information about different metrics and evaluation 
methods given in session talks and invited talks, panels, and moderated 
group discussions.

The number of attendees will not be limited, but registration will be 

Required Format of workshop contributions
Technical papers of 6 -- 8 pages focusing on metrics and methods for the 
analysis of human robot interaction

Plan for documentation:
Besides proceedings all presentation materials will be available on the 
workshop webpage. The aim of the workshop is to come up with a set of 
guidelines for experimental evaluation involving human beings and a 
handbook of different metrics. It is intended to publish the results as 
well as selected papers in a special issue of an international journal.

Program committee:
The co-chairs are supported by a distinguished list of organizers, all 
of whom have had significant experience both in organization and in 
relevant research. The list includes:

Brian Scassellati, Yale University

Alan Schultz, Naval Research Laboratory

Chad (Odest) Jenkins, Brown University

Gal Kaminka, Bar Ilan University

Ralf Mikut, KIT
-------------- next part --------------
A non-text attachment was scrubbed...
Name: burghart.vcf
Type: text/x-vcard
Size: 294 bytes
Desc: not available
Url : http://duerer.usc.edu/pipermail/robotics-worldwide/attachments/20070911/c1a3e3ed/burghart-0001.vcf

More information about the robotics-worldwide mailing list