[robotics-worldwide] Call for Participation and Program: 2009 Robotics: Science and Systems Workshop on GOOD EXPERIMENTAL METHODOLOGY IN ROBOTICS

Fabio Bonsignorio fabio.bonsignorio at heronrobots.com
Mon May 18 04:35:45 PDT 2009

Apologies for multiple postings

Dear All,
this is to invite you to attend the RSS2009 Workshop on GOOD
It will be an highly interactive workshop on a hot topic.
You will find the program here below
All the best


2009 Robotics: Science and Systems Workshop on

Full-day workshop  held in conjuntion with the 2009 Robotics:
Science and Systems Conference in Seattle, WA, USA  on June 28.

Rationale and goals

 As the complexity of current robotic and embodied intelligent systems
grows, it is more and more necessary to define proper experimental
approaches and benchmarking procedures. The Special interest group on
Good Experimental Methodology was formed by EURON in response to a
wide perception -- evidenced by some 90 responses to an email call for
interest -- that roboticists could do much better at performing and,
particularly, reporting experimental work. A major output of the
Special Interest Group is a set of guidelines for good experimental
(reporting) practice, which we believe supports the community's wish
to produce better experimental work. Equally significant is a series
of workshops on Benchmarking and Good Experimental Methodology held at
major Robotics conferences. Good experimental work is not novel in
robotics: there are many good experimental scientists in our
community. However, uniformly good experimental work and reporting has
not yet been achieved. The evidence of community interest in the topic
mentioned above suggests that the community is willing to take steps
to improve in this area. Thus we propose to take the work of good
experimental robotics groups and use it to illustrate high-quality
experimental work and reporting

The workshop will  draw out the strengths (and weaknesses) of
presented work and encourage sharing and adoption of good practices.
It will mix invited and regular presentations and will encourage the
discussion and interaction between the participants

List of topics

- Design of Experiments in Robotics
- Execution of Experiments in Robotics
- Reporting Experiments in Robotics
- Examples of Good Practice
- Evaluation of Experimental Robotics Work
- Proposals for Promotion of Good Experimental Work

The workshop will consist of presentations interleaved with a
significant amount of additional time for discussions between the
presentations and at the end of the full day single track sessions.

 The workshop will generate proceedings; selected contributions may be
invited to submit to a journal special issue on good experimental


Sunday, June 28th 2009

Coffee at 8:00 and registration

Session 1: 9:00 - 10:30

9:00 - 9:10 Introduction

9:10 - 09:30 Publishing Identifiable Experiment Code And Configuration
Is Important, Good and Easy
Jens Wawerla Richard T. Vaughan
School of Computing Science, Simon Fraser University

9:30 - 9:50 Toward a Science of Robotics: Goals and Standards for
Experimental Research
L. Takayama
Willow Garage

9:50 -10:10 Experiment Design for Large Multi-Robot Systems
J. McLurkin
Computer Science and Engineering
University of Washington

10:10 - 10:30 Towards Establishing Clinical Credibility for
Rehabilitation and Assistive Robots Through Experimental Design
Katherine M. Tsui Holly A. Yanco
University of Massachusetts Lowell

Break: 10:30 - 11:00

Session 2: 11:00 - 12:30

11:00 - 11:20 Experimental Identification of Friction and Dynamic
Coupling in a Dual Actuator Testbed
D. Rabindran D. Tesar
Robotics Research Group
Department of Mechanical Engineering
The University of Texas at Austin, USA

11:20 - 11:40 Good Experimental Methodologies for Mobile Robot Olfaction
Lino Marques
Institute of Systems and Robotics
University of Coimbra

11:40 - 12:00 A Proposal of a Set of Metrics for Collective Movement of Robots
I. Navarro F. Matıa
Intelligent Control Group
Universidad Politecnica de Madrid

12:00 - 12:20 A Traceable Inertial Calibration Parameter Estimation
Procedure Suited for Mobile Robots
Surya P. N. Singh
Australian Centre for Field Robotics, at the
School of Aerospace, Mechanical, and Mechatronic Engineering
University of Sydney

12:20 - 13:00 : Discussion

Lunch: 13:00 - 2:00

Session 3: 2:00 - 3:30

2:00 2:10 Morning recap

2:10-2:30 Datasets for the Evaluation of Multi-Sensor Perception in
Natural Environments with Challenging Conditions
Thierry Peynot and Steve Scheding
ARC Centre of Excellence for Autonomous Systems
Australian Centre for Field Robotics
The University of Sydney

2:30 - 2:50 Acquisition of 2-D ground truth data in multirobot experiments
M. Delaine Anderson
The University of Alabama

2:50 - 3:10 Evaluating the Performance of Robot Mapping Systems
E. Olson, University of Michigan
M. Kaess, MIT

3:10 - 3:30 Evaluation of Adaptive Technology Algorithms in Small
Robotic Platforms
M. Farmer,J. Pippine, C. Sullivan,C. Valdez,A. Watson
System Planning Corporation

Break: 3:30 - 4:00

Session 4: 4:00 - 5:30

4:00 - 4:30 Defining the requisites of a replicable robotics experiment
F.P. Bonsignorio Heron Robots
A.P Del Pobil University Jaume I Castellon
J. Hallam South Denmark University Odense

4:30 - 5:45: Discussion

5:45 - 6:00: Wrap-up

Relates workshops:
Previous workshops on the related topic of Benchmarking have been
organized successfully at IROS  (and one is being organized at next
IROS in St. Louis)  and RSS conferences.

Workshop Organizers:

Fabio Bonsignorio, Heron Robots, Italy, <fabio.bonsignorio at heronrobots.com>
Angel P. del Pobil, Universitat  Jaume I, Spain, <pobil at icc.uji.es>
John Hallam, University of Southern Denmark, <john at mmmi.sdu.dk>

Fabio P. Bonsignorio
Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova

More information about the robotics-worldwide mailing list