[robotics-worldwide] Reminder: CfP and PROGRAM: Workshop about the road Towards Replicable Experiments in Robotics Research at ICRA 2011 (Shanghai, China, May 13, 2011)

Fabio Bonsignorio fabio.bonsignorio at uc3m.es
Wed Mar 30 04:04:43 PDT 2011


(apologies for multiple postings)

Dear All,

This is a kind reminder of the invitation to participate actively to
the Workshop about the road ahead Towards Replicable Experiments in
Robotics Research at ICRA 2011 (Shanghai, China, May 13, 2011) with
the final PROGRAM. This is a quite hot and intriguing topic.
The workshop will consist of  invited presentations interleaved with a
significant amount of additional time for discussions between the
presentations and at the end of the full day single track sessions.
Interaction in person and by social networking media with people in
the room and outside is welcome.
Please be aware that the EARLY REGISTRATION deadline is MARCH 31 :-)

More details and the PROGRAM are here and below:

http://www.heronrobots.com/EuronGEMSig/GEMSIGICRA11Program.html

A related workshop will be organized in Vasteras (Sweden),during the
European Robotics Forum, in a couple of weeks, if you are interested
check here:
http://www.eucognition.org/eucogii-euron-workshop

All the Best

Fabio, Angel, John and Raj

PROGRAM

May 13th, 2011

09:00 Introduction

09:10 Wolfram Burgard Autonomous Lifelong Navigation: Experiment
replication and Benchmarking
University of Freiburg
Germany

9:50 Weidong Chen Experimental method and benchmarking in Mobile Robot Networks
Shanghai Jiao Tong University
China

10:30 - 11:00 Coffee break

11:00 Libor Kral Performance evaluation and benchmarking in EU-funded
activities
EU Commission, Challenge 2 Head of Unit
Luxembourg

11:40 Vincent C. Müller Benchmarking benchmarks: What should count as
'success' towards a benchmark?
EUCogII coordinator
Anatolia College/ACT, Thessaloniki
Greece

12:20 - 14:10 Lunch break

14:10 Jeff Trinkle On Grasping in Simulation and the 'Real World'
(provisional title)
Renssellaer Politechnic Institute
USA

14:50 Sven Wachsmuth Performance Assessment and System Design in Human
Robot Interaction
Citec, University of Bielefeld
Germany

15:30-16:00 Coffee break

16:00 Organizers' 'editorial’: Time for action!

16:40 Panel and discussion

17:40 Wrap up




Content:

In all field of science experiments play an important role, in order
to confirm/refute a theory and to discover new theories. It is a
widespread opinion that experimental methodologies in robotics have
not yet achieved a level of maturity comparable with that in
traditional science. In this workshop, we will discuss fundamental
issues about the role of experiments in robotics, such as how can
results be replicable and refutable on the one hand, and
quantitatively comparable according to community-endorsed metrics to
enable a faster cumulative progress, or even appreciate disruptive
changes. We will particularly focus on how might be possible, by
providing the proper kind and amount of data to enable the replication
of experiments as a prerequisite to quantitative comparison of
capabilities. A key point to allow replication and comparison of
results is having adequate data support: all the data necessary to
repeat a given experiment, how to achieve it with today's digital
media will be addressed. These issues, when viewed in the context of
some general principles about experiments in science and engineering,
will allow us to do some insightful considerations on the role of
experiments in robotics and it scientific and epistemological
foundations. This workshop is a joint initiative of the IEEE Technical
Committee on Performance Evaluation and Benchmarking of Robotic and
Automation Systems (PEBRAS) and the EURON Special Interest Group on
Good Experimental Methodology for Robotics (SIG GEM).


Workshop Highlights:

--- List of topics:
             o Design of Experiments in Robotics
             o Execution of Experiments in Robotics
             o Reporting Experiments in Robotics
             o Epistemological issues
             o Examples of Good Practice
             o Evaluation of Experimental Robotics Work
             o Proposals for Promotion of Good Experimental Work
             o Metrics for sensory motor coordination and visual
servoing effectiveness/efficiency
             o Benchmarking autonomy and robustness to changes in the
environment/task
             o Scalable autonomy measurements
             o Requirements for robots in terms of performance, the
approaches to meeting these requirements, the trade-offs in terms of
performance
             o Experimental scenarios to evaluate performance,
demonstrate generality, and measure robustness
             o Performance modeling of the relationship between a
task and the environment where it is performed
             o Relationship between benchmarking and replication of
experiments with robots

Format: The workshop will consist of presentations interleaved with a
significant amount of additional time for discussions between the
presentations and at the end of the full day single track sessions.


Proceedings: Selected contributions may be invited to
submit to a journal special issue on good experimental robotics.

Intended Audience: Robotics researchers from any subfield of the
discipline from both academia and industry.
Industry members interested in the exploitation of research results,
others interested in methodologies in scientific and engineering
disciplines.

Background and previous workshops: This workshop is a joint initiative
of the IEEE-TC on Performance Evaluation and Benchmarking of Robotic
and Automation Systems (PEBRAS) and the EURON Special Interest Group
on Good Experimental Methodology for Robotics (SIG GEM). The proposers
are co-chairs of IEEE-TC PEBRAS and/or EURON SIG GEM and have jointly
co-organized over 10 successful related events in the last 5 years,
such as 5-in-a-row workshops on Benchmarking and Performance Metrics
at IROS (2006-2010), three workshops at RSS (2008-2010) and the
Performance Metrics for Intelligent Systems Workshop (PERMIS) series
(20060-2010). A list of previously organized events can be found here:
http://www.heronrobots.com/EuronGEMSig/GEMSIGEvents.html The latest
workshop at RSS 2010 had a certified attendance of over 50
participants.

Unconference style interaction is encouraged: This will be a 'working'
:-) workshop interaction in person and by social networking media with
people in the room and outside is welcome


Organizers:

Fabio Bonsignorio
Board Member European Robotics Network EURON
Heron Robots srl
V.R.Ceccardi 1/18, 16121 Genova, Italy,
Tel: +39-339-8406011,
fabio.bonsignorio at heronrobots.com
Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Avda. Universidad, 30
28911 Leganés, Spain
Tel: +34 916246014
fabio.bonsignorio at uc3m.es

John Hallam,
Board Member European Robotics Network EURON
Mærsk-McKinney Møller Institute, University of Southern
Denmark,
Odense, Denmark,
Tel: +45-65503546,
john at mmmi.sdu.dk

Angel P. del Pobil, Ph.D,
Board Member European Robotics Network EURON
Professor
Robotic Intelligence Laboratory Universitat Jaume I,
12071 Castellon, Spain,
Tel:+34-964-728293,
pobil at icc.uji.es

Raj Madhavan, Ph.D.
Intelligent Systems Division
National Institute of Standards and Technology
100 Bureau Drive, Mail Stop 8230
Gaithersburg, MD 20899-8230,USA
Tel: +1(301) 975-2865
raj.madhavan at nist.gov



--

Fabio P. Bonsignorio

Ceo
Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova
Italy
www.heronrobots.com

Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés
Spain


More information about the robotics-worldwide mailing list