[robotics-worldwide] CfP: Workshop about the road Towards Replicable Experiments in Robotics Research at ICRA 2011 (Shanghai, China, May 13, 2011)

Fabio Bonsignorio fabio.bonsignorio at heronrobots.com
Thu Feb 3 04:44:50 PST 2011


(apologies for multiple postings)

Dear All,

This is to  invite you to participate actively to the Workshop about the
road ahead Towards Replicable Experiments in Robotics Research at ICRA 2011
(Shanghai, China, May 13, 2011). This is a quite hot and intriguing topic.
People wishing to contribute must send an IEEE formatted paper to one of the
organizers (please notice that deadlines
are HARD!)

Important Dates:
             o February 15: Drat Paper Due
             o February 22: Notification of acceptance
             o March 18: Final Paper Due

More details are here and below:

http://www.heronrobots.com/EuronGEMSig/GEMSIGICRA11Program.html<http://www.heronrobots.com/EuronGEMSig/GEMSIGICRA10Program.html>
.

We wish peace, prosperity and good health for the New Year of the Rabbit
many people are celebrating all over the world!

All the Best

Fabio, Angel, John and Raj

Content:

In all field of science experiments play an important role, in order to
confirm/refute a theory and to discover new theories. It is a widespread
opinion that experimental methodologies in robotics have not yet achieved a
level of maturity comparable with that in traditional science. In this
workshop, we will discuss fundamental issues about the role of experiments
in robotics, such as how can results be replicable and refutable on the one
hand, and quantitatively comparable according to community-endorsed metrics
to enable a faster cumulative progress, or even appreciate disruptive
changes. We will particularly focus on how might be possible, by providing
the proper kind and amount of data to enable the replication of experiments
as a prerequisite to quantitative comparison of capabilities. A key point to
allow replication and comparison of results is having adequate data support:
all the data necessary to repeat a given experiment, how to achieve it with
today's digital media will be addressed. These issues, when viewed in the
context of some general principles about experiments in science and
engineering, will allow us to do some insightful considerations on the role
of experiments in robotics and it scientific and epistemological
foundations. This workshop is a joint initiative of the IEEE Technical
Committee on Performance Evaluation and Benchmarking of Robotic and
Automation Systems (PEBRAS) and the EURON Special Interest Group on Good
Experimental Methodology for Robotics (SIG GEM).

Workshop Highlights:

--- List of topics:
             o Design of Experiments in Robotics
             o Execution of Experiments in Robotics
             o Reporting Experiments in Robotics
             o Epistemological issues
             o Examples of Good Practice
             o Evaluation of Experimental Robotics Work
             o Proposals for Promotion of Good Experimental Work
             o Metrics for sensory motor coordination and visual
servoing effectiveness/efficiency
             o Benchmarking autonomy and robustness to changes in the
environment/task
             o Scalable autonomy measurements
             o Requirements for robots in terms of performance, the
approaches to meeting these requirements, the trade-offs in terms of
performance
             o Experimental scenarios to evaluate performance,
demonstrate generality, and measure robustness
             o Performance modeling of the relationship between a
task and the environment where it is performed
             o Relationship between benchmarking and replication of
experiments with robots

Format: The workshop will consist of presentations interleaved with a
significant amount of additional time for discussions between the
presentations and at the end of the full day single track sessions.

Important dates: People wishing to contribute must send an IEEE
formatted paper to one of the organizers (please notice that deadlines
are HARD!)

             o February 15: Drat Paper Due
             o February 22: Notification of acceptance
             o March 18: Final Paper Due

Proceedings: The workshop contribution will be included in the ICRA
2010 Workshop/Tutorial CD; selected contributions may be invited to
submit to a journal special issue on good experimental robotics.

Intended Audience: Robotics researchers from any subfield of the
discipline from both academia and industry.
Industry members interested in the exploitation of research results,
others interested in methodologies in scientific and engineering
disciplines.

Background and previous workshops: ** This workshop is a joint initiative of
the IEEE-TC on Performance Evaluation and Benchmarking of Robotic and
Automation Systems (PEBRAS) and the EURON Special Interest Group on Good
Experimental Methodology for Robotics (SIG GEM). The proposers are co-chairs
of IEEE-TC PEBRAS and/or EURON SIG GEM and have jointly co-organized over 10
successful related events in the last 5 years, such as 5-in-a-row workshops
on Benchmarking and Performance Metrics at IROS (2006-2010), three workshops
at RSS (2008-2010) and the Performance Metrics for Intelligent Systems
Workshop (PERMIS) series (20060-2010). A list of previously organized events
can be found here:
http://www.heronrobots.com/EuronGEMSig/GEMSIGEvents.htmlThe latest
workshop at RSS 2010 had a certified attendance of over 50
participants.

Unconference style interaction is encouraged: This will be a 'working'
:-) workshop interaction in person and by social networking media with
people in the room and outside is welcome


Organizers:

Fabio Bonsignorio
Board Member European Robotics Network EURON
Heron Robots srl
V.R.Ceccardi 1/18, 16121 Genova, Italy,
Tel: +39-339-8406011,
fabio.bonsignorio at heronrobots.com
Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Avda. Universidad, 30
28911 Leganés, Spain
Tel: +34 916246014
fabio.bonsignorio at uc3m.es

John Hallam,
Board Member European Robotics Network EURON
Mærsk-McKinney Møller Institute, University of Southern
Denmark,
Odense, Denmark,
Tel: +45-65503546,
john at mmmi.sdu.dk

Angel P. del Pobil, Ph.D,
Board Member European Robotics Network EURON
Professor
Robotic Intelligence Laboratory Universitat Jaume I,
12071 Castellon, Spain,
Tel:+34-964-728293,
pobil at icc.uji.es

Raj Madhavan, Ph.D.
Intelligent Systems Division
National Institute of Standards and Technology
100 Bureau Drive, Mail Stop 8230
Gaithersburg, MD 20899-8230,USA
Tel: +1(301) 975-2865
raj.madhavan at nist.gov



--

Fabio P. Bonsignorio

Ceo
Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova
Italy
www.heronrobots.com

Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés
Spain


More information about the robotics-worldwide mailing list