[robotics-worldwide] Last Call: Program and CfP of the Workshop on The Role of Experiments in Robotics Research at ICRA 2010 (Anchorage, Alaska, USA, May 3-8, 2010)

Fabio Bonsignorio fabio.bonsignorio at heronrobots.com
Sat May 1 14:05:35 PDT 2010


(apologies for multiple postings)

Dear All,

This is to warmly invite you to actively participate to the Workshop
on The Role of
Experiments in Robotics
Research on May 3rd at ICRA 2010 (Anchorage, Alaska, USA, May 3-8,
2010). This is
a quite hot topic. You are invited to participate actively.
Program and details are here:

http://www.heronrobots.com/EuronGEMSig/GEMSIGICRA10Program.html.

Pleas be aware that there is a workshop-only registration option at the
conference for attendees who only wish to attend workshops
but not the conference (btw a very interesting conference :-) ).  When
you go to the registration page, proceed as though you
were going to register for the conference and the
workshops. When you get to the Select Events page, enter 0
for main registration and enter 1 for Workshops, and you
will be able to get registered for the workshops without
registering for the conference.

A related workshop, more focused on the issues of robotics experiment
replication and related publishing process, will be organized on Good
Experimental Methodology in
Robotics and Replicable Robotics Research at RSS'10 (Zaragoza,Spain,
June 28, 2010) details here:
http://www.heronrobots.com/EuronGEMSig/GEMSIGRSS10Program.html

All the Best

Fabio, Angel, John and Raj

Content:

Experiments are essential ingredients of science, both to
confirm/refute a theory and to discover new theories.
It is a common belief that experimentation in robotics has not yet
reached a level of maturity comparable with that reached in
traditional science. In this workshop, we will discuss fundamental
issues about the role of experiments in robotics, such as how can
results be replicable and refutable on the one hand, and
quantitatively comparable according to community-endorsed metrics to
enable a faster cumulative progress, or even appreciate disruptive
changes.
These issues, when viewed in the context of some general principles
about experiments in science and engineering, will lead us to derive
some insightful considerations on the role of experiments in robotics.
A key point to allow replication and comparison of results is having
adequate data support: all the data necessary to repeat a given
experiment, how to achieve it with today's digital media will be
addressed.
This workshop is a joint initiative of the new IEEE-TC on Performance
Evaluation and Benchmarking of Robotic and Automation Systems (PEBRAS)
and the EURON Special Interest Group on Good Experimental Methodology
for Robotics (SIG GEM).
 Most forms of robotic system performance measurement, evaluation,
comparison, characterization etc. involve practical experimentation,
which must be carried out responsibly and reported well. Recently, the
interest in experimental methodologies increased dramatically within
the robotics community, both from researchers and from funding
agencies, according to the idea that good experimental activities
could reduce the gap between research and industrial applications.

Some projects have been funded by the European Commission and a series
of workshops (see below) have been held in the latest years. Despite
the ongoing efforts and the recognized importance of experiments for
rigorously evaluating new approaches and for reporting them in an
objective and complete manner, these ideas have not yet become really
part of current practice, as it can be seen by having a look at
recently published papers. This may be due to the diffculty to perform
time-consuming experiments and to the weak awareness of experiments as
fundamental elements in the development of a robotic system.
The aim of this workshop is to discuss fundamental issues about the
role of experiments in robotics, and namely as already noticed above,
issues such as how can results be replicable and refutable on the one
hand, and quantitatively comparable according to community-endorsed
metrics, on the other hand. As both replication and benchmarking are
needed to foster a cumulative advancement of robotics, and even to
correctly appreciate disruptive innovation in the science and
technology of robots.  The recent evidence of community interest
suggests that it is willing to take steps to improve in this area.
A major output of the Euron SIG GEM is a set of guidelines for good
experimental and reporting practice:
http://www.heronrobots.com/EuronGEMSig/Downloads/GemSigGuidelinesBeta.pdf
A deep discussion of these issues, when viewed in the context of some
general principles about experiments in science and engineering, will
lead us to derive some insightful considerations on the role of
experiments in robotics.

Workshop Highlights:

--- List of topics:
             o Design of Experiments in Robotics
             o Execution of Experiments in Robotics
             o Reporting Experiments in Robotics
             o Epistemological issues
             o Examples of Good Practice
             o Evaluation of Experimental Robotics Work
             o Proposals for Promotion of Good Experimental Work
             o Metrics for sensory motor coordination and visual
servoing effectiveness/efficiency
             o Benchmarking autonomy and robustness to changes in the
environment/task
             o Scalable autonomy measurements
             o Requirements for robots in terms of performance, the
approaches to meeting these requirements, the trade-offs in terms of
performance
             o Experimental scenarios to evaluate performance,
demonstrate generality, and measure robustness
             o Performance modeling of the relationship between a
task and the environment where it is performed
             o Relationship between benchmarking and replication of
experiments with robots

Format: The workshop will consist of presentations interleaved with a
significant amount of additional time for discussions between the
presentations and at the end of the full day single track sessions.

Proceedings: The workshop contribution will be included in the ICRA
2010 Workshop/Tutorial CD; selected contributions may be invited to
submit to a journal special issue on good experimental robotics.

Intended Audience: Robotics researchers from any subfield of the
discipline from both academia and industry.
Industry members interested in the exploitation of research results,
others interested in methodologies in scientific and engineering
disciplines.

Background and previous workshops: This workshop is a joint initiative
of the new IEEE-TC on Performance Evaluation and Benchmarking of
Robotic and Automation Systems (PEBRAS) and the EURON Special Interest
Group on Good Experimental Methodology for Robotics (SIG GEM). The
proposers are co-chairs of IEEE-TC PEBRAS and/or EURON SIG GEM and
have jointly co-organized over 10 successful related events in the
last 5 years, such as 4-in-a-row workshops on Benchmarking and
Performance metrics at IROS (2006-2009), two workshops at RSS
(2008-2009) and the Performance Metrics for Intelligent Systems
Workshop (PERMIS) series.

Unconference style interaction is encouraged: This will be a 'working'
:-) workshop interaction in person and by social networking media with
people in the room and outside is welcome

A related workshop on Good Experimental Methodology and Benchmarking
in Robotics Research and Applications - GEMBENCH10 at the Euron Annual
General Meeting (Donostia-S.Sebastian, Spain, 10-12 March, 2010)
colocated with the Europ Annual General Meeting,
http://www.euron-europ-2010.eu/en/programme#12.

Organizers:

Fabio Bonsignorio
Board Member European Robotics Network EURON
Heron Robots srl
V.R.Ceccardi 1/18, 16121 Genova, Italy,
Tel: +39-339-8406011,
fabio.bonsignorio at heronrobots.com
Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Avda. Universidad, 30
28911 Leganés, Spain
Tel: +34 916246014
fabio.bonsignorio at uc3m.es

John Hallam,
Board Member European Robotics Network EURON
Mærsk-McKinney Møller Institute, University of Southern
Denmark,
Odense, Denmark,
Tel: +45-65503546,
john at mmmi.sdu.dk

Angel P. del Pobil, Ph.D,
Board Member European Robotics Network EURON
Professor
Robotic Intelligence Laboratory Universitat Jaume I,
12071 Castellon, Spain,
Tel:+34-964-728293,
pobil at icc.uji.es

Raj Madhavan, Ph.D.
Intelligent Systems Division
National Institute of Standards and Technology
100 Bureau Drive, Mail Stop 8230
Gaithersburg, MD 20899-8230,USA
Tel: +1(301) 975-2865
raj.madhavan at nist.gov



--


Fabio P. Bonsignorio

Ceo
Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova
Italy
www.heronrobots.com

Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés
Spain



-- 
CONFIDENTIAL AND PRE-DECISIONAL INFORMATION


Fabio P. Bonsignorio

Ceo
Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova
Italy
www.heronrobots.com

Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés
Spain


More information about the robotics-worldwide mailing list