[robotics-worldwide] Reminder: Program and CfP of the Workshop on Good Experimental Methodology and Benchmarking in Robotics Research --- GEMBENCH10 during the Euron/Europ Annual General Meeting 2010 in Donostia-San Sebastian, Spain

Fabio Bonsignorio fabio.bonsignorio at heronrobots.com
Wed Mar 3 06:55:29 PST 2010

apologies for cross-postings

Dear All,

Just to recall you GEMBENCH10 next week.
You will find here below the PROGRAM of the  Workshop on Good Experimental
Methodology and Benchmarking in Robotics Research --- GEMBENCH10
during the  Euron/Europ  Annual General Meeting  2010 in Donostia-San
Sebastian, Spain, http://www.euron-europ-2010.eu/en/home, on March 12,
You are invited to contribute by attending  actively. We aim at a
possibly chaotic but productive meeting.

A related workshop on the role of experiments in robotics research,
http://www.heronrobots.com/EuronGEMSig/GEMSIGICRA10Program.html, will
be organized at ICRA 2010, Alaska, USA, 3-10 May, www.icra2010.org

The Euron/Europ  Annual General Meeting  2010 in Donostia-San
Sebastian will be the first joint annual meeting of Euron and Europ
and is supported by the euRobotics CA.

Voice your opinion!
All the best

Workshop Program

9:00 9:10 Welcome and Introduction
F Bonsignorio A P Del Pobil J Hallam

9:10 9:40 FP7 Challenge 2 : Why benchmarking and standardisation are important
A Bajart
EU Commission  DG INFSO

9:40 10:10 ROBOSKIN: Capturing Human Motion as a Benchmark
for Humanoid Touch-triggered Protective Reflexes
T S Dahl A Palmer
University of Wales Newport Robotics Intelligence Lab

10:10 10:30 RAWSEEDS: hands-on benchmarking
A Bonarini M Matteucci G Fontana
Politecnico di Milano
D Sorrenti
University of Milano Bicocca

10:30 10:50 A proposal of benchmark tests for underactuated or compliant hands
G A Kragten J L Herder
Delft University of Technology Dept. of BioMechanical Engineering

10:50 11:00 coffee break

11:00 11:20 Omnidirectional vision: from calibration to robot motion estimation
D Scaramuzza
ETH Zurich  Autonomous Systems Lab

11:20 11:40 Teleworkbench: The Teleoperated Platform for Robotic Experiments
A Tanoto J Welzel
University of Paderborn Heinz Nixdorf Institute
F Werner U Rueckert
University of Bielefield Cognitive Interation Technology Centre of Excellence

11:40 12:10: BRICS: Enhancing software quality in robotics:
implications on benchmarking
D Brugali
University of Bergamo, IEEE TC-Soft

12:10 12:30 Replication, benchmarking and the publishing process
F Bonsignorio A P Del Pobil J Hallam

12:30 13:00 Final discussion

Workshop Highlights:

-- Motivation and objectives:

On the one hand, reliable benchmarks are called for in order to allow
the comparison of the many research results in robotics research, so
that their industrial application is eventually possible. On the other
hand, if robotics aims to be regarded as serious science, replication
of experiments deserves consciencious attention; it is necessary to be
able to verify if and by which measure new procedures and algorithms
proposed in research papers constitute a real advancement and can be
used in new applications. We have now been working on this issues for
some time: what we need to go forward and allow and spread a fully
replicable and measurable way of reporting in our discipline?

-- Approach and expected results:

• Relationship between replication of experiments and benchmarking of
robotic systems
• Robotics experiment methodology
• The development of replicable/refutable experimental scenarios to
show capabilities, evaluate performance, demonstrate generality, and
measure robustness
• Performance modelling of the relationship between a task and the
environment where it is performed -Measuring and replicating knowledge
representation, perception (sensing), and learning -Metrics for
sensory motor coordination and visual servoing
effectiveness/efficiency -Benchmarking autonomy and robustness to
changes in the environment/task -Scalable autonomy measurements
• Shared ontologies to discuss robotic cognitive systems
• Detailing and understanding better the requirements for robot
experiments in terms of their generality replicability comparison of
performance, the approaches to meeting these requirements, the
trade-offs in terms of performance
Results : spread awareness of the issues, gather ideas, some possible
action items to foster research and facilitate applications

-- How can you contribute to, and prepare for, the workshop?

Attend actively. We aim at a possibly chaotic but
productive meeting

-- Registration is Free
-- Seminar Format: This forum aims to provoke a public discussion of
the challenges, problems, possible approaches and doubts raised,
related to this program and to identify the possible ways to cope (or
fail) with them. The forum will consist of presentations interleaved
with a significant amount of additional time for discussions between
the presentations and at the end of the half-day single track session.
--Post Proceedings: The speakers and the attendees will be invited to
send a 'real' paper AFTER the discussion for a post proceedings book,
with no hurry :-)
-- Advance Booking of Zipped Talks: If you want to book in advance for
a 3 minutes talk on one of the topics, just send an email to the
organizers, with a 'title'.
-- Unconference style interaction is encouraged: This will be a
'working' :-) workshop interaction in person and by social networking
media with people in the room and outside is welcome

Fabio Bonsignorio
CEO & Founder
Heron Robots srl V.R. Ceccardi 1/18, 16121 Genova, Italy.
Email: fabio.bonsignorio at heronrobots.com
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés

Angel P. del Pobil, Ph.D.
Co-Chair for Research, European Robotics Research Network EURON
Professor, Department of Engineering and Computer Science
Universitat Jaume-I
Campus Riu Sec, Edificio TI, E-12071 Castellon, Spain.
Email: pobil at icc.uji.es
Tel: +34-964-72.82.93

John Hallam,

Mærsk Mc-Kinney Møller Institute, University of Southern Denmark (SDU)
Odense, Denmark

Email:john at mmmi.sdu.dk
Tel: +45-65503546

Fabio P. Bonsignorio

Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova

Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés
Sent from Leganes, Spain

More information about the robotics-worldwide mailing list