[robotics-worldwide] Reminder: CfP: Workshop on Good Experimental Methodology and Benchmarking in Robotics Research --- GEMBENCH10 during the Euron/Europ Annual General Meeting 2010 in Donostia-San Sebastian, Spain

Fabio Bonsignorio fabio.bonsignorio at heronrobots.com
Tue Feb 9 03:25:29 PST 2010


(apologies for multiple postings)

Dear All,

Just to remind you that there will be a Workshop on Good Experimental
Methodology and
Benchmarking in Robotics Research --- GEMBENCH10
during the  Euron/Europ  Annual General Meeting  2010 in Donostia-San
Sebastian, Spain, http://www.euron-europ-2010.eu/en/home, on March 12,
2010. You are invited to contribute.

-- Motivation and objectives:

On the one hand, reliable benchmarks are called for in order to allow
the comparison of the many research results in robotics research, so
that their industrial application is eventually possible. On the other
hand, if robotics aims to be regarded as serious science, replication
of experiments deserves consciencious attention; it is necessary to be
able to verify if and by which measure new procedures and algorithms
proposed in research papers constitute a real advancement and can be
used in new applications. We have now been working on this issues for
some time: what we need to go forward and allow and spread a fully
replicable and measurable way of reporting in our discipline?

-- Approach and expected results:

• Relationship between replication of experiments and benchmarking of
robotic systems
• Robotics experiment methodology
• The development of replicable/refutable experimental scenarios to
show capabilities, evaluate performance, demonstrate generality, and
measure robustness
• Performance modelling of the relationship between a task and the
environment where it is performed -Measuring and replicating knowledge
representation, perception (sensing), and learning -Metrics for
sensory motor coordination and visual servoing
effectiveness/efficiency -Benchmarking autonomy and robustness to
changes in the environment/task -Scalable autonomy measurements
• Shared ontologies to discuss robotic cognitive systems
• Detailing and understanding better the requirements for robot
experiments in terms of their generality replicability comparison of
performance, the approaches to meeting these requirements, the
trade-offs in terms of performance
Results : spread awareness of the issues, gather ideas, some possible
action items to foster research and facilitate applications

-- How can you contribute to, and prepare for, the workshop?

Send a short abstract, for a 20 minute interactive talk, book a 3 min
flash talk, attend actively. We aim at a possibly chaotic but
productive meeting

A related workshop on the role of experiments in robotics research,
http://www.heronrobots.com/EuronGEMSig/GEMSIGICRA10Program.html, will
be organized at ICRA 2010, Alaska, USA, 3-10 May, www.icra2010.org

The Euron/Europ  Annual General Meeting  2010 in Donostia-San
Sebastian will be the first joint annual meeting of Euron and Europ
and is supported by the euRobotics CA.

Voice your opinion!


All the best
Fabio



Workshop Highlights:
-- Registration is Free
-- Seminar Format: This forum aims to provoke a public discussion of
the challenges, problems, possible approaches and doubts raised,
related to this program and to identify the possible ways to cope (or
fail) with them. The forum will consist of presentations interleaved
with a significant amount of additional time for discussions between
the presentations and at the end of the half-day single track session.
--Post Proceedings: The speakers and the attendees will be invited to
send a 'real' paper AFTER the discussion for a post proceedings book,
with no hurry :-)
-- Advance Booking of Zipped Talks: If you want to book in advance for
a 3 minutes talk on one of the topics, just send an email to the
organizers, with a 'title'.
-- Unconference style interaction is encouraged: This will be a
'working' :-) workshop interaction in person and by social networking
media with people in the room and outside is welcome



Organizers:
Fabio Bonsignorio
CEO & Founder
Heron Robots srl V.R. Ceccardi 1/18, 16121 Genova, Italy.
Email: fabio.bonsignorio at heronrobots.com
Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés
Spain


Angel P. del Pobil, Ph.D.
Co-Chair for Research, European Robotics Research Network EURON
Professor, Department of Engineering and Computer Science
Universitat Jaume-I
Campus Riu Sec, Edificio TI, E-12071 Castellon, Spain.
Email: pobil at icc.uji.es
Tel: +34-964-72.82.93

John Hallam,

Mærsk Mc-Kinney Møller Institute, University of Southern Denmark (SDU)
Odense, Denmark

Email:john at mmmi.sdu.dk
Tel: +45-65503546

--
Fabio P. Bonsignorio

Ceo
Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova
Italy
www.heronrobots.com

Professor
Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés
Spain
Sent from Leganes, Spain


More information about the robotics-worldwide mailing list