[robotics-worldwide] [Meetings] REMINDER: CfP to the ICRA 2014: DL March 21st: Epistemological issues in robotics research and research result evaluation, Hong Kong, China - June 5, 2014 (PM)

Fabio Bonsignorio fabio.bonsignorio at heronrobots.com
Wed Mar 5 06:22:27 PST 2014

Apologies for multiple postings

Dear All,

this is a reminder that you are kindly invited to submit to the ICRA  2014
Workshop on
Epistemological issues in robotics research and research result
evaluation which will be held in Hong Kong, China on June 5, 2014 (PM)

This workshop addresses a number of epistemological issues in
robotics, related to performance measurement, methods for the
objective comparison of different algorithms and systems, the
possibility itself to replicate published results.

How research should be performed (and reported) in order to allow
result replications?

While the practical utility of challenges and competitions is widely
recognized, which is their epistemological status? How should they be
designed in order to maximize their contribution to robotics research
(and the industrial exploitation of results?)?

To which extent and for measuring which functionalities and
capabilities are benchmarks useful and possible?

Which balance of result replication, benchmarking, challenges and
competitions would allow a more objective evaluation of results and
consequent objective assessment of the state of the art in the various
subfields of our domain of investigation?

The workshop will provide a forum for the discussion of these issues
and will show a number of examples of replicable experiment in
Robotics Research. Moreover, we believe that the ideas developed
within the community and the available tools allows to discuss, and
possibly to implement, a robotics research publishing thread based on
the publication of fully replicable experiments. This would possibly
be very beneficial for the education of undergraduate and graduate
students, too.

Up to date info will be posted here:

There will be post-proceedings.

We look forward your active participation

All the best
Fabio, Angel, Elena and John

Submission info:

Key Dates:

March 21st, 2014 (23:59 PST): Abstract Submission Deadline
March, 28th, 2014: Notification of Acceptance
April 12th, 2014: Final version due

Abstract Format:

Abstract should be submitted as PDF files (from minimum 1  to  maximum
 3 pages, plus references)
in ICRA regular paper format.

List of topics:

- Epistemological issues
- Experiments in Robotics
- Examples of Good Practice
- Evaluation of Experimental Robotics Work
- Proposals for Promotion of Good Experimental Work
- Performance modeling of the relationship between a task and the
environment where it is performed
- Relationship between benchmarking and replication of experiments with
- Reporting experiments in Robotics
- Comparison of experimental methodology in neurosciences,
neurophysiology and in Robotics
- Comparison of experimental methodology in
neurosciences/neurophysiology and in AI
- Comparison of experimental methodology in Biology and in Robotics
- Comparison of experimental methodology in Biology and in AI
- Experimental scenarios to evaluate performance, demonstrate
generality, and measure - robustness in robots and animals
- Well grounded experimental methods to compare artificial and natural
cognitive systems; - - Benchmarking in Robotics/AI/Cognition
- Robotics/AI/Cognition competitions
- Design of Robotics/AI/Cognition competitions
- Robotics/AI/Cognition Challenges
- Design of Robotics/AI/Cognition Challenges
- How to integrate Experimental Methods, Benchmarking, Challenges and
Competitions for a better evaluation of results


Fabio P. Bonsignorio

IEEE Senior Member

Publication Chair IEEE RAS Humanoids 2014

Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova

Founding Past Director
euRobotics aisbl

Banco de Santander Chair of Excellence in Robotics
Universidad Carlos III de Madrid
Edificio Agustín de Betancourt, Despacho 1.3B01
Avda. Universidad, 30
28911 Leganés

More information about the robotics-worldwide mailing list