[robotics-worldwide] [journals] Call for contributions: Reminder: IEEE Robotics & Automation Magazine Special Issue on Replicable and Measurable Robotics Research

Fabio Bonsignorio fabio.bonsignorio at gmail.com
Sat Nov 1 04:15:14 PDT 2014

Apologies for multiple postings

Dear all,
this is a kind reminder that you are invited  to contribute to the IEEE
Robotics & Automation Magazine  Special Issue on Replicable and Measurable
Robotics Research, see here:

There are a number of issues in robotics, related to performance
measurement, methods for the objective comparison of different algorithms
and systems, the possibility itself to replicate published results.

We are now at a point where it is possible to give concrete directions for
experiment planning, execution, and reporting, allowing objective
performance comparisons and potentially affecting the content of obtained
results, not only their 'production process'.

The key point to allow replication and comparison of results is having
adequate data support: all the data necessary to repeat a given experiment.

We are planning to publish a list of replicable/reproducible and
quantitatively comparable research results in strict accordance with the
rules we have discussed in the past few years within the TC-Pebras (IEEE
RAS Technical Committee on Performance Evaluation and Benchmarking of
Robotics and Automation systems), EURON (European Robotics Network) ,
euRobotics aisbl and the whole community. As a consequence ‘replicable’
contributions will be strongly preferred in the review process.

This will be the very first well-structured example of a publication in
robotics which will list a series of replicable and objectively measurable

Contributed papers reporting about experiments, benchmarking methods,
challenges and competitions are solicited. They need to include results on
real robots and be described in such a way to allow their replication.  In
particular challenges and competitions might be needed to compare
intelligent or system level behaviors and capabilities. We seek papers on
challenges and competitions describing real world events with real robots
and designed as robotics ‘replicable experiments’.

*Important  dates *

*Call for papers June 2014*

*Submission deadline:  December 10, 2014 *

*First Review: February 6, 2015 *

*Final Review: May 20, 2015 *

*Publication: September  2015 *

*Scope, Description and information*

Contributions from ANY area of Robotics and Automation are sought, under
the condition that they are ‘replicable’.

The topics include but are not limited to:

·            Experiments in Robotics;

·            Benchmarking methods;

·            Challenges and Competitions;

·            Examples of Good Practice;

·            Evaluation of Experimental Robotics Work;

·            Relationship between benchmarking and replication of
experiments with robots;

·            Comparison of experimental methodology in neurosciences/
neurophysiology and in Robotics;

·            Comparison of experimental methodology in neurosciences/
neurophysiology, in AI and Robotics;

·            Comparison of experimental methodology in Biology and in

·            Success metrics in Robotics;

·            Well grounded experimental methods to compare artificial and
natural systems, and their interaction

_Any application area_ of Robotics and Automation can be considered, such
as: Aerial Robotics, Rehabilitation and Assistive Robotics, Medical
Robotics, Industrial robotics, Prosthetics and Exoskeletons, Wearable
Robotics, Marine Robotics, and more.


RAM allows the attachment of extended materials (e.g. datasets, software
tools, experimental protocols, code and or hardware identifiers, open
source software, open source hardware designs, etc.), accompanying the
submission of a paper. Instructions on the preparation of this material can
be found on www.ieee-ras.org/ram/for_authors. Extended materials will
appear side-by-side to the accepted paper in the electronic version of the
Special Issue within IEEE Xplore.


*Guest editors*

*Fabio Bonsignorio*, The Biorobotics Institute, Scuola Superiore S. Anna.
Pisa, Italy and CEO and founder of Heron Robots. (Corresponding guest

*John Hallam, *Maersk Institute, University of Southern Denmark, Odense,

*Angel P. del Pobil* founder director of the Robotic Intelligence
Laboratory, University Jaume I, Castellon, Spain and WCU Visiting Professor
at Sungkyungkwan University, Seoul, Korea.

All the best

Fabio, John and Angel


Fabio P. Bonsignorio

IEEE Senior Member

Publication Chair IEEE RAS Humanoids 2014

Affiliate Professor
Scuola Superiore Sant'Anna, Pisa, Italy
The BioRobotics Institute
viale Rinaldo Piaggio 34, 56025 Pontedera (Pisa)

Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova

Founding Past Director
euRobotics aisbl

More information about the robotics-worldwide mailing list