[robotics-worldwide] [Meetings] CfP, Program and accepted contributions for the ICRA 2019 (May 20-24) Workshop on 'Taking Reproducible Research in Robotics to the Mainstream: Building on the IEEE RAM R-Articles' which will be held in Montreal (Canada), (FULL DAY)

Fabio Bonsignorio fabio.bonsignorio at gmail.com
Wed Feb 27 03:44:59 PST 2019

Apologies for multiple postings

Dear All,

you are kindly invited to actively participate to the ICRA 2019  Workshop
on 'Taking Reproducible Research in Robotics to the Mainstream: Building on
the IEEE RAM R-Articles'  which will be held in  Montreal, during ICRA 2019
(20-24 May). Check the website here for updates:

As you may know reproducibility issues are recently attracting a lot of
interest in many fields (including medicine, psychology, etc...) and
reproducibility of research results is a priority for IEEE at large. The
robotics community is no exception, as shown by the long list of valuable
contributions to this workshop.

Reproducibility of results is  the cornerstone of scientific methodology.
In Robotics research the replicability and reproducibility of results and
their objective evaluation and comparison is still not common.

Thanks to the R-article process in IEEE RAM, we are now able to make
progress towards a widespread and much needed practice of Reproducible
Research in Robotics. This workshop will provide necessary information,
knowledge and motivation to support the community’s transition to an
environment where reproducible research is possible and common.

*There will be post-proceedings.*

*IEEE Robotics and Automation Magazine solicit Reproducible Article
submissions, for more info please check here:
<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ieee-2Dras.org_publications_ram_information-2Dfor-2Dauthors&d=DwIFaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=0w3solp5fswiyWF2RL6rSs8MCeFamFEPafDTOhgTfYI&m=pVv0MBd7nIgExH6ht6QPavXEnQmmT6KSVDvsbiCYzzU&s=bfhmw7nQiRmmu4I7GUQRxJwGdxWpOn9ukwAi6jhmJXQ&e=> (check
in particular section 9.), here:
<https://urldefense.proofpoint.com/v2/url?u=https-3A__ieeexplore.ieee.org_stamp_stamp.jsp-3Farnumber-3D8036322&d=DwIFaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=0w3solp5fswiyWF2RL6rSs8MCeFamFEPafDTOhgTfYI&m=pVv0MBd7nIgExH6ht6QPavXEnQmmT6KSVDvsbiCYzzU&s=MIV_bJm85wPmliRgS1lAAymO7zc3lB5DtZuUKF-MyNI&e=> and

We look forward your active participation

All the best
Fabio, Angel and Signe


Preliminary Agenda


Fabio Bonsignorio, The BioRobotics Institute, Scuola Superiore S. Anna and
Heron Robots, Italy

Topic: The R-Article Process in IEEE Robotics & Automation Magazine

Session 1: Problem Definition

Signe Redfield , Naval Research Laboratory, USA

Topic: The Case for Modular Task Specification: Specification via the
future 1872.1 Task Ontology


Neil Dantam (invited), Colorado School of Mines, USA

Topic: The Case for Platform-Specific Task Specification: The Task-Motion

*Contributed Presentations*


Session 2: Performance Measurement

Amit Kumar Pandey, Softbank Robotics, France

Topic: Benchmarking and Reproducible Robotics in Social Robots

Davide Scaramuzza, University of Zurich, Switzerland

Topic: How to Run Reproducible Visual SLAM Experiments

Stefano Carpin , University of California Merced, USA

Topic: How to Run Reproducible Visual Grasping Experiments

*Contributed Presentations*


Session 3: Objective Comparison

Matteo Matteucci, Politecnico di Milano, Italy

Topic: ERL: Toward Sustainable Benchmarking Competitions

Jorge Dias, Khalifa University, UAE

Topic: Benchmarking and Assessment in Robotics Acting in Dynamic
Environments – Facts and

Figures from MBZ International Robotic Challenge 2017

Wolfram Burgard (tbc), University of Freiburg, Germany

Topic: Accurately Benchmarking SLAM and SLAM Experiment Reproducibility

*Contributed Presentations*


Session 4: Replication of Published Results

Francesco Amigoni, Politecnico di Milano, Italy

Topic: Experiments, Tests, and Benchmarks in Robotics: Is a Demarcation

Ken Goldberg (tbc), University of California Berkeley, USA

Topic: Reproducible Results and Benchmarking in Robotic Manipulation

*Contributed Presentations*


Fabio Bonsignorio, Heron Robots and The BioRobotics Institute, Scuola
Superiore S. Anna, Italy

Topic: Reproducible Research in Robotics: State of the Art and Road Ahead

*Discussion and Wrap-up*


Reproducible Experimental Results of Swarming

Behavior Using Mixed Reality

Victoria Edwards, Ioana Triandaf, Loy McGuire, Donald Sofge, Ira B. Schwartz

Naval Research Laboratory, USA

Chris Taylor

George Mason University, USA

Performance Benchmarking via Adversarial Test Generation for Autonomous
Surface Vehicles

Galen Mullins, Paul Stankiewicz

Johns Hopkins Applied Physics Laboratory

Statistical Methods are Foundational to


P. Michael Furlong

Brian Coltin

Intelligent Robotics Group, NASA Ames (SGT), USA


ROSjects: reproducible and shareable robotics paper

results based on ROS

Ricardo Tellez

Miguel A. Rodriguez

The Construct, Spain

Reproducibility Tools for Robotics Code: ROS, Docker, and Jupyter

Enric Cervera,

UJI Spain

DevOps at MECH - a cloud infrastructure for reproducible research

Johan Philips, Herman Bruyninckx

Department of Mechanical Engineering, KU Leuven, Belgium

Reproducing Industrial Robot Performance Observed in Lab Experiments in

Marek Franaszek, Geraldine S. Cheok, and Jeremy A. Marvel
National Institute of Standards and Technology, USA


Fabio P. Bonsignorio

IEEE Senior Member

Reproducibility Editor IEEE Robotics & Automation Magazine

ERF 2019 PC Member

Ceo and founder
Heron Robots s.r.l.
Via Malta, 3/7
I-16121 Genova

Research Board of Directors Member
euRobotics aisbl

Visiting Professor (2014-2019)
Scuola Superiore Sant'Anna, Pisa, Italy
The BioRobotics Institute
viale Rinaldo Piaggio 34, 56025 Pontedera (Pisa)

Banco de Santander - UC3M Chair of Excellence (2010)

Founding Past Director
euRobotics aisbl

More information about the robotics-worldwide mailing list