[robotics-worldwide] [meetings] CFP IROS15 - See and Touch: 1st Workshop on multimodal sensor-based robot control for HRI and soft manipulation

Andrea Cherubini andrea.cherubini at lirmm.fr
Tue Jul 7 00:27:43 PDT 2015

See and Touch: 1st Workshop on multimodal sensor-based robot control for HRI and soft manipulation
IROS 2015, September 28, Hamburg

Website: http://www.lirmm.fr/recherche/departements/rob/projets/iros15_wk_visio-haptic_control


Recent technological developments on bio-inspired sensors have made them affordable and lightweight, and therefore eased their use on robots, in particular on anthropomorphic ones (e.g., humanoids and dexterous hands). These sensors include e.g. RGB-D cameras, tactile skins, force/moment transducers, and capacitive proximity sensors.
Historically, heterogeneous sensor data was fed to fusion algorithms (e.g., Kalman or Bayesian-based methods) to provide state estimation for modelling the environment. However, since these sensors generally measure different physical phenomena, it is preferable to use them directly in the low-level servo controller rather than to apply multi-sensory fusion, or to design complex state machines. This idea, originally proposed in the hybrid position-force control paradigm, when extended to feedback from multiple sensors, brings new challenges to the controller design; e.g. related to the sensors characteristics (synchronisation, hybrid control, task compatibility, etc.) or to the task representation.
However, this approach represents at best many of our cognitive processes (which directly link perception and action), and is fundamental in many innovative robotic applications, such as soft material manipulation, and human-robot interaction. Whole-body control is another field of research that would greatly profit from the discussed methods. In fact, multiple tasks (manipulation, self collision avoidance, etc.) can be simultaneously realized by exploiting the diverse sensing capabilities of the robot body.
The purpose of this workshop is to bring together researchers with common interests in the area of multimodal servo-control, based on a variety of feedback signals, including vision (2D and 3D), touch (haptics), position, force, proximity (from capacitive measurements) etc.


Multimodal robot control, based on the concurrent use of various sensors directly at the control level, is crucial in many applications. For instance, human-robot interaction for collaborative tasks often relies on force/tactile feedback to transmit the user intention to the robot. However, the robot should be capable of recognizing the intention even without direct contact between the two. A possible solution comes from visual data, which should then be combined with haptics to obtain the best result. This is of particular interest in whole-body control of humanoid robots, since their actuators and sensors are generally bio-inspired, to facilitate interaction with the human.
The automatic manipulation of soft materials (e.g., in the food industry) represents a second important case study. The natural evolution of recent works on vision-based servoing of soft objects, is the integration of haptics and force feedback.
For all these reasons, we believe that adaptive sensor-based methods directly linking perception to action, as in the above-mentioned approaches, can provide better solutions in unpredictable scenarios, than traditional planning and model-based techniques, which require a priori models of the environment.
We propose a half-day workshop to enhance active collaboration and discuss formal methods for sensor-based control. The invited speakers will share their experience and will give an insight into the evolution and current status of multimodal control. The workshop will also be opened to paper submission, and the final schedule will be adapted depending on the quantity and quality of the submissions. We will organise a poster session of the submitted papers, to ease interaction and discussion between participants.

Topics of interest

• hands-on applications where multimodal control is necessary
• whole-body control with heterogeneous sensors
• bio-inspired approaches to multimodal control
• theoretical foundations of multimodal control (e.g., task frame approaches or constraint-based task specification)
• new trends in sensor-based control, based on perspective integration with other modalities (e.g: visual deformation servoing, tactile/haptic servoing, proximity servoing)

Submission Information

Prospective participants are required to submit an extended abstract (maximum 2 pages in length), but videos are also welcome!
All submissions will be reviewed using a single-blind review process.
Accepted contributions will be presented during the workshop as posters. 
Submissions must be sent in pdf, following the IEEE conference style (two-columns), to: 
cherubini at lirmm.fr 
indicating [IROS 2015 Workshop] in the e-mail subject. 
 After the workshop, the organising committee will consider pursuing publication of a special issue in a journal or book including extended versions of the best papers.

Submission Deadline: August 15 
Notification of acceptance: August 31
Workshop day: September 28


Andrea Cherubini
Youcef Mezouar
David Navarro-Alarcon
Mario Prats

This workshop is supported by the IEEE RAS Technical Committees on:
- Robotic Hands, Grasping and Manipulation,
- Human-Robot Interaction and Coordination,
- Whole-Body Control,
- Computer & Robot Vision,
- Humanoid Robotics,
- Haptics.

Andrea Cherubini
Associate Professor
LIRMM / Université de Montpellier

More information about the robotics-worldwide mailing list