[robotics-worldwide] CfP: IROS 2009 Workshop Performance Evaluation and Benchmarking for Next Intelligent Robots and Systems

Fabio Bonsignorio fabio.bonsignorio at gmail.com
Sat Jun 6 05:53:52 PDT 2009


apologies for multiple postings

Dear all,

You will find below the call for participation for the IROS workshop
on Performance Evaluation and Benchmarking for Next Intelligent Robots
and Systems to
be held in St. Louis, MO, USA  during IROS 2009 (October 11-15 2009).

High quality and even provocative contributions on measuring and
comparing objectively  capabilities of artificial agents, such as
autonomy and cognition, as well as more well analysed such as SLAM,
navigation and objetc avoidance and visual servoing, are welcome.
Interaction between the workshop attendees is highly encouraged.
To contribute send an email to one of the organizer
All the best

Fabio

Important Dates

Papers/Ext. Abstracts: July 17th

Acceptance: August 14th

Full Papers: August 28th

Workshop: At IROS 2009 October 11-15

CALL FOR PARTICIPATION

High-level cognitive competencies encompassing knowledge
representation, perception,
control, and learning are considered essential elements that will
allow robots to perform
complex tasks within highly uncertain environments with an appropriate
level of autonomy
in various domains (service, manufacturing, and search and rescue). As
the complexity and
variety of required tasks and of the targeted environments increase
exploring new
application capabilities and domains, it becomes necessary to develop
well principled
procedures that allow quantitative comparison of the solutions
provided by robotics
research thereby facilitating exchanges of methods and solutions
between different research
groups and assessment of the state of the art. New more successful
implementations of
concepts already presented in literature, but not implemented with
exhaustive experimental
methodology, run the risk of being ignored, if appropriate
benchmarking procedures
allowing to compare the actual practical results with reference to
standard accepted
procedures, are not in place.
The emphasis of the workshop will be on principles, methods, and
applications expanding
beyond the current limit of robotics applications in terms of
cognitive capabilities and
autonomy. Another key issue will be a capability-led understanding of
cognitive robots:
how to define shared ontologies or dictionaries to discuss robotic
cognitive systems in
terms of their performance, relationships between different cognitive
robotics capabilities,
requirements, theories, architectures, models and methods that can be
applied across
multiple engineering and application domains, detailing and
understanding better the
requirements for robots in terms of performance, the approaches to meeting these
requirements and the trade-offs in terms of performance. The proper
definition of
benchmarking is related to the problem of measuring capabilities of
robots in a context in
which, in many cases, the ‘robotics experiments’ themselves are
difficult to ‘replicate’.

We welcome any topic relevant to benchmarking and performance
evaluation in the context
of cognitive solutions to practical problems, such as:
- Knowledge representation, perception (sensing), and learning
- Uncertainty management in robot navigation, path-planning and control
- Cognitive manipulation
- Metrics for sensory motor coordination and visual servoing
effectiveness/efficiency
- Benchmarking autonomy and robustness to changes in the environment/task
- Scalable autonomy measurements
- Shared ontologies to discuss robotic cognitive systems in terms of
their performance
capabilities
- Relationships between different cognitive robotics capabilities
- Requirements, theories, architectures, models and methods that can
be applied across
multiple engineering and application domains
- Detailing and understanding better the requirements for robots in terms of
performance, the approaches to meeting these requirements, the
trade-offs in terms of
performance
- The development of experimental scenarios to evaluate performance, demonstrate
generality, and measure robustness
- Performance modeling of the relationship between a task and the
environment where
it is performed
- Relationship between benchmarking and replication of experiments with robots
- Robotics experiment reporting

Workshop Format & Date

The workshop will consist of invited presentations and regular
presentations. INTERACTION IS HIGHLY ENCOURAGED. The papers have to be
formatted according to IROS 2009 formatting rules and will be included
in the IROS 2009 Tutorials and Workshops DVD.  You can register for
the workshop via the IROS'09
website at http://www.iros2009.org/.

Intended Audience

The primary audience of the proposed workshop is intended to be researchers
and practitioners both from academia and industry with an interest in cognitive
robotics and how these approaches can be utilized in generating
intelligent behaviors
amidst uncertainty for robots in the service and commercial sectors.
The workshop is
also aimed at benchmarking and objectively evaluating performance of
such robots. Accordingly, it is envisioned to be useful for anyone who
has an interest in quantitative performance evaluation of robots
and/or robot algorithms.

Contact Details

Angel P. del Pobil,
Univ. Jaume I
pobil at icc.uji.es

Raj Madhavan
ORNL/NIST
raj.madhavan at nist.gov

Fabio Bonsignorio
Heron Robots
fabio.bonsignorio at heronrobots.com

About the Organizers

The organizers of the workshop have been actively involved in
performance evaluation and benchmarking for robotics. The organizers
are currently involved in several projects to define methods for
measuring cognitive abilities for robots, both at the component and
the systems level.




-- 
Fabio P. Bonsignorio
Ceo
Heron Robots s.r.l.
Via R.Ceccardi 1/18
I-16121 Genova
Italy
www.heronrobots.com


More information about the robotics-worldwide mailing list