[robotics-worldwide] [Deadline Extended to June 17th]: 2009 Performance Metrics for Intelligent Systems Workshop (PerMIS'09)

Raj Madhavan raj_madhavan at yahoo.com
Wed Jun 10 14:07:53 PDT 2009

Due to multiple requests, the deadline for paper submissions and special session proposals has been extended to June 17th.

2009 Performance Metrics for Intelligent Systems Workshop (PerMIS’09) 
September 21-23, 2009

Elena Messina, NIST 
Raj Madhavan, ORNL/NIST

E. Tunstel, JHU-APL USA

NIST, DARPA, ACM, IEEE (W/NV Robotics and Automation Chapter) & 
IEEE RAS-TC on Performance Evaluation and Benchmarking of Robotic and Automation Systems

The Performance Metrics for Intelligent Systems workshop is the only
one of its kind dedicated to defining measures and methodologies of
evaluating performance of intelligent systems. Started in 2000, the
PerMIS series focuses on applications of performance measures to
practical problems in commercial, industrial, homeland security, and
military applications. It has proved to be an excellent forum for
discussions and partnerships, dissemination of ideas, and future
collaborations between researchers, graduate students, and
practitioners from industry, academia, and government agencies.

The main theme of the ninth iteration of the workshop, PerMIS’09,
seeks to address the question: "Does performance measurement
accelerate the pace of advancement for intelligent systems?"

In addition to the main theme, as in previous years, the workshop
will focus on applications of performance measures to practical
problems in commercial, industrial, homeland security, and military
applications. Topic areas include, but are not limited to:
* Defining and measuring aspects of a system:
    The level of autonomy
    Human-robot interaction
    Collaboration & coordination
    Biologically inspired models
* Evaluating components within intelligent systems:
    Sensing and perception
    Knowledge representation, world models, ontologies
    Planning and control
    Learning and adapting
* Infrastructural support for performance evaluation:
    Testbeds and competitions for intercomparisons
    Instrumentation and other measurement tools
    Simulation and modeling support
* Technology readiness measures for intelligent systems
* Benchmarks and applied performance measures in various domains, e.g.,
    Industrial and manufacturing systems
    Intelligent transportation systems
    Emergency response robots (e.g., search and rescue, bomb disposal)
    Homeland security systems
    Defense robotics
    Intelligent systems for hazardous environments (e.g., nuclear remediation)
    Smart grid
    Space robotics
    Medical robotics & assistive devices

The Proceedings of PerMIS are indexed by INSPEC, Compendex, ACM
Digital Library, and are released as a NIST Special Publication.
Selected papers from past workshops have been published as special
issues with the Journal of Integrated Computer-Aided Engineering
(PerMIS’04), the Journal of Field Robotics (PerMIS’06), and as a
Springer Edited Book Volume (PerMIS’08).

Washington, D.C. (The workshop will be held at NIST,
Gaithersburg MD 20899)

Prospective authors are requested to submit a
draft paper (max. 8 pages) or an extended abstract (1-2 pages) for
review. Invited session proposals can also be submitted as draft
papers but should contain 1) a session title and a brief statement
of purpose, 2) name and affiliation of the organizer(s), and 3) a
preliminary list of speakers. All submissions must be written in
English, starting with a succinct statement of the problem, the
results achieved, their significance, and a comparison with previous
work. Papers are to be submitted at
http://www.isd.mel.nist.gov/PerMIS_2009/submission.htm/ using the
specified templates.

Submission of full papers           June 17, 2009 
Proposal for invited sessions   June 17, 2009 
Notification of acceptance        July 24, 2009 
Final papers due                August 21, 2009


More information about the robotics-worldwide mailing list