[robotics-worldwide] [IROS] [Meetings] Call for Participation: RSJ Tutorial on Robot Audition Open Source Software HARK in IEEE/RSJ IROS 2018

Kazuhiro Nakadai nakadai at jp.honda-ri.com
Thu Jul 19 20:25:06 PDT 2018


[We apologize if you receive multiple copies of this message]

RSJ Tutorial on Robot Audition Open Source Software HARK in IEEE/RSJ IROS 2018 (Fr-TUT-3)

Date & Time: 9:00 – 13:30, Oct. 5, 2018 (Half-day)
Room: TBA
Web page: https://urldefense.proofpoint.com/v2/url?u=https-3A__www.hark.jp_rsj-2Dtutorial-2Don-2Drobot-2Daudition-2Dopen-2Dsource-2Dsoftware-2Dhark_&d=DwIDaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=0w3solp5fswiyWF2RL6rSs8MCeFamFEPafDTOhgTfYI&m=Hy4NGceeaa8MFEYDKVf0ecSHYQm2L9VfdhDjP_cZYHs&s=FsnPJF12Il8TUo3unp1cu4dAxp-a4zRBausXicCgFkk&e=
Registration: visit IEEE/RSJ IROS web site (https://urldefense.proofpoint.com/v2/url?u=https-3A__www.iros2018.org_&d=DwIDaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=0w3solp5fswiyWF2RL6rSs8MCeFamFEPafDTOhgTfYI&m=Hy4NGceeaa8MFEYDKVf0ecSHYQm2L9VfdhDjP_cZYHs&s=KM9CdH-ZSBWm6SoSDe8CYA8LF4YZAIuFbS1HQCVpRDg&e=)


Auditory processing is essential for a robot to communicate with
people. However, most studies in robotics used a head set microphone
attached close to the mouth. Robot audition, thus, proposed to solve
such a problem in 2000 and was registered as a keyword in IEEE
Robotics and Automation Society (RAS) in 2014. We have developed a lot
of robots to solve such as ambient noise, speech noise, ego-noise,
reverberation, and so on, and published papers mainly in robotics
conferences such as IROS, ICRA, and Humanoids. The methods in those
publications are collected as open source software called HARK (HRI-JP
Audition for Robots with Kyoto University). HARK was
released in 2008 aiming to become an audio-equivalent to OpenCV, and
the total number of downloads has exceeded 12,000 as of December 2017.
HARK has been applied to various fields such as human-robot verbal
interaction, drones, ICT and IVI systems, ecological and ethological
research areas, etc.  This tutorial will consist of lectures,
practices, introduction of case studies, and live demonstrations, and
thus it will provide participants with its basic concepts as well as
practical knowledge on HARK. We are happy if this tutorial will be a
good opportunity to lower the barrier for researcher of robot
audition, to increase the awareness of HARK, and to expand to more
applications of HARK into various fields to realize its full
potential. For more information, please visit

Apart from this tutorial, we will also organize a special session on
robot audition in the main conference of IROS 2018 for those who wish
to learn a more technical overview on HARK and robot audition.  For
more information please visit special session website.

Note that this tutorial is sponsored by the Robotics Society of Japan
(RSJ), a sponsor of IROS. Thus, this is positioned as an extended
version of the RSJ tutorial which is normally held during the IROS
main conference.


This is a half-day tutorial consisting of two lectures, four practical
lessons, introduction of two case studies and two live demonstration.
Attendees will learn what robot audition and HARK are, how to use
HARK, and how it works with a live demonstration.

Time Table (tentative)
   9:00-9:05 Opening remarks
       by Prof. Minoru Asada (Osaka University/Vice-President of RSJ)
   9:05-9:15 Lecture 1: Introduction
       by Prof. Hiroshi G. Okuno (Waseda University)
   9:15-9:45 Lecture 2: Overview of HARK
       by Prof. Kazuhiro Nakadai (Honda Research Institute Japan/Tokyo
Institute of Technology)
   9:45-10:15 Practice 0: Preparation of Your Laptop
       by Dr. Kotaro Hoshiba (Kanagawa University)
  10:15-10:45 Practice 1: Sound Sources Localization
       by Dr. Ryosuke Kojima (Kyoto University)
  10:45-11:00 Practice 2-1: Sound Source Separation and Automatic Speech Recognition  
       by Dr. Katsutoshi Itoyama (Tokyo Institute of Technology)
  11:00-11:30 Coffee Break
  11:30-11:55 Practice 2-2: Sound Source Separation and Automatic Speech Recognition
       by Dr. Katsutoshi Itoyama (Tokyo Institute of Technology)
  11:55-12:25 Practice 3: Integration with ROS
       by Dr. Osamu Sugiyama (Kyoto University)
  12:25-12:40 Case Study 1: Drone Audition
       by Prof. Makoto Kumon (Kumamoto University)
  12:40-12:55 Case Study 2: Bird Song Analysis
       by Prof. Reiji Suzuki (Nagoya University)
  12:55-13:25 Live Demos:
       1. Sound Source Localization for Drones
       2. Speech Enhancement for Active Scope Robots
  13:25-13:30 Closing remark

[Equipment to bring]

 Each participant should bring the following items to attend this tutorial:
 * A laptop computer. Requirements are as follows:
    - CPU: Core i5 / i7 series
    - 4 GB of RAM
    - Bootable with a USB device
    - Two USB ports: one USB 3.0/3.1 port for a bootable USB device, and another USB port 
      to connect with a microphone array (provided by us). When only one USB port or type C, 
      please bring USB 3.0/3.1 hub by yourself.
    - Headphone jack
 * Headphones (to practice listening to sounds)
 * A microphone array. We will provide a microphone array (Tamago) to
   each participant. We will only have 50 microphone arrays available.


  Kazuhiro Nakadai (Honda Research Institute Japan/Tokyo Institute of
  Hiroshi G. Okuno (Waseda University)
  Makoto Kumon (Kumamoto University)
  Reiji Suzuki (Nagoya University)
  Gokhan Ince (Istanbul Technical University)
  Osamu Sugiyama (Kyoto University)
  Katsuhisa Itoyama (Tokyo Institute of Technology)
  Ryosuke Kojima (Kyoto University)
  Kotaro Hoshiba (Kanagawa University)

Kazuhiro Nakadai, Ph.D.
 Principal Researcher, Honda Research Institute Japan Co., Ltd.
 Specially-Appointed Professor, Tokyo Institute of Technology
  8-1 Honcho, Wako, Saitama, 351-0188, Japan
  tel: +81-48-462-2121 ext. 8777948 fax:+81-48-462-5221

More information about the robotics-worldwide mailing list