SlideShare a Scribd company logo
Introduction to RoboCup@Home

Imitation learning applied to domestic service robot tasks
2013/12/13

Komei Sugiura
National Institute of Information and Communication Technology, Japan
komei.sugiura@nict.go.jp
RoboCup@Home: Benchmark tests for domestic robots
• RoboCup@Home: The largest competition for domestic robots
– One of the major RoboCup leagues
– Focuses on human-robot interaction and mobile manipulation
– Robots are evaluated by 7 standardized and 3 demonstration tasks

• Info
– >200 participants from 15 countries
– 6-10 members/team

2
3
Difficulties
• Mobile manipulation
– Navigation in unknown environments
– Surrounded by spectators
– Real shop environments
– Manipulation of everyday objects
• Human robot interaction
– Very noisy environments
– Robust dialogue management
– Gesture recognition
4
Standard test 1: Cocktail Party
• Task: learn and recognize unknown persons, and deliver drinks

Item

Max score

Best team

Average

Detecting the calling persons

150 x 3

300

95

Understanding human/drink names

100 x 3

300

108

Delivering correct ordered drinks

200 x 3

400

31.6
5
Standard test 2: Restaurant
• Task: Retrieve three objects in an unknown environment e.g. restaurant
• Environment: a real restaurant (robots are transported)

Item

Score

Best team

Average

Reaching a location in the guide phase

50 x 5

250

143

Reaching a location in the navigation phase

100 x 4

200

50

Grasping the correct objects

250 x 3

500

45
6
Standard test 3: Enduring General Purpose Service Robots

• NimbRo (Bonn University)
LCore Applied (1): Imitation learning for household activities
Teacher: “Throw-into.” ( with demonstrating motions several times)
Robot: (Estimates relative objects and learns motion trajectories)
User: “Throw a plastic bottle into a dust bin.”
Robot: (Searches for the objects and executes “throw-into” motion)

Dialog example
LCore Applied (2): Learning unknown words
• Difficulty: low phoneme recognition accuracy
• Proposed
– Learns phoneme sequence with waveform
– Voice conversion using EigenVoice Gaussian Mixture Model*[Toda+ 2007]
Evaluation using CMOS metric
• proposed method outperformed baseline

9

More Related Content

PPTX
Happy Robot Mini
PDF
New challenge in RoboCup 2017 Nagoya: RoboCup@Home Standard Platform
PDF
20151129インテリジェントホームロボティクス研究会
ODP
Robots I made in Robocup
PDF
実世界の意味を扱う理論と機械知能の構築
PDF
20161014IROS_WS
PDF
AUPAIR: The Personal Home Service Robot that Won the RoboCup@Home League
PPT
bodhisatttaghosh999999999999999999999998
Happy Robot Mini
New challenge in RoboCup 2017 Nagoya: RoboCup@Home Standard Platform
20151129インテリジェントホームロボティクス研究会
Robots I made in Robocup
実世界の意味を扱う理論と機械知能の構築
20161014IROS_WS
AUPAIR: The Personal Home Service Robot that Won the RoboCup@Home League
bodhisatttaghosh999999999999999999999998

More from Komei Sugiura (18)

PDF
ロボティクスにおける言語の利活用
PDF
生活支援ロボットにおける 大規模データ収集に向けて
PDF
生活支援ロボットのマルチモーダル言語理解技術
PDF
SuMo-SS: Submodular Optimization Sensor Scattering for Deploying Sensor Netwo...
PDF
ロボットの音声コミュニケーション技術:言葉や能力の壁を越えるデータ指向知能に向けて
PDF
Spatio-Temporal Pseudo Relevance Feedback for Large-Scale and Heterogeneous S...
PDF
言葉や能力の壁を越えるデータ指向知能
PDF
20160907rsj16ロボット聴覚OS
PDF
20160606劣モジュラ性を利用したドローンによるばらまき型センサ配置
PDF
20160221statistic imitation learning and human-robot communication
PDF
20140513大規模異分野データ横断検索における時空間情報を用いた擬似適合性フィードバック
PDF
20150531Deep Recurrent Neural Networkによる環境モニタリングデータの予測
PDF
階層型評価構造に基づく観光スポット推薦システムの構築と長期実証実験
PDF
Cloud Robotics for Human-Robot Dialogues
PDF
Japan Robot Week 2014けいはんなロボットフォーラム
PDF
Language acquisition framework for robots: From grounded language acquisition...
PDF
rospeex: a cloud-based speech communication toolkit for ROS
PDF
ロボカップ@ホーム入門
ロボティクスにおける言語の利活用
生活支援ロボットにおける 大規模データ収集に向けて
生活支援ロボットのマルチモーダル言語理解技術
SuMo-SS: Submodular Optimization Sensor Scattering for Deploying Sensor Netwo...
ロボットの音声コミュニケーション技術:言葉や能力の壁を越えるデータ指向知能に向けて
Spatio-Temporal Pseudo Relevance Feedback for Large-Scale and Heterogeneous S...
言葉や能力の壁を越えるデータ指向知能
20160907rsj16ロボット聴覚OS
20160606劣モジュラ性を利用したドローンによるばらまき型センサ配置
20160221statistic imitation learning and human-robot communication
20140513大規模異分野データ横断検索における時空間情報を用いた擬似適合性フィードバック
20150531Deep Recurrent Neural Networkによる環境モニタリングデータの予測
階層型評価構造に基づく観光スポット推薦システムの構築と長期実証実験
Cloud Robotics for Human-Robot Dialogues
Japan Robot Week 2014けいはんなロボットフォーラム
Language acquisition framework for robots: From grounded language acquisition...
rospeex: a cloud-based speech communication toolkit for ROS
ロボカップ@ホーム入門
Ad

Recently uploaded (20)

PPTX
observCloud-Native Containerability and monitoring.pptx
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PDF
August Patch Tuesday
PPTX
The various Industrial Revolutions .pptx
PDF
Getting Started with Data Integration: FME Form 101
PDF
A comparative study of natural language inference in Swahili using monolingua...
PPTX
1. Introduction to Computer Programming.pptx
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PDF
Developing a website for English-speaking practice to English as a foreign la...
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Zenith AI: Advanced Artificial Intelligence
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
Web App vs Mobile App What Should You Build First.pdf
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
A novel scalable deep ensemble learning framework for big data classification...
PPTX
OMC Textile Division Presentation 2021.pptx
PDF
Hybrid model detection and classification of lung cancer
observCloud-Native Containerability and monitoring.pptx
NewMind AI Weekly Chronicles – August ’25 Week III
August Patch Tuesday
The various Industrial Revolutions .pptx
Getting Started with Data Integration: FME Form 101
A comparative study of natural language inference in Swahili using monolingua...
1. Introduction to Computer Programming.pptx
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Developing a website for English-speaking practice to English as a foreign la...
NewMind AI Weekly Chronicles - August'25-Week II
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Zenith AI: Advanced Artificial Intelligence
Programs and apps: productivity, graphics, security and other tools
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
Web App vs Mobile App What Should You Build First.pdf
Enhancing emotion recognition model for a student engagement use case through...
A novel scalable deep ensemble learning framework for big data classification...
OMC Textile Division Presentation 2021.pptx
Hybrid model detection and classification of lung cancer
Ad

Introduction to RoboCup@Home

  • 1. Introduction to RoboCup@Home Imitation learning applied to domestic service robot tasks 2013/12/13 Komei Sugiura National Institute of Information and Communication Technology, Japan komei.sugiura@nict.go.jp
  • 2. RoboCup@Home: Benchmark tests for domestic robots • RoboCup@Home: The largest competition for domestic robots – One of the major RoboCup leagues – Focuses on human-robot interaction and mobile manipulation – Robots are evaluated by 7 standardized and 3 demonstration tasks • Info – >200 participants from 15 countries – 6-10 members/team 2
  • 3. 3
  • 4. Difficulties • Mobile manipulation – Navigation in unknown environments – Surrounded by spectators – Real shop environments – Manipulation of everyday objects • Human robot interaction – Very noisy environments – Robust dialogue management – Gesture recognition 4
  • 5. Standard test 1: Cocktail Party • Task: learn and recognize unknown persons, and deliver drinks Item Max score Best team Average Detecting the calling persons 150 x 3 300 95 Understanding human/drink names 100 x 3 300 108 Delivering correct ordered drinks 200 x 3 400 31.6 5
  • 6. Standard test 2: Restaurant • Task: Retrieve three objects in an unknown environment e.g. restaurant • Environment: a real restaurant (robots are transported) Item Score Best team Average Reaching a location in the guide phase 50 x 5 250 143 Reaching a location in the navigation phase 100 x 4 200 50 Grasping the correct objects 250 x 3 500 45 6
  • 7. Standard test 3: Enduring General Purpose Service Robots • NimbRo (Bonn University)
  • 8. LCore Applied (1): Imitation learning for household activities Teacher: “Throw-into.” ( with demonstrating motions several times) Robot: (Estimates relative objects and learns motion trajectories) User: “Throw a plastic bottle into a dust bin.” Robot: (Searches for the objects and executes “throw-into” motion) Dialog example
  • 9. LCore Applied (2): Learning unknown words • Difficulty: low phoneme recognition accuracy • Proposed – Learns phoneme sequence with waveform – Voice conversion using EigenVoice Gaussian Mixture Model*[Toda+ 2007] Evaluation using CMOS metric • proposed method outperformed baseline 9