SlideShare a Scribd company logo
Jürgen ’Juxi’ Leitner
          S. Harding, M. Frank, A. Förster, J. Schmidhuber

          istituto dalle molle di studi sull’intelligenza artificiale
                                 università della svizzera italiana
                                                   idsia / usi / supsi




              transferring
        spatial perception
between robots operating
   in a shared workspace
                                                         #iros 2012
our iCub
 setup is for
manipulation
visual perception




Harding et al., GPTP 2012, Leitner et al., ICDL 2012   IROS 2012
current
localisation approaches
learning
    approach


+
transferring
spatial perception
COLLISIONS ARE
         BAD
MoBeE
framework
            Frank et al., ICINCO, 2012.
MoBeE
framework
            Frank et al., ICINCO, 2012.
9DOF              bounding box
                                  iCub               6 per eye
                                                        .
                                                        .
                                                        .




                                         fully connected
                                              .
                                              .
                                              .




                                         fully connected




                                           Cartesian
                                          Coordinates
            spatial perception
neural network
600                                                       400                                                        -200
             550                                                       300                                                        -300

             500                                                       200                                                        -400

             450                                                       100                                                        -500
                                                                         0                                                        -600
             400




                                                              Y (mm)
    X (mm)




                                                                                                                         Z (mm)
                                                                       -100                                                       -700
             350
                                                                       -200                                                       -800
             300
                                                                       -300                                                       -900
             250
                                                                       -400                                                  -1000
             200
                                                                       -500                                                  -1100
             150                                                       -600                               Predicted          -1200
                                                                                                          Expected
             100                                                       -700                                                  -1300
                   0   200    400      600      800    1000                   0   200   400       600    800      1000                   0
                                Sample Index                                              Sample Index
         -200
         -300
         -400
         -500
         -600
Z (mm)




         -700
         -800


    -1000
         -900
                                                                                                   results
                                                                                                     ANN
    -1100
    -1200
    -1300
                   0   200   400      600      800    1000
                               Sample Index
spatial perception
neural network
future
 work

 unsupervised learning
 different spatial representations
 “intrinsic motivation” learning
 online, continuous learning
 eye-hand coordination
thanks
                                           for listening
       juxi@idsia.ch   http://Juxi.net/projects
video at http://Juxi.net/projects/im-clever/year3.html

More Related Content

PDF
Enabling Clean Talking
PPTX
Hereditary influences on development
DOCX
Obsesif kompulsif disorder (ocd)
PPTX
09 emotional development
PPTX
Emotional Development in Adolescents
PPTX
Psychology: Visual perception 3. By Janice Fung.
PPT
7.emotional development
PPTX
Emotional development
Enabling Clean Talking
Hereditary influences on development
Obsesif kompulsif disorder (ocd)
09 emotional development
Emotional Development in Adolescents
Psychology: Visual perception 3. By Janice Fung.
7.emotional development
Emotional development

Similar to Transferring Spatial Perception Between Robots Operating In A Shared Workspace (14)

XLS
Data generation for Waterfall Diagram
PDF
Sl&Et Automation Eng
PPT
10,00 Modelling and analysis of geophysical data using geostatistics and mach...
PDF
Kjøkken 4
PDF
Kjøkken 4
PDF
Kjøkken 3
PDF
Kjøkken 2
PDF
Kjøkken 2
PDF
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
PDF
Canopy management tree training & crop loading – opportunities to learn fro...
PDF
L&t%20 investor%20presentation%20 %20feb%202013
PDF
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
Data generation for Waterfall Diagram
Sl&Et Automation Eng
10,00 Modelling and analysis of geophysical data using geostatistics and mach...
Kjøkken 4
Kjøkken 4
Kjøkken 3
Kjøkken 2
Kjøkken 2
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
Canopy management tree training & crop loading – opportunities to learn fro...
L&t%20 investor%20presentation%20 %20feb%202013
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
Ad

More from Juxi Leitner (20)

PDF
The Need For Robots To Grasp the World
PDF
Robots that Grasp the World
PDF
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
PDF
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
PDF
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
PDF
ACRV Picking Benchmark: how to benchmark pick and place robotics research
PDF
Team ACRV's experience at #AmazonPickingChallenge 2016
PDF
(deep) reinforcement learning - CAB420
PDF
ACRV : Robotic Vision presentation in Lisbon at IST
PDF
The Australian Centre for Robotic Vision (ACRV)
PDF
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
PDF
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
PDF
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
PDF
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
PDF
ACRV Research Fellow Intro/Tutorial [Vision and Action]
PDF
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
PDF
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
PDF
Tele-operation of a Humanoid Robot, Using Operator Bio-data
PDF
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
PDF
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
The Need For Robots To Grasp the World
Robots that Grasp the World
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
ACRV Picking Benchmark: how to benchmark pick and place robotics research
Team ACRV's experience at #AmazonPickingChallenge 2016
(deep) reinforcement learning - CAB420
ACRV : Robotic Vision presentation in Lisbon at IST
The Australian Centre for Robotic Vision (ACRV)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ACRV Research Fellow Intro/Tutorial [Vision and Action]
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Tele-operation of a Humanoid Robot, Using Operator Bio-data
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
Ad

Recently uploaded (20)

PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Encapsulation theory and applications.pdf
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Electronic commerce courselecture one. Pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Encapsulation_ Review paper, used for researhc scholars
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Network Security Unit 5.pdf for BCA BBA.
Dropbox Q2 2025 Financial Results & Investor Presentation
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Review of recent advances in non-invasive hemoglobin estimation
20250228 LYD VKU AI Blended-Learning.pptx
Chapter 3 Spatial Domain Image Processing.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
Encapsulation theory and applications.pdf
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Advanced methodologies resolving dimensionality complications for autism neur...
Electronic commerce courselecture one. Pdf
NewMind AI Weekly Chronicles - August'25 Week I
How UI/UX Design Impacts User Retention in Mobile Apps.pdf

Transferring Spatial Perception Between Robots Operating In A Shared Workspace

  • 1. Jürgen ’Juxi’ Leitner S. Harding, M. Frank, A. Förster, J. Schmidhuber istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana idsia / usi / supsi transferring spatial perception between robots operating in a shared workspace #iros 2012
  • 2. our iCub setup is for manipulation
  • 3. visual perception Harding et al., GPTP 2012, Leitner et al., ICDL 2012 IROS 2012
  • 5. learning approach +
  • 8. MoBeE framework Frank et al., ICINCO, 2012.
  • 9. MoBeE framework Frank et al., ICINCO, 2012.
  • 10. 9DOF bounding box iCub 6 per eye . . . fully connected . . . fully connected Cartesian Coordinates spatial perception neural network
  • 11. 600 400 -200 550 300 -300 500 200 -400 450 100 -500 0 -600 400 Y (mm) X (mm) Z (mm) -100 -700 350 -200 -800 300 -300 -900 250 -400 -1000 200 -500 -1100 150 -600 Predicted -1200 Expected 100 -700 -1300 0 200 400 600 800 1000 0 200 400 600 800 1000 0 Sample Index Sample Index -200 -300 -400 -500 -600 Z (mm) -700 -800 -1000 -900 results ANN -1100 -1200 -1300 0 200 400 600 800 1000 Sample Index
  • 13. future work unsupervised learning different spatial representations “intrinsic motivation” learning online, continuous learning eye-hand coordination
  • 14. thanks for listening juxi@idsia.ch http://Juxi.net/projects video at http://Juxi.net/projects/im-clever/year3.html