SlideShare a Scribd company logo
Jürgen ’Juxi’ Leitner
                                             S. Harding, M. Frank, A. Förster, J. Schmidhuber

                                             istituto dalle molle di studi sull’intelligenza artificiale
                                                                    università della svizzera italiana
                                                                                      idsia / usi / supsi




                                                   towards
                                         spatial perception
                             learning to locate objects from vision

                                                                                     #robotdoc 2012


Monday, September 10, 2012
iCub



                             thanks to G. Metta, IIT and U.Plymouth for their pictures

Monday, September 10, 2012
our iCub
                              setup is for
                             manipulation
Monday, September 10, 2012
thanks to G. Metta and IIT for this picture




                                                   visual
                                              perception




Monday, September 10, 2012
three parts




Monday, September 10, 2012
detecting
            objects
                             Harding et al., GPTP 2012, Leitner et al., ICDL 2012
Monday, September 10, 2012
Image credit: NASA




                 also works for
                detecting rocks
                on Mars
                                  Leitner et al., iSAIRAS 2012
Monday, September 10, 2012
detecting
            objects
                             Harding et al., GPTP 2012, Leitner et al., ICDL 2012
Monday, September 10, 2012
icVision
        framework            Leitner et al., BICA 2012

Monday, September 10, 2012
three parts
  GPTP2012, ICDL2012(?)                    BICA 2012




Monday, September 10, 2012
locate
                             objects
Monday, September 10, 2012
current
         localisation approaches
Monday, September 10, 2012
learning
                                 approach


                             +


Monday, September 10, 2012
learning
                             setup




Monday, September 10, 2012
spatial perception
                             neural network
Monday, September 10, 2012
spatial perception
                             genetic programming
Monday, September 10, 2012
x = 17.81 − 0.01906 v1 + 0.1527 v4 + 0.1378 v7 +
                               0.01108 v10 − 0.0296 v11 − 0.1207 v12

                              y = 1.124224045 + 0.1295920897 v10 +
                                0.1156011386 v8 + 0.01695234993 v0




                                        spatial perception
                              genetic programming
Monday, September 10, 2012
relative
                             errors
Monday, September 10, 2012
transferring
                             spatial perception
Monday, September 10, 2012
future
            work

                 automate the learning (IROS 2012)
                 different spatial representations
                 “intrinsic motivation” learning
                 online, continuous learning
                 eye-hand coordination


Monday, September 10, 2012
thanks
                                                             for listening

                             juxi@idsia.ch   http://Juxi.net/projects


Monday, September 10, 2012

More Related Content

PPT
The year 2 sleepover
PDF
Foe lndscape aug_2012
PDF
Autonomous Learning of Robust Visual Object Detection & Identification on a H...
PDF
IDSIA's Presentation IM-CLeVeR, WP4
PDF
ALife in Humanoid Robots #ecal2013
PPTX
Joining Up Content
PDF
An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Res...
PDF
Towards Autonomous and Adaptive Humanoids [PhD Proposal @ Università della Sv...
The year 2 sleepover
Foe lndscape aug_2012
Autonomous Learning of Robust Visual Object Detection & Identification on a H...
IDSIA's Presentation IM-CLeVeR, WP4
ALife in Humanoid Robots #ecal2013
Joining Up Content
An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Res...
Towards Autonomous and Adaptive Humanoids [PhD Proposal @ Università della Sv...

Similar to Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC (8)

PDF
FailChat: UX Comes First Because UX is Everything!
PDF
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
PDF
Learning organisations and design thinking
PDF
Website Usability | Class 1
PDF
Persuasive design presentationd3=r1
PDF
Persuasive design presentationd3=r1
PDF
Mars Terrain Image Classification Using Cartesian Genetic Programming #isaira...
PPTX
Virtual Worlds in Higher Education: More Than Simulation (A Case-Study of Sec...
FailChat: UX Comes First Because UX is Everything!
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
Learning organisations and design thinking
Website Usability | Class 1
Persuasive design presentationd3=r1
Persuasive design presentationd3=r1
Mars Terrain Image Classification Using Cartesian Genetic Programming #isaira...
Virtual Worlds in Higher Education: More Than Simulation (A Case-Study of Sec...
Ad

More from Juxi Leitner (20)

PDF
The Need For Robots To Grasp the World
PDF
Robots that Grasp the World
PDF
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
PDF
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
PDF
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
PDF
ACRV Picking Benchmark: how to benchmark pick and place robotics research
PDF
Team ACRV's experience at #AmazonPickingChallenge 2016
PDF
(deep) reinforcement learning - CAB420
PDF
ACRV : Robotic Vision presentation in Lisbon at IST
PDF
The Australian Centre for Robotic Vision (ACRV)
PDF
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
PDF
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
PDF
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
PDF
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
PDF
ACRV Research Fellow Intro/Tutorial [Vision and Action]
PDF
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
PDF
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
PDF
Tele-operation of a Humanoid Robot, Using Operator Bio-data
PDF
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
PDF
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
The Need For Robots To Grasp the World
Robots that Grasp the World
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
ACRV Picking Benchmark: how to benchmark pick and place robotics research
Team ACRV's experience at #AmazonPickingChallenge 2016
(deep) reinforcement learning - CAB420
ACRV : Robotic Vision presentation in Lisbon at IST
The Australian Centre for Robotic Vision (ACRV)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ACRV Research Fellow Intro/Tutorial [Vision and Action]
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Tele-operation of a Humanoid Robot, Using Operator Bio-data
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
Ad

Recently uploaded (20)

PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
MYSQL Presentation for SQL database connectivity
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Empathic Computing: Creating Shared Understanding
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Machine learning based COVID-19 study performance prediction
PPT
Teaching material agriculture food technology
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Network Security Unit 5.pdf for BCA BBA.
Building Integrated photovoltaic BIPV_UPV.pdf
MYSQL Presentation for SQL database connectivity
NewMind AI Weekly Chronicles - August'25 Week I
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
The Rise and Fall of 3GPP – Time for a Sabbatical?
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Empathic Computing: Creating Shared Understanding
Review of recent advances in non-invasive hemoglobin estimation
Advanced methodologies resolving dimensionality complications for autism neur...
Digital-Transformation-Roadmap-for-Companies.pptx
Machine learning based COVID-19 study performance prediction
Teaching material agriculture food technology
Chapter 3 Spatial Domain Image Processing.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Network Security Unit 5.pdf for BCA BBA.

Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

  • 1. Jürgen ’Juxi’ Leitner S. Harding, M. Frank, A. Förster, J. Schmidhuber istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana idsia / usi / supsi towards spatial perception learning to locate objects from vision #robotdoc 2012 Monday, September 10, 2012
  • 2. iCub thanks to G. Metta, IIT and U.Plymouth for their pictures Monday, September 10, 2012
  • 3. our iCub setup is for manipulation Monday, September 10, 2012
  • 4. thanks to G. Metta and IIT for this picture visual perception Monday, September 10, 2012
  • 6. detecting objects Harding et al., GPTP 2012, Leitner et al., ICDL 2012 Monday, September 10, 2012
  • 7. Image credit: NASA also works for detecting rocks on Mars Leitner et al., iSAIRAS 2012 Monday, September 10, 2012
  • 8. detecting objects Harding et al., GPTP 2012, Leitner et al., ICDL 2012 Monday, September 10, 2012
  • 9. icVision framework Leitner et al., BICA 2012 Monday, September 10, 2012
  • 10. three parts GPTP2012, ICDL2012(?) BICA 2012 Monday, September 10, 2012
  • 11. locate objects Monday, September 10, 2012
  • 12. current localisation approaches Monday, September 10, 2012
  • 13. learning approach + Monday, September 10, 2012
  • 14. learning setup Monday, September 10, 2012
  • 15. spatial perception neural network Monday, September 10, 2012
  • 16. spatial perception genetic programming Monday, September 10, 2012
  • 17. x = 17.81 − 0.01906 v1 + 0.1527 v4 + 0.1378 v7 + 0.01108 v10 − 0.0296 v11 − 0.1207 v12 y = 1.124224045 + 0.1295920897 v10 + 0.1156011386 v8 + 0.01695234993 v0 spatial perception genetic programming Monday, September 10, 2012
  • 18. relative errors Monday, September 10, 2012
  • 19. transferring spatial perception Monday, September 10, 2012
  • 20. future work automate the learning (IROS 2012) different spatial representations “intrinsic motivation” learning online, continuous learning eye-hand coordination Monday, September 10, 2012
  • 21. thanks for listening juxi@idsia.ch http://Juxi.net/projects Monday, September 10, 2012