SlideShare a Scribd company logo
Jürgen ’Juxi’ Leitner
          S. Harding, P. Chandrashekhariah
                                   M. Frank, G. Spina,
               A. Förster, J. Triesch, J. Schmidhuber
               idsia / usi / supsi, machine intelligence, fias




    autonomous learning
   of robust visual object
detection & identification
          on a humanoid
                                        #icdl/epirob 2012
our iCub
 setup is for
manipulation
thanks to G. Metta and IIT for this picture




                                                   visual
                                              perception
the
challenge
IDSIA’s three parts




Harding et al., GPTP 2012,
                             Leitner et al., IROS 2012   Leitner et al., BICA 2012
 Leitner et al., ICDL 2012
current
cv approaches
detecting
  objects
            Harding et al., GPTP 2012
our learning
  approach
INP   INP   INP   +    dilate   min   avg




                          cartesian
                            genetic
                      programming
INP              INP   INP    +    dilate   min   avg




Func,on"                3"
Connec,on"1"           "#2"
Connec,on"2"
A"real"number"
                       "#1"
                       4.3"           cartesian
                                        genetic
                        """
                          "



                                  programming
icImage GreenTeaBoxDetector::runFilter() {
!     icImage node0 = InputImages[6];
!     icImage node1 = InputImages[1];
!     icImage node2 = node0.absdiff(node1);
!     icImage node5 = node2.SmoothBilateral(11);
!     icImage node12 = InputImages[0];
!     icImage node16 = node12.Sqrt();
!     icImage node33 = node16.erode(6);
!     icImage node34 = node33.log();
!     icImage node36 = node34.min(node5);
!     icImage node49 = node36.Normalize();

        //cleanup
        ...
        icImage out = node49.threshold(230.7218f);
!       return out;
    }




detection
detect
detect
BUT:
       supervised learning
                approach
FIAScollaboration

saliency
map




                      feature
                 segmentation
pre
segmentation
combined
approach
MoBeE
framework   Frank et al., ICINCO, 2012.
conclusion


  salient object detection
              +
  rough feature-based segmentation
              =
  automatic training set generation
             for
  cgp-based, robust filter-learning
thanks
                                                 for listening
juxi@idsia.ch    http://Juxi.net/projects   http://robotics.idsia.ch

           video at http://robotics.idsia.ch/im-clever/

More Related Content

PDF
IDSIA's Presentation IM-CLeVeR, WP4
PDF
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
PDF
Mars Terrain Image Classification Using Cartesian Genetic Programming #isaira...
PPT
CVPR2009: Object Detection Using a Max-Margin Hough Transform
PPT
Cvpr2007 object category recognition p4 - combined segmentation and recogni...
PPTX
Multiple object detection
PDF
Anatomy of human motion
PPTX
Edge Detection using Hough Transform
IDSIA's Presentation IM-CLeVeR, WP4
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Mars Terrain Image Classification Using Cartesian Genetic Programming #isaira...
CVPR2009: Object Detection Using a Max-Margin Hough Transform
Cvpr2007 object category recognition p4 - combined segmentation and recogni...
Multiple object detection
Anatomy of human motion
Edge Detection using Hough Transform

Viewers also liked (13)

PPTX
HUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCE
PPTX
Kinetic Concepts for Analyzing Human Motion
PPTX
Multiple object detection
PPTX
Linear Hough TRansform
PPT
Presentation Object Recognition And Tracking Project
PPTX
Moving object detection
PPTX
HUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCE
PPTX
Background subtraction
PPTX
Matlab Feature Extraction Using Segmentation And Edge Detection
PPTX
Image feature extraction
PPTX
Real Time Object Tracking
PPT
Moving object detection
PPTX
A comparative review of various approaches for feature extraction in Face rec...
HUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCE
Kinetic Concepts for Analyzing Human Motion
Multiple object detection
Linear Hough TRansform
Presentation Object Recognition And Tracking Project
Moving object detection
HUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCE
Background subtraction
Matlab Feature Extraction Using Segmentation And Edge Detection
Image feature extraction
Real Time Object Tracking
Moving object detection
A comparative review of various approaches for feature extraction in Face rec...
Ad

Similar to Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012 (20)

PDF
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
PDF
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
PDF
Genetic Programming based Image Segmentation
PPT
PDF
Fcv core szeliski_zisserman
PDF
An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Res...
PPTX
Elettronica: Multimedia Information Processing in Smart Environments by Aless...
PPTX
Iccv11 salientobjectdetection
PDF
Applications of Search-based Software Testing to Trustworthy Artificial Intel...
PPT
P02 sparse coding cvpr2012 deep learning methods for vision
PDF
Fcv taxo zisserman
PDF
Cartoonization of images using machine Learning
PPTX
Ai use cases
PDF
Interactive Machine Learning
PDF
Towards Autonomous and Adaptive Humanoids [PhD Proposal @ Università della Sv...
PPT
Introduction to Machine Vision
PDF
Computer Vision: Pattern Recognition
PDF
The Computation Complexity Reduction of 2-D Gaussian Filter
PDF
Quoc Le, Stanford & Google - Tera Scale Deep Learning
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Genetic Programming based Image Segmentation
Fcv core szeliski_zisserman
An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Res...
Elettronica: Multimedia Information Processing in Smart Environments by Aless...
Iccv11 salientobjectdetection
Applications of Search-based Software Testing to Trustworthy Artificial Intel...
P02 sparse coding cvpr2012 deep learning methods for vision
Fcv taxo zisserman
Cartoonization of images using machine Learning
Ai use cases
Interactive Machine Learning
Towards Autonomous and Adaptive Humanoids [PhD Proposal @ Università della Sv...
Introduction to Machine Vision
Computer Vision: Pattern Recognition
The Computation Complexity Reduction of 2-D Gaussian Filter
Quoc Le, Stanford & Google - Tera Scale Deep Learning
Ad

More from Juxi Leitner (20)

PDF
The Need For Robots To Grasp the World
PDF
Robots that Grasp the World
PDF
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
PDF
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
PDF
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
PDF
ACRV Picking Benchmark: how to benchmark pick and place robotics research
PDF
Team ACRV's experience at #AmazonPickingChallenge 2016
PDF
(deep) reinforcement learning - CAB420
PDF
ACRV : Robotic Vision presentation in Lisbon at IST
PDF
The Australian Centre for Robotic Vision (ACRV)
PDF
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
PDF
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
PDF
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
PDF
ACRV Research Fellow Intro/Tutorial [Vision and Action]
PDF
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
PDF
Tele-operation of a Humanoid Robot, Using Operator Bio-data
PDF
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
PDF
Appetizer Talk Slides
PDF
ALife in Humanoid Robots #ecal2013
PDF
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
The Need For Robots To Grasp the World
Robots that Grasp the World
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
ACRV Picking Benchmark: how to benchmark pick and place robotics research
Team ACRV's experience at #AmazonPickingChallenge 2016
(deep) reinforcement learning - CAB420
ACRV : Robotic Vision presentation in Lisbon at IST
The Australian Centre for Robotic Vision (ACRV)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ACRV Research Fellow Intro/Tutorial [Vision and Action]
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Tele-operation of a Humanoid Robot, Using Operator Bio-data
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
Appetizer Talk Slides
ALife in Humanoid Robots #ecal2013
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...

Recently uploaded (20)

PDF
DP Operators-handbook-extract for the Mautical Institute
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPT
Module 1.ppt Iot fundamentals and Architecture
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
Getting Started with Data Integration: FME Form 101
PDF
project resource management chapter-09.pdf
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PDF
Architecture types and enterprise applications.pdf
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PPTX
Tartificialntelligence_presentation.pptx
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
August Patch Tuesday
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
STKI Israel Market Study 2025 version august
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPTX
TLE Review Electricity (Electricity).pptx
PPTX
OMC Textile Division Presentation 2021.pptx
PDF
Developing a website for English-speaking practice to English as a foreign la...
DP Operators-handbook-extract for the Mautical Institute
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Module 1.ppt Iot fundamentals and Architecture
A novel scalable deep ensemble learning framework for big data classification...
Getting Started with Data Integration: FME Form 101
project resource management chapter-09.pdf
Final SEM Unit 1 for mit wpu at pune .pptx
Architecture types and enterprise applications.pdf
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Tartificialntelligence_presentation.pptx
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
August Patch Tuesday
gpt5_lecture_notes_comprehensive_20250812015547.pdf
STKI Israel Market Study 2025 version august
Programs and apps: productivity, graphics, security and other tools
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Group 1 Presentation -Planning and Decision Making .pptx
TLE Review Electricity (Electricity).pptx
OMC Textile Division Presentation 2021.pptx
Developing a website for English-speaking practice to English as a foreign la...

Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

  • 1. Jürgen ’Juxi’ Leitner S. Harding, P. Chandrashekhariah M. Frank, G. Spina, A. Förster, J. Triesch, J. Schmidhuber idsia / usi / supsi, machine intelligence, fias autonomous learning of robust visual object detection & identification on a humanoid #icdl/epirob 2012
  • 2. our iCub setup is for manipulation
  • 3. thanks to G. Metta and IIT for this picture visual perception
  • 5. IDSIA’s three parts Harding et al., GPTP 2012, Leitner et al., IROS 2012 Leitner et al., BICA 2012 Leitner et al., ICDL 2012
  • 7. detecting objects Harding et al., GPTP 2012
  • 8. our learning approach
  • 9. INP INP INP + dilate min avg cartesian genetic programming
  • 10. INP INP INP + dilate min avg Func,on" 3" Connec,on"1" "#2" Connec,on"2" A"real"number" "#1" 4.3" cartesian genetic """ " programming
  • 11. icImage GreenTeaBoxDetector::runFilter() { ! icImage node0 = InputImages[6]; ! icImage node1 = InputImages[1]; ! icImage node2 = node0.absdiff(node1); ! icImage node5 = node2.SmoothBilateral(11); ! icImage node12 = InputImages[0]; ! icImage node16 = node12.Sqrt(); ! icImage node33 = node16.erode(6); ! icImage node34 = node33.log(); ! icImage node36 = node34.min(node5); ! icImage node49 = node36.Normalize(); //cleanup ... icImage out = node49.threshold(230.7218f); ! return out; } detection
  • 14. BUT: supervised learning approach
  • 15. FIAScollaboration saliency map feature segmentation
  • 18. MoBeE framework Frank et al., ICINCO, 2012.
  • 19. conclusion salient object detection + rough feature-based segmentation = automatic training set generation for cgp-based, robust filter-learning
  • 20. thanks for listening juxi@idsia.ch http://Juxi.net/projects http://robotics.idsia.ch video at http://robotics.idsia.ch/im-clever/