SlideShare a Scribd company logo
Kensuke Harada, T.Yoshimi, Y.Kita, K.Nagata, N.Yamanobe, T.Ueshiba,
Y.Satoh, T.Masuda, R.Takase, T.Nishi, T.Nagami, Y.Kawai and O.Nakamura
National Institute of Advanced Industrial Science and Technology (AIST)
National Institute of
Advanced Industrial Science and Technology (AIST)
2014 IEEE/SICE Int. Symp. on System Integration
 Develop Hand-eye System to Support Small
Companies
 Low Cost but Can Replace Human Workers
 Organization
Collaboration
National Institute of
Advanced Industrial Science and Technology (AIST)
 Hand-eye System for Random Bin-picking
 Grasp/Manipulation Planner for Dual-arm Manipulator
 Grasp Planner
 Pick and Place Motion Planner with Re-grasp
 Vision System for Low Cost RGB-D Camera (e.g.,
Xtion)
National Institute of
Advanced Industrial Science and Technology (AIST)
Fixture
3D Camera Dual-arm Robot
Multi-fingered Hand
Vacuum Gripper
Object
Parts of Exhaust Manifold
National Institute of
Advanced Industrial Science and Technology (AIST)
Right : Vacuum with
Two Suction Cups
Left : Multi-Finger with Under-actuation
National Institute of
Advanced Industrial Science and Technology (AIST)
PIPE-1
PIPE-2
PIPE-3
PLATE-UP
PLATE-LOW
Target State
Fixture for Welding
Picking
Setting
National Institute of
Advanced Industrial Science and Technology (AIST)
• Setting Parts to the Fixture
• Regrasping Needed
National Institute of
Advanced Industrial Science and Technology (AIST)
 Offline Phase – Grasp Planner-
 Generation of Grasp Database for Each Object/Hand
 Online Phase – Pick-and-Place Planner-
 Database Search
 Planning for Picking/Regrasping/Placing Postures
 PRM
National Institute of
Advanced Industrial Science and Technology (AIST)
 Grasp Planner
 A Method Well Applied for Pipes
 Pick-and-Place Planner
 How to Save the Calculation Time
National Institute of
Advanced Industrial Science and Technology (AIST)
 Fitting Multiple Cylinders to Each Object by iteratively using
RANSAC
 Generating a Database of Grasping Postures by Referring the
Cylinders
(a) Geometrical model of plate (b) Cylinders to model plate
(c) Grasping postures by using right hand
(a) Geometrical model of Pipe-1 (b) Cylinders to model Pipe-1
(c) Some Grasping postures by using left hand
Result of Grasp Planning for a Pipe
 How to Save Calculation Time
 Reducing the Size of Grasp Database
 Setting Priority for Searching the Grasp Database
 Using Multi-thread Programming
National Institute of
Advanced Industrial Science and Technology (AIST)
Grasp DB : Right
IK Solvable
Collision Free
Grasp DB : Left
IK Solvable
Collision Free
Object Posture Set
for Regrasp
IK Solvable
Searching Regrasping Posture with Reduced Grasp Database
For Picking For Placing
 Grasp Stability Index for Multi-fingered Hand
(Harada et al. ICRA 2014)
 Distance btw CoG and Contact Point for Vacuum
Gripper
 Collision with Neighboring Objects
(Nishi et al. CVIM 2014)
CoG
 Inverse Kinematics by IKfast
 Solving Inverse Kinematics in Parallel for Grasp
Database in Picking/Regrasping/Placing Postures
National Institute of
Advanced Industrial Science and Technology (AIST)
Principal
Direction/Curvature
Segmentation
Input
Model
シーン
Recognition
Nishi et al. MIRU 2014, CVIM 2014
National Institute of
Advanced Industrial Science and Technology (AIST)
Distortion Removing + 3D Model Matching Method
2014 IEEE Int. Symposium on System Integration (SII) : Project on Development of a Robot System for Random Picking -Grasp/Manipulation Planner for a Dual-Arm Manipulator-
 Success Rate
 About 80% Including Regrasps
 Calculation Time of Pick-and-place Planner
 About 1sec by Using 12 Threads
National Institute of
Advanced Industrial Science and Technology (AIST)
 Hand-eye System for Random Bin-picking
 Grasp/Manipulation Planner for Dual-arm
Manipulator
 Grasp Planner
 Pick and Place Motion Planner with Re-grasp
 Vision System for Low Cost RGB-D Camera (e.g.,
Xtion)
National Institute of
Advanced Industrial Science and Technology (AIST)
 歪みの大きいRGB-Dカメラのキャリブレーショ
ンを行い、データの歪みをとる
21 National Institute of
Advanced Industrial Science and Technology (AIST)
主方向ベクト
ル/曲率計算
領域分割
入力
モデル
シーン
位置姿勢認識
National Institute of
Advanced Industrial Science and Technology (AIST)
孤立ワーク位置姿勢推定
 いったんハンドで持ち上げた状態で計測し、
点群にモデルをあてはめて正確な位置姿勢
を推定する
23
Masuda, Takeshi: "Log-polar height maps for
multiple range image registration", Computer
Vision and Image Understanding, 113.11, 1158-
1169, 2009 National Institute of
Advanced Industrial Science and Technology (AIST)
 中小企業が導入可能なハンドアイシステムを
開発するプロジェクトを広島県および広島の
民間企業と実施している。
 RGB-DカメラとHiroを使用しバラ積み状態の
排気マニフォールド部品を拾い上げ治具上に
組み上げるシステムを構築中である。
 要素技術はそろってきており、システム化して
全体の作業を調整する予定である。
24 National Institute of
Advanced Industrial Science and Technology (AIST)
 生産ラインにおいて実用に耐えうるシステムに
なるためには処理速度と認識・把持・設置の
すべてで十分な精度を実現する必要があり、
今後の技術的な課題である。
 実用性の高いシステムにするためには、さら
に多様な形状・材質の対象物において技術
の検証をする必要がある。
25

More Related Content

PPTX
Iterative Visual Recognition for Learning Based Randomized Bin-picking
PPTX
Initial Experiments on Learning Based Randomized Bin-Picking Allowing Finger...
PPTX
Base Position Planning for Dual-arm Mobile Manipulators Performing a Sequence...
PPTX
Intergrated Single-arm Assembly and Manipulation Planning using Dynamic Regra...
PPT
Gold presentation lastri
PPTX
ieee nss mic 2016 poster N30-21
PDF
Ieee 2016 nss mic poster N30-21
PDF
EFFECT OF SILICON - RUBBER (SR) SHEETS AS AN ALTERNATIVE FILTER ON HIGH AND L...
Iterative Visual Recognition for Learning Based Randomized Bin-picking
Initial Experiments on Learning Based Randomized Bin-Picking Allowing Finger...
Base Position Planning for Dual-arm Mobile Manipulators Performing a Sequence...
Intergrated Single-arm Assembly and Manipulation Planning using Dynamic Regra...
Gold presentation lastri
ieee nss mic 2016 poster N30-21
Ieee 2016 nss mic poster N30-21
EFFECT OF SILICON - RUBBER (SR) SHEETS AS AN ALTERNATIVE FILTER ON HIGH AND L...

What's hot (8)

PPTX
A two stage svm-based mammographic cbir for ca dx
PDF
Definition and Validation of Scientific Algorithms for the SEOSAT/Ingenio GPP
DOCX
Optical CT scan
PPTX
Polarization-based Dehazing
DOCX
People or human tracking system
PDF
Simpleware and Abaqus
PDF
RadioWeb: Web Application to Perform Practices of Subjects Related to the Rad...
PPTX
A multi-sensor based uncut crop edge detection method for head-feeding combin...
A two stage svm-based mammographic cbir for ca dx
Definition and Validation of Scientific Algorithms for the SEOSAT/Ingenio GPP
Optical CT scan
Polarization-based Dehazing
People or human tracking system
Simpleware and Abaqus
RadioWeb: Web Application to Perform Practices of Subjects Related to the Rad...
A multi-sensor based uncut crop edge detection method for head-feeding combin...
Ad

Similar to 2014 IEEE Int. Symposium on System Integration (SII) : Project on Development of a Robot System for Random Picking -Grasp/Manipulation Planner for a Dual-Arm Manipulator- (8)

PPTX
2014 IEEE Int. Conf. on Robotics and Automation : A Manipulation Motion Plann...
PDF
RSJ 2017 - Grasp Adaptation Control with Finger Vision
PDF
Development Prototype Design of Virtual Assembly Application-Based Leap Motion
PDF
Motion Planning and Controlling Algorithm for Grasping and Manipulating Movin...
PDF
FCN-Based 6D Robotic Grasping for Arbitrary Placed Objects
PPTX
Grasp slides pptx
PDF
Motion planning and controlling algorithm for grasping and manipulating movin...
PDF
Icam2015 presentation poster - Object Recognition and Planning of Ring-type C...
2014 IEEE Int. Conf. on Robotics and Automation : A Manipulation Motion Plann...
RSJ 2017 - Grasp Adaptation Control with Finger Vision
Development Prototype Design of Virtual Assembly Application-Based Leap Motion
Motion Planning and Controlling Algorithm for Grasping and Manipulating Movin...
FCN-Based 6D Robotic Grasping for Arbitrary Placed Objects
Grasp slides pptx
Motion planning and controlling algorithm for grasping and manipulating movin...
Icam2015 presentation poster - Object Recognition and Planning of Ring-type C...
Ad

Recently uploaded (20)

PPTX
microscope-Lecturecjchchchchcuvuvhc.pptx
PPTX
Cell Membrane: Structure, Composition & Functions
PDF
Biophysics 2.pdffffffffffffffffffffffffff
PPTX
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
PPTX
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
PPTX
2. Earth - The Living Planet Module 2ELS
PDF
AlphaEarth Foundations and the Satellite Embedding dataset
PPTX
Microbiology with diagram medical studies .pptx
PPTX
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
PPTX
Introduction to Cardiovascular system_structure and functions-1
PDF
Phytochemical Investigation of Miliusa longipes.pdf
PDF
An interstellar mission to test astrophysical black holes
PDF
Placing the Near-Earth Object Impact Probability in Context
PPTX
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
DOCX
Viruses (History, structure and composition, classification, Bacteriophage Re...
PPTX
Taita Taveta Laboratory Technician Workshop Presentation.pptx
PDF
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
PPT
POSITIONING IN OPERATION THEATRE ROOM.ppt
PPTX
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
PPTX
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
microscope-Lecturecjchchchchcuvuvhc.pptx
Cell Membrane: Structure, Composition & Functions
Biophysics 2.pdffffffffffffffffffffffffff
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
2. Earth - The Living Planet Module 2ELS
AlphaEarth Foundations and the Satellite Embedding dataset
Microbiology with diagram medical studies .pptx
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
Introduction to Cardiovascular system_structure and functions-1
Phytochemical Investigation of Miliusa longipes.pdf
An interstellar mission to test astrophysical black holes
Placing the Near-Earth Object Impact Probability in Context
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
Viruses (History, structure and composition, classification, Bacteriophage Re...
Taita Taveta Laboratory Technician Workshop Presentation.pptx
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
POSITIONING IN OPERATION THEATRE ROOM.ppt
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...

2014 IEEE Int. Symposium on System Integration (SII) : Project on Development of a Robot System for Random Picking -Grasp/Manipulation Planner for a Dual-Arm Manipulator-

Editor's Notes

  • #18: 文献番号 "IS3"→"SS3"
  • #21: 以前のプロジェクト目標ページを膨らませた
  • #25: "中小企業が導入可能なハンドアイシステムを開発するプロジェクトを開始した。"→"中小企業が導入可能なハンドアイシステムを開発するプロジェクトを広島県および広島の民間企業と実施している"
  • #26: "供給が安定しないため他のデバイスを検討中である。"→"生産が終了したため他のデバイスを検討中である。" 140827 "実用性の高いシステムにするためには、さらに多様な形状・材質の対象物において技術の検証をする必要がある。"を追加