SlideShare a Scribd company logo
Kensuke Harada∗1, Tokuo Tsuji∗2, Kohei Kikuchi∗3
Kazuyuki Nagata∗1, Hiromu Onda∗1, Yoshihiro Kawai∗1
∗1 National Inst. of AIST
∗2 Kyushu Univ.
∗3 Toyota Motors Co. Ltd.
National Institute of
Advanced Industrial Science and Technology (AIST)
Base Position Planning for Dual-arm Mobile Manipulators
Performing a Sequence of Pick-and-place Tasks
INTRODUCTION
Parts Supply Task
Collect necessary parts from
the storage area
Determine a sequence of
the base position
Selective Use of Two Hands
Can Reduce the Number of
Sequence
Dual-arm Mobile Manipulator
Performing Parts-Supply Task
OVERVIEW OF PROPOSED METHOD
Dual-arm mobile manipulator collects one part from each box.
Shipping Carton
Example
OVERVIEW OF PROPOSED METHOD
Region on base position
where right hand can grasp
an object in the box 1
Region on base position
where left hand can grasp
an object in the box 1
OVERVIEW OF PROPOSED METHOD
Obtain region on base position for all the boxes
OVERVIEW OF PROPOSED METHOD
Obtain a sequence of base position
OVERVIEW OF PROPOSED METHOD
Minimize : Number of Sequence and Travel Distance
Common Area of Base position:
・Left Hand Picks an Object in the Box 1
・Right Hand Pick an Object in the Box 2
Minimizing the travel distance
FEATURES OF PROPOSED METHOD
• Objects stored in a box is known
• The number and the pose are not known
• Stable grasp
• Collision avoidance when grasping
• Minimizing the number of sequence
• Minimizing the travel distance
Base Position Planning for Dual-arm Mobile Manipulators
Performing a Sequence of Pick-and-place Tasks
RELATED WORKS
Base Position for Mobile Manipulator Maximizing the Manipulability
F.G.Pin et al. (1990), H. Seragi et al. (1993), K. Tchon et al. (2000) 等
Base Position Considering the Stable Grasp
R. Diankov et al. (2008), N. Vahrenkamp et al. (2012)
Manipulation Planner for Dual-arm Manipulator
Y. Koga et al. (1994), J.-P. Saut et al. (2010), K. Harada et al. (2012)
IN THIS PRESENTATION
1. Inverse Kinematics Considering the Stable Grasp
2. Region on Mobile Base
3. Formulation of Optimization Problem
4. Numerical Examples
INVERSE KINEMATICS CONSIDERING THE
STABLE GRASP(1/3)
Collision Avoidance
Joint Limit
Ellipsoidal Approximation
of Links and Environments
Using EQuadProg++
QP Problem to Obtain Joint Velocity
INVERSE KINEMATICS CONSIDERING THE
STABLE GRASP(2/3)
Grasping Posture Database
• Quadratic Approximation of
Object Surface
• Grasp Planning
• Construction of Grasping
Posture Database
INVERSE KINEMATICS CONSIDERING
THE STABLE GRASP(3/3)
1. Connect Initial Pose and 1st Data using Straight Line Segment
2. Split Segment into Small Steps
3. Solve QP Problem for Each Step
4. If QP problem does not have solution, proceed to next data
Search for the Grasping Posture Database
IN THIS PRESENTATION
1. Inverse Kinematics Considering the Stable Grasp
2. Region on Mobile Base
3. Formulation of Optimization Problem
4. Numerical Examples
REGION ON MOBILE BASE
Object pose is not known
Mobile Base Pose Stably
Grasping of an Object
Discretize the Box / Moving Area
REGION ON MOBILE BASE
Searching Algorithm
STEP1
Base Pose Stably Grasping
All Objects in the Box
Using Multi-thread
REGION ON MOBILE BASE
Searching Algorithm
STEP1
STEP2
Checking Neighboring Points
Base Pose Stably Grasping
All Objects in the Box
REGION ON MOBILE BASE
STEP1
STEP2
Checking Neighboring Points
Base Pose Stably Grasping
All Objects in the Box
Searching Algorithm
REGION ON MOBILE BASE
Searching Algorithm
STEP1
STEP2
Checking Neighboring Points
Base Pose Stably Grasping
All Objects in the Box
REGION ON MOBILE BASE
Searching Algorithm
STEP1
STEP2
Checking Neighboring Points
Base Pose Stably Grasping
All Objects in the Box
IN THIS PRESENTATION
1. Inverse Kinematics Considering the Stable Grasp
2. Region on Mobile Base
3. Formulation of Optimization Problem
4. Numerical Examples
DEFINITION
P1 P2 P3 P4 P5 P6
P = [P1 P2 P3 P4 P5 P6]
P2P1∩ P3P2∩ P4P3∩ P6P5∩
s=[ 1, 2, 3, 4, 5, 6, (1,2), (2,3), (3,4), (5,6)]
=[ s1, s2, s3, s4, s5, s6, s7, s8, s9, s10]
FORMULATION
Which Area to Visit 0-1 Knapsack Problem
Minimizing: Number of Sequence
Branch and Bound (BB) Method
Number of Sequence
FORMULATION
Order of Area to Visit
Minimizing: Traveling Distance
Traveling Salesman Problem
Simulated Annealing
EXAMPLES
Discretizing Box Area
Region on Mobile Base
Realizing the Stable Grasp
Region (Grasped
by Left Hand)
Nextage + Mobile Base
Region (Grasped
by Right Hand)
RESULTS
Distance between Two Boxes : 0
1st Base Position : Pick an Object from Boxes 1, 2, 3 and 4
RESULTS
1st Base Position : Pick an Object from Boxes 1 and 2
2nd Base Position : Pick an Object from Boxes 3 and 4
Distance between Two Boxes : 0.4 [m]
RESULTS
Distance between Two Boxes : 0.8 [m]
1st Base Position : Pick an Object from Box 1
2nd Base Position : Pick an Object from Box 2
3rd Base Position : Pick an Object from Box 3
4th Base Position : Pick an Object from Box 4
EXAMPLES
1st Base Position
2nd Base Position
Initial Pose
Base Position Planning for Dual-arm Mobile Manipulators Performing a Sequence of Pick-and-place Tasks
CALCULATION TIME
This method is to be used
for offline calculation of base position
SUMMARY
• A sequence of the base position is planned for dual-arm
mobile manipulators performing multiple pick-and-place
tasks.
• A robot can selectively use either the right or the left hand
to pick up an object and can minimize the sequence size of
the base position.
• A region on the base position is obtained where a robot
can pick up an object placed anywhere in a box.
• A sequence of base positions is obtained by combining the
branch and bound and simulated annealing methods.

More Related Content

PPTX
Intergrated Single-arm Assembly and Manipulation Planning using Dynamic Regra...
PPTX
Initial Experiments on Learning Based Randomized Bin-Picking Allowing Finger...
PPTX
Iterative Visual Recognition for Learning Based Randomized Bin-picking
PPTX
Cellular feature
PDF
PR-272: Accelerating Large-Scale Inference with Anisotropic Vector Quantization
PDF
R-FCN : object detection via region-based fully convolutional networks
PPT
MSShin-Machine_Learning_Algorithm_in_Period_Estimation.ppt
PPTX
Automatic road environment classification 20121002
Intergrated Single-arm Assembly and Manipulation Planning using Dynamic Regra...
Initial Experiments on Learning Based Randomized Bin-Picking Allowing Finger...
Iterative Visual Recognition for Learning Based Randomized Bin-picking
Cellular feature
PR-272: Accelerating Large-Scale Inference with Anisotropic Vector Quantization
R-FCN : object detection via region-based fully convolutional networks
MSShin-Machine_Learning_Algorithm_in_Period_Estimation.ppt
Automatic road environment classification 20121002

Similar to Base Position Planning for Dual-arm Mobile Manipulators Performing a Sequence of Pick-and-place Tasks (20)

PPTX
2014 IEEE Int. Conf. on Robotics and Automation : A Manipulation Motion Plann...
PDF
Motion planning and controlling algorithm for grasping and manipulating movin...
PDF
Motion Planning and Controlling Algorithm for Grasping and Manipulating Movin...
PDF
Inverse Kinematics Using Genetic Algorithms
PPT
Travelling Salesman Problem, Robotics & Inverse Kinematics
PPTX
Robotics of Quadruped Robot
PPTX
COMP 775 Motion planning paper presentation
PDF
Performance measurement and dynamic analysis of two dof robotic arm manipulator
ODP
Matlab robotics toolbox
PPTX
JHDFGDFHDFHKJGFGFJGHJ.ppFDGFDDGGFFGDFGDFtx
PDF
KINEMATICS, TRAJECTORY PLANNING AND DYNAMICS OF A PUMA 560 - Mazzali A., Patr...
PPT
robotics presentation (2).ppt is good for the student life and easy to gain t...
PPT
Robotics: Forward and Inverse Kinematics
PDF
Robotics unit4 slides
PPTX
ROBOTICS-ROBOT KINEMATICS AND ROBOT PROGRAMMING
PPT
16355694.ppt
PPT
Robotics - introduction to Robotics
PPTX
types of robots.pptx
PPT
49046502-Robotics-powerpoint-presentation-ppt.ppt
PPTX
DOC-20230926-WA0002..pptx
2014 IEEE Int. Conf. on Robotics and Automation : A Manipulation Motion Plann...
Motion planning and controlling algorithm for grasping and manipulating movin...
Motion Planning and Controlling Algorithm for Grasping and Manipulating Movin...
Inverse Kinematics Using Genetic Algorithms
Travelling Salesman Problem, Robotics & Inverse Kinematics
Robotics of Quadruped Robot
COMP 775 Motion planning paper presentation
Performance measurement and dynamic analysis of two dof robotic arm manipulator
Matlab robotics toolbox
JHDFGDFHDFHKJGFGFJGHJ.ppFDGFDDGGFFGDFGDFtx
KINEMATICS, TRAJECTORY PLANNING AND DYNAMICS OF A PUMA 560 - Mazzali A., Patr...
robotics presentation (2).ppt is good for the student life and easy to gain t...
Robotics: Forward and Inverse Kinematics
Robotics unit4 slides
ROBOTICS-ROBOT KINEMATICS AND ROBOT PROGRAMMING
16355694.ppt
Robotics - introduction to Robotics
types of robots.pptx
49046502-Robotics-powerpoint-presentation-ppt.ppt
DOC-20230926-WA0002..pptx
Ad

Recently uploaded (20)

PPTX
Management Information system : MIS-e-Business Systems.pptx
PDF
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
PPTX
Information Storage and Retrieval Techniques Unit III
PDF
COURSE DESCRIPTOR OF SURVEYING R24 SYLLABUS
PPTX
Feature types and data preprocessing steps
PPTX
Nature of X-rays, X- Ray Equipment, Fluoroscopy
PPTX
communication and presentation skills 01
PDF
EXPLORING LEARNING ENGAGEMENT FACTORS INFLUENCING BEHAVIORAL, COGNITIVE, AND ...
PDF
737-MAX_SRG.pdf student reference guides
PPTX
Fundamentals of safety and accident prevention -final (1).pptx
PDF
BIO-INSPIRED HORMONAL MODULATION AND ADAPTIVE ORCHESTRATION IN S-AI-GPT
PDF
null (2) bgfbg bfgb bfgb fbfg bfbgf b.pdf
PDF
Categorization of Factors Affecting Classification Algorithms Selection
PDF
Accra-Kumasi Expressway - Prefeasibility Report Volume 1 of 7.11.2018.pdf
PDF
Artificial Superintelligence (ASI) Alliance Vision Paper.pdf
PDF
22EC502-MICROCONTROLLER AND INTERFACING-8051 MICROCONTROLLER.pdf
PPTX
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
PPT
Total quality management ppt for engineering students
PDF
A SYSTEMATIC REVIEW OF APPLICATIONS IN FRAUD DETECTION
PPTX
"Array and Linked List in Data Structures with Types, Operations, Implementat...
Management Information system : MIS-e-Business Systems.pptx
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
Information Storage and Retrieval Techniques Unit III
COURSE DESCRIPTOR OF SURVEYING R24 SYLLABUS
Feature types and data preprocessing steps
Nature of X-rays, X- Ray Equipment, Fluoroscopy
communication and presentation skills 01
EXPLORING LEARNING ENGAGEMENT FACTORS INFLUENCING BEHAVIORAL, COGNITIVE, AND ...
737-MAX_SRG.pdf student reference guides
Fundamentals of safety and accident prevention -final (1).pptx
BIO-INSPIRED HORMONAL MODULATION AND ADAPTIVE ORCHESTRATION IN S-AI-GPT
null (2) bgfbg bfgb bfgb fbfg bfbgf b.pdf
Categorization of Factors Affecting Classification Algorithms Selection
Accra-Kumasi Expressway - Prefeasibility Report Volume 1 of 7.11.2018.pdf
Artificial Superintelligence (ASI) Alliance Vision Paper.pdf
22EC502-MICROCONTROLLER AND INTERFACING-8051 MICROCONTROLLER.pdf
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
Total quality management ppt for engineering students
A SYSTEMATIC REVIEW OF APPLICATIONS IN FRAUD DETECTION
"Array and Linked List in Data Structures with Types, Operations, Implementat...
Ad

Base Position Planning for Dual-arm Mobile Manipulators Performing a Sequence of Pick-and-place Tasks

  • 1. Kensuke Harada∗1, Tokuo Tsuji∗2, Kohei Kikuchi∗3 Kazuyuki Nagata∗1, Hiromu Onda∗1, Yoshihiro Kawai∗1 ∗1 National Inst. of AIST ∗2 Kyushu Univ. ∗3 Toyota Motors Co. Ltd. National Institute of Advanced Industrial Science and Technology (AIST) Base Position Planning for Dual-arm Mobile Manipulators Performing a Sequence of Pick-and-place Tasks
  • 2. INTRODUCTION Parts Supply Task Collect necessary parts from the storage area Determine a sequence of the base position Selective Use of Two Hands Can Reduce the Number of Sequence Dual-arm Mobile Manipulator Performing Parts-Supply Task
  • 3. OVERVIEW OF PROPOSED METHOD Dual-arm mobile manipulator collects one part from each box. Shipping Carton Example
  • 4. OVERVIEW OF PROPOSED METHOD Region on base position where right hand can grasp an object in the box 1 Region on base position where left hand can grasp an object in the box 1
  • 5. OVERVIEW OF PROPOSED METHOD Obtain region on base position for all the boxes
  • 6. OVERVIEW OF PROPOSED METHOD Obtain a sequence of base position
  • 7. OVERVIEW OF PROPOSED METHOD Minimize : Number of Sequence and Travel Distance Common Area of Base position: ・Left Hand Picks an Object in the Box 1 ・Right Hand Pick an Object in the Box 2 Minimizing the travel distance
  • 8. FEATURES OF PROPOSED METHOD • Objects stored in a box is known • The number and the pose are not known • Stable grasp • Collision avoidance when grasping • Minimizing the number of sequence • Minimizing the travel distance Base Position Planning for Dual-arm Mobile Manipulators Performing a Sequence of Pick-and-place Tasks
  • 9. RELATED WORKS Base Position for Mobile Manipulator Maximizing the Manipulability F.G.Pin et al. (1990), H. Seragi et al. (1993), K. Tchon et al. (2000) 等 Base Position Considering the Stable Grasp R. Diankov et al. (2008), N. Vahrenkamp et al. (2012) Manipulation Planner for Dual-arm Manipulator Y. Koga et al. (1994), J.-P. Saut et al. (2010), K. Harada et al. (2012)
  • 10. IN THIS PRESENTATION 1. Inverse Kinematics Considering the Stable Grasp 2. Region on Mobile Base 3. Formulation of Optimization Problem 4. Numerical Examples
  • 11. INVERSE KINEMATICS CONSIDERING THE STABLE GRASP(1/3) Collision Avoidance Joint Limit Ellipsoidal Approximation of Links and Environments Using EQuadProg++ QP Problem to Obtain Joint Velocity
  • 12. INVERSE KINEMATICS CONSIDERING THE STABLE GRASP(2/3) Grasping Posture Database • Quadratic Approximation of Object Surface • Grasp Planning • Construction of Grasping Posture Database
  • 13. INVERSE KINEMATICS CONSIDERING THE STABLE GRASP(3/3) 1. Connect Initial Pose and 1st Data using Straight Line Segment 2. Split Segment into Small Steps 3. Solve QP Problem for Each Step 4. If QP problem does not have solution, proceed to next data Search for the Grasping Posture Database
  • 14. IN THIS PRESENTATION 1. Inverse Kinematics Considering the Stable Grasp 2. Region on Mobile Base 3. Formulation of Optimization Problem 4. Numerical Examples
  • 15. REGION ON MOBILE BASE Object pose is not known Mobile Base Pose Stably Grasping of an Object Discretize the Box / Moving Area
  • 16. REGION ON MOBILE BASE Searching Algorithm STEP1 Base Pose Stably Grasping All Objects in the Box Using Multi-thread
  • 17. REGION ON MOBILE BASE Searching Algorithm STEP1 STEP2 Checking Neighboring Points Base Pose Stably Grasping All Objects in the Box
  • 18. REGION ON MOBILE BASE STEP1 STEP2 Checking Neighboring Points Base Pose Stably Grasping All Objects in the Box Searching Algorithm
  • 19. REGION ON MOBILE BASE Searching Algorithm STEP1 STEP2 Checking Neighboring Points Base Pose Stably Grasping All Objects in the Box
  • 20. REGION ON MOBILE BASE Searching Algorithm STEP1 STEP2 Checking Neighboring Points Base Pose Stably Grasping All Objects in the Box
  • 21. IN THIS PRESENTATION 1. Inverse Kinematics Considering the Stable Grasp 2. Region on Mobile Base 3. Formulation of Optimization Problem 4. Numerical Examples
  • 22. DEFINITION P1 P2 P3 P4 P5 P6 P = [P1 P2 P3 P4 P5 P6] P2P1∩ P3P2∩ P4P3∩ P6P5∩ s=[ 1, 2, 3, 4, 5, 6, (1,2), (2,3), (3,4), (5,6)] =[ s1, s2, s3, s4, s5, s6, s7, s8, s9, s10]
  • 23. FORMULATION Which Area to Visit 0-1 Knapsack Problem Minimizing: Number of Sequence Branch and Bound (BB) Method Number of Sequence
  • 24. FORMULATION Order of Area to Visit Minimizing: Traveling Distance Traveling Salesman Problem Simulated Annealing
  • 25. EXAMPLES Discretizing Box Area Region on Mobile Base Realizing the Stable Grasp Region (Grasped by Left Hand) Nextage + Mobile Base Region (Grasped by Right Hand)
  • 26. RESULTS Distance between Two Boxes : 0 1st Base Position : Pick an Object from Boxes 1, 2, 3 and 4
  • 27. RESULTS 1st Base Position : Pick an Object from Boxes 1 and 2 2nd Base Position : Pick an Object from Boxes 3 and 4 Distance between Two Boxes : 0.4 [m]
  • 28. RESULTS Distance between Two Boxes : 0.8 [m] 1st Base Position : Pick an Object from Box 1 2nd Base Position : Pick an Object from Box 2 3rd Base Position : Pick an Object from Box 3 4th Base Position : Pick an Object from Box 4
  • 30. 1st Base Position 2nd Base Position Initial Pose
  • 32. CALCULATION TIME This method is to be used for offline calculation of base position
  • 33. SUMMARY • A sequence of the base position is planned for dual-arm mobile manipulators performing multiple pick-and-place tasks. • A robot can selectively use either the right or the left hand to pick up an object and can minimize the sequence size of the base position. • A region on the base position is obtained where a robot can pick up an object placed anywhere in a box. • A sequence of base positions is obtained by combining the branch and bound and simulated annealing methods.

Editor's Notes

  • #33: "中小企業が導入可能なハンドアイシステムを開発するプロジェクトを開始した。"→"中小企業が導入可能なハンドアイシステムを開発するプロジェクトを広島県および広島の民間企業と実施している"
  • #34: "中小企業が導入可能なハンドアイシステムを開発するプロジェクトを開始した。"→"中小企業が導入可能なハンドアイシステムを開発するプロジェクトを広島県および広島の民間企業と実施している"