SlideShare a Scribd company logo
4
Most read
5
Most read
11
Most read
Particle Swarm
Optimization(PSO)
Group 1: Div, Jaikishan, Prathmesh
Swarm Intelligence
● Swarm intelligence (SI) is in the field of artificial intelligence (AI) and is based
on the collective behavior of elements in decentralized and self-organized
systems.
● Any attempt to design algorithms or distributed problem-solving devices
inspired by the collective behaviour of social insect colonies and other animal
societies.
● An artificial intelligence (AI) technique based on the collective behavior in
decentralized, self-organized systems
● Generally made up of agents who interact with each other and the
environment
● No centralized control structures
● Based on group behavior found in nature
What is PSO?
● Particle swarm optimization (PSO) is a population based
stochastic optimization technique.
● Developed by Dr. Eberhart and Dr. Kennedy in 1995.
● Inspired by social behavior of bird flocking or fish schooling.
● The swarm searches for the food in a cooperative way.
● Each member in the swarm learns from its experience and also
from other members for changing the search pattern to locate
the food.
How It works?
● The goal of PSO is to find the optimal solution to an optimization problem
within a given search space.
● The space of all feasible solutions(set of all possible solution candidates) is
called search space. Each point in the search space represents one possible
solution.
● PSO starts with initializing population randomly.
● Solutions are assigned with randomized velocity to explore the search space.
● Each solution in PSO is referred to as a particle.
How it works?
● Three distinct features of PSO are
○ Best fitness of each particle(pbest)
○ Best fitness of swarm (gbest)
○ Velocity and position update of each particle
● PSO is in initialized with a group of random particles(solutions) and then
searches for optimal by updating generations.
● Particles move through the solution space, and are evaluated according to
some fitness criterion after each time step. In every iteration, each particle is
updated following two “best” values.
How It works?
● The first one is the best solution it has obtained so far. This is called pbest.
● The best value obtained so far by any particle in the population or the global
best is called gbest.
● Velocity and position are updated for exploring and exploiting the search
space to locate the optimal solution.
Algorithm
For each particle
Initialize particle
END Do
For each particle
Calculate fitness value
If the fitness value is better than the best fitness value (pBest) in history
set current value as the new pBest
End
Algorithm
Choose the particle with the best fitness value of all the particles as the gBest
For each particle
Calculate particle velocity according equation (a)
Update particle position according equation (b)
End
While maximum iterations or minimum error criteria is not attained
Equations to update position and velocity
● v[] = v[] + c1 * rand() * (pbest[] - present[]) + c2 * rand() * (gbest[] - present[]) (a)
● present[] = persent[] + v[] (b)
v[] is the particle velocity,
persent[] is the current particle (solution),
pbest[] is the personal best,
gbest[] is the global best,
rand () is a random number between (0,1),
c1, c2 are learning factors.
usually c1 = c2 = 2
Stopping Criteria
● The maximum number of iterations the PSO execute. Set a predefined
maximum number of iterations or generations. The algorithm terminates when
it reaches this limit.
● Terminate the algorithm if the best-known solution remains unchanged or
shows no significant improvement over a specific number of iterations
● The minimum error requirement. If prior knowledge of the desired solution
quality is known, stop the algorithm once the best solution meets or exceeds
this quality.
● This stop condition depends on the problem to be optimized.
Flowchart
Advantages
● Easy to understand and implement
● Very few algorithm parameters to adjust
● There is no evolution or mutation in the operator
● PSO requires less computing so it is more efficient
● In several cases PSO is more flexible in maintaining a balance between
global and local searches for its search space.
● Easily parallelized for concurrent processing
Disadvantages
● Easy to fall(get trapped) into local optimum in high-dimensional space.
● Low convergence rate in the iterative process
● Needs memory to update velocity
Applications
Smart City
GIS-based placement of charging stations for electric vehicles
Forecasting Day-ahead traffic flow Highways
Health Care
Diagnosis of Alzheimer’s Disease
• Outperforming several SVM models and two other state-of-the-art deep learning
methods
Intelligent Leukaemia diagnosis
• Escaping from the local optima trap
Applications
Environment
Forecasting short-term atmospheric pollutant concentration based on PSO-SVM
• High forecasting accuracy
Industry
Positioning a 3D wind turbine with multiple hub heights on flat terrain
General Purpose
Travelling salesman problem
Path planning of multi-robots
Particle swarm optimization (PSO) ppt presentation
Comparison between GA and PSO
● Both algorithms start with a group of a randomly generated population
● Both have fitness values to evaluate the population
● Both update the population and search for the optimium with random
techniques.
● Both systems do not guarantee success.
● PSO does not have genetic operators like crossover and mutation. Particles
update themselves with the internal velocity. They also have memory, which
is important to the algorithm.
Comparison between GA and PSO
● Compared with genetic algorithms (GAs), the information sharing mechanism
in PSO is significantly different.
● In GAs, chromosomes share information with each other. So the whole
population moves like a one group towards an optimal area.
● In PSO, only gBest (or lBest) gives out the information to others. It is a one -
way information sharing mechanism.
● The evolution only looks for the best solution. Compared with GA, all the
particles tend to converge to the best solution quickly even in the local version
in most cases.

More Related Content

PPTX
Deep Learning - CNN and RNN
PDF
Particle Swarm Optimization: The Algorithm and Its Applications
PPT
Particle Swarm Optimization - PSO
PPT
neural networks
PPTX
Convolutional Neural Networks
PPT
Neural Networks
PPTX
Deep Learning With Neural Networks
PDF
Convolutional Neural Network Models - Deep Learning
Deep Learning - CNN and RNN
Particle Swarm Optimization: The Algorithm and Its Applications
Particle Swarm Optimization - PSO
neural networks
Convolutional Neural Networks
Neural Networks
Deep Learning With Neural Networks
Convolutional Neural Network Models - Deep Learning

What's hot (20)

PPTX
Particle Swarm Optimization.pptx
PDF
Yasunori Futamura
PDF
Introduction to Recurrent Neural Network
PDF
Optimization in deep learning
PPT
PSO.ppt
PDF
Training Deep Neural Nets
PDF
PR-144: SqueezeNext: Hardware-Aware Neural Network Design
PDF
Handwritten Digit Recognition using Convolutional Neural Networks
PPSX
Perceptron in ANN
PPTX
Practical Swarm Optimization (PSO)
PPTX
PPT
Non-maximum suppression using fewer than two comparison per pixels
PDF
Recursive Neural Networks
PDF
第4回 配信講義 計算科学技術特論B(2022)
PPTX
ViT.pptx
PPT
PSO and Its application in Engineering
PPTX
Transfer Learning and Fine Tuning for Cross Domain Image Classification with ...
PDF
Neural networks introduction
PDF
Convolutional Neural Networks (CNN)
Particle Swarm Optimization.pptx
Yasunori Futamura
Introduction to Recurrent Neural Network
Optimization in deep learning
PSO.ppt
Training Deep Neural Nets
PR-144: SqueezeNext: Hardware-Aware Neural Network Design
Handwritten Digit Recognition using Convolutional Neural Networks
Perceptron in ANN
Practical Swarm Optimization (PSO)
Non-maximum suppression using fewer than two comparison per pixels
Recursive Neural Networks
第4回 配信講義 計算科学技術特論B(2022)
ViT.pptx
PSO and Its application in Engineering
Transfer Learning and Fine Tuning for Cross Domain Image Classification with ...
Neural networks introduction
Convolutional Neural Networks (CNN)
Ad

Similar to Particle swarm optimization (PSO) ppt presentation (20)

PPT
Swarm intelligence pso and aco
PPTX
Particle swarm optimization
PPT
SI and PSO --Machine Learning
PPTX
Particle swarm optimization
PPSX
DOC
Pso notes
PDF
Particle Swarm Optimization
PPTX
PSO__AndryPinto_InesDomingues_LuisRocha_HugoAlves_SusanaCruz.pptx
PPTX
TEXT FEUTURE SELECTION USING PARTICLE SWARM OPTIMIZATION (PSO)
PDF
Using particle swarm optimization to solve test functions problems
PPTX
Particle swarm optimization
PPTX
Particle swarm optimization
PPTX
Partical swarm optimization (PSO).pptx
PPTX
Particle Swarm Optimization by Rajorshi Mukherjee
PDF
A REVIEW OF PARTICLE SWARM OPTIMIZATION (PSO) ALGORITHM
PPTX
Particle Swarm Optimization
PDF
Pso kota baru parahyangan 2017
PPSX
Particle Swarm optimization
PPTX
Optimization and particle swarm optimization (O & PSO)
Swarm intelligence pso and aco
Particle swarm optimization
SI and PSO --Machine Learning
Particle swarm optimization
Pso notes
Particle Swarm Optimization
PSO__AndryPinto_InesDomingues_LuisRocha_HugoAlves_SusanaCruz.pptx
TEXT FEUTURE SELECTION USING PARTICLE SWARM OPTIMIZATION (PSO)
Using particle swarm optimization to solve test functions problems
Particle swarm optimization
Particle swarm optimization
Partical swarm optimization (PSO).pptx
Particle Swarm Optimization by Rajorshi Mukherjee
A REVIEW OF PARTICLE SWARM OPTIMIZATION (PSO) ALGORITHM
Particle Swarm Optimization
Pso kota baru parahyangan 2017
Particle Swarm optimization
Optimization and particle swarm optimization (O & PSO)
Ad

Recently uploaded (20)

PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PDF
Complications of Minimal Access Surgery at WLH
PPTX
PPH.pptx obstetrics and gynecology in nursing
PPTX
GDM (1) (1).pptx small presentation for students
PPTX
Pharma ospi slides which help in ospi learning
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PPTX
Institutional Correction lecture only . . .
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PDF
Anesthesia in Laparoscopic Surgery in India
PPTX
Cell Structure & Organelles in detailed.
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
Computing-Curriculum for Schools in Ghana
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
RMMM.pdf make it easy to upload and study
PPTX
master seminar digital applications in india
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
Complications of Minimal Access Surgery at WLH
PPH.pptx obstetrics and gynecology in nursing
GDM (1) (1).pptx small presentation for students
Pharma ospi slides which help in ospi learning
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Institutional Correction lecture only . . .
VCE English Exam - Section C Student Revision Booklet
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Anesthesia in Laparoscopic Surgery in India
Cell Structure & Organelles in detailed.
Abdominal Access Techniques with Prof. Dr. R K Mishra
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Computing-Curriculum for Schools in Ghana
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
RMMM.pdf make it easy to upload and study
master seminar digital applications in india
Final Presentation General Medicine 03-08-2024.pptx
STATICS OF THE RIGID BODIES Hibbelers.pdf
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...

Particle swarm optimization (PSO) ppt presentation

  • 1. Particle Swarm Optimization(PSO) Group 1: Div, Jaikishan, Prathmesh
  • 2. Swarm Intelligence ● Swarm intelligence (SI) is in the field of artificial intelligence (AI) and is based on the collective behavior of elements in decentralized and self-organized systems. ● Any attempt to design algorithms or distributed problem-solving devices inspired by the collective behaviour of social insect colonies and other animal societies. ● An artificial intelligence (AI) technique based on the collective behavior in decentralized, self-organized systems ● Generally made up of agents who interact with each other and the environment ● No centralized control structures ● Based on group behavior found in nature
  • 3. What is PSO? ● Particle swarm optimization (PSO) is a population based stochastic optimization technique. ● Developed by Dr. Eberhart and Dr. Kennedy in 1995. ● Inspired by social behavior of bird flocking or fish schooling. ● The swarm searches for the food in a cooperative way. ● Each member in the swarm learns from its experience and also from other members for changing the search pattern to locate the food.
  • 4. How It works? ● The goal of PSO is to find the optimal solution to an optimization problem within a given search space. ● The space of all feasible solutions(set of all possible solution candidates) is called search space. Each point in the search space represents one possible solution. ● PSO starts with initializing population randomly. ● Solutions are assigned with randomized velocity to explore the search space. ● Each solution in PSO is referred to as a particle.
  • 5. How it works? ● Three distinct features of PSO are ○ Best fitness of each particle(pbest) ○ Best fitness of swarm (gbest) ○ Velocity and position update of each particle ● PSO is in initialized with a group of random particles(solutions) and then searches for optimal by updating generations. ● Particles move through the solution space, and are evaluated according to some fitness criterion after each time step. In every iteration, each particle is updated following two “best” values.
  • 6. How It works? ● The first one is the best solution it has obtained so far. This is called pbest. ● The best value obtained so far by any particle in the population or the global best is called gbest. ● Velocity and position are updated for exploring and exploiting the search space to locate the optimal solution.
  • 7. Algorithm For each particle Initialize particle END Do For each particle Calculate fitness value If the fitness value is better than the best fitness value (pBest) in history set current value as the new pBest End
  • 8. Algorithm Choose the particle with the best fitness value of all the particles as the gBest For each particle Calculate particle velocity according equation (a) Update particle position according equation (b) End While maximum iterations or minimum error criteria is not attained
  • 9. Equations to update position and velocity ● v[] = v[] + c1 * rand() * (pbest[] - present[]) + c2 * rand() * (gbest[] - present[]) (a) ● present[] = persent[] + v[] (b) v[] is the particle velocity, persent[] is the current particle (solution), pbest[] is the personal best, gbest[] is the global best, rand () is a random number between (0,1), c1, c2 are learning factors. usually c1 = c2 = 2
  • 10. Stopping Criteria ● The maximum number of iterations the PSO execute. Set a predefined maximum number of iterations or generations. The algorithm terminates when it reaches this limit. ● Terminate the algorithm if the best-known solution remains unchanged or shows no significant improvement over a specific number of iterations ● The minimum error requirement. If prior knowledge of the desired solution quality is known, stop the algorithm once the best solution meets or exceeds this quality. ● This stop condition depends on the problem to be optimized.
  • 12. Advantages ● Easy to understand and implement ● Very few algorithm parameters to adjust ● There is no evolution or mutation in the operator ● PSO requires less computing so it is more efficient ● In several cases PSO is more flexible in maintaining a balance between global and local searches for its search space. ● Easily parallelized for concurrent processing
  • 13. Disadvantages ● Easy to fall(get trapped) into local optimum in high-dimensional space. ● Low convergence rate in the iterative process ● Needs memory to update velocity
  • 14. Applications Smart City GIS-based placement of charging stations for electric vehicles Forecasting Day-ahead traffic flow Highways Health Care Diagnosis of Alzheimer’s Disease • Outperforming several SVM models and two other state-of-the-art deep learning methods Intelligent Leukaemia diagnosis • Escaping from the local optima trap
  • 15. Applications Environment Forecasting short-term atmospheric pollutant concentration based on PSO-SVM • High forecasting accuracy Industry Positioning a 3D wind turbine with multiple hub heights on flat terrain General Purpose Travelling salesman problem Path planning of multi-robots
  • 17. Comparison between GA and PSO ● Both algorithms start with a group of a randomly generated population ● Both have fitness values to evaluate the population ● Both update the population and search for the optimium with random techniques. ● Both systems do not guarantee success. ● PSO does not have genetic operators like crossover and mutation. Particles update themselves with the internal velocity. They also have memory, which is important to the algorithm.
  • 18. Comparison between GA and PSO ● Compared with genetic algorithms (GAs), the information sharing mechanism in PSO is significantly different. ● In GAs, chromosomes share information with each other. So the whole population moves like a one group towards an optimal area. ● In PSO, only gBest (or lBest) gives out the information to others. It is a one - way information sharing mechanism. ● The evolution only looks for the best solution. Compared with GA, all the particles tend to converge to the best solution quickly even in the local version in most cases.