SlideShare a Scribd company logo
Clustering for New Discovery in Data
Part 2
Houston Machine Learning Meetup
2
SCR©
https://energyconferencenetwork.com/machine-learning-oil-gas-2017/
20% off, PROMO code: HML
3
SCR©
Roadmap: Method
• Tour of machine learning algorithms (1 session)
• Feature engineering (1 session)
– Feature selection - Yan
• Supervised learning (4 sessions)
– Regression models -Yan
– SVM and kernel SVM - Yan
– Tree-based models - Dario
– Bayesian method - Xiaoyang
– Ensemble models - Yan
• Unsupervised learning (3 sessions)
– K-means clustering
– DBSCAN - Cheng
– Mean shift
– Agglomerative clustering – Kunal
– Spectral clustering – Yan
– Dimension reduction for data visualization - Yan
• Deep learning (4 sessions)
_ Neural network
– From neural network to deep learning
– Convolutional neural network
– Train deep nets with open-source tools
4
SCR©
Roadmap: Application
• Business analytics
• Recommendation system
• Natural language processing
• Computer vision
• Energy industry
5
SCR©
Clustering Algorithm
• K-Means (King of clustering, many variants)
• DBSCAN (group neighboring points)
• Hierarchical clustering (a hierarchical structure, multiple levels)
• Mean shift (locating the maxima of density)
• Spectral clustering (cares about connectivity instead of proximity)
• Expectation Maximization (k-means is a variant of EM)
• Latent Dirichlet Allocation (natural language processing)
……
6
SCR©
Agenda
• Hierarchical clustering
• Mean shift
• Spectral clustering
7
SCR©
Referenece: http://www.cvl.isy.liu.se:82/education/graduate/spectral-clustering.html
Spectral Clustering
8
SCR©
9
SCR©
10
SCR©
11
SCR©
Add noise to A
12
SCR©
13
SCR©
Modification I
14
SCR©
Min-cut problem
15
SCR©
Modification II
16
SCR©
17
SCR©
Ratio-cut problem
18
SCR©
19
SCR©
20
SCR©
21
SCR©
Normalized spectral clustering
Make the clustering less sensitive to the cluster sizes
22
SCR©
Normalized symmetric spectral clustering
Less sensitive to the cluster sizes and better separation of clusters
23
SCR©
24
SCR©
25
SCR©
26
SCR©
Summary
• Application of spectral clustering in computer vision
27
SCR©
Roadmap: Method
• Tour of machine learning algorithms (1 session)
• Feature engineering (1 session)
– Feature selection - Yan
• Supervised learning (4 sessions)
– Regression models -Yan
– SVM and kernel SVM - Yan
– Tree-based models - Dario
– Bayesian method - Xiaoyang
– Ensemble models - Yan
• Unsupervised learning (3 sessions)
– K-means clustering
– DBSCAN - Cheng
– Mean shift
– Agglomerative clustering
– Spectral clustering – Kunal, Yan
– Dimension reduction for data visualization - Yan
• Deep learning (4 sessions)
_ Neural network
– From neural network to deep learning
– Convolutional neural network
– Train deep nets with open-source tools
28
SCR©
https://energyconferencenetwork.com/machine-learning-oil-gas-2017/
20% off, PROMO code: HML
29
SCR©
Thank you
Slides will be posted on slide share:
http://www.slideshare.net/xuyangela
30
SCR©
ParkingWe are here
@ W205
Enter

More Related Content

PPTX
Optimization in Deep Learning
PPTX
Clustering introduction
PDF
Introduction to Recurrent Neural Network
PDF
Nonlinear dimension reduction
PDF
Introduction to Neural Network
PDF
Score based Generative Modeling through Stochastic Differential Equations
PPTX
Optimization in deep learning
PDF
Introduction to Diffusion Models
Optimization in Deep Learning
Clustering introduction
Introduction to Recurrent Neural Network
Nonlinear dimension reduction
Introduction to Neural Network
Score based Generative Modeling through Stochastic Differential Equations
Optimization in deep learning
Introduction to Diffusion Models

What's hot (20)

PDF
Domain Transfer and Adaptation Survey
PDF
Deep Learning behind Prisma
PDF
Deep image generating models
PDF
Explicit Density Models
PDF
Introduction to deep learning
PDF
Deep Learning for Computer Vision: Optimization (UPC 2016)
PPTX
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
PDF
Training Neural Networks
PDF
Recursive Neural Networks
PDF
Score-Based Generative Modeling through Stochastic Differential Equations
PDF
Learning deep features for discriminative localization
PDF
Learning Theory 101 ...and Towards Learning the Flat Minima
PDF
[PR12] PR-063: Peephole predicting network performance before training
PDF
Deep Learning for Computer Vision: Visualization (UPC 2016)
PPTX
Object classification using CNN & VGG16 Model (Keras and Tensorflow)
PPTX
Image classification using cnn
PPTX
[PR12] PR-050: Convolutional LSTM Network: A Machine Learning Approach for Pr...
PDF
Deep Learning for Computer Vision: Backward Propagation (UPC 2016)
PDF
強化学習の分散アーキテクチャ変遷
PDF
D1L5 Visualization (D1L2 Insight@DCU Machine Learning Workshop 2017)
Domain Transfer and Adaptation Survey
Deep Learning behind Prisma
Deep image generating models
Explicit Density Models
Introduction to deep learning
Deep Learning for Computer Vision: Optimization (UPC 2016)
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
Training Neural Networks
Recursive Neural Networks
Score-Based Generative Modeling through Stochastic Differential Equations
Learning deep features for discriminative localization
Learning Theory 101 ...and Towards Learning the Flat Minima
[PR12] PR-063: Peephole predicting network performance before training
Deep Learning for Computer Vision: Visualization (UPC 2016)
Object classification using CNN & VGG16 Model (Keras and Tensorflow)
Image classification using cnn
[PR12] PR-050: Convolutional LSTM Network: A Machine Learning Approach for Pr...
Deep Learning for Computer Vision: Backward Propagation (UPC 2016)
強化学習の分散アーキテクチャ変遷
D1L5 Visualization (D1L2 Insight@DCU Machine Learning Workshop 2017)
Ad

Viewers also liked (20)

PPTX
Cloud-based Storage, Processing and Rendering for Gegabytes 3D Biomedical Images
PDF
K means and dbscan
PDF
Mean shift and Hierarchical clustering
PPTX
Visualization using tSNE
PDF
Kernel Bayes Rule
PDF
طبقه بندی و بازشناسی الگو با شبکه های عصبی LVQ در متلب
PDF
icml2004 tutorial on spectral clustering part II
PPTX
Clusterin k means
PPTX
Spectral clustering Tutorial
PDF
ICWSM12 Brief Review
PDF
IJCAI13 Paper review: Large-scale spectral clustering on graphs
PDF
Laplacian Colormaps: a framework for structure-preserving color transformations
PPTX
Distributed approximate spectral clustering for large scale datasets
PDF
Introduction to Sparse Methods
PDF
Notes on Spectral Clustering
DOCX
A secure-anti-collusion-data-sharing-scheme-for-dynamic-groups-in-the-cloud
PPTX
Film Openings: Codes and Conventions
DOC
AVISHESH BHARGAVA resume
PPTX
Transporte em nanoestruturas_3_algumas_consideracoes_fisicas
Cloud-based Storage, Processing and Rendering for Gegabytes 3D Biomedical Images
K means and dbscan
Mean shift and Hierarchical clustering
Visualization using tSNE
Kernel Bayes Rule
طبقه بندی و بازشناسی الگو با شبکه های عصبی LVQ در متلب
icml2004 tutorial on spectral clustering part II
Clusterin k means
Spectral clustering Tutorial
ICWSM12 Brief Review
IJCAI13 Paper review: Large-scale spectral clustering on graphs
Laplacian Colormaps: a framework for structure-preserving color transformations
Distributed approximate spectral clustering for large scale datasets
Introduction to Sparse Methods
Notes on Spectral Clustering
A secure-anti-collusion-data-sharing-scheme-for-dynamic-groups-in-the-cloud
Film Openings: Codes and Conventions
AVISHESH BHARGAVA resume
Transporte em nanoestruturas_3_algumas_consideracoes_fisicas
Ad

Similar to Spectral clustering - Houston ML Meetup (20)

PDF
ASE2010
PDF
"Energy-efficient Hardware for Embedded Vision and Deep Convolutional Neural ...
PDF
Spark Summit EU talk by Josef Habdank
PPTX
CMU Lecture on Hadoop Performance
PPTX
Prediction as a service with ensemble model in SparkML and Python ScikitLearn
PDF
Modern Computing: Cloud, Distributed, & High Performance
PPTX
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
PDF
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
PPT
Presentation
PDF
Grid is Dead ? Nimrod on the Cloud
PPTX
Graphlab Ted Dunning Clustering
PPSX
PPTX
Talk@rmit 09112017
PPTX
Scalable Deep Learning in ExtremeEarth-phiweek19
PPTX
Platinum inspection using image processing
PDF
Parallel Genetic Algorithms in the Cloud
PPT
Contributions to the Efficient Use of General Purpose Coprocessors: KDE as Ca...
PDF
AI Assisted Digital System Design Lecture 1
PDF
Machine Learning and AI: Core Methods and Applications
PDF
Structured Forests for Fast Edge Detection [Paper Presentation]
ASE2010
"Energy-efficient Hardware for Embedded Vision and Deep Convolutional Neural ...
Spark Summit EU talk by Josef Habdank
CMU Lecture on Hadoop Performance
Prediction as a service with ensemble model in SparkML and Python ScikitLearn
Modern Computing: Cloud, Distributed, & High Performance
Using Feature Grouping as a Stochastic Regularizer for High Dimensional Noisy...
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
Presentation
Grid is Dead ? Nimrod on the Cloud
Graphlab Ted Dunning Clustering
Talk@rmit 09112017
Scalable Deep Learning in ExtremeEarth-phiweek19
Platinum inspection using image processing
Parallel Genetic Algorithms in the Cloud
Contributions to the Efficient Use of General Purpose Coprocessors: KDE as Ca...
AI Assisted Digital System Design Lecture 1
Machine Learning and AI: Core Methods and Applications
Structured Forests for Fast Edge Detection [Paper Presentation]

More from Yan Xu (19)

PPTX
Kaggle winning solutions: Retail Sales Forecasting
PDF
Basics of Dynamic programming
PPTX
Walking through Tensorflow 2.0
PPTX
Practical contextual bandits for business
PDF
Introduction to Multi-armed Bandits
PDF
A Data-Driven Question Generation Model for Educational Content - by Jack Wang
PDF
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
PDF
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
PDF
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
PDF
Introduction to Autoencoders
PPTX
State of enterprise data science
PDF
Long Short Term Memory
PDF
Deep Feed Forward Neural Networks and Regularization
PPTX
Linear algebra and probability (Deep Learning chapter 2&3)
PPTX
HML: Historical View and Trends of Deep Learning
PDF
Secrets behind AlphaGo
PDF
Convolutional neural network
PPTX
Introduction to data integration in bioinformatics
PPTX
Snakes in Images (Active contour tutorial)
Kaggle winning solutions: Retail Sales Forecasting
Basics of Dynamic programming
Walking through Tensorflow 2.0
Practical contextual bandits for business
Introduction to Multi-armed Bandits
A Data-Driven Question Generation Model for Educational Content - by Jack Wang
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Introduction to Autoencoders
State of enterprise data science
Long Short Term Memory
Deep Feed Forward Neural Networks and Regularization
Linear algebra and probability (Deep Learning chapter 2&3)
HML: Historical View and Trends of Deep Learning
Secrets behind AlphaGo
Convolutional neural network
Introduction to data integration in bioinformatics
Snakes in Images (Active contour tutorial)

Recently uploaded (20)

PPTX
microscope-Lecturecjchchchchcuvuvhc.pptx
PPTX
2. Earth - The Living Planet Module 2ELS
PDF
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
PDF
Biophysics 2.pdffffffffffffffffffffffffff
PPTX
Microbiology with diagram medical studies .pptx
PPTX
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
PPTX
7. General Toxicologyfor clinical phrmacy.pptx
PPTX
famous lake in india and its disturibution and importance
PPTX
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
PPTX
Derivatives of integument scales, beaks, horns,.pptx
PDF
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
PPTX
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PPTX
Taita Taveta Laboratory Technician Workshop Presentation.pptx
PPTX
Introduction to Cardiovascular system_structure and functions-1
PDF
The scientific heritage No 166 (166) (2025)
PPTX
Cell Membrane: Structure, Composition & Functions
PPT
POSITIONING IN OPERATION THEATRE ROOM.ppt
PPTX
ECG_Course_Presentation د.محمد صقران ppt
PPTX
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
microscope-Lecturecjchchchchcuvuvhc.pptx
2. Earth - The Living Planet Module 2ELS
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
Biophysics 2.pdffffffffffffffffffffffffff
Microbiology with diagram medical studies .pptx
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
7. General Toxicologyfor clinical phrmacy.pptx
famous lake in india and its disturibution and importance
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
Derivatives of integument scales, beaks, horns,.pptx
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
The KM-GBF monitoring framework – status & key messages.pptx
Taita Taveta Laboratory Technician Workshop Presentation.pptx
Introduction to Cardiovascular system_structure and functions-1
The scientific heritage No 166 (166) (2025)
Cell Membrane: Structure, Composition & Functions
POSITIONING IN OPERATION THEATRE ROOM.ppt
ECG_Course_Presentation د.محمد صقران ppt
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg

Spectral clustering - Houston ML Meetup