SlideShare a Scribd company logo
Advanced network modelling II:
   connectivity measures, group analysis
Ga¨l Varoquaux
  e                                 INRIA, Parietal
                                       Neurospin



                         Learning objectives
                          Extraction of the
                          network structure from
                          the observations
                          Statistics for comparing
                          correlations structures
                          Interpret network
                          structures
Problem setting and vocabulary



     Given regions,
   infer and compare
       connections


Graph: set of nodes and connections
  Weighted or not.
  Directed or not.
  Can be represented by an
 adjacency matrix.

G Varoquaux                           2
Functional network analysis: an outline


    1 Signal extraction


    2 Connectivity graphs


    3 Comparing connections


    4 Network-level summary



G Varoquaux                                3
1 Signal extraction
    Capturing network interplay




                       [Fox 2005]
G Varoquaux                         4
1 Choice of regions

   Too many regions gives
   harder statistical problem:
  ⇒ ∼ 30 ROIs for
        group-difference analysis

   Nearly-overlapping regions
   will mix signals

   Avoid too small regions ⇒ ∼ 10mm radius

   Capture different functional networks


G Varoquaux                                  5
1 Time-series extraction
   Extract ROI-average signal:
   weighted-mean with weights
   given by white-matter probability

   Low-pass filter fMRI data
   (≈ .1 Hz – .3 Hz)

   Regress out confounds:
     - movement parameters
     - CSF and white matter signals
     - Compcorr: data-driven noise identification
         [Behzadi 2007]


G Varoquaux                                        6
2 Connectivity graphs
    From correlations to connections




 Functional connectivity:
 correlation-based statistics

G Varoquaux                            7
2 Correlation, covariance
    For x and y centered:
                                    1
         covariance:    cov(x, y) =                     xi yi
                                    n               i
                                                    cov(x, y)
           correlation:          cor(x, y) =
                                                  std(x) std(y)
    Correlation is normalized: cor(x, y) ∈ [−1, 1]
    Quantify linear dependence between x and y

 Correlation matrix

                                                                  1
 functional connectivity graphs
 [Bullmore1996,..., Eguiluz2005, Achard2006...]



G Varoquaux                                                           8
2 Partial correlation
    Remove the effect of z by regressing it out
                x/z = residuals of regression of x on z
    In a set of p signals,
    partial correlation: cor(xi/Z , xj/Z ), Z = {xk , k = i, j}
    partial variance:          var(xi/Z ), Z = {xk , k = i}



 Partial correlation matrix
 [Marrelec2006, Fransson2008, ...]




G Varoquaux                                                       9
2 Inverse covariance
    K = Matrix inverse of the covariance matrix

    On the diagonal: partial variance
    Off diagonal: scaled partial correlation
            Ki,j = −cor(xi/Z , xj/Z ) std(xi/Z ) std(xj/Z )




 Inverse covariance matrix
 [Smith 2010, Varoquaux NIPS 2010, ...]




G Varoquaux                                                   10
2 Summary: observations and indirect effects
  Observations              Direct connections
  Correlation               Partial correlation
              1                       1
   2                        2

                  0                         0

  3                         3
              4                       4


 + Variance:                 + Partial variance
amount of observed signal    innovation term

G Varoquaux                                       11
2 Summary: observations and indirect effects
  Observations                 Direct connections
  Correlation                  Partial correlation




   [Fransson 2008]: partial correlations highlight the
                    backbone of the default mode



G Varoquaux                                              11
2 Inverse covariance and graphical model




Gaussian graphical models
 Zeros in inverse covariance give
 conditional independence




                     xi , xj independent
    Σ−1 = 0 ⇔
     i,j
                     conditionally on {xk , k = i, j}

                            Robust to the Gaussian assumption
G Varoquaux                                                     12
2 Inverse covariance matrix estimation

   p nodes, n observations (e.g. fMRI volumes)
                                       0               1




   If not n p 2 ,                              2


        ambiguities:
                       0       1
                                   ?
                                   0
                                                   ?
                                                   1       0       1



                           2               2                   2




      Thresholding partial correlations does not
    recover ground truth independence structure



G Varoquaux                                                            13
2 Inverse covariance matrix estimation
   Sparse Inverse Covariance estimators:
        Joint estimation of
        connections and values

   Sparsity amount set by cross-validation,
   to maximize likelihood of left-out data

   Group-sparse inverse covariance: learn
   simultaneously different values with same
   connections

                                      [Varoquaux, NIPS 2010]

G Varoquaux                                                    14
3 Comparing connections
 Detecting and localizing differences




G Varoquaux                            15
3 Comparing connections
 Detecting and localizing differences

 Learning sculpts the spontaneous activity of the resting
 human brain                                [Lewis 2009]




   Cor        ...learn...   cor              differences

G Varoquaux                                                 15
3 Pair-wise tests on correlations

 Correlations ∈ [−1, 1]
     ⇒ cannot apply Gaussian
          statistics, e.g. T tests


 Z-transform:
                      1 1 + cor
 Z = arctanh cor =     ln
                      2 1 − cor

   Z (cor) is normaly-distributed:              
                                                 1
      For n observations, Z (cor) = N Z (cor), √ 
                                                  n
G Varoquaux                                           16
3 Indirect effects: to partial or not to partial?
0                                  0                                0                                0

 5          Correlation matrices    5                                5                                5

10                                 10                               10                               10

15                                 15                               15                               15

20                                 20                               20                               20

25   Control                       25   Control                     25   Control                      Large lesion
                                                                                                     25

     0    5    10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25
0                                  0                                0                                0

 5            Partial correlation matrices
                                    5                                5                                5

10                                 10                               10                               10

15                                 15                               15                               15

20                                 20                               20                               20

25   Control                       25   Control                     25   Control                      Large lesion
                                                                                                     25

     0    5    10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25

              Spread-out variability in correlation matrices
              Noise in partial-correlations
                 Strong dependence between coefficients
                                                                                 [Varoquaux MICCAI 2010]
G Varoquaux                                                                                                                           17
3 Indirect effects versus noise: a trade off
0                                 0                                0                                0

 5          Correlation matrices   5                                5                                5

10                                10                               10                               10

15                                15                               15                               15

20                                20                               20                               20

25   Control                      25   Control                     25   Control                      Large lesion
                                                                                                    25

     0    5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25
0                                 0                                0                                0

 5            Partial correlation matrices
                                   5                                5                                5

10                                10                               10                               10

15                                15                               15                               15

20                                20                               20                               20

25   Control                      25   Control                     25   Control                      Large lesion
                                                                                                    25

     0    5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25
0                                 0                                0                                0

 5            Tangent-space residuals
                                   5                                5                                5

10            [Varoquaux MICCAI 2010]
                         10                                        10                               10

15                                15                               15                               15

20                                20                               20                               20

25   Control                      25   Control                     25   Control                      Large lesion
                                                                                                    25

     0    5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25        0   5   10   15   20   25
G Varoquaux                                                                                                                          18
3 Graph-theoretical analysis
   Summarize a graph by a few key metrics, expressing
   its transport properties       [Bullmore & Sporns 2009]




                                [Eguiluz 2005]



   Permutation testing for null distribution

   Use a good graph (sparse inverse covariance)
                                      [Varoquaux NIPS 2010]

G Varoquaux                                                   19
4 Network-level summary
 Comparing network activity




G Varoquaux                   20
4 Network-wide activity: generalized variance


                   Quantify amount of signal in Σ?




                   Determinant: |Σ|
                   = generalized variance
                   = volume of ellipse



G Varoquaux                                          21
4 Integration across networks

                           Networks-level sub-matrices ΣA

                           Network integration: = log |ΣA |

                           Cross-talk between network A
                           and B: mutual information =
                           log |ΣAB | − log |ΣA | − log |ΣB |

   Information-theoretical interpretation: entropy and
   cross-entropy
              [Tononi 1994, Marrelec 2008, Varoquaux NIPS 2010]



G Varoquaux                                                       22
Wrapping up: pitfalls
    Missing nodes



    Very-correlated nodes:
     e.g. nearly-overlapping regions



    Hub nodes give more noisy partial
     correlations



G Varoquaux                             23
Wrapping up: take home messages
    Regress confounds out from signals

    Inverse covariance to capture
     only direct effects
                                      0                                0


    Correlations cofluctuate            5

                                      10
                                                                        5

                                                                       10


    ⇒ localization of differences      15

                                      20
                                                                       15

                                                                       20


                         is difficult   25

                                           0   5   10   15   20   25
                                                                       25

                                                                            0   5   10   15   20   25




     Networks are interesting units for
    comparison

   http://gael-varoquaux.info
G Varoquaux                                                                                             24
References (not exhaustive)
[Achard 2006] A resilient, low-frequency, small-world human brain
functional network with highly connected association cortical hubs, J
Neurosci
[Behzadi 2007] A component based noise correction method (CompCor)
for BOLD and perfusion based fMRI, NeuroImage
[Bullmore 2009] Complex brain networks: graph theoretical analysis of
structural and functional systems, Nat Rev Neurosci
[Eguiluz 2005] Scale-free brain functional networks, Phys Rev E
[Frasson 2008] The precuneus/posterior cingulate cortex plays a pivotal
role in the default mode network: Evidence from a partial correlation
network analysis, NeuroImage
[Fox 2005] The human brain is intrinsically organized into dynamic,
anticorrelated functional networks, PNAS
[Lewis 2009] Learning sculpts the spontaneous activity of the resting
human brain, PNAS
[Marrelec 2006] Partial correlation for functional brain interactivity
investigation in functional MRI, NeuroImage
References (not exhaustive)
[Marrelec 2007] Using partial correlation to enhance structural equation
modeling of functional MRI data, Magn Res Im
[Marrelec 2008] Regions, systems, and the brain: hierarchical measures
of functional integration in fMRI, Med Im Analys
[Smith 2010] Network Modelling Methods for fMRI, NeuroImage
[Tononi 1994] A measure for brain complexity: relating functional
segregation and integration in the nervous system, PNAS
[Varoquaux MICCAI 2010] Detection of brain functional-connectivity
difference in post-stroke patients using group-level covariance modeling,
Med Imag Proc Comp Aided Intervention
[Varoquaux NIPS 2010] Brain covariance selection: better individual
functional connectivity models using population prior, Neural Inf Proc Sys
[Varoquaux 2012] Markov models for fMRI correlation structure: is
brain functional connectivity small world, or decomposable into
networks?, J Physio Paris

More Related Content

PPTX
Brain Networks
PPTX
Introduction to CNN
PPTX
Convolutional neural network from VGG to DenseNet
PDF
First Principles Calculation of Charge and Spin Transport in Tin-Monolayer
PDF
Denoising Diffusion Probabilistic Modelsの重要な式の解説
PDF
PRML 5.5.6-5.6
PDF
[DL輪読会]Deep Learning 第2章 線形代数
PDF
Introduction to Neural Networks
Brain Networks
Introduction to CNN
Convolutional neural network from VGG to DenseNet
First Principles Calculation of Charge and Spin Transport in Tin-Monolayer
Denoising Diffusion Probabilistic Modelsの重要な式の解説
PRML 5.5.6-5.6
[DL輪読会]Deep Learning 第2章 線形代数
Introduction to Neural Networks

What's hot (20)

PDF
量子アニーリングマシンのプログラミング
PDF
ICML 2021 Workshop 深層学習の不確実性について
PDF
[논문리뷰] 딥러닝 적용한 EEG 연구 소개
PPTX
Deep Learning - A Literature survey
PDF
Recurrent Neural Networks. Part 1: Theory
PPTX
Wasserstein GANを熟読する
PDF
Neural Networks and Deep Learning
PPTX
InfoGAN: Interpretable Representation Learning by Information Maximizing Gene...
PPTX
Koyama ASA ASJ joint meeting 2016
PPT
Neural Networks
PPTX
Generative Adversarial Networks and Their Applications in Medical Imaging
PPTX
Introduction Of Artificial neural network
PDF
Artificial Neural Networks Lect7: Neural networks based on competition
PDF
[PRML] パターン認識と機械学習(第2章:確率分布)
PPTX
Fuzzy Logic Ppt
PDF
機械学習概論 講義テキスト
PDF
PRML 5章 PP.227-PP.247
PPTX
Activation functions
PDF
[기초개념] Graph Convolutional Network (GCN)
PPSX
Perceptron (neural network)
量子アニーリングマシンのプログラミング
ICML 2021 Workshop 深層学習の不確実性について
[논문리뷰] 딥러닝 적용한 EEG 연구 소개
Deep Learning - A Literature survey
Recurrent Neural Networks. Part 1: Theory
Wasserstein GANを熟読する
Neural Networks and Deep Learning
InfoGAN: Interpretable Representation Learning by Information Maximizing Gene...
Koyama ASA ASJ joint meeting 2016
Neural Networks
Generative Adversarial Networks and Their Applications in Medical Imaging
Introduction Of Artificial neural network
Artificial Neural Networks Lect7: Neural networks based on competition
[PRML] パターン認識と機械学習(第2章:確率分布)
Fuzzy Logic Ppt
機械学習概論 講義テキスト
PRML 5章 PP.227-PP.247
Activation functions
[기초개념] Graph Convolutional Network (GCN)
Perceptron (neural network)
Ad

Viewers also liked (17)

PPTX
Brain Network - Thalamocortical Motif
PDF
A tutorial in Connectome Analysis (1) - Marcus Kaiser
PDF
Sporns kavli2008
PPTX
Exploring Complex Networks
PPT
ITAB2010-Thresholding Correlation Matrices
PDF
Brain connectivity analysis
PDF
On the code of data science
PPTX
Presentation Internship Brain Connectivity Graph 2014 (ENG)
PDF
A tutorial in Connectome Analysis (2) - Marcus Kaiser
PDF
Introduction to Neuroimaging Informatics
PDF
Functional Brain Networks - Javier M. Buldù
PDF
Lean Manga. The Lean Brain
PDF
Learning and comparing multi-subject models of brain functional connecitivity
PPTX
Connectome
PPTX
Introduction to Graph Theory
PPTX
Central Nervous System, The Autonomic Nervous System
PPTX
Frontotemporal dementia: Neural circuits, genetics and neuropathology
Brain Network - Thalamocortical Motif
A tutorial in Connectome Analysis (1) - Marcus Kaiser
Sporns kavli2008
Exploring Complex Networks
ITAB2010-Thresholding Correlation Matrices
Brain connectivity analysis
On the code of data science
Presentation Internship Brain Connectivity Graph 2014 (ENG)
A tutorial in Connectome Analysis (2) - Marcus Kaiser
Introduction to Neuroimaging Informatics
Functional Brain Networks - Javier M. Buldù
Lean Manga. The Lean Brain
Learning and comparing multi-subject models of brain functional connecitivity
Connectome
Introduction to Graph Theory
Central Nervous System, The Autonomic Nervous System
Frontotemporal dementia: Neural circuits, genetics and neuropathology
Ad

Similar to Brain network modelling: connectivity metrics and group analysis (20)

PDF
Connectomics: Parcellations and Network Analysis Methods
PDF
Estimating Functional Connectomes: Sparsity’s Strength and Limitations
PDF
Advanced network modelling 2: connectivity measures, goup analysis
PDF
Machine learning for functional connectomes
PPTX
Multi Level Modelling&Weights Workshop Kiel09
PPT
T tests anovas and regression
PDF
Brain reading, compressive sensing, fMRI and statistical learning in Python
PDF
Social-sparsity brain decoders: faster spatial sparsity
PDF
MVPA with SpaceNet: sparse structured priors
PDF
Integrability and weak diffraction in a two-particle Bose-Hubbard model
PPTX
L-8 VECM Formulation, Hypothesis Testing, and Forecasting - KH.pptx
PDF
Paper Summary of Beta-VAE: Learning Basic Visual Concepts with a Constrained ...
PDF
Lecture 2: Stochastic Hydrology
PDF
Network and risk spillovers: a multivariate GARCH perspective
PPTX
Swapping between Two Nonorthogonal Entangled Coherent States (and Branching o...
PDF
An O(log^2 k)-approximation algorithm for k-vertex connected spanning subgraph
PDF
A short and naive introduction to using network in prediction models
PDF
Iclr2016 vaeまとめ
PDF
An integer linear programming formulation and branch-and-cut algorithm for th...
PPT
Regression and Co-Relation
Connectomics: Parcellations and Network Analysis Methods
Estimating Functional Connectomes: Sparsity’s Strength and Limitations
Advanced network modelling 2: connectivity measures, goup analysis
Machine learning for functional connectomes
Multi Level Modelling&Weights Workshop Kiel09
T tests anovas and regression
Brain reading, compressive sensing, fMRI and statistical learning in Python
Social-sparsity brain decoders: faster spatial sparsity
MVPA with SpaceNet: sparse structured priors
Integrability and weak diffraction in a two-particle Bose-Hubbard model
L-8 VECM Formulation, Hypothesis Testing, and Forecasting - KH.pptx
Paper Summary of Beta-VAE: Learning Basic Visual Concepts with a Constrained ...
Lecture 2: Stochastic Hydrology
Network and risk spillovers: a multivariate GARCH perspective
Swapping between Two Nonorthogonal Entangled Coherent States (and Branching o...
An O(log^2 k)-approximation algorithm for k-vertex connected spanning subgraph
A short and naive introduction to using network in prediction models
Iclr2016 vaeまとめ
An integer linear programming formulation and branch-and-cut algorithm for th...
Regression and Co-Relation

More from Gael Varoquaux (20)

PDF
Evaluating machine learning models and their diagnostic value
PDF
Measuring mental health with machine learning and brain imaging
PDF
Machine learning with missing values
PDF
Dirty data science machine learning on non-curated data
PDF
Representation learning in limited-data settings
PDF
Better neuroimaging data processing: driven by evidence, open communities, an...
PDF
Functional-connectome biomarkers to meet clinical needs?
PDF
Atlases of cognition with large-scale human brain mapping
PDF
Similarity encoding for learning on dirty categorical variables
PDF
Towards psychoinformatics with machine learning and brain imaging
PDF
Simple representations for learning: factorizations and similarities
PDF
A tutorial on Machine Learning, with illustrations for MR imaging
PDF
Scikit-learn and nilearn: Democratisation of machine learning for brain imaging
PDF
Computational practices for reproducible science
PDF
Coding for science and innovation
PDF
Scientist meets web dev: how Python became the language of data
PDF
Machine learning and cognitive neuroimaging: new tools can answer new questions
PDF
Scikit-learn: the state of the union 2016
PDF
Inter-site autism biomarkers from resting state fMRI
PDF
Brain maps from machine learning? Spatial regularizations
Evaluating machine learning models and their diagnostic value
Measuring mental health with machine learning and brain imaging
Machine learning with missing values
Dirty data science machine learning on non-curated data
Representation learning in limited-data settings
Better neuroimaging data processing: driven by evidence, open communities, an...
Functional-connectome biomarkers to meet clinical needs?
Atlases of cognition with large-scale human brain mapping
Similarity encoding for learning on dirty categorical variables
Towards psychoinformatics with machine learning and brain imaging
Simple representations for learning: factorizations and similarities
A tutorial on Machine Learning, with illustrations for MR imaging
Scikit-learn and nilearn: Democratisation of machine learning for brain imaging
Computational practices for reproducible science
Coding for science and innovation
Scientist meets web dev: how Python became the language of data
Machine learning and cognitive neuroimaging: new tools can answer new questions
Scikit-learn: the state of the union 2016
Inter-site autism biomarkers from resting state fMRI
Brain maps from machine learning? Spatial regularizations

Recently uploaded (20)

PPTX
Big Data Technologies - Introduction.pptx
PDF
Encapsulation theory and applications.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
Spectroscopy.pptx food analysis technology
PPT
Teaching material agriculture food technology
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
A Presentation on Artificial Intelligence
Big Data Technologies - Introduction.pptx
Encapsulation theory and applications.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Encapsulation_ Review paper, used for researhc scholars
Advanced methodologies resolving dimensionality complications for autism neur...
MYSQL Presentation for SQL database connectivity
Spectral efficient network and resource selection model in 5G networks
Digital-Transformation-Roadmap-for-Companies.pptx
Per capita expenditure prediction using model stacking based on satellite ima...
“AI and Expert System Decision Support & Business Intelligence Systems”
Network Security Unit 5.pdf for BCA BBA.
Diabetes mellitus diagnosis method based random forest with bat algorithm
Spectroscopy.pptx food analysis technology
Teaching material agriculture food technology
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Review of recent advances in non-invasive hemoglobin estimation
20250228 LYD VKU AI Blended-Learning.pptx
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
A Presentation on Artificial Intelligence

Brain network modelling: connectivity metrics and group analysis

  • 1. Advanced network modelling II: connectivity measures, group analysis Ga¨l Varoquaux e INRIA, Parietal Neurospin Learning objectives Extraction of the network structure from the observations Statistics for comparing correlations structures Interpret network structures
  • 2. Problem setting and vocabulary Given regions, infer and compare connections Graph: set of nodes and connections Weighted or not. Directed or not. Can be represented by an adjacency matrix. G Varoquaux 2
  • 3. Functional network analysis: an outline 1 Signal extraction 2 Connectivity graphs 3 Comparing connections 4 Network-level summary G Varoquaux 3
  • 4. 1 Signal extraction Capturing network interplay [Fox 2005] G Varoquaux 4
  • 5. 1 Choice of regions Too many regions gives harder statistical problem: ⇒ ∼ 30 ROIs for group-difference analysis Nearly-overlapping regions will mix signals Avoid too small regions ⇒ ∼ 10mm radius Capture different functional networks G Varoquaux 5
  • 6. 1 Time-series extraction Extract ROI-average signal: weighted-mean with weights given by white-matter probability Low-pass filter fMRI data (≈ .1 Hz – .3 Hz) Regress out confounds: - movement parameters - CSF and white matter signals - Compcorr: data-driven noise identification [Behzadi 2007] G Varoquaux 6
  • 7. 2 Connectivity graphs From correlations to connections Functional connectivity: correlation-based statistics G Varoquaux 7
  • 8. 2 Correlation, covariance For x and y centered: 1 covariance: cov(x, y) = xi yi n i cov(x, y) correlation: cor(x, y) = std(x) std(y) Correlation is normalized: cor(x, y) ∈ [−1, 1] Quantify linear dependence between x and y Correlation matrix 1 functional connectivity graphs [Bullmore1996,..., Eguiluz2005, Achard2006...] G Varoquaux 8
  • 9. 2 Partial correlation Remove the effect of z by regressing it out x/z = residuals of regression of x on z In a set of p signals, partial correlation: cor(xi/Z , xj/Z ), Z = {xk , k = i, j} partial variance: var(xi/Z ), Z = {xk , k = i} Partial correlation matrix [Marrelec2006, Fransson2008, ...] G Varoquaux 9
  • 10. 2 Inverse covariance K = Matrix inverse of the covariance matrix On the diagonal: partial variance Off diagonal: scaled partial correlation Ki,j = −cor(xi/Z , xj/Z ) std(xi/Z ) std(xj/Z ) Inverse covariance matrix [Smith 2010, Varoquaux NIPS 2010, ...] G Varoquaux 10
  • 11. 2 Summary: observations and indirect effects Observations Direct connections Correlation Partial correlation 1 1 2 2 0 0 3 3 4 4 + Variance: + Partial variance amount of observed signal innovation term G Varoquaux 11
  • 12. 2 Summary: observations and indirect effects Observations Direct connections Correlation Partial correlation [Fransson 2008]: partial correlations highlight the backbone of the default mode G Varoquaux 11
  • 13. 2 Inverse covariance and graphical model Gaussian graphical models Zeros in inverse covariance give conditional independence xi , xj independent Σ−1 = 0 ⇔ i,j conditionally on {xk , k = i, j} Robust to the Gaussian assumption G Varoquaux 12
  • 14. 2 Inverse covariance matrix estimation p nodes, n observations (e.g. fMRI volumes) 0 1 If not n p 2 , 2 ambiguities: 0 1 ? 0 ? 1 0 1 2 2 2 Thresholding partial correlations does not recover ground truth independence structure G Varoquaux 13
  • 15. 2 Inverse covariance matrix estimation Sparse Inverse Covariance estimators: Joint estimation of connections and values Sparsity amount set by cross-validation, to maximize likelihood of left-out data Group-sparse inverse covariance: learn simultaneously different values with same connections [Varoquaux, NIPS 2010] G Varoquaux 14
  • 16. 3 Comparing connections Detecting and localizing differences G Varoquaux 15
  • 17. 3 Comparing connections Detecting and localizing differences Learning sculpts the spontaneous activity of the resting human brain [Lewis 2009] Cor ...learn... cor differences G Varoquaux 15
  • 18. 3 Pair-wise tests on correlations Correlations ∈ [−1, 1] ⇒ cannot apply Gaussian statistics, e.g. T tests Z-transform: 1 1 + cor Z = arctanh cor = ln 2 1 − cor Z (cor) is normaly-distributed:   1 For n observations, Z (cor) = N Z (cor), √  n G Varoquaux 16
  • 19. 3 Indirect effects: to partial or not to partial? 0 0 0 0 5 Correlation matrices 5 5 5 10 10 10 10 15 15 15 15 20 20 20 20 25 Control 25 Control 25 Control Large lesion 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 0 0 0 5 Partial correlation matrices 5 5 5 10 10 10 10 15 15 15 15 20 20 20 20 25 Control 25 Control 25 Control Large lesion 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 Spread-out variability in correlation matrices Noise in partial-correlations Strong dependence between coefficients [Varoquaux MICCAI 2010] G Varoquaux 17
  • 20. 3 Indirect effects versus noise: a trade off 0 0 0 0 5 Correlation matrices 5 5 5 10 10 10 10 15 15 15 15 20 20 20 20 25 Control 25 Control 25 Control Large lesion 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 0 0 0 5 Partial correlation matrices 5 5 5 10 10 10 10 15 15 15 15 20 20 20 20 25 Control 25 Control 25 Control Large lesion 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 0 0 0 5 Tangent-space residuals 5 5 5 10 [Varoquaux MICCAI 2010] 10 10 10 15 15 15 15 20 20 20 20 25 Control 25 Control 25 Control Large lesion 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 0 5 10 15 20 25 G Varoquaux 18
  • 21. 3 Graph-theoretical analysis Summarize a graph by a few key metrics, expressing its transport properties [Bullmore & Sporns 2009] [Eguiluz 2005] Permutation testing for null distribution Use a good graph (sparse inverse covariance) [Varoquaux NIPS 2010] G Varoquaux 19
  • 22. 4 Network-level summary Comparing network activity G Varoquaux 20
  • 23. 4 Network-wide activity: generalized variance Quantify amount of signal in Σ? Determinant: |Σ| = generalized variance = volume of ellipse G Varoquaux 21
  • 24. 4 Integration across networks Networks-level sub-matrices ΣA Network integration: = log |ΣA | Cross-talk between network A and B: mutual information = log |ΣAB | − log |ΣA | − log |ΣB | Information-theoretical interpretation: entropy and cross-entropy [Tononi 1994, Marrelec 2008, Varoquaux NIPS 2010] G Varoquaux 22
  • 25. Wrapping up: pitfalls Missing nodes Very-correlated nodes: e.g. nearly-overlapping regions Hub nodes give more noisy partial correlations G Varoquaux 23
  • 26. Wrapping up: take home messages Regress confounds out from signals Inverse covariance to capture only direct effects 0 0 Correlations cofluctuate 5 10 5 10 ⇒ localization of differences 15 20 15 20 is difficult 25 0 5 10 15 20 25 25 0 5 10 15 20 25 Networks are interesting units for comparison http://gael-varoquaux.info G Varoquaux 24
  • 27. References (not exhaustive) [Achard 2006] A resilient, low-frequency, small-world human brain functional network with highly connected association cortical hubs, J Neurosci [Behzadi 2007] A component based noise correction method (CompCor) for BOLD and perfusion based fMRI, NeuroImage [Bullmore 2009] Complex brain networks: graph theoretical analysis of structural and functional systems, Nat Rev Neurosci [Eguiluz 2005] Scale-free brain functional networks, Phys Rev E [Frasson 2008] The precuneus/posterior cingulate cortex plays a pivotal role in the default mode network: Evidence from a partial correlation network analysis, NeuroImage [Fox 2005] The human brain is intrinsically organized into dynamic, anticorrelated functional networks, PNAS [Lewis 2009] Learning sculpts the spontaneous activity of the resting human brain, PNAS [Marrelec 2006] Partial correlation for functional brain interactivity investigation in functional MRI, NeuroImage
  • 28. References (not exhaustive) [Marrelec 2007] Using partial correlation to enhance structural equation modeling of functional MRI data, Magn Res Im [Marrelec 2008] Regions, systems, and the brain: hierarchical measures of functional integration in fMRI, Med Im Analys [Smith 2010] Network Modelling Methods for fMRI, NeuroImage [Tononi 1994] A measure for brain complexity: relating functional segregation and integration in the nervous system, PNAS [Varoquaux MICCAI 2010] Detection of brain functional-connectivity difference in post-stroke patients using group-level covariance modeling, Med Imag Proc Comp Aided Intervention [Varoquaux NIPS 2010] Brain covariance selection: better individual functional connectivity models using population prior, Neural Inf Proc Sys [Varoquaux 2012] Markov models for fMRI correlation structure: is brain functional connectivity small world, or decomposable into networks?, J Physio Paris