sudhirraman-multivariate analyses with fmri data … · multivariate analyses with fmri data ......

42
MULTIVARIATE ANALYSES WITH fMRI DATA Sudhir Shankar Raman Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering University of Zurich & ETH Zurich

Upload: lamnguyet

Post on 11-Jun-2018

226 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

MULTIVARIATE ANALYSES WITH

fMRI DATA

Sudhir Shankar Raman Translational Neuromodeling Unit (TNU)

Institute for Biomedical Engineering

University of Zurich & ETH Zurich

Page 2: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Motivation

Modelling Concepts

Learning From Data

Multivariate Bayes in SPM

Generative Embedding

Page 3: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Motivation

• Local activations – Univariate approach

2

1

significant

not significant

Page 4: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Univariate to Multivariate

2

1

1

2

not significant

not significant

Page 5: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Motivation

Learning from data

Multivariate Bayes in SPM

Generative Embedding

Modelling Terminology

Page 6: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Steps for analysis

Feature

Extraction

Modelling

Classification

Clustering

Regression

Prediction

Model Selection

Cross validation

Performance

Inference

Page 7: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Feature Spaces Raw data

Model parameters

GLM – regression coefficients DCM – connection parameters

Voxel activity

F1 F2 . . . FP

S1

S2 Data Point or Feature Vector

.

. SN

• High dimensionality

• Class/Cluster distributions

• Interpretation

Page 8: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Modelling goals

• Prediction

• Model Selection

h X Y

Sparse Coding Distributed Coding

Predictive Density

Model Evidence

Page 9: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Model Selection - Generalizability

Model Fit

Model Complexity

Bishop (2006), Pitt & Miyung (2002), TICS

Page 10: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Motivation

Learning From Data

Multivariate Bayes in SPM

Generative Embedding

Modelling Concepts

Page 11: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Learning from Data

Supervised Learning

Unsupervised Learning

Reinforcement Learning

Semi-supervised Learning

Page 12: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Supervised Learning

Function - f

Independent variables X

dependent variable Y Categorical Continuous

Page 13: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

SVM

Classification

• Kernel Function – K 𝒙𝒊,𝒙𝒋 = 𝝓 𝒙𝒊 .𝝓 𝒙𝒋

𝝓

Function - f X Y

• Generative classifier

• Discriminative classifier

Kernel Methods

Kernel methods for pattern analysis, Taylor , Cristianini, 2004

Page 14: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

K-fold Cross Validation

• Model Selection

• Performance evaluation

Accuracy

1

2

3

87%

75%

89%

Training data

Test data

Page 15: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Performance – Single Subject

𝑝 = 𝑃 𝑋 ≥ 𝑘 𝐻0 = 1 − 𝐵 𝑘|𝑛,𝜋0

Brodersen et al. 2013, NeuroImage

Binomial Test

k=30

Page 16: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Performance – Multiple Subjects

Brodersen et al. 2013, NeuroImage

Fixed effects

Random effects

http://www.translationalneuromodeling.org/tapas/

Page 17: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Using classification for fMRI data

Pattern localization

Searchlight classifier

Kriegeskorte et al. (2006) PNAS Mourao-Miranda et al. (2005) NeuroImage, Marquand et al. (2010) NeuroImage

Whole brain

Pereira et al. (2009) NeuroImage, Mitchell et al. (2004) Machine Learning

Word Category

Food Building People

Page 18: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Confounds – GLM vs MVPA

Todd et al. 2013, NeuroImage

Page 19: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Unsupervised Learning

Building a representation of data

Dimensionality Reduction Clustering

K-means Mixture models

Page 20: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

K-means

Mixture of Gaussians

Bishop (2006)

Page 21: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Interpretation

• Cluster parameters

• Internal Criterion – Model Evidence

• External Criterion - Purity

Inferred

Labels

External

Labels

Subjects

Cluster 1 Cluster 2

Page 22: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Motivation

Learning from Data

Multivariate Bayes in SPM

Generative Embedding Modelling

Page 23: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Encoding Vs Decoding Models

Page 24: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Encoding Vs Decoding

Friston et al. 2008 NeuroImage

Page 25: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Coding hypotheses

Spatial vectors Smooth vectors

Sparse vectors

Singular vectors of data Support vectors

Distributed vectors

𝑈 = 𝑅𝑌𝑇 𝑈𝑈𝑉𝑇 = 𝑅𝑌𝑇

Page 26: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Bayesian decoding of motion

Experimental factors:

1. Photic

2. Motion

3. Attention

Attention to motion dataset - Büchel &

Friston 1999 Cerebral Cortex

Friston et al. 2008 NeuroImage

Page 27: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Multivariate Bayes in SPM

Page 28: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Results

Friston et al. 2008 NeuroImage

Page 29: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Results

Page 30: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Laminar activity related to novelty and episodic encoding

Maas et al. 2014 Nature Communications

Page 31: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Motivation

Learning from Data

Multivariate Bayes in SPM

Generative Embedding

Modelling Principles

Page 32: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Subject 1

Subject 2

Subject N

Voxel activity

Subject 1

Subject 2

Subject N

Connectivity

Dynamic causal

model (DCM)

Classification

Clustering

Group 1 Group 2

. . . . . . • High dimensionality

• Class/Cluster distributions

• Interpretation

Page 33: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Generative Embedding - Classification

Brodersen et al. pLOS computation biology 2011.

Page 34: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

DCM - Speech processing

Brodersen et al. pLOS computation biology 2011.

Page 35: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Working memory - fMRI

• 41 Schizophrenia patients (DSM IV,ICD 10), 42 controls

• Visual numeric n-back working memory task

Deserno, Lorenz et al 2012. The Journal of Neuroscience 32 (1). Society for Neuroscience: 12–20.

1 5 4 2 9 8 9

3 5 900ms

500ms

Page 36: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Model based clustering

Brodersen et al 2014 Neuroimage

Page 37: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Results – Healthy vs Schizophrenic

Brodersen et al 2014 Neuroimage

Page 38: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Brodersen et al 2014 Neuroimage

Results – Schizophrenia patients

Page 39: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Unified model for identifying subgroups

Raman, S et al A hierarchical model for unifying unsupervised generative embedding and empirical Bayes Under Revision

Page 40: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Summary

Learning from Data

Multivariate Bayes in SPM

Generative Embedding

Modelling Principles

Page 41: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Practicals

• Multivariate Bayes in SPM • Classification

• Clustering

Page 42: SudhirRaman-Multivariate Analyses with fMRI data … · MULTIVARIATE ANALYSES WITH fMRI DATA ... Bayes in SPM Generative ... Bishop (2006), Pitt & Miyung (2002), TICS . Motivation

Thank you