neuroinformatics€¦ · neuroinformatics.group ‘’coping with brain complexity’’ 4...

40

Upload: others

Post on 29-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal
Page 2: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal
Page 3: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

3

NeuroInformatics.GRoup‘’Coping with Brain Complexity’’

Page 4: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

4

Single-Trial analysisof cognitive ERP Responses

Data Learning

Information Mining

Signal Analysis

Dynamical systems

Page 5: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

5

The Clinical problem (simplified ):

There are complaints about decline in cognitive performance

Can we distinguish between normal ageing effects and

mild cognitive impairment (MCI) / prodromal AD pathology?

A Clinical Approach (just one possibility)

ERPs - auditory oddball paradigm

Page 6: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

6

Single-trials

A waveform-biomarker

reflecting the ‘average’ performance in a simple cognitive task

alternatively …

Page 7: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

7

Preliminaries – Our Motivation

Discriminative VQ - descriptor

Cross Frequency Coupling - Biomarker

Future directions

Page 8: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Preliminaries – Our Motivation

8

the synopsis of response dynamics and its variability

by means of

Semantic Maps

and Brainwaves Dictionary

[Laskaris et al., 2001-2009]

Page 9: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

9

In a nutshell,

directed queries are formed in the Single-Trial signals,

which are then summarized

using a very limited vocabulary of information granules (prototypes)

that are easily understood, accompanied by well-defined semantics

and help expressing the inherent data structure.

The information abstraction is accomplished

via unsupervised data-manifold learning techniques

and followed by a suitable visualization scheme

that can readily spot interesting events & trends in the experimental data

Semantic Maps : is a cartography of single-trials that results in a topographical representation of response variation

and enables the virtual navigation in the encephalographic database.

Page 10: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

10

A Short Intro

Page 11: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

11

Step_the spatiotemporal dynamics are decomposed

By designing a spatial filter that is used to extract

temporal patterns conveying

the regional response dynamics

Page 12: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

12

Feature selection

Embedding in high-D

feature space

Manifold learning

Neural-Gas Codebook

design

Vector Quantization

&

Ordering

Dimensionality Reduction

MAP

with semantics attached

Response re-parameterization

Signal Understanding

&

Machine learning

Step_Pattern & Graph-theoretic Analysisof the extracted ST-patterns

Page 13: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

13

Page 14: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

14

Page 15: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

16

Can single-trial response dynamics

(i.e. the recorded brainwaves)

be described/characterized

in ways that would help revealing

the cognitive impairment

better than the averaged response ?

Page 16: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Exploiting BrainWaves in aMCI-detection Part-I. Discriminative VQ - descriptor

auditory oddball paradigm with 20% target tones

Signals were recorded at Cz and Pz sites with fs=1024 ,

~ 30 responses to target stimulus per subject

25 amnestic MCI patients & 25 non-impaired subjects

from GAADRD

Page 17: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

The concept

Semantic Map

Single-Trial response dynamics

BrainWaves

descriptors

CodeBook design

Feature

selection

Initial representation of STs

1. Design the Codebook

discriminatively

2. Derive semantic map

based on CodeWaves

3. Embed ST-responses as

trajectories on the map.

4. Compute distributions

over the Codebook

5. Compare ‘histograms’

Page 18: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Training stage

Page 19: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

The temporal patterning in δ-rhythm showed the most prominent

differences between NI and aMCI single-trial cognitive responses.

Two distinct temporal segments (LOIs) were identified,

associated with the N200 and P300 (averaged) response

Page 20: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Using randomization,

Page 21: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Based on the detected LOIs

Page 22: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Classification stage

Page 23: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

The semantic map of the overall CodeBook (a)

with single-trial response trajectories sketched within (b & c).

Page 24: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Single-subject (top) and group-averaged (bottom) DVQ-profiles

Page 25: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

MDS-based scatterplot for the DVQ-profiles (left)

and the Signal-Averaging representation (right)

Comparing with Signal Averaging

Page 26: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

By means of 5-fold cross-validation for CodeBook design

& leave-one-out cross-validation (LOOCV) for the knn-classifier

1NN 3NN

DVQ-profile Averaged

Signal

DVQ-profile Averaged

Signal

ACC 0.90 0.80 0.93 0.83

Sensitivity 0.87 0.73 0.93 0.80

Specificity 0.93 0.87 0.93 0.87

Descriptors’ validation

Page 27: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal
Page 28: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Can the study of

interactions among distinct brain rhythms

(i.e. brainwaves of different prominent frequency jointly analyzed)

offer alternative / additional ways

for detecting cognitive impairment ?

Page 29: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

δ(2-4)Hz

θ(4-8) Hz

α1(8-10)

α2(10-13)

β1(13-20)

β2(20-30)

γ1(40-45)

Exploiting BrainWaves in aMCI-detection Part-II. Cross Frequency Coupling - Biomarker

CFC is a key mechanism for the integration of distinct processes

mediated by the distinct brain rhythms, and there is rapidly

accumulating experimental evidence about its role in cognition

Page 30: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

1

• a PAC-estimator is employed across trials• for each pair of brain rhythms a time-varying profile

of interaction is estimated by means of PLV(low, high)

2distinct CFC events

associated with the ERP components are detected

3

rhythm-pairs and latencies of high discriminative power are detected and wrapped in a multifaceted-biomarker

Method’s outline

Page 31: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

time-resolved PAC estimation

θ β1

Using Band-Pass filtering and Hilbert transform

𝒙 𝒕 ՜𝟏𝑯𝑭𝒇𝒊𝒍𝒕𝒆𝒓 𝒙 𝒕

𝟐:𝑯𝒊𝒍𝒃𝒆𝒓𝒕𝒆𝒏𝒗𝒆𝒍𝒐𝒑𝒆՜

𝟑𝑳𝑭𝒇𝒊𝒍𝒕𝒆𝒓(𝒆𝒏𝒗𝒆𝒍𝒐𝒑𝒆)

𝟒: 𝑯𝒊𝒍𝒃𝒆𝒓𝒕inst. phase

𝒙 𝒕 ՜𝟓𝑳𝑭𝒇𝒊𝒍𝒕𝒆𝒓 𝒙 𝒕

𝟔: 𝑯𝒊𝒍𝒃𝒆𝒓𝒕inst. phase

Page 32: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

by integrating across trials and within a temporal window

Page 33: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

δ

θ

α1

α2β1

β2

γ1

δθ δα1 δα2 δβ1 δβ2 δγ1

θα1 θα2 θβ1 θβ2 θγ1

α1α2 α1β1 α1β2 α1γ1

α2β1 α2β2 α2γ1

β1β2 β1γ1

β2γ121 pairs

LF HF

the corresponding 3D/2D array encapsulated the temporal evolution of

CFC associated with the response generation.

instantaneous PLV measurements can be tabulated in a [7x7] Matrix

or more compactly in a 21-tuple vector

PLV

δθ

δα1

θα1

δα2

β2γ1

PAC dynamics representation

Page 34: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

studying the PAC evolution - I

Single-subject (NI) example

Averaging

across pairs

Picking the maximal

interaction

Page 35: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Group-averaged results for healthy participants :

contrasting CFC from responses to Target and Nontarget stimuli

studying the PAC evolution - II

Page 36: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Group-averaged results

aMCI vs. NI subjects

studying the PAC evolution - III

Page 37: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Class-Separability Analysis

The dynamic PAC profiles from aMCI and NI subjects

are statistically compared

Page 38: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

Biomarker - validation

Page 39: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

40

ERPs

• Multichannel signal

• Functional connectivity

Resting State

• BrainWaves VQ-characterization

• CFC

Interventions

• Restoring brainwaves distribution

• Restoring CFC

Page 40: NeuroInformatics€¦ · NeuroInformatics.GRoup ‘’Coping with Brain Complexity’’ 4 Single-Trial analysis of cognitive ERP Responses Data Learning Information Mining Signal

41

M.Tsolaki, I.Tarnanas

& coworkers

S.Dimitriadis, M.Bitzidou

& coworkers

http://neuroinformatics.gr/