from hopfield models to the neural networks toolbox ...mw25/files/mweber_picscie-talk.pdf ·...

19
Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural Networks in Matlab and Applications in Biomedical Research Contact: [email protected] Web: https://web.math.princeton.edu/~mw25/about/

Upload: others

Post on 14-Mar-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Melanie Weber

From Hopfield Models to the Neural Networks Toolbox: Implementing Neural Networks in Matlab and Applications in Biomedical Research

Contact: [email protected]: https://web.math.princeton.edu/~mw25/about/

Page 2: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Outline

❖ Introduction

❖ Matlab’s Neural Networks Toolbox

❖ How to build a Neural Network from scratch

❖ Hopfield Networks and Hebbian Learning

❖ Implementation

❖ Biomedical applications

Page 3: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Introduction: Neural Networks

Page 4: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Outputinput variables

Page 5: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Outputweights

Page 6: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Output

update network states

Page 7: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Output

activation function

Page 8: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Matlab’s Neural Networks Toolbox

Page 9: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Neural Networks ToolboxNetwork Architectures

Supervised UnsupervisedFeedforward Networks

Dynamic Networks

Learning Vector Quantification (LVQ)

- Perceptrons- Backpropagation- Nonlinear Feedforward* Prediction* Pattern Recognition* Fitting nonlinear functions

- Nonlinear Autoregression(NARX)- Recurrent Feedback Models- Hopfield Networks* Spatial-temporal Patterns* Learning & Control

Classification of not linearly separable patterns

Competitive LayersCategorization* Classification tasks* Pattern recognition

Self-organizing Mapstopology-preserving categorization* Classification tasks* Pattern recignition

Page 10: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

How to build a Neural Network from scratch

Page 11: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Hopfield Networks (Hebbian Learning)

Page 12: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Hopfield Networks (Hebbian Learning)

Matlab

Page 13: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Biomedical Application Modeling brain disorders with Hopfield Networks

Page 14: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Focal Axonal Swellings as cause of Brain disorders

Page 15: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Modelling FAS

Page 16: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Distribution of FAS mechanisms

[Weber, Maia, Kutz (2016); submitted]

Page 17: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Implementation with Hopfield Networks

Page 18: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Implementation with Hopfield Networks

Page 19: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Thank you for your attention!

- Questions?