spikelm: a second-order supervised learning algorithm for training spiking neural networks
DESCRIPTION
Yongji Wang Jian Huang Huazhong University of Sci. & Tech. Wuhan, China. SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks. Overview. Introduction Preliminaries SpikeLM algorithm Experimental validation Conclusions. Introduction. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/1.jpg)
IJCNN, July 27, 2004 [email protected] 1
SpikeLM: A Second-Order Supervised Learning Algorithm
for Training Spiking Neural Networks
Yongji WangJian Huang
Huazhong University of Sci. & Tech.Wuhan, China
![Page 2: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/2.jpg)
IJCNN, July 27, 2004 [email protected] 2
Overview
● Introduction● Preliminaries● SpikeLM algorithm● Experimental validation● Conclusions
![Page 3: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/3.jpg)
IJCNN, July 27, 2004 [email protected] 3
Introduction
● Spiking neural networks get increased attention:● Biologically more plausible ● Computational power not less than traditional ANN
● Main problem: supervised learning algorithms, it is just in its infancy. ● SpikeProp, a grads-descent supervising learning
algorithm
![Page 4: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/4.jpg)
IJCNN, July 27, 2004 [email protected] 4
Preliminaries
● Model of SNN● Originally introduced by Natschläger and Ruf● Every connection consists of several synaptic connections● Each terminal is associated with a different delay and
weight
![Page 5: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/5.jpg)
IJCNN, July 27, 2004 [email protected] 5
Preliminaries
● Model of SNN (continued)● Notations:
● : the set of spiking neurons for the r-th layer;● : the spike firing time from neuron to● : the weight of the m-th terminal between i and j ;● : the delay of the m-th terminal;● : membrane potential of neuron i ;
![Page 6: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/6.jpg)
IJCNN, July 27, 2004 [email protected] 6
Preliminaries
● Model of SNN (continued)● Spiking Response Model (SRM):
● Where is the unweighted contribution of a single synaptic terminal from j to i.
![Page 8: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/8.jpg)
IJCNN, July 27, 2004 [email protected] 8
SpikeLM algorithm
● Training samples:● Note that all inputs and outputs are firing times.● We use and to describe the actual and
desire firing time respectively. ●
![Page 9: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/9.jpg)
IJCNN, July 27, 2004 [email protected] 9
SpikeLM algorithm
● Dynamics equation of the three-layered SNN:
● Vectorial form:
![Page 10: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/10.jpg)
IJCNN, July 27, 2004 [email protected] 10
SpikeLM algorithm
● The performance index:
● To compute the Jacobian matrix, define
![Page 11: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/11.jpg)
IJCNN, July 27, 2004 [email protected] 11
SpikeLM algorithm
● The representation of Jacobian matrix:
where the k,q,r,m,i,j can be easily obtained given h and l.
![Page 12: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/12.jpg)
IJCNN, July 27, 2004 [email protected] 12
SpikeLM algorithm
● Computation of Jacobian matrix:
Sensitivities in SpikeLM
![Page 13: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/13.jpg)
IJCNN, July 27, 2004 [email protected] 13
SpikeLM algorithm
● Computation of Jacobian matrix:● Sensitivities: (output layer) The same way as SpikeProp did
![Page 14: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/14.jpg)
IJCNN, July 27, 2004 [email protected] 14
SpikeLM algorithm
● Computation of Jacobian matrix:● To form sensitivity matrix: (output layer)
where
![Page 15: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/15.jpg)
IJCNN, July 27, 2004 [email protected] 15
SpikeLM algorithm
● Computation of Jacobian matrix:● Sensitivities: (hidden layer)
As SpikeProp did
![Page 17: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/17.jpg)
IJCNN, July 27, 2004 [email protected] 17
SpikeLM algorithm
● Computation of Jacobian matrix:● To form sensitivity matrix: (hidden layer)
![Page 18: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/18.jpg)
IJCNN, July 27, 2004 [email protected] 18
SpikeLM algorithm
● Computation of Jacobian matrix:● The matrix form of computation:
● Define
and
![Page 20: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/20.jpg)
IJCNN, July 27, 2004 [email protected] 20
SpikeLM algorithm
● Computation of Jacobian matrix:● The matrix form of computation:
![Page 22: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/22.jpg)
IJCNN, July 27, 2004 [email protected] 22
SpikeLM algorithm
● Summarize the SpikeLM algorithm:1) Compute the performance index;2) Compute Jacobian matrix via backpropagation method;3) Solve4) Recompute the performance index using . If
the new index is smaller than that computed in step 1, then reduce by , go to 1). Otherwise, increase by and go back to 3).
5) If the convergent condition is met, then stop.
![Page 23: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/23.jpg)
IJCNN, July 27, 2004 [email protected] 23
Experimental validation
● XOR Problem:● We assume the same setup as Bothe did. a “late”
and “early” firing time substitute 0 and 1.● Both SpikeProp and SpikeLM algorithm are applied
to cope with this problem. The convergent rates are compared to illustrate the merit of the latter algorithm.
![Page 24: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/24.jpg)
IJCNN, July 27, 2004 [email protected] 24
Experimental validation
● 4 output spike time examples during learning
![Page 25: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/25.jpg)
IJCNN, July 27, 2004 [email protected] 25
Experimental validation
● Convergence comparison for SpikeProp and SpikeLM
![Page 26: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/26.jpg)
IJCNN, July 27, 2004 [email protected] 26
Experimental validation
● Nonlinear function approximation:● Select a nonlinear function● the values of F(x) are totally normalized into a
interval from 10 to 22.● The approximation curve was obtained after about
200 epochs of learning.
![Page 27: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/27.jpg)
IJCNN, July 27, 2004 [email protected] 27
Experimental validation
● The function approximation by SpikeLM:
![Page 28: SpikeLM: A Second-Order Supervised Learning Algorithm for Training Spiking Neural Networks](https://reader035.vdocuments.mx/reader035/viewer/2022062816/5681587e550346895dc5e012/html5/thumbnails/28.jpg)
IJCNN, July 27, 2004 [email protected] 28
Conclusion
● A second-order supervising learning rule is derived for feedforward spiking neural networks using temporal-coding scheme.
● This procedure is represented by a fairly concise vectorial form, which can be easily implemented by any softwares.
● Elementary tests show the great potential of this algorithm.