2806 neural computation recurrent neetworks lecture 12 2005 ari visa

Download 2806 Neural Computation Recurrent Neetworks Lecture 12 2005 Ari Visa

Post on 21-Dec-2015

214 views

Category:

Documents

2 download

Embed Size (px)

TRANSCRIPT

  • Slide 1
  • 2806 Neural Computation Recurrent Neetworks Lecture 12 2005 Ari Visa
  • Slide 2
  • Agenda n Some historical notes n Some theory n Recurrent networks n Training n Conclusions
  • Slide 3
  • Some Historical Notes The recurrent network : Automata Studies, Kleene 1954 Kalman filter theory (Rudolf E. Kalman, 1960) Controllability and observability (Zadeh & Desoer, 1963) (Kailath, 1980), (Sontag, 1990), (Lewis & Syrmos, 1995) The NARX model (Leontaritis & Billings 1985) The NARX model in the context of neural networks (Chen et al, 1990) Recurrent network architectures (Jordan 1986) Olin and Giles (1996) showed that using second-order recurrent networks the correct classification of temporal sequences of finite length is quaranteed.
  • Slide 4
  • Some Historical Notes n The idea behind back-propagation through time (Minsky & Papert, 1969), Werbos (1974), Rumelhart (1986). n The real-time recurrent learning algorithm (Williams & Zipser, 1989)