August 31, 2016

Rajiv shahRajivShah.com

rshahATpobox.comgithub.com/rajshah4/

rajcs4

Teaching Recurrent Neural

Networks using Tensorflow 

• why• theory/app - deep learning• theory/app - recurrent neural

networks

why?

http

://g

oogl

eres

earc

h.bl

ogsp

ot.c

om/2

015/

11/c

ompu

ter-

resp

ond-

to-t

his-

emai

l.htm

l

smart reply

http

s://

rese

arch

.goo

gleb

log.

com

/201

6/08

/tex

t-su

mm

ariz

atio

n-w

ith-

tens

orflo

w.ht

ml

text summarization

http

://b

log.

kagg

le.c

om/2

016/

01/0

4/ho

w-m

uch-

did-

it-r

ain-

ii-w

inne

rs-i

nter

view

-1st

-pla

ce-p

upa-

aka-

aaro

n-si

m/

kaggle

http

s://

mag

enta

.ten

sorfl

ow.o

rg/2

016/

07/1

5/lo

okba

ck-r

nn-a

tten

tion

-rnn

/

music

theory: deep learning

http

://p

layg

roun

d.te

nsor

flow.

org/

feature rich model

http

://p

layg

roun

d.te

nsor

flow.

org/

deep learning model

http

://c

s231

n.gi

thub

.io/n

eura

l-ne

twor

ks-1

/

deep learning

theory: operation

Recurrent

recurrent neural network

http

://c

olah

.git

hub.

io/p

osts

/201

5-08

-Und

erst

andi

ng-L

STM

s/

rnn: rolled out

10 22310+3+22

demo: char-rnn

http

://c

s.st

anfo

rd.e

du/p

eopl

e/ka

rpat

hy/r

ecur

rent

js/

theory ii: cells

http

://c

olah

.git

hub.

io/p

osts

/201

5-08

-Und

erst

andi

ng-L

STM

s/

rnn cell

vanish gradients

http

://g

oogl

eres

earc

h.bl

ogsp

ot.c

om/2

015/

11/c

ompu

ter-

resp

ond-

to-t

his-

emai

l.htm

l

http

://c

olah

.git

hub.

io/p

osts

/201

5-08

-Und

erst

andi

ng-L

STM

s/

long short term memory (LSTM)

long short term memory

http

s://

gith

ub.c

om/r

ajsh

ah4/

tens

orflo

w_s

hiny

demo: sine wave

theory iii: architecture

rnn architecture

rnn architecture:one to many

rnn architecture:one to many

rnn architecture:many to many

(array([[7], [4], [1], [8], [0], [3], [1], [5], [6], [9], [2], [0], [0], [0], [0]]), 46.0)

demo: addition

http

://p

roje

cts.

rajiv

shah

.com

/blo

g/20

16/0

4/05

/rnn

_add

itio

n/

generative

demo: basketball trajectories

http

://t

inyu

rl.c

om/t

raj-

rnn

demo: handwriting

http

://w

ww.

cs.t

oron

to.e

du/~

grav

es/h

andw

riti

ng.h

tml

• rnn’s have value• lots of good examples you can

use as a starting point in building an rnn

http

s://

rese

arch

.goo

gleb

log.

com

/201

6/08

/tex

t-su

mm

ariz

atio

n-w

ith-

tens

orflo

w.ht

ml

text summarization

August 31, 2016

Rajiv shahRajivShah.com

rshahATpobox.comgithub.com/rajshah4/

rajcs4

Teaching Recurrent Neural

Networks using Tensorflow