convolutional neural networks for sentence classification

14
Convolutional Neural Networks for Sentence Classification Yoon Kim New York University EMNLP 2014 발발 : 발발발

Upload: keunbong-kwak

Post on 16-Apr-2017

60 views

Category:

Software


7 download

TRANSCRIPT

PowerPoint

Convolutional Neural Networks for Sentence ClassificationYoon KimNew York University

EMNLP 2014:

Word vector CNN Abstract word vector Word2vec vector

Simple CNN 3 filter Convolutional Layer

7 4

NBT All Rights Reserved.

(Sentence Classification) (Sentiment Analysis))

) , 19 , ?

NBT All Rights Reserved.

Word Representations(Embedding) ? ID ( , =ID143, =ID537) ,

Vector (, =[2,6,3,1,4])

NBT All Rights Reserved.

Word2Vec Vector ? !

the quick brown fox jumped over the lazy dog([the, brown], quick), ([quick, fox], brown), ([brown, jumped], fox)

NBT All Rights Reserved.

Word2Vec Vector ? !

https://tensorflowkorea.gitbooks.io/tensorflow-kr/content/g3doc/tutorials/word2vec/

NBT All Rights Reserved.

CNN Word Vector k

n

hn : k : Word Vector h :

Model ArchitecturePage2 Figure1 (Yoon Kim, Convolutional Neural Networks for Sentence Classification, EMNLP 2014)

NBT All Rights Reserved.

Static, Non-static, Multichannelk

n

h

Back Propagationstaticnon-static

multichannel

NBT All Rights Reserved.

Static vs. Non-staticPage5 Table3 (Yoon Kim, Convolutional Neural Networks for Sentence Classification, EMNLP 2014)

Non-static word vector !

NBT All Rights Reserved.

CNN Word Vector

ResultsPage4 Table2 (Yoon Kim, Convolutional Neural Networks for Sentence Classification, EMNLP 2014)

NBT All Rights Reserved.

?

NBT All Rights Reserved.

28 (2016) , , Word2Vec ,

, , , , , 28 (2016)

NBT All Rights Reserved.

2015 CNN Word2Vec , , , ,

, , , , , , 2015

NBT All Rights Reserved.

Q&A [email protected]://github.com/kkb2849

NBT All Rights Reserved.