convolutional neural networks for sentence classification
TRANSCRIPT
PowerPoint
Convolutional Neural Networks for Sentence ClassificationYoon KimNew York University
EMNLP 2014:
Word vector CNN Abstract word vector Word2vec vector
Simple CNN 3 filter Convolutional Layer
7 4
NBT All Rights Reserved.
(Sentence Classification) (Sentiment Analysis))
) , 19 , ?
NBT All Rights Reserved.
Word Representations(Embedding) ? ID ( , =ID143, =ID537) ,
Vector (, =[2,6,3,1,4])
NBT All Rights Reserved.
Word2Vec Vector ? !
the quick brown fox jumped over the lazy dog([the, brown], quick), ([quick, fox], brown), ([brown, jumped], fox)
NBT All Rights Reserved.
Word2Vec Vector ? !
https://tensorflowkorea.gitbooks.io/tensorflow-kr/content/g3doc/tutorials/word2vec/
NBT All Rights Reserved.
CNN Word Vector k
n
hn : k : Word Vector h :
Model ArchitecturePage2 Figure1 (Yoon Kim, Convolutional Neural Networks for Sentence Classification, EMNLP 2014)
NBT All Rights Reserved.
Static, Non-static, Multichannelk
n
h
Back Propagationstaticnon-static
multichannel
NBT All Rights Reserved.
Static vs. Non-staticPage5 Table3 (Yoon Kim, Convolutional Neural Networks for Sentence Classification, EMNLP 2014)
Non-static word vector !
NBT All Rights Reserved.
CNN Word Vector
ResultsPage4 Table2 (Yoon Kim, Convolutional Neural Networks for Sentence Classification, EMNLP 2014)
NBT All Rights Reserved.
?
NBT All Rights Reserved.
28 (2016) , , Word2Vec ,
, , , , , 28 (2016)
NBT All Rights Reserved.
2015 CNN Word2Vec , , , ,
, , , , , , 2015
NBT All Rights Reserved.
Q&A [email protected]://github.com/kkb2849
NBT All Rights Reserved.