word2vec hendrik heuer from theory to practicehen-drik.de/pub/heuer - word2vec - from theory...
TRANSCRIPT
![Page 1: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/1.jpg)
Hendrik HeuerStockholm NLP Meetup
word2vec From theory to practice
![Page 3: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/3.jpg)
–J. R. Firth 1957
“You shall know a word by the company it keeps”
![Page 4: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/4.jpg)
–J. R. Firth 1957
“You shall know a word by the company it keeps”
Quoted after Socher
![Page 5: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/5.jpg)
Quoted after Socher
![Page 6: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/6.jpg)
Quoted after Socher
![Page 7: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/7.jpg)
![Page 8: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/8.jpg)
Vectors are directions in space Vectors can encode relationships
![Page 9: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/9.jpg)
man is to woman as king is to ?
![Page 10: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/10.jpg)
![Page 11: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/11.jpg)
![Page 12: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/12.jpg)
![Page 13: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/13.jpg)
![Page 14: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/14.jpg)
word2vec
• by Mikolov, Sutskever, Chen, Corrado and Dean at Google
• NAACL 2013
• takes a text corpus as input and produces the word vectors as output
![Page 15: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/15.jpg)
Sweden Similar words
![Page 16: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/16.jpg)
Harvard Similar words
![Page 17: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/17.jpg)
word2vec
• word meaning and relationships between words are encoded spatially
• two main learning algorithms in word2vec: continuous bag-of-words and continuous skip-gram
![Page 18: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/18.jpg)
Goal
![Page 19: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/19.jpg)
continuous bag-of-words
• predicting the current word based on the context
• order of words in the history does not influence the projection
• faster & more appropriate for larger corpora
Mikolov et al.
![Page 20: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/20.jpg)
continuous skip-gram
• maximize classification of a word based on another word in the same sentence
• better word vectors for frequent words, but slower to train
Mikolov et al.
![Page 21: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/21.jpg)
Why it is awesome
• there is a fast open-source implementation
• can be used as features for natural language processing tasks and machine learning algorithms
![Page 22: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/22.jpg)
Machine Translation
Quoted after Mikolov
![Page 23: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/23.jpg)
Sentiment Analysis
Quoted after SocherRecursive Neural Tensor Network
![Page 24: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/24.jpg)
Image Descriptions
Quoted after Vinyals
![Page 25: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/25.jpg)
Using word2vec
• Original: http://word2vec.googlecode.com/svn/trunk/
• C++11 version: https://github.com/jdeng/word2vec
• Python: http://radimrehurek.com/gensim/models/word2vec.html
• Java: https://github.com/ansjsun/word2vec_java
• Parallel java: https://github.com/siegfang/word2vec
• CUDAversion: https://github.com/whatupbiatch/cuda-word2vec
Quoted after Wang
![Page 26: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/26.jpg)
Using it in Python
![Page 27: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/27.jpg)
![Page 28: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/28.jpg)
Usage
![Page 29: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/29.jpg)
Training a model
Quoted after Řehůřek
![Page 30: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/30.jpg)
Training a model with iterator
Quoted after Řehůřek
![Page 31: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/31.jpg)
Doing it in C
• Download the code: git clone https://github.com/h10r/word2vec-macosx-maverics.git !
• Run 'make' to compile word2vec tool !
• Run the demo scripts: ./demo-word.sh and ./demo-phrases.sh
![Page 32: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/32.jpg)
Doing it in C
• Download the code: git clone https://github.com/h10r/word2vec-macosx-maverics.git !
• Run 'make' to compile word2vec tool !
• Run the demo scripts: ./demo-word.sh and ./demo-phrases.sh
![Page 33: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/33.jpg)
![Page 34: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/34.jpg)
Testing a model
Quoted after Řehůřek
![Page 35: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/35.jpg)
![Page 36: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/36.jpg)
![Page 37: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/37.jpg)
![Page 38: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/38.jpg)
![Page 39: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/39.jpg)
![Page 40: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/40.jpg)
word2vec t-SNE JSON
1. Find Word Embeddings
2. Dimensionality Reduction 3. Output
![Page 41: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/41.jpg)
word2vec t-SNE JSON
1. Find Word Embeddings
2. Dimensionality Reduction 3. Output
![Page 42: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/42.jpg)
![Page 43: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/43.jpg)
![Page 44: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/44.jpg)
word2vec t-SNE JSON
1. Find Word Embeddings
2. Dimensionality Reduction 3. Output
![Page 45: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/45.jpg)
![Page 46: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/46.jpg)
Should be in Macports py27-scikit-learn @0.15.2 (python, science)
![Page 47: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/47.jpg)
![Page 48: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/48.jpg)
word2vec t-SNE JSON
1. Find Word Embeddings
2. Dimensionality Reduction 3. Output
![Page 49: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/49.jpg)
![Page 50: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/50.jpg)
![Page 51: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/51.jpg)
![Page 52: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/52.jpg)
![Page 53: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/53.jpg)
word2vec From theory to practice
Hendrik HeuerStockholm NLP Meetup
!
Discussion: Can anybody here think of ways
this might help her or him?
![Page 54: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/54.jpg)
Further Reading
• Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. Efficient Estimation of Word Representations in Vector Space. In Proceedings of Workshop at ICLR, 2013.
• Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean. Distributed Representations of Words and Phrases and their Compositionality. In Proceedings of NIPS, 2013.
• Tomas Mikolov, Wen-tau Yih,and Geoffrey Zweig. Linguistic Regularities in Continuous Space Word Representations. In Proceedings of NAACL HLT, 2013.
![Page 55: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/55.jpg)
Further Reading
• Richard Socher - Deep Learning for NLP (without Magic)http://lxmls.it.pt/2014/?page_id=5
• Wang - Introduction to Word2vec and its application to find predominant word senses http://compling.hss.ntu.edu.sg/courses/hg7017/pdf/word2vec%20and%20its%20application%20to%20wsd.pdf
• Exploiting Similarities among Languages for Machine Translation, Tomas Mikolov, Quoc V. Le, Ilya Sutskever, http://arxiv.org/abs/1309.4168
• Title Image by Hans Arp
![Page 56: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/56.jpg)
Further Coding
• word2vechttps://code.google.com/p/word2vec/
• word2vec for MacOSX Maverics https://github.com/h10r/word2vec-macosx-maverics
• Gensim Python Library https://radimrehurek.com/gensim/index.html
• Gensim Tutorialshttps://radimrehurek.com/gensim/tutorial.html
• Scikit-Learn TSNEhttp://scikit-learn.org/stable/modules/generated/sklearn.manifold.TSNE.html
![Page 57: word2vec Hendrik Heuer From theory to practicehen-drik.de/pub/Heuer - word2vec - From theory to...word2vec • by Mikolov, Sutskever, Chen, Corrado and Dean at Google • NAACL 2013](https://reader036.vdocuments.mx/reader036/viewer/2022062603/5f0a62067e708231d42b5dca/html5/thumbnails/57.jpg)
Hendrik HeuerStockholm NLP Meetup
word2vec From theory to practice