demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/fa18 11-711... · properties of neural...
TRANSCRIPT
![Page 1: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/1.jpg)
![Page 2: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/2.jpg)
![Page 3: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/3.jpg)
![Page 4: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/4.jpg)
![Page 5: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/5.jpg)
fesource phrase
target phrase
translation features
Translation Model
f
Language Model
e f
Reranking Model
feature weights
Parallel corpus
Monolingual corpus
Held-out parallel corpus
![Page 6: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/6.jpg)
▪▪▪
▪▪
![Page 7: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/7.jpg)
▪▪▪
▪▪
![Page 8: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/8.jpg)
▪▪
![Page 9: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/9.jpg)
![Page 10: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/10.jpg)
Ilya Sutskever, Oriol Vinyals, Quoc V. Le. 2014. Sequence to Sequence Learning with Neural Networks. Proc. NIPS
Я увидела кОшку
I saw a
<EOS>
cat <EOS>
![Page 11: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/11.jpg)
Ilya Sutskever, Oriol Vinyals, Quoc V. Le. 2014. Sequence to Sequence Learning with Neural Networks. Proc. NIPSKyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, Yoshua Bengio. 2014. On the Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST
Я увидела кОшку
I saw a
<EOS>
cat <EOS>
![Page 12: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/12.jpg)
Ilya Sutskever, Oriol Vinyals, Quoc V. Le. 2014. Sequence to Sequence Learning with Neural Networks. Proc. NIPS
Я увидела кОшку
I saw a
<EOS>
cat <EOS>
![Page 13: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/13.jpg)
Я увидела кОшку
I saw a
<EOS>
cat <EOS>
![Page 14: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/14.jpg)
▪
▪
Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, Yoshua Bengio. 2014. On the Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST
![Page 15: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/15.jpg)
▪
▪
▪
Я увидела кОшку
I saw a
<EOS>
cat <EOS>
![Page 16: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/16.jpg)
▪
▪ Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio. 2015. Neural Machine Translation by Jointly Learning to Align and Translate. Proc. ICLR
▪▪▪▪
▪
![Page 17: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/17.jpg)
![Page 18: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/18.jpg)
![Page 19: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/19.jpg)
![Page 20: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/20.jpg)
![Page 21: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/21.jpg)
![Page 22: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/22.jpg)
![Page 23: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/23.jpg)
![Page 24: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/24.jpg)
▪
![Page 25: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/25.jpg)
![Page 26: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/26.jpg)
![Page 27: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/27.jpg)
![Page 28: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/28.jpg)
![Page 29: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/29.jpg)
![Page 30: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/30.jpg)
![Page 31: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/31.jpg)
![Page 32: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/32.jpg)
▪
▪▪▪
▪▪
▪▪
▪
![Page 33: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/33.jpg)
▪
![Page 34: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/34.jpg)
Minh-Thang Luong, Hieu Pham, Christopher D. Manning. 2015. Effective Approaches to Attention-based Neural Machine Translation. Proc. EMNLP
![Page 35: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/35.jpg)
Minh-Thang Luong, Hieu Pham, Christopher D. Manning. 2015. Effective Approaches to Attention-based Neural Machine Translation. Proc. EMNLP
![Page 36: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/36.jpg)
▪
(Cho et al. 2015)
![Page 37: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/37.jpg)
▪
▪
▪▪
(Cho et al. 2015)
![Page 38: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/38.jpg)
Philipp Koehn, Rebecca Knowles. 2017. Six Challenges for Neural Machine Translation. Proc. WNMT
![Page 39: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/39.jpg)
▪▪▪
▪▪▪▪▪
(Chan et al. 2015)
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention (Xu et al. 2016)
![Page 40: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/40.jpg)
▪▪▪▪
![Page 41: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/41.jpg)
▪▪▪▪
→
![Page 42: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/42.jpg)
▪▪▪▪
→▪▪
▪
![Page 43: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/43.jpg)
▪▪▪▪
→▪▪
▪→
![Page 44: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/44.jpg)
Image thanks to Rico Sennrich
▪▪▪
▪
![Page 45: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/45.jpg)
(Cho 2016)
(Koehn & Knowles 2017)
![Page 46: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/46.jpg)
h
W
softmax
wi
![Page 47: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/47.jpg)
▪▪▪
▪▪
▪▪▪▪
→
![Page 48: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/48.jpg)
▪
▪
Image thanks to Rico Sennrich
![Page 49: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/49.jpg)
![Page 50: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/50.jpg)
![Page 51: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/51.jpg)
▪▪▪▪▪
▪▪▪
![Page 52: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/52.jpg)
Philipp Koehn, Rebecca Knowles. 2017. Six Challenges for Neural Machine Translation. Proc. WNMT
![Page 53: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/53.jpg)
Philipp Koehn, Rebecca Knowles. 2017. Six Challenges for Neural Machine Translation. Proc. WNMT
![Page 54: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/54.jpg)
![Page 55: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/55.jpg)
Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation
Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff
Hughes, Jeffrey Dean
![Page 56: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/56.jpg)
![Page 57: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/57.jpg)
![Page 58: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/58.jpg)
![Page 59: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/59.jpg)
Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
▪▪
▪▪▪▪▪
![Page 60: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/60.jpg)
![Page 61: demo.clab.cs.cmu.edudemo.clab.cs.cmu.edu/11711fa18/slides/FA18 11-711... · Properties of Neural Machine Translation: Encoder-Decoder Approaches. Proc. SSST Я увидела кОшку](https://reader033.vdocuments.mx/reader033/viewer/2022060504/5f1d78f337c78823546b2e4b/html5/thumbnails/61.jpg)
Unsupervised Machine Translation Using Monolingual Corpora Only
Guillaume Lample, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato