#3 global ai meetup (nlp) - Станислав Гафаров, mrbot
TRANSCRIPT
![Page 1: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/1.jpg)
QnA bot. Experience
![Page 2: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/2.jpg)
http://www.slideshare.net/YuriyGuts/natural-language-processing-nlp
1
![Page 3: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/3.jpg)
Standards in QA systemsRule-based systems
https://www.researchgate.net/publication/235923461_QArabPro_A_Rule_Based_Question_Answering_System_for_Reading_Comprehension_Tests_in_Arabic 2
![Page 4: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/4.jpg)
Standards in QA systemsBag of words
http://www.slideshare.net/hadyelsahar/word-embedings-why-the-hype-55769273
3
![Page 5: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/5.jpg)
Bag of words + TF-IDF
http://www.slideshare.net/hadyelsahar/word-embedings-why-the-hype-55769273
Standards in QA systems
4
![Page 6: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/6.jpg)
Word embedding
https://blog.heuritech.com/2016/04/11/report-of-the-heuritech-deep-learning-meetup-6-with-yann-lecun/
Standards in QA systems
5
![Page 7: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/7.jpg)
1D Convolutional neural network
http://www.wildml.com/2015/12/implementing-a-cnn-for-text-classification-in-tensorflow/
Standards in QA systems
6
![Page 8: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/8.jpg)
Recurrent Neural Network
Standards in QA systems
http://karpathy.github.io/2015/05/21/rnn-effectiveness/7
![Page 9: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/9.jpg)
Standards in QA systems
8
![Page 10: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/10.jpg)
Main problems 1) Limited data
9
![Page 11: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/11.jpg)
Main problems2) Difference between train dataset and “real life”
10
![Page 12: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/12.jpg)
Main problems3) “I don't know” answers
11
![Page 13: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/13.jpg)
Main problems 4) Quality metrics
https://arxiv.org/pdf/1603.08023v2.pdf12
![Page 14: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/14.jpg)
Main problems5) Model degradation and “refitting model”
13
![Page 15: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/15.jpg)
Main problems 6) Trash questions
Where is the nearest library?14
![Page 16: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/16.jpg)
One more thing...
Russian language parser
Word embedding API (word2vec, Glove)
Solutions for business
15
![Page 17: #3 Global AI Meetup (NLP) - Станислав Гафаров, MrBot](https://reader034.vdocuments.mx/reader034/viewer/2022042722/58aa33981a28abbb108b5ec9/html5/thumbnails/17.jpg)
Наши
кейсы
From Russia with love