ibm bluemix paris meetup #27 20171219 - introduction to nlp with recast.ai
TRANSCRIPT
![Page 3: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/3.jpg)
Collaborative end-to-end bot platform
BUILD CONNECT MONITOR TRAIN
![Page 4: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/4.jpg)
1950: Turing Test (“Computing Machinery and Intelligence” / Alan Turing)
Historic Background
50’s-60’s: Machine translation to be reality in three to five years (Georgetown experiment)
60’s-80’s: NLP systems based on hard rules, some quite impressive!
![Page 5: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/5.jpg)
80’s-90’s: Machine learning for NLP, starting with simple algorithms (decision trees)
Historic Background
90’s-2000’s: Increasingly statistical models are used (starting with HMM for POS tagging)
2000’s-today: Neural Networks added to the mix
![Page 6: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/6.jpg)
NLU over translation Written over spoken Chatbots and Recast.AI
This Talk
![Page 7: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/7.jpg)
State of the Art Intents Entities Skills
![Page 8: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/8.jpg)
Intents Subject of communication
Entities Important objects
Skills Take action
![Page 9: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/9.jpg)
greetings
I have no internet 4G doesn’t work No signal at my place
report-issue weather
![Page 10: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/10.jpg)
report-issue greetings
I have no internet 4G doesn’t work No signal at my place
weather
![Page 11: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/11.jpg)
report-issue greetings
I have no internet 4G doesn’t work No signal at my place
weather
![Page 12: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/12.jpg)
report-issue greetings
I have no internet 4G doesn’t work No signal at my place
weather
- Where are you located?
![Page 13: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/13.jpg)
Powered by Machine Learning
![Page 14: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/14.jpg)
Code
ML
data answers
rules
answers
data rules data answers
![Page 15: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/15.jpg)
Supervised Unsupervised
![Page 16: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/16.jpg)
Classification Regression
![Page 17: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/17.jpg)
Preprocessing Be Prepared!
![Page 18: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/18.jpg)
J’ai envie d’une pizza aujourd’hui
J’ai envie d’une pizza aujourd’hui (fr)
J ’ ai envie d ’ une pizza aujourd’hui (fr) PRON
VERB
NOUN
ADP
DET
ADV
J ’ ai envie d ’ une pizza aujourd’hui (fr)
![Page 19: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/19.jpg)
Intent Classification
![Page 20: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/20.jpg)
Naive Bayes
Bayes’ Rule: P(i|w) = P(w|i)P(i)/P(w)
‘Sparse’ approach
L’enfant a mangé un poisson
Un poisson a mangé l’enfant
No context management
![Page 21: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/21.jpg)
Neural Networks
Words are represented densely in an n-dimensional space
Representations are learned through context
Main problem: How to represent sentences?
vct(Berlin) - vct(Germany) + vct(France) = vct(Paris)
![Page 22: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/22.jpg)
SVM
RNNs (LSTM/GRU/QRNN/...)
Bi-LSTM with Attention
What’s more?
Siamese Networks
![Page 23: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/23.jpg)
Named Entity Recognition
![Page 24: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/24.jpg)
Named Entity Recognition Sequence Labeling
![Page 25: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/25.jpg)
I have no in yesterday since internet Nancy
![Page 26: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/26.jpg)
I have no in yesterday since internet Nancy
O O O CONNECTION O LOCATION O DATETIME
![Page 27: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/27.jpg)
? ? ? ? ? ? ? ?
I have no in yesterday since internet Nancy
![Page 28: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/28.jpg)
? ? ? ? ? ? ? ?
I have no in yesterday since internet Nancy
PERSON
LOCATION
![Page 29: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/29.jpg)
? ? ? ? ? ? ? ?
I have no in yesterday since internet Nancy
LOCATION
![Page 30: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/30.jpg)
Hidden Markov Chains
![Page 31: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/31.jpg)
SSVM
CRF
RNN (LSTM/GRU/QRNN/...)
What’s more?
![Page 32: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/32.jpg)
Entity Enrichment
![Page 33: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/33.jpg)
I have no internet in Nancy since yesterday
{
canonical: …
value: …
}
{
formatted: …
lat: …
lng: …
}
{
formatted: …
iso: …
accuracy: …
}
![Page 34: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/34.jpg)
Dialog Management
![Page 35: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/35.jpg)
Markov Decision Process Finite State Architecture Frame Based
![Page 36: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/36.jpg)
User Initiative Greetings
System Initiative Payment
Mixed Initiative QA/Track/Order
![Page 37: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/37.jpg)
Wrap Up
![Page 38: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/38.jpg)
ML and NLP as engine behind chatbots
A chatbot is built on many ML tasks
Different algorithms fit different tasks
Recast.AI as an end-to-end chatbot development platform
![Page 39: IBM Bluemix Paris Meetup #27 20171219 - Introduction to NLP with Recast.ai](https://reader031.vdocuments.mx/reader031/viewer/2022030318/5a6552c27f8b9a10228b4a0d/html5/thumbnails/39.jpg)
Questions?