![Page 1: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/1.jpg)
![Page 2: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/2.jpg)
Conversations as a Platform: Bots and AI powered by Cloud
Sophie ChanialakiTechnical Evangelist @ Microsoft Hellas
![Page 3: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/3.jpg)
![Page 4: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/4.jpg)
![Page 5: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/5.jpg)
![Page 6: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/6.jpg)
![Page 7: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/7.jpg)
![Page 8: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/8.jpg)
![Page 9: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/9.jpg)
Australian GovernmentDepartment of Human Services
![Page 10: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/10.jpg)
![Page 11: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/11.jpg)
![Page 12: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/12.jpg)
![Page 13: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/13.jpg)
Your conversation logic
Logic
Web service
LUIS
![Page 14: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/14.jpg)
![Page 15: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/15.jpg)
Bot Framework is a Microsoft-operated service and an SDK.
Bot Framework is one of many tools Microsoft offers for building a complete bot.
Others include: LUIS, Speech APIs, Azure, more
![Page 16: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/16.jpg)
Your bot
![Page 17: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/17.jpg)
![Page 18: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/18.jpg)
Your bot code
EntityExtractionSpeech
Bot Clipboard w entities
Natural Language Translation
+ Intelligent Services
Bing Knowledge
UserPreference
s
Image Intelligenc
e
…
Message input <> outputState Management
Bot Connector Service
Conversation Canvas/Channels
………
Other services, APIs,Databases, Azure Machine
Learning, Azure Search, etc…
Bot Builder SDK
Web Chat
Direct Line…
GroupMe
Kik
Skype
Slack
Telegram
Twilio (SMS)
An x-ray of a typical bot
Bot Builder SDK
Your code goes here
![Page 19: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/19.jpg)
![Page 20: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/20.jpg)
![Page 21: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/21.jpg)
![Page 22: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/22.jpg)
![Page 23: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/23.jpg)
Microsoft Cognitive Services
From faces to feelings, allow your apps to understand images and video
Hear and speak to your users by filtering noise, identifying speakers, and understanding intent
Process text and learn how to recognize what users want
Tap into rich knowledge amassed from the web, academia, or your own data
Access billions of web pages, images, videos, and news with the power of Bing APIs
![Page 24: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/24.jpg)
Computer Vision API
Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }]
V1: [{ "name": "grass", "confidence": 0.9999992847442627 },
{ "name": "outdoor", "confidence": 0.9999072551727295 },
{ "name": "cow", "confidence": 0.99954754114151 },{ "name": "field", "confidence": 0.9976195693016052 },
{ "name": "brown", "confidence": 0.988935649394989 },
{ "name": "animal", "confidence": 0.97904372215271 },
{ "name": "standing", "confidence": 0.9632768630981445 },
{ "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" },
{ "name": "wire", "confidence": 0.8946959376335144 },
{ "name": "green", "confidence": 0.8844101428985596 },
{ "name": "pasture", "confidence": 0.8332059383392334 },
{ "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" },
{ "name": "grassy", "confidence": 0.48627158999443054 },
{ "name": "lush", "confidence": 0.1874018907546997 },
{ "name": "staring", "confidence": 0.165890634059906 }]
Describe0.975 "a brown cow standing on top of a lush green field“
0.974 “a cow standing on top of a lush green field”
0.965 “a large brown cow standing on top of a lush green field”
![Page 25: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/25.jpg)
![Page 26: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/26.jpg)
{“entities”: [
{“entity”: “flight_delays”,“type”: “Topic”
}],“intents”: [
{“intent”: “FindNews”,“score”: 0.99853384
},{“intent”: “None”,“score”: 0.07289317
},{“intent”: “ReadNews”,“score”: 0.0167122427
},{“intent”: “ShareNews”,“score”: 1.0919299E-06
}]
}
“News about flight delays”
Language Understanding Models
![Page 27: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/27.jpg)
LUIS.ai• Language Understanding Intelligence Service• Identify entities and intents of messages• Train through GUI or programmatically• Built in LUIS intent handling in bot framework
![Page 28: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/28.jpg)
Reduce labeling effort with interactive featuringSeamless integration to Speech APIDeploy using just a few examples with active learningSupports 5 languages (English, Chinese, Italian, French, Spanish)
Language Understanding Models
![Page 29: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/29.jpg)
1. Obtain API subscription key from microsoft.com/cognitive
2. Call REST endpoint, and pass API key via special header
GET https://bingapis.azure-api.net/v5/search?q=nasa HTTP/1.1
OCP-Apim-Subscription-Key: <API KEY>
Accessing the APIs
![Page 30: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/30.jpg)
![Page 31: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/31.jpg)
A bot with a single dialog using 100 LUIS intents is a bad design:
Hello user! How can I help you?
One question
100 LUIS intents, * 100 different utterances per intent = 10000 different things users may say (plus the other 90000 possibilities you didn’t predict)
100 different things your bot can do
Users will only guess 3 or so
So you just wasted 97% of your code
![Page 32: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/32.jpg)
So instead:
Hello user! How can I help you?
Events
Stages
Amenities
What events are you interested in?
Music
Comedy
Film
Laser Dome
Spectacles
Theater
What music would you like? (by the way, next time you could just type “I’m looking for a song named xyz” and I will know what to do)
• Guide the user• Save time• Help the user discover what your bot can do
![Page 33: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/33.jpg)
![Page 34: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/34.jpg)
![Page 35: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/35.jpg)
![Page 36: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/36.jpg)
![Page 37: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/37.jpg)
• Users are often terrible at using search on web
• Add search to a bot and now you have a great tool to guide the user into refining their search• Knowledge base, informational, Q&A bots are great scenarios. They typically use QnA Maker and
Azure Search for it
![Page 38: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/38.jpg)
![Page 39: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/39.jpg)
• Even if standard channels can’t do it, you can always build your own UI/App/Web• Think richer UIs with bots. It is all possible
![Page 40: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/40.jpg)
They separate concerns and organize flows, exactly the same way:
![Page 41: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/41.jpg)
![Page 42: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/42.jpg)
![Page 43: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/43.jpg)
This is how we know how to navigate “back”
![Page 44: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/44.jpg)
![Page 45: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/45.jpg)
![Page 46: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/46.jpg)
•••
![Page 47: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/47.jpg)
https://dev.botframework.com/
https://github.com/Microsoft/BotBuilder
https://blog.botframework.com/
https://channel9.msdn.com/Blogs/raw-tech/Build-Reaction-Cortana-and-the-Bot-Framework
https://channel9.msdn.com/Shows/Cloud+Cover/Episode-206-Bot-Framework-with-Mike-Hall
![Page 48: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/48.jpg)
http://aka.ms/bf-bc-vstemplate
https://github.com/Microsoft/BotBuilder
https://github.com/ActiveNick/TheMakerShowBot
![Page 49: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/49.jpg)
![Page 51: Conversations as a Platform: Bots - Microsoft · Conversations as a Platform: Bots and AI powered by Cloud Sophie Chanialaki. Technical Evangelist @ Microsoft Hellas. Australian Government](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd74371eba9023a6459ba2/html5/thumbnails/51.jpg)
Thank You