Vinnie Saini

Cloud Solution Architect

vasaini@microsoft.com

May 10’ 2017

Vision

• Custom Vision (in preview) - build and refine customized image classifiers - Custom Vision now performs object recognition as well- recognize the precise location of specific objects in images- download Custom Vision models in three formats: TensorFlow, CoreML, and ONNX

• Content Moderator- machine-assisted content moderation and human review tool- text classification to flag potentially adult, racy and offensive content- human review capabilities for text and video moderation insights

• Video Indexer- can now be connected to an Azure account

Unified Speech Services

• Real time speech to text…build voice-triggered smart apps

See it in action

• Real-time speech translation cloud-based automatic translation service based on neural machine translation

(NMT) n customize

• Text-to-speech near real time text to audio, tailor to change the speed of speech, pitch, volume,

and more

➢Speech devices SDK and Speech client SDK in preview by invitation

Support for multiple platforms and different language bindings

Language

• Text Analytics introduces the ability to perform entity identificationand linking from raw text.

- recognizes and disambiguates well-known entities found in text such as people, places, organizations, and more while linking to more information on the web.

• Our Language Understanding (LUIS) service simplifies the speech to intent process with a new integrated offer

See it in action

Knowledge

• QnA Maker is Generally Available on Azure

A service that makes it possible to respond to user's questions in a more natural, conversational way.

• Bot Builder SDKv4 aprovides building blocks to create ever more sophisticated bots from a simple starting point

SearchSearch has been another key area of AI investment: we’re empowering developers to leverage it through multiple search APIs.

• Bing Visual Search, a new service in general availability that lets you harness the capabilities of Bing Search to perform intelligent search by image capabilities, such as searching similar products for a given product (e.g. in retail scenario, wherein user would like to see products similar to the one being considered), identifying barcodes, text, celebrities and many more! We’re also announcing a preview by invite portal for intelligent Visual Search.

Perform smart product search with Bing Visual Search

• Bing Statistics-add-in, an add-in which provides various metrics and rich slicing and dicing capabilities for several Bing APIs

• Bing Custom Search updates including custom image search, custom autosuggest, specific statistics information, instance staging and sharing capabilities;

• The Bing APIs SDK now in general availability.

Cognitive Services LabsTowards next generation AI

Cognitive Services labs : An early look at the emerging Cognitive Services technologies, such as:

• Project Answer Search –automatically retrieve and display commonly known facts and information from across the internet.

• Project URL Preview - informs your users’ social interactions by enabling creation of web page previews from a given URL or flagging adult content to suppress it.

• Project Anomaly Finder - monitor their data over time and detect anomalies by automatically applying a statistical model.

• Project Conversation Learner by invite - build and teach conversational interfaces that learn directly from example interactions. Spanning a broad set of task-oriented use cases, Project Conversation Learner applies machine learning behind the scenes to decrease manual coding of dialogue control logic.

• Project Personality Chat – available soon by invitation– make intelligent agents more complete and conversational by handling common small talk in a consistent tone and fallback responses. Give your agent a personality by choosing from multiple default personas, and enhance it to create a character that aligns with your brand voice.

• Project Ink Analysis – available soon by invitation- provides digital ink recognition and layout analysis through REST APIs. Using various machine learning techniques, the service analyzes the ink stroke input and provides information about the layout and contents of those ink strokes. Project Ink Analysis can be used for a variety of scenarios that involve ink to text as well as ink to shape conversions.

New Bot Builder Tools

• Bot Builder SDK (v4 preview)- Designed for extensibility and modularity

- quickly start with a simple bot design and increase the intelligence (Cognitive Services Language Understanding models and QnAMaker knowledge bases)

- supports coding in 4 languages: C#, JavaScript, Python, and Java

• Improved Bot Framework Emulator (v4 Preview)

• An end-to-end conversational app-centric development workflow

Check for more details

AI LabExploring AI innovations

• A new collection of AI projects designed to enable developers to get started with AI by exploring, experiencing, learning and coding the latest Microsoft AI technology innovations.

http://www.ailab.microsoft.com/

Launching AI for Accessibility

• Microsoft Translator is today empowering people who are deaf or hard of hearing with real-time captioning of conversations.

• Helpicto (turns voice commands into images)

- is enabling children in France with autism to better understand situations and communicate with others.

• Seeing AI and auto alt-text features are helping narrate the world for people who are blind or low vision

Updates to Azure Machine Learning (AML)• Azure ML SDK for Python (Preview)

single control plane API to the data scientist to execute the key AML workflows simple, seamless dispatch and management of scale -jobs on a serverless fabric

that supports a diversity of CPU/ GPU configurations with support for all python compatible frameworks

fully integrated into the AML Experimentation service giving you a single pane of glass for seeing all your team’s experiments, rapidly comparing them side by side, and choosing the models you want to deploy.

• Azure ML Packages for Computer Vision, Financial Forecasting and Text Analytics (Preview)

Rich set of Python pip-installable extensions to Azure ML that accelerate deep learning scenarios

• ML.NETCross-platform open source ML Framework for .NET developers

https://github.com/dotnet/machinelearning.

Project Brainwave (in limited preview)Bringing the power of real-time AI to customers both on the cloud and on the edge

• Integrated with Azure Machine Learning

• Architecture is deployed on a FPGA (field programmable gate array)

• Offers real-time AI calculations at

- competitive cost

- industry’s lowest latency

• Towards ultra-fast image recognition

• Works on TensorFlow…AI calculations using deep neural networks

Azure Lab Services (formerly DevTest Labs) Preview

• Use Azure Lab Services to quickly set up a development, test, hackathon, or lab for your team in the cloud.

• Azure Tutorials, samples, and more show you how to create, manage, and secure labs.

https://docs.microsoft.com/en-us/azure/lab-services/

• Intelligent Retinal Imaging Systems

Preventing blindness

Enlightening Stories