deep learning for everyone season ii (deep nlp!) · nlp applications •applications range...

10

Deep Learning for Everyone Season II (Deep NLP!) Sung Kim <[email protected]> https://hunkim.github.io/ml/ https://www.facebook.com/groups/TensorFlowKR/

Upload: dinhtu

Post on 11-Apr-2018

230 views

Category:

Documents

2 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

Deep Learning for Everyone Season II (Deep NLP!)

Sung Kim <[email protected]>

https://hunkim.github.io/ml/https://www.facebook.com/groups/TensorFlowKR/

Page 2: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

NLP: Natural Language Processing

• Understanding what you are saying/writing

• Several levels of understandings- Syntactic- Semantic

- Meaning (thinking)

• Perfect language understanding is AI-complete

http://cs224d.stanford.edu/

Page 3: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

NLP levels

http://cs224d.stanford.edu/

Page 4: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

NLP Applications

• Applications range from simple to complex:-  Spell checking, keyword search, finding synonyms- Extracting information from websites such as product price, dates, location, people

or company names

•  Classifying, reading level of school texts, positive/negative, sentiment oflonger documents

• Machine translation

• Spoken dialog systems

• Complex question answeringhttp://cs224d.stanford.edu/

Page 5: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

(Tentative) topics

• Chatbots

• NLP vs Deep NLP

• Word2Vec

• NN for NLP

• Recurrent Neural Network

• Recursive Neural Network

• Attention and Memory

Page 6: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

Chatbots

https://techcrunch.com/2016/05/10/facebook-chatbot-analytics/

Page 7: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

Chatbots

http://www.zdnet.co.kr/news/news_view.asp?artice_id=20160523095336

Page 8: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

Chatbot - NLP application

• Extracting information from given text/speech

• Simple dialog systems

• Three simple platforms- Api.ai: Conversational UX Platform

- Wit.ai: Facebook bot NLP processing engine- Amazon Echo (Alexa) skill set

Page 9: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

Prerequisite

• Deep Learning Session 1

• https://hunkim.github.io/ml/

Page 10: Deep Learning for Everyone Season II (Deep NLP!) · NLP Applications •Applications range fromsimple to complex:-Spell checking, keyword search, ﬁnding synonyms-Extracting information

Next

chatbot: Api.ai

CS224d: Deep NLP Lecture 13: Convolutional Neural Networks ...cs224d.stanford.edu/lectures/CS224d-Lecture13.pdf · CS224d: Deep NLP Lecture 13: Convolutional Neural Networks (for

Natural Language Processing (NLP) Applications of …bengioy/ift6266/H13/nlp.pdfNatural Language Processing (NLP) Applications of Deep Learning 1 (taken"from"IPAM/"CIFAR2012"summer"school"on"deep"learning,"with"parts"

Applications - Deep LearningGoodfellow 2016) Natural Language Processing • An important predecessor to deep NLP is the family of models based on n-grams: CHAPTER 12. APPLICATIONS

Applications in NLP - University of Washingtonssli.ee.washington.edu/classes/ee517/notes/nlp-applications.pdf · What is NLP? ! Fundamental goal: deep understand of broad language

List of Deep Learning and NLP Resources - Computer … + +

CS224d: Deep NLP Lecture 12: Midterm Reviewcs224d.stanford.edu/lectures/CS224d-Lecture12.pdf · CS224d: Deep NLP Lecture 12: Midterm Review Richard Socher [email protected]. Overview

Deep Learning: An Introduction from the NLP Perspectivecl.naist.jp/~kevinduh/notes/duh12deeplearn.pdf3 Integrating deep learning into current NLP pipelines In particular: how to handle

Deep Learning for NLP

Introduction to Deep Processing Techniques for NLP

Article A Survey on Bias in Deep NLP

Deep Learning for NLP Review - sentic.net

Stock Prediction Using NLP and Deep Learning

AI, Machine, Deep learning and NLP

Deep Learning for NLP @Noah€¦ · Deep Learning for NLP @Noah: progress, challenges and opportunities Zhengdong Lu ... Deep Matching Models: • Models addressing different aspects

Engineering Intelligent NLP Applications Using Deep Learning – Part 2

Recent advances in Deep Learning for NLP

Deep Learning for NLP without Magic - Richard Socher

An introduction to Deep Learning for NLP - polytechniquekskianis/presentations/dl_for_nlp_2017.pdf · An introduction to Deep Learning for NLP Konstantinos Skianis,Ph.D.Student May05,2017

Natural Language Processing (NLP) Applicationsbengioy/talks/gss2012-YB5-NLP.pdf · Natural Language Processing (NLP) Applications 196 (parts$coming$from$ACL’2012$tutorial$on$Deep$Learning$for$NLP,$with$Richard$

Deep Learning & NLP: Graphs to the Rescue!

CS224d: Deep NLP Lecture 12: Midterm Review · with such semantic relationships could be used to improve many existing NLP applications, such as machine translation, information retrieval

DEEP LEARNING IN (ACTION | NLP) - uni-muenchen.de · DEEP LEARNING IN (ACTION | NLP) Sebastian Ebert CIS, University of Munich June 24, 2015

Shallow & Deep QA Systems Ling 573 NLP Systems and Applications April 9, 2013

List of Deep Learning and NLP Resourcescs- · List of Deep Learning and NLP Resources Dragomir Radev [email protected] May 3, 2017 * Intro +

Socher & Manning's Deep Learning for NLP tutorialnlp.stanford.edu/courses/NAACL2013/NAACL2013-Socher...Socher & Manning's Deep Learning for NLP tutorial

Practical Deep Learning for NLP

Deep Learning for NLP Applications

Question-Answering: Shallow & Deep Techniques for NLP Ling571 Deep Processing Techniques for NLP March 9, 2011 Examples from Dan Jurafsky)

600.465 - Intro to NLP - J. Eisner1 NLP Tasks and Applications

NLP Applications using Deep Learning - GitHub Pages · As a result of their deep understanding, they can produce new knowledge by discovering relationships, solving problems, constructing

Learning Deep Structured Semantic ... - Purdue NLP Group

Deep Adversarial Learning for NLP

Deep Learning for Natural Language processingufal.mff.cuni.cz/~zabokrtsky/fel/slides/lect13-deep-learning-nlp.pdf · Deep Learning in NLP • NLP tasks learn end-to-end using deep

TowardsaDeep and Uniﬁed Understanding of Deep Neural Models in NLP · 2019-05-15 · Towards A Deep and Uniﬁed Understanding of Deep Neural Models in NLP representation (Li et

Deep Learning Architectures for NLP (Hungarian NLP Meetup 2016-09-07)