![Page 1: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/1.jpg)
Transfer LearningHow new technology is enabling Natural Language
Understanding for multilingual text, domain jargon, and slang.
Dr. Catherine Havasi, LuminosoIlluminate the unknown in your data
www.luminoso.com
![Page 2: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/2.jpg)
Artificial intelligence seems poised to change every aspect of our world.
Illuminate the unknown in your datawww.luminoso.com
![Page 3: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/3.jpg)
The future of user interfaces is
conversational.
Siri and other systems have opened the
door.
Illuminate the unknown in your datawww.luminoso.com
![Page 4: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/4.jpg)
Advances have transformed language understanding.
1960sPattern Matching
& Keywords
1990sRule Sets & Ontologies
2000sUnsupervised
ML (Bayes)Word Embeddings(“Deep Learning”)
2010s
Illuminate the unknown in your datawww.luminoso.comPhoto by: Wing-Chi Poon CC BY-SA 2.5.
![Page 5: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/5.jpg)
Photo by: Johnny One Speed, CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
Accenture projects that the market value of the artificial intelligence industry will
rise to $2.1 trillion in Japan by 2035.
![Page 6: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/6.jpg)
Accomplishments of deep learning systems have shown the business and end users the power and ease of automation that artificial intelligence can
bring.
Illuminate the unknown in your datawww.luminoso.com
![Page 7: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/7.jpg)
Deep learning focuses on finding patterns in its input data
at a sophistication and scale that hasn’t been done before.
Photo by: Steve Evans CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 8: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/8.jpg)
In 2013, Google popularized a type of machine learning called word embeddings that applied the power of deep
learning to natural language understanding.
Photo by: Steve Evans CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 9: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/9.jpg)
Could this be the keyto language understanding?
Photo by: Petar Milošević CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 10: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/10.jpg)
For natural language understanding to be successful, it must be:
Multilingual &Global
Explainable Unbiased &Ethical
Adaptable Automated
Illuminate the unknown in your datawww.luminoso.com
![Page 11: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/11.jpg)
The flaw in deep learning is that it requires more data, time, and compute than is
practical in most circumstances.
Illuminate the unknown in your datawww.luminoso.com
![Page 12: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/12.jpg)
Training a deep learning system can take
hundreds of millions or billionsof points of data.
Photo by: Karl E. Jorgensen CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 13: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/13.jpg)
This data is needed because the model must learn from scratch each time it learns anything.
This isn’t how people work.
Photo by: Carl Hoffman
Illuminate the unknown in your datawww.luminoso.com
![Page 14: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/14.jpg)
Imagine understanding the way the public & experts tasters talk about chocolate.
Photo by: leasqueaky CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
There would not be enough data for a deep learning system to understand chocolate.
![Page 15: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/15.jpg)
This is worse for financial services, healthcare, and other jargon-heavy fields.
Photo by: Anna Dziubinska CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 16: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/16.jpg)
Transfer learning helps apply what they learned in one context
to another context.
Photo by: Bill Evans/United States Air Force Academy.
Illuminate the unknown in your datawww.luminoso.com
![Page 17: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/17.jpg)
“Transfer learning will be … the next driver of
ML commercial success.”
– Andrew Ng 2016
Illuminate the unknown in your datawww.luminoso.com
![Page 18: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/18.jpg)
Transfer learning is what powers the app on your phone that makes it look like your cat
was painted by Picasso.
Photo by: Gene KoganIlluminate the unknown in your data
www.luminoso.com
![Page 19: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/19.jpg)
Photo by: Chris Rodley
Illuminate the unknown in your datawww.luminoso.com
Or imagining what would happen if a book of dinosaurs was painted with flowers
instead of scales.
![Page 20: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/20.jpg)
Transfer learning helps self-driving cars learn from simulation or generalize from
dangerous situations.
Photo by: Google Research Blog
Illuminate the unknown in your datawww.luminoso.com
![Page 21: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/21.jpg)
We’ve used transfer learning to help computers understand under-
resourced languages.
Illuminate the unknown in your datawww.luminoso.comPhoto by: Koenders VrkiezingCC BY-SA 3.0.
![Page 22: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/22.jpg)
It’s beginning to work for voice and video…
Illuminate the unknown in your datawww.luminoso.com
Photo by: UniversityofErlangen-Nuremberg
And its future implications are unpredictable!
![Page 23: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/23.jpg)
Why does domain specificity matter for business?
Photo by: Steve Hobson CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 24: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/24.jpg)
“�������' %!" (������������ #&$(���������������)”
Illuminate the unknown in your datawww.luminoso.com
![Page 25: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/25.jpg)
CPG: Colors Matter
CASE STUDY
Finding the right color of a consumer toiletry product drove sales and customer brand loyalty –
even for men.
Photo by: leasqueaky CC BY-SA 4.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 26: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/26.jpg)
Technology: Language of Gaming
CASE STUDY Learning the ever-changing
language of online gaming
enables prioritization of bug fixes in new
releases.
Photo by: Tore Saetre CC BY-SA 4.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 27: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/27.jpg)
What do we do at Luminoso?
27Illuminate the unknown in your data
www.luminoso.com
![Page 28: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/28.jpg)
We are transforming the contact center using our experience with transfer learning in the
enterprise.
Photo by: MAV Zrt CC BY-SA 3.0.Illuminate the unknown in your data
www.luminoso.com
![Page 29: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/29.jpg)
We work in the technology/mobile, consumer finance, retail, and marketing verticals.
Illuminate the unknown in your datawww.luminoso.com
Photo by: Colin CC BY-SA 3.0.
![Page 30: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/30.jpg)
We can automate discovering the reasons people call a contact center with 80-90% alignment with people…
…in 15 minutes instead of 4 months.
Illuminate the unknown in your datawww.luminoso.comPhoto by: Erika Aya Eiffel CC BY-SA 3.0.
![Page 31: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/31.jpg)
We have built building models of how people think about the world in 70 languages – called ConceptNet.
Luminoso’s machine learning lets computers not start from scratch and bring a digital intuition of ConceptNet to natural
language understanding.
Illuminate the unknown in your datawww.luminoso.com
![Page 32: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/32.jpg)
We’ve been using transfer learning in production for seven years to help brands and agencies do better market research.
Illuminate the unknown in your datawww.luminoso.com
Transfer learning is often referred to as “emerging technology”.
Photo by: Tommy Tang CC-BY-SA 3.0.
![Page 33: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/33.jpg)
Our transfer learning is so accurate, it can outperform Facebook’s Spanish deep
learning model with no Spanish training data.
Photo by: Sanbernar CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
(This claim is externally verified.)
![Page 34: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/34.jpg)
Our software works natively in Japanese. We also do Chinese, Korean, and ten additional languages.
Photo by: Aotearoa CC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com
![Page 35: Luminoso BDAT 10.17 Transfer Learning · Transfer Learning How new technology is enabling Natural Language Understanding for multilingual text, domain jargon, and slang. Dr. Catherine](https://reader033.vdocuments.mx/reader033/viewer/2022042012/5e72dfffca4fc77c772ffd03/html5/thumbnails/35.jpg)
Illuminate the unknown in your datawww.luminoso.com
Thank you so much for listening to my talk!
I’m here with my colleagues who would love to talk to you about your business problems or about machine learning on
Japanese text!
Photo by: Lisa TancsicsCC BY-SA 3.0.
Illuminate the unknown in your datawww.luminoso.com