multi cultural modal - information and computer scienceungar/sentiment/multi_cultural_modal.pdf ·...
TRANSCRIPT
![Page 1: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/1.jpg)
Cross-lingual SA
Lyle Ungar University of Pennsylvania
![Page 2: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/2.jpg)
Translating sentiment is subtle
2
u Machine translation is not terrible l But cultures us different words
n Hahahahaha l And sometimes have different feelings about the same words
n España
Does ‘well-being’ translate on Twitter?
![Page 3: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/3.jpg)
English-Spanish translation
3
u Label English or Spanish Tweets for l Positive emotion l Engagement l Relationships l Meaning l Accomplishment
u Build models l Translate them and compare
![Page 4: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/4.jpg)
Some words evoke different feelings
4
Meaning Not accomplishment Not meaning Not relationship Not positive emotions
No change
No change
![Page 5: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/5.jpg)
English-Spanish translation
5
u The biggest problem is ‘missing terms’
![Page 6: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/6.jpg)
Translating sentiment is subtle
6
u Cultures are different l La selectividad SAT l Cinco de Mayo 4th of July l Iker Casillas Michael Jordan l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister) friend relationships
![Page 7: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/7.jpg)
Best: train in your target language
7
![Page 8: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/8.jpg)
Twitter is not mono-lingual
8
u English speaking countries differ l behaviour, theatre, mum, boot l 4th of July, GRE, SAT l bloody, brilliant
u Different products differ l Blue, small
u English posts often aren’t pure English l “Low IQ” Facebook users in California l Extreme personality predictions in some states
![Page 9: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/9.jpg)
Domain Adaptation
9
u Structured correspondence learning l Find words associated with pivots in both domains
n Pivots: excellent, awful, … n Associated words:
Biographies, Bollywood, Boom-boxes and Blenders: Domain Adaptation for Sentiment Classification
![Page 10: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/10.jpg)
Domain Adaptation
10
u Structured correspondence learning l Find words associated with pivots in both domains l Θ maps original words to ones in new domain
Biographies, Bollywood, Boom-boxes and Blenders: Domain Adaptation for Sentiment Classification
w weights on original features v weights on projected features – adjust on target domain yi labels
![Page 11: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/11.jpg)
Multimodal SA
Lyle Ungar University of Pennsylania
![Page 12: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/12.jpg)
Images reflect sentiment
12
u How do I feel about the product?
u <show trump posts>
![Page 13: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/13.jpg)
Images reflect personality
13
![Page 14: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/14.jpg)
Image features
14
![Page 15: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/15.jpg)
Deep nets detect face sentiment u Joy, surprise, anger, disgust, fear sadness
15
imagga.com clairifai.com https://www.kairos.com/emotion-analysis-api https://www.microsoft.com/cognitive-services/en-us/emotion-api
![Page 16: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/16.jpg)
16
https://www.kairos.com
![Page 17: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/17.jpg)
Videos reflect sentiment / emotion
17
u Videos (and audio) reveal emotion l http://www.affectiva.com
u Increasingly done with neural nets l Recurrent Neural Networks for Emotion Recognition in Video
![Page 18: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/18.jpg)
Emotion
18
u Phone-based apps
![Page 19: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/19.jpg)
Conclusions
19
u Be very careful about ‘translating’ sentiment u Sentiment in images
l Content extraction often challenging n But color spectra easy to pull
l Pre-trained deep networks give useful features n Faces: smiling, bored, … n Objects: target of the sentiment and how it is viewed
u Sentiment in video – strong but tricky to get
![Page 20: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/20.jpg)
Wrap-up Lyle Ungar, University of Pennsylania
![Page 21: multi cultural modal - Information and Computer Scienceungar/sentiment/multi_cultural_modal.pdf · l Gilipollas, tonto kill, stupid negative emotion (douchebag, fool) l Hermana (sister)](https://reader034.vdocuments.mx/reader034/viewer/2022042416/5f3186156018d34256097751/html5/thumbnails/21.jpg)
Tutorial outline u Core sentiment analysis (SA) methods
l Simple: using lexica (dictionaries) l Aspect-based: using information extraction or parsing
u Machine learning for SA l Unsupervised: open language SA – DLA & LDA l Supervised: regression and deep learning
u SA extensions l Post, person and community: emotion, personality l Multilingual, multimodal
21