keepr presentation at mit cmsw
DESCRIPTION
audio and live blog notes http://cmsw.mit.edu/liveblog-hong-qu-keepr/TRANSCRIPT
![Page 1: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/1.jpg)
KeeprAlgorithm for Extracting Entities, Eyewitnesses and Amplifiers
Hong QuSeptember 19, 2013
![Page 2: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/2.jpg)
![Page 3: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/3.jpg)
http://twitpic.com/135xahttps://twitter.com/jkrums/status/1121915133
![Page 4: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/4.jpg)
http://www.telegraph.co.uk/technology/twitter/4269765/New-York-plane-crash-Twitter-breaks-the-news-again.html
![Page 5: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/5.jpg)
http://www2.sims.berkeley.edu/courses/is290-2/f04/sched.html
![Page 6: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/6.jpg)
![Page 7: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/7.jpg)
https://twitter.com/hqu/status/1745171763
![Page 8: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/8.jpg)
![Page 9: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/9.jpg)
![Page 10: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/10.jpg)
![Page 11: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/11.jpg)
![Page 12: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/12.jpg)
![Page 13: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/13.jpg)
![Page 14: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/14.jpg)
![Page 15: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/15.jpg)
![Page 16: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/16.jpg)
![Page 17: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/17.jpg)
![Page 18: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/18.jpg)
![Page 19: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/19.jpg)
![Page 20: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/20.jpg)
![Page 21: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/21.jpg)
![Page 22: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/22.jpg)
![Page 23: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/23.jpg)
![Page 24: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/24.jpg)
![Page 25: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/25.jpg)
Humans vs Machines
Pattern RecognitionValue Judgment
![Page 26: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/26.jpg)
Computers count really, really fast!
![Page 27: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/27.jpg)
What is a Tweet?
140 characters:● words● @user mentions● #hashtags● links
![Page 28: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/28.jpg)
Hows does Keepr process tweets?
140 character * 100 tweets = 14,000 characters
❏ Parse it❏ Count it❏ Visualize it❏ Zoom in❏ Archive it
![Page 29: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/29.jpg)
https://canvas.instructure.com/courses/812708/assignments/syllabus
Natural Language Processing
![Page 30: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/30.jpg)
![Page 31: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/31.jpg)
Humans are way better at at making value judgements and telling stories
![Page 32: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/32.jpg)
Social media and the Boston bombings: When citizens and journalists cover the same story
![Page 33: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/33.jpg)
Keepr’s Algorithm➔ Entity extraction
◆ Topics
➔ Media extraction◆ images, videos
➔ Link expansion◆ articles
➔ Conversation analysis◆ @ mentions
◆ source discovery
◆ amplification velocity
➔ Source verification◆ geo-location
◆ social media profiles
![Page 34: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/34.jpg)
Topic Extraction by Term Frequency
http://trimc-nlp.blogspot.com/2013/04/tfidf-with-google-n-grams-and-pos-tags.html
![Page 35: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/35.jpg)
https://twitter.com/hqu/stawww.cs.cornell.edu/home/kleinber/bhs.pdftus/1745171763
![Page 36: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/36.jpg)
Journalists want
❏ Source discovery and curation
❏ Passive monitoring and alerts
❏ Saving and archiving
❏ Visualizations
❏ Parity with TweetDeck user interface
![Page 37: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/37.jpg)
People want
“I want to catch up with a summary of key information about the breaking news story.”
I want to get a list of Twitter accounts who are official organizations related to that story.
![Page 39: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/39.jpg)
![Page 40: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/40.jpg)
What’s next for keepr?
➔ refine algorithm➔ source classification➔ conversation analysis and visualization➔ archiving search results and tweets
Rolling out a Beta program for newsroomsSign up at www.keepr.com/beta
![Page 43: Keepr presentation at MIT CMSW](https://reader033.vdocuments.mx/reader033/viewer/2022042613/53fed5dc8d7f72965c8b46a3/html5/thumbnails/43.jpg)
Verification Resources
● Verifying Social Media Content● verificationjunkie.tumblr.com● BBC processes for verifying social media content● Storyful’s validation process● InformaCam