sa discover text webinar
DESCRIPTION
TRANSCRIPT
Unlock the Power of Text: New Analysis Options via DiscoverTextA presentation byDr. Stu ShulmanTexifter, LLC
and
Esther LaVielle from Survey Analytics
What We’ll Cover
ABOUT The Presenters Hot Trend: DIY Text Analysis 5 Steps: Getting
Started with Text Analysis DiscoverText –
Simple Tools To Uncovering The Power of Words
Example Included Q&A / Conclusion
About Survey Analytics
• Started back in 2002 in Seattle, WA • #172 out of 500 fastest growing private
companies • 6,000 + clients & growing
• SurveyAnalytics, QuestionPro, IdeaScale, MicroPoll, SurveySwipe, SurveyPocket, BadgeFarm
• Esther LaVielle: Chief Education Director
Stuart Shulman is: – Assistant professor of political science at
the University of Massachusetts Amherst– Founder & CEO, Texifter, LLC– Founder & Director, QDAP-UMass– Editor-in-Chief, Journal of Information
Technology & Politics.Fun fact: Stu is garlic growing enthusiast with a popular YouTube channel on growing garlic!
About Dr. Stu Shulman
• Texifter products help index, search, filter and classify large amounts of text.
–Market research, eDiscovery & extraction of key insights
–Large & diverse enterprise data sets
–Social media search and archival services
–Peer group and crowd sourced collaboration
–Credential-based, cross-organizational work groups
DiscoverText: http://discovertext.com
About Texifter, LLC.
HOT TRENDS: DIY TEXT
ANALYTICS
Hot Trends: DIY Text Analysis
http://blogs.forrester.com/leslie_owens/10-12-20-text_analytics_a_key_trend_to_watch_over_the_next_three_years
Forrester Research named text analytic technologies one of top 15 trends to watch the next 3 years!
Used to:• Mine, interpret & structure information to reveal hidden patterns &
relationships.• Reveal the voice of customers, conduct competitive intelligence, make
operations improvements, & achieve better compliance or law enforcement.
Techniques:• Analytics and search: Analytics tools surface and visualize patterns• Analytics and information retrieval: Content professionals use text analytic
tools to identify duplicate, near-duplicate, similar or irrelevant content• Social network analysis: focused on identifying and forecasting connections,
relationships, and influence among individuals and groups.
• Identify & categorize high-frequency
words, themes or concepts• Review recurring phrases & associations
of words (build topic models)
• Present open-ended text findings via
charts or tag clouds
Hot Trend: DIY Text Analysis
Code & analyze unstructured text data from:
- Surveys- Social network sites or Twitter- Blogs- Anywhere really!
Pros:-Cut down the costs of coding-Control your dataCons:Which one to choose?What is the learning curve?
1) Clean and organize the data (format, edit, spelling, etc.) 2) Translate survey data to uniform language (if needed) 3) Segment it by metadata properties and categories 4) Label & bookmark interesting items
5) Look for obvious patterns, for example frequency counts, tag clouds, repetition, idiosyncratic ideas, punctuation or grammar used for emphases.
5 Steps: Getting Started with Text Analysis
Unify Your Data
Files Web
Import & archive data from multiple sources into a single, searchable, unified repository
SurveyAnalytics & DiscoverText
SurveyAnalytics is compatible with DiscoverText softwareExport an XML report & Login to http://discovertext.com/ to get started!
Login to DiscoverText
The DiscoverText Dashboard
From the DiscoverText dashboard, create a new project or work on an existing one
Select the “Import Data” option from the Manage Project screen or Archives Screen
Your DiscoverText Project
Select the “Survey Analytics Export” file type
Select Your File Type
Select your data file and click “Upload”
Upload Your XML Export Data
View Archive Details
Browse and Search to Create Buckets
Import Other Data Via Live Feeds
Import Facebook Page Content
Schedule Day-Forward Imports
Generate Tag Clouds from Keywords
Cluster Documents
Duplicate & near duplicate
detection
Dynamic user-seeded tag clouds
Adaptable, intuitive and
reusable topic models &
shared memos
Sentiment detection,
redaction & seamless
adjudication
Find and Add PeersSecurely segment your peers into project groups by
agency, firm, department, location, or affiliation,while controlling their access via credentials
Code Datasets
Annotation enhances your analysis by applying human interpretation to machine results
Explore Crowdsourcing
- MIT professor Eric von Hippel, specialist in innovation management“This is really the biggest paradigm shift in innovation since the Industrial Revolution”
Add Bookmarks
Generate Reports
• Q1, 2011– Sentiment Analysis
• Computer-assisted labeling of positive and negative sentiments in comments
– Topic Clustering• Computer-assisted tagging and labeling of topics for
comments and clustering
• Q2, 2011– Active Learning
• Our algorithms learn from your input! Over time, our natural language processing tools (such as sentiment and topic analysis) will get better with accumulated user feedback
Coming Soon!
Q & A Session and Conclusion
Esther [email protected]://www.surveyanalytics.comblog.surveyanalytics.com
Dr. Stuart W. ShulmanFounder & CEOTexifter, LLChttp://[email protected]