intro to data vis for the humanities nov 2013
Post on 11-Sep-2014
2.353 views
DESCRIPTION
This is an extensive but high level look at principles, methods, and tools looking to a couple case studies around the use of data visualisation for humanities research.TRANSCRIPT
![Page 1: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/1.jpg)
Data Visualisation in the Digital Arts and
HumanitiesTools, Methods & Techniques toPut Your Research Data to Work
!
Shawn DayQueen’s University Library
![Page 2: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/2.jpg)
Objective‣ To appreciate the rich variety of techniques and tools
available to digital humanities scholars for data visualisation and analysis. This workshop will provide an introduction to the varied use of data visualisation in the humanities through examples, case studies and hopefully inspire you to some hands-on fun.
![Page 3: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/3.jpg)
The beginningof a conversation …
![Page 4: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/4.jpg)
Upcoming Seminars and Workshops‣ 18 November - A Survey of Digital Humanities ‣ 2 December - Engaging Your Auduence with Your Research Data
(Exhibit) ‣ 9 December - Telling Stories with Data – Collections Visualisation
for Arts and Humanities Scholars (OMEKA) ‣ January - Digital Project Management ‣ Februrary - Hands On Workshop – Data Visualisation for
Presentation ‣ February - Social Scholarship – Tools for Collaborative Research ‣ March - Data Visualisation for Textual and Spatial Analysis
!
‣ More to come: http://qubdh.co.uk
![Page 5: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/5.jpg)
Agenda‣ Introduction ‣ What is Data Visualisation ‣ Why Visualise Data? ‣ Case Studies ‣ Things to Visualise ‣ Ways to Visualise ‣ Tools for Visualisation
![Page 6: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/6.jpg)
Breakpoint‣ One of the keys to good visualization is understanding
what your immediate (and longer term) goals are. !
‣ Are you visualizing data to understand what’s in it, or are you trying to communicate meaning to others?
!
‣ You - Visualisation for Data Analysis !
‣ Share with Others - Visualisation for Presentation
![Page 7: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/7.jpg)
Why Visualise? The Basics‣ Open Up Large Datasets ‣ Increase Density of Observable Data ‣ Reduce Complexity ‣ Aestheticise Data ‣ Illustrate an Interpretation ‣ Make an Argument
![Page 8: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/8.jpg)
Why Visualise? The Psychology and Physiology‣ Bypass language centres to tap directly into the visual
cortex; ‣ Leverage ability to recognise patterns - what they call
visual sense-making; ‣ Powerful graphics engines now allow for live data
processing and sophisticated animations and interactive research environments.
![Page 9: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/9.jpg)
Why Visualise? From a Data Perspective‣ Can link different formats ‣ Can share more easily with others ‣ Can see new meanings and connections ‣ Sort and re-organize in automated fashion ‣ Manage larger amounts of information ‣ Visualise your results
![Page 10: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/10.jpg)
Why Visualise? For Humanities Research ‣ Work with new data to create new knowledge
‣ Explore data to discover things that used to be unknown, unknowable or impractical to know
‣ Take a new perspective on the familiar to reveal previously hidden insights
![Page 11: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/11.jpg)
Data Visualisation hasdefinitely hit the big-time‣ Guardian Awards ‣ New York Times ‣ Why?
![Page 12: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/12.jpg)
Tourists vs Locals, Eric Fischer, 2010 - Flickr
Visualise New Information
![Page 13: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/13.jpg)
Red - Tourists Blue - Locals Yellow- NA
![Page 14: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/14.jpg)
Areas of Interest
![Page 15: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/15.jpg)
Crowdsourcing
![Page 16: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/16.jpg)
Visualising New Information
Flickr Flow, Martin Wattenberg and
![Page 17: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/17.jpg)
The Familiar through New Eyes
The London Times Atlas
![Page 19: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/19.jpg)
How Could You Use Data Analysis?‣ “In the Lab” - for your own analysis ‣ Online as part of collabourative groups ‣ Through dissemination for extension of own work -
crowdsourcing ‣ Others?
![Page 20: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/20.jpg)
Case Study: The Time Strip
![Page 21: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/21.jpg)
Visualisation Objective‣ Exploring the ‘ordinary’ lives of rural pioneers/farmers in
nineteenth century Ontario
![Page 22: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/22.jpg)
Canada
![Page 23: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/23.jpg)
Ontario
![Page 24: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/24.jpg)
South Western Ontario
![Page 25: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/25.jpg)
Farm Journal Raw Materials‣ 100s of pages ‣ Varying hands ‣ Varying quality ‣ Columns ‣ No Context
William Sunter Farm Diary, 1858
![Page 26: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/26.jpg)
Medical Diary by BlueChillies
Example: Medical Diary
![Page 27: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/27.jpg)
History flow by Martin Wattenberg and Fernanda Viegas
Example: History Flow
![Page 28: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/28.jpg)
Mechanics of the Process‣ Generate word frequency (Voyant, TAPoR) ‣ Isolate known farm activities (NLP - LanguageWare) ‣ Collocate to link activity references to time, duration, and
resources (Voyant)
![Page 29: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/29.jpg)
The Result/ New Patterns
![Page 30: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/30.jpg)
The Result/ New Patterns‣ Less time haying ‣ The impact of technology ‣ More tasks faster
![Page 31: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/31.jpg)
How Else Could this be done?
![Page 32: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/32.jpg)
What is the Value of this Visualisation?‣ Easier to compare over intervals ‣ Multiple vectors with greater granularity in a compressed
space ‣ The challenge is to find rich enough source materials to
yield substantive datasets
![Page 33: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/33.jpg)
Case Study: The Tree Map
![Page 35: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/35.jpg)
Example: Panopticon
Ben Scheiderman and Hard Drive Space
![Page 36: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/36.jpg)
Example: Bachelor’s Degrees 2011
Ben Schmidt, 2013 http://benschmidt.org/Degrees/2011Overview/
![Page 37: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/37.jpg)
Case Study: Occupations of Politicians‣ What are we studying? • Self-declared occupations of politicians
‣ Why? • What bias might they bring to their job?
‣ How? • Visualising past occupation and mapping to political
platform of party affiliated with
![Page 38: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/38.jpg)
Occupations of MPs in the 2nd Canadian Parliament
![Page 39: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/39.jpg)
Occupations of MPs in the 37th Canadian Parliament
![Page 41: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/41.jpg)
The Result/ New Patterns‣ The emergence of the professional politician with no
private sector experience ‣ Occupational continuity across changes in governing
party ‣ http://dev.dho.ie/~sday/dail/index.html
![Page 42: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/42.jpg)
How Else Could this be Done?
![Page 44: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/44.jpg)
The Value of Data Vis for Analysis‣ New ways of presenting allow new ways of seeing ‣ Hidden patterns become evident ‣ Suggest other hypotheses to test for ‣ Good research raises more questions than answers
![Page 45: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/45.jpg)
People demanding more…‣ Interactivity ‣ Involvement ‣ Action ‣ Participation ‣ Web 2.0 … 3.0 ….
![Page 46: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/46.jpg)
General Steps in Data Vis for DH1.Discovery / Acquisition 2.Cleaning / ‘Munging’ 3.Analysis / Exploratory Vis 4.Presentation
![Page 47: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/47.jpg)
Types of Data to Visualise‣ Audio Data ‣ Categorical Data ‣ Cartographic Data ‣ Collections ‣ Image Data • Still • Moving ‣ Metadata ‣ Multimedia Data
‣ Network Data • Social • Other ‣ Numerical Data ‣ Temporal Data ‣ Textual Data • Narrative • Qualitative ‣ ????
![Page 48: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/48.jpg)
Audio Data‣ Spectrogram ‣ Wave forms ‣ Notes ‣ Frequency ‣ Beats
![Page 49: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/49.jpg)
Visualisation of "Canada is Really Big" by The Arrogant Worms” http://www.sonicvisualiser.org/
Audio Data‣ What does sound look like?
![Page 50: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/50.jpg)
Audio Data: The Shape of Song‣ http://www.turbulence.org/Works/song/index.html ‣ Measuring Musical Patterns using Translucent Arcs ‣ Repetition
Phillip Glass, Candyman 2
Madonna, Like a Prayer
![Page 51: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/51.jpg)
Audio Data: IBM ‘Glass Engine’
http://www.philipglass.com/glassengine/
![Page 52: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/52.jpg)
Categorical Data‣ Data is grouped into categories based on a qualitative
trait, ‣ The resulting data represents the labels of these groups. ‣ Nominal, Ordinal
and/or Binary
![Page 53: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/53.jpg)
Cartographic Data‣ Communicate spatial information
![Page 54: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/54.jpg)
Cartographic Visualisation
![Page 55: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/55.jpg)
Cartographic Visualisation
http://maps.stamen.com/watercolor/#13/53.3355/-6.2181
![Page 56: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/56.jpg)
Digital Collections‣ Collections of data, images, movies, sound … etc • Visualise the
object incontext aspart of collection
• Representthe structureof thecollection
![Page 57: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/57.jpg)
Google Art Project: Visualising Museum Collections
Digital Collection Visualisation
![Page 58: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/58.jpg)
Digital Still Image Data‣ Colour ‣ Texture ‣ Shape ‣ Content ‣ Format ‣ Metadata ‣ Luminosity/Hue/
Saturation/Range
![Page 59: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/59.jpg)
Digital Moving Image Data‣ Adding Data on: • Narrative • Length • Frame rate • Sound/Image • Key Frames • Storyboard
![Page 60: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/60.jpg)
Metadata
![Page 61: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/61.jpg)
Numerical/Quantitative Data‣ Does anyone really need me to tell them about this? • Analysed using statistical methods • displayed using tables, charts, histograms and graphs…
![Page 62: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/62.jpg)
Social Network Data‣ Nodes and Edges ‣ Representing relations and quantifying and qualifyign the
same between objects
![Page 63: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/63.jpg)
Temporal Data‣ Show changes over time ‣ Show temporal clusters
![Page 64: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/64.jpg)
Xerox Parc, Stuart K.Card, George G. Robertson, Jock D. Mackinlay
http://www.itc.nl/personal/kraak/
Different Ways of Seeing Time
![Page 66: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/66.jpg)
Quantitative Textual Visualisation
![Page 67: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/67.jpg)
Textual - Qualitative‣ Textual attributes graphically represented • Frequency • Collocation • Adjacency
![Page 68: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/68.jpg)
Textual - Narrative
![Page 69: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/69.jpg)
Time, Space, Narrative: MythEngine
http://www.bbc.co.uk/blogs/
![Page 70: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/70.jpg)
Time, Space, Narrative: MythEngine
http://www.bbc.co.uk/blogs/researchanddevelopment/2010/03/the-mythology-engine-represent.shtml
![Page 71: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/71.jpg)
General Steps in Data Vis for DH1. Discovery / Acquisition 2. Cleaning / ‘Munging’ 3. Analysis / Exploratory Vis 4. Presentation
![Page 72: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/72.jpg)
Step 1 Discovery / Acquisition
![Page 73: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/73.jpg)
An Iterative Process
ACQUIRE w PARSE w FILTER w MINE w REPRESENT w REFINE w INTERACT
![Page 74: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/74.jpg)
Visualizing What?‣ Basic types of content that we are used to deal with: • Text • Numbers • Image • Video
‣ Other, more “complex” stuff: • Relations, connections, links - a genealogy • Time and space coords - the path of migratory birds • Animations – a piece of courseware • 3D models – the plan of your house
![Page 75: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/75.jpg)
Acquisition: Junar‣ http://www.junar.com
http://goo.gl/oexnB
![Page 76: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/76.jpg)
Acquisition: Public Data Sources‣ CSO: Data Formats ‣ The Data Hub: Linked Data
![Page 77: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/77.jpg)
Acquisition: Public Data Sources
![Page 78: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/78.jpg)
Cleaning / Munging (Normalisation, Format Conversion)‣ Tools: • Data Wrangler • Google Refine • Mr. Data Converter
!
‣ Data Wrangler • Does simple, split, clear, fold/unfold transforms on data • See example --> Data and Script
!
‣ Google Refine • Works with larger datasets
![Page 79: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/79.jpg)
Open Data/Linked Data
Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/
![Page 80: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/80.jpg)
Munging Tool: Data Wrangler‣ http://vis.stanford.edu/wrangler/app/
![Page 81: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/81.jpg)
Cleaning Exercise
![Page 82: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/82.jpg)
Alternate: Google Refine‣ http://code.google.com/p/google-refine/
![Page 83: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/83.jpg)
Alternate: Mr Data Converter‣ http://shancarter.com/data_converter/
![Page 84: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/84.jpg)
Now You’ve Got Data ... ‣ What’s Next? ‣ Data Visualisation in the Analysis Process ‣ Data Visualisation for Presentation
![Page 85: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/85.jpg)
General Steps in Data Vis for DH1. Discovery / Acquisition 2. Cleaning / ‘Munging’ 3. Analysis / Exploratory Vis 4. Presentation
![Page 86: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/86.jpg)
Breakpoint‣ Are you visualizing data to understand what’s in it, or are
you trying to communicate meaning to others? ‣ You - Visualisation for Data Analysis ‣ Share with Others - Visualisation for Presentation
![Page 87: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/87.jpg)
Google NGram Viewers‣ Examine word frequency in digitised books ‣ Currently about 4% of books ever published ‣ In English, Chinese, French, German, Hebrew, Russian, and
Spanish ‣ Changes in word usage ‣ Trends
![Page 88: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/88.jpg)
Google NGram Viewer
http://books.google.com/ngrams/graph
![Page 89: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/89.jpg)
The Value of Data Vis for Analysis‣ New ways of presenting allow new ways of seeing ‣ Hidden patterns become evident ‣ Suggest other hypotheses to test for ‣ Good research raises more questions than answers
![Page 91: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/91.jpg)
Data Analysis Principles1. Process is a Way of Thinking, not a Substitute for
Thinking 2. Data needs to be considered and reported in Context 3. Look Before you Leap - Get to Know Your Data 4. Question Everything - CollectionProcess, Bias, etc. 5. Do a Gut Check 6. Coincidence is Not the Same as Causality 7. Just Because Data Exists Doesn’t Mean its Relevant
Fern Halper - Seven Guiding Principles
![Page 92: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/92.jpg)
Analysis / Exploratory Visualisation
![Page 93: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/93.jpg)
Cleaning&Structuring: Google Fusion Tables
![Page 97: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/97.jpg)
Gephi: Analysis and Discovery of Networks
![Page 98: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/98.jpg)
Where to Keep up with the Community‣ Highbrow: http://osc.hul.harvard.edu/highbrow
!
!
!
‣ http://chronicle.com/blogs/profhacker ‣ Flowing Data: http://flowingdata.com ‣ Perceptual Edge: http://www.perceptualedge.com ‣ Info is Beautiful: http://www.informationisbeautiful.net ‣ Visualising Data: http://www.visualisingdata.com ‣ Infosthetics: http://infosthetics.com ‣ Datavisualisation.ch: http://datavisualization.ch ‣ Dig Hum Specialist: https://dhs.stanford.edu/the-digital-
humanities-as
![Page 99: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/99.jpg)
New Perspectiveson Old Data
Presenting Your Data Visually
![Page 100: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/100.jpg)
Objectives‣ Consider best practices in sharing research findings
using visualisation tools; ‣ Identify and judge between publicly available tools to
create and deploy humanities visualisation research products;
‣ Consider data visualisation as part of a larger research discussion.
![Page 101: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/101.jpg)
General Steps in Data Vis for DH‣ Discovery / Acquisition ‣ Cleaning / ‘Munging’ ‣ Analysis / Exploratory Vis ‣ Presentation
![Page 102: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/102.jpg)
Academic Visualisation?There’s lots of published papers out there
http://www.autodeskresearch.com/projects/citeology
![Page 103: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/103.jpg)
The Life on An Idea through Citations
![Page 105: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/105.jpg)
Data Visualisation Lessons from Tufte‣ Show the Data ‣ Provoke Thought about the Subject at Hand ‣ Avoid Distorting the Data ‣ Present Many Numbers in a Small Space ‣ Make Large Datasets Coherent ‣ Encourage Eyes to Compare Data ‣ Reveal Data at Several Levels of Detail ‣ Serve a Reasonably Clear Purpose ‣ Be Closely Integrated with Statistical and Verbal
Descriptions of the Dataset
![Page 106: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/106.jpg)
What Visual Techniques Exist?‣ Connecting your data with the right visualisation ‣ What is your message? ‣ How do we know what we might use? ‣ Start with your Exploratory/Research/Analytical
Environment ‣ How do visuals fit into your narrative?
![Page 107: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/107.jpg)
Connecting your data with the right visualisation
What Visual Techniques Exist?
Visual Everything
Connecting your data with the right visualisation
![Page 108: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/108.jpg)
Structured Data Presentation Tools(a tiny subset)‣ Webservices • Temporal: TimeFlow • Google Fusion Tables • Textual, Spatial and
Numeric: Many Eyes • Temporal: Dipity • Infographics: Visual.ly
!
!
!
!
‣ Frameworks • GraphViz • Gephi • Prefuse • D3 • Processing • Exhibit (Exercise)
![Page 109: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/109.jpg)
TimeFlow‣ Journalism ‣ Getting the flow
of events and factsstraight
!
!
!
!
‣ http://flowingmedia.com/timeflow.html ‣ Great for historians
![Page 110: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/110.jpg)
Google FusionTables‣ Initially Exploratory
and useful for ‘Munging’ ‣ Allows for Embedding ‣ And for User Interaction ‣ Transparency ‣ Experimental (Good)
!
!
‣ http://www.google.com/fusiontables/Home/
![Page 111: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/111.jpg)
Many Eyes‣ http://www-958.ibm.com ‣ Rich, Varied and Accessible ‣ Free Rapid Prototyping
![Page 112: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/112.jpg)
Visual.ly
![Page 113: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/113.jpg)
Visual.ly‣ Well crafted Infographics gaining credibility ‣ The new poster presentation ‣ Data-driven narrative in words and pictures ‣ Visual.ly currently driven by social media
![Page 114: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/114.jpg)
Dipity
![Page 115: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/115.jpg)
Frameworks and Languages‣ GraphViz ‣ R Programming Language ‣ JIT (JavaScript Infovis
Toolkit) ‣ Protovis ‣ D3 ‣ Processing ‣ Tableau ‣ Prefuse ‣ Gephi
‣ WEAVE (http://www.oicweave.org/)
!
‣ Exhibit (Exercise)
![Page 116: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/116.jpg)
Graphviz‣ An Open Source Framework ‣ Mature (1988) ‣ AT&T Labs ‣ Used as a basis for subsequent ‣ A great prototyping and starting point
!
!
!
!
!
‣ http://www.graphviz.org/
![Page 117: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/117.jpg)
R Programming Language‣ Geared towards statistical analysis ‣ More recently has had some powerful graphics
frameworks added ‣ Open Source ‣ Typically Command Line but a variety of GUI editors
available ‣ > Jeff Rydberg-Cox: R for the Digital Humanities
![Page 118: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/118.jpg)
JavaScript InfoVis Toolkit (JIT)‣ JIT Demos (http://thejit.org/demos/) ‣ The JavaScript InfoVis Toolkit is a complete set of tools to
create Interactive Data Visualizations for the Web. It includes JSON loading, animation, 2D point and graph classes and some predefined tree visualization methods.
‣ Smaller datasets in a clean form ‣ Related and Aggregated/Categorised Data
![Page 120: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/120.jpg)
JavaScript InfoVis Toolkit (JIT)
![Page 122: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/122.jpg)
ProtoVis‣ Protovis is a visualization toolkit for JavaScript using SVG.
It takes a graphical approach to data visualization, composing custom views of data with simple graphical primitives like bars and dots. These primitives are called marks, and each mark encodes data visually through dynamic properties such as color and position.
‣ Jerome Cukier: ProtoVis Tutorial ‣ Development shifted to D3 ‣ ProtoVis still very accessible and usable
![Page 123: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/123.jpg)
http://mbostock.github.com/protovis/ex/crimea-rose.html
ProtoVis
![Page 124: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/124.jpg)
http://mbostock.github.com/protovis/ex/napoleon.html
ProtoVis
![Page 125: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/125.jpg)
D3‣ D3 allows you to bind arbitrary data to a Document
Object Model (DOM), and then apply data-driven transformations to the document. As a trivial example, you can use D3 to generate a basic HTML table from an array of numbers. Or, use the same data to create an interactive SVG bar chart with smooth transitions and interaction.
‣ Open Source
![Page 127: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/127.jpg)
Processing‣ Now we are getting serious... ‣ Ben Fry ‣ Like R has a serious statistical bent ‣ Has a client and development environment, but deploys
easily to the web using processing.js ‣ Large and VL datasets ‣ Good with related data ‣ Serious support for aesthetics ‣ Modelling Environment ‣ http://processing.org/ ‣ http://www.openprocessing.org/
![Page 129: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/129.jpg)
Processing.js
![Page 130: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/130.jpg)
http://nytlabs.com/projects/cascade.html
Processing.JS
![Page 131: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/131.jpg)
Tableau‣ Commercial ‣ Offers a Free Public Application ‣ Encourages sharing and focusses on building a narrative
around visualisation of your research data ‣ Education and Non-Commercial Licenses available ‣ Mature and evolving rapidly to demonstrate the newest
and most exciting visualisation types
![Page 132: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/132.jpg)
http://www.tableausoftware.com/public
Tableau
![Page 133: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/133.jpg)
Prefuse‣ flare.prefuse ‣ Flash-based ‣ Great transitions and very approachable ‣ Beware of Datalocking ‣ http://flare.prefuse.org/demo
![Page 134: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/134.jpg)
Gephi‣ Open Source ‣ Mapping and Visualising Relationships and Networks ‣ An outstanding Visual Development Environment ‣ Multiplatform ‣ Extensible!! ‣ https://gephi.org/
![Page 135: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/135.jpg)
Gephi
![Page 136: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/136.jpg)
Gephi
![Page 137: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/137.jpg)
Where to go further‣ DIRT (Digital Research Toolkit) ‣ Timeline Tools ‣ Visualisation in Education ‣ Visual Complexity ‣ DataVis.ca ‣ R: A Tiny Handbook of R - Springer ‣ Using R in DH ‣ MONK ‣ http://datajournalism.stanford.edu/
![Page 138: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/138.jpg)
Upcoming Workshops‣ 18 November - A Survey of Digital Humanities ‣ 2 December - Engaging Your Auduence with Your Research Data
(Exhibit) ‣ 9 December - Telling Stories with Data – Collections Visualisation
for Arts and Humanities Scholars (OMEKA) ‣ January - Digital Project Management ‣ Februrary - Hands On Workshop – Data Visualisation for
Presentation ‣ February - Social Scholarship – Tools for Collaborative Research ‣ March - Data Visualisation for Textual and Spatial Analysis
!
‣ More to come: http://qubdh.co.uk
![Page 139: Intro to Data Vis for the Humanities nov 2013](https://reader035.vdocuments.mx/reader035/viewer/2022081412/541235678d7f729e728b475c/html5/thumbnails/139.jpg)
Thank YouShawn Day - [email protected] - @iridium
!
The Library/Institute for Collaborative Research in the Humanities18 University Square
Ground Floor http://qubdh.co.uk