humanities in the digital world
TRANSCRIPT
David De Roure @dder
Intersection, Scale, and Social Machines: The Humanities in the Digital World
DIRECTOR, UNIVERSITY OF OXFORD E-RESEARCH CENTRE
Data-intensive research
Human-intensive research
Music
Scholarly Communication
The Big Picture(s)
Challenging Assumptions
Chr
istin
e B
orgm
an
13,785,659 total volumes 6,871,154 book 6tles 364,473 serial 6tles 4,824,980,650 pages 618 terabytes 163 miles 11,201 tons 5,372,477 public domain volumes
10,000,000,000,000,000 bytes archived!
New Forms of Data ▶ Internet data, derived from social
media and other online interactions (including data gathered by connected people and devices, eg mobile devices, wearable technology, Internet of Things)
▶ Tracking data, monitoring the movement of people and objects (including GPS/geolocation data, traffic and other transport sensor data, CCTV images etc)
▶ Satellite and aerial imagery (eg Google Earth, Landsat, infrared, radar mapping etc) http://www.oecd.org/sti/sci-tech/new-data-for-
understanding-the-human-condition.htm
The Big Picture
More people
Mor
e m
achi
nes
Big Data Big Compute Conventional Computation
“Big Social” Social Networks
e-infrastructure
Online R&D (Science 2.0)
Digital Scholarship
@dder
theODI.org
Data Detect Store Analytics Filter Analysts
@dder
There is no such thing as the Internet of Things
There is no such thing as a closed system
Humans are creative and subversive
The Rise of the Bots A Swarm of Drones
Accidents happen (in the lab, bin)
Holding machines to account Software vulnerability
Where are the throttle points?
@dder
F i r s t
Edwards, P. N., et al. (2013) Knowledge Infrastructures: Intellectual Frameworks and Research Challenges. Ann Arbor: Deep Blue. http://hdl.handle.net/2027.42/97552
Social Machines
Empowered Citizens
Social Machines Defini6on TBL
Pip Willcox
https://twitter.com/CR_UK/status/446223117841494016/
Some people's smartphones had autocorrected the word "BEAT" to instead read "BEAR". "Thank you for choosing an adorable polar bear," the reply from the WWF said. "We will call you today to set up your adoption."
http://www.bbc.com/news/technology-26723457
SOCIAM: The Theory and Practice of Social Machines is funded by the UK Engineering and Physical Sciences Research Council (EPSRC) under grant number EPJ017728/1 and comprises the Universities of Southampton, Oxford and Edinburgh. See sociam.org
“Yet Wikipedia and its stated ambi6on to “compile the sum of all human knowledge” are in trouble. The volunteer workforce that built the project’s flagship, the English-‐language Wikipedia—and must defend it against vandalism, hoaxes, and manipula6on—has shrunk by more than a third since 2007 and is s6ll shrinking… The main source of those problems is not mysterious. The loose collec6ve running the site today, es6mated to be 90 percent male, operates a crushing bureaucracy with an oYen abrasive atmosphere that deters newcomers who might increase par6cipa6on in Wikipedia and broaden its coverage…” http://www.technologyreview.com/featuredstory/520446/the-decline-of-wikipedia/
“Panoptes has been designed so that it’s easier for us to update and maintain, and to allow more powerful tools for project builders. It’s also open source from the start, and if you find bugs or have suggestions about the new site you can note them on Github (or, if you’re so inclined, contribute to the codebase yourself).”
"
http://blog.zooniverse.org/2015/06/29/a-whole-new-zooniverse/
http://monsterspedia.wikia.com/wiki/File:Argus-Panoptes.jpg
Panoptes
Musical Social Machines
Social Machines of Scholarship
INT. VERSE VERSE VERSE VERSEBRIDGEBRIDGE OUT.
ê
The Problem
signal
understanding
Ichiro Fujinaga
salami.music.mcgill.ca
Jordan B. L. Smith, J. Ashley Burgoyne, Ichiro Fujinaga, David De Roure, and J. Stephen Downie. 2011. Design and creation of a large-scale database of structural annotations. In Proceedings of the International Society for Music Information Retrieval Conference, Miami, FL, 555–60
Sequence alignment
http://en.wikipedia.org/wiki/Sequence_alignment#/media/File:Histone_Alignment.png
Dan Edelstein, Robert Morrissey, and Glenn Roe, To Quote or not to Quote: Citation Strategies in the Encyclopédie. Journal of the History of Ideas , Volume 74, Number 2, April 2013 . pp. 213-236. 10.1353/jhi.2013.0012 Glenn Roe
Digital Music Collec6ons
Grad-‐sourced ground truth
Community SoYware
Linked Data Repositories
Supercomputer
23,000 hours of recorded music
Music Information Retrieval Community
SALAMI
Ashley Burgoyne
ww
w.m
usic
-ir.o
rg/m
irex
Music Information Retrieval Evaluation eXchange Audio Onset Detection Audio Beat Tracking Audio Key Detection Audio Downbeat Detection Real-time Audio to Score Alignment(a.k.a Score Following) Audio Cover Song Identification Discovery of Repeated Themes & Sections Audio Melody Extraction Query by Singing/Humming Audio Chord Estimation Singing Voice Separation Audio Fingerprinting Music/Speech Classification/Detection Audio Offset Detection
Downie, J. Stephen, Andreas F. Ehmann, Mert Bay and M. Cameron Jones. (2010). The Music Information Retrieval Evaluation eXchange: Some Observations and Insights. Advances in Music Information Retrieval Vol. 274, pp. 93-115
Stephen Downie
http://chordify.net/
Digital Material Pip Willcox
Kevin Page David Weigl
Interfaces, for computer and human
!
Sonifying the Variants
• From Play to Sonifica6on • Using First Folio and Quartos data • Parsing the TEI XML, conver6ng it with rule set into numbers, sonifying the data to produce sounds
34
Sonification
Iain Emsley
Studying Social Machines
Scholarship of Social Machines
Ecosystem �Perspective
• We see a community of living, hybrid organisms, rather than a set of machines which happen to have humans amongst their components
• Their successes and failures inform the design and construction of their offspring and successors
time
Social Machine instances @dder
Observer of one social machine
Observers using third party observatory
Observer of multiple social
machines
Human participants in
Social Machine
Human participants in multiple Social Machines
Observer of Social Machine infrastructure
1
4
2
3
5
6
SM
SM
SM
Social Machine Observing Social
Machines
7
@dder
De Roure, D., Hooper, C., Page, K., Tarte, S., and Willcox, P. 2015. Observing Social Machines Part 2: How to Observe? ACM Web Science
The Web Observatory
Tiropanis, T., Hall, W., Shadbolt, N., De Roure, D., Contractor, N. and Hendler, J. 2013. The Web Science Observatory, IEEE Intelligent Systems 28(2) pp 100–104.
Thanassis Tiropanis
Simpson, R., Page, K.R. and De Roure, D. 2014. Zooniverse: observing the world's largest citizen science platform. In Proceedings of the companion publication of the 23rd international conference on World Wide Web, 1049-1054.
Kevin Page
STORYTELLING AS A STETHOSCOPE FOR SOCIAL MACHINES
1. Sociality through storytelling potential and realization
2. Sustainability through reactivity and interactivity
3. Emergence through collaborative authorship and mixed authority
Zooniverse is a highly storified Social Machine
Facebook doesn’t allow for improvisa6on
Wikipedia assigns authority rights rigidly
http://ora.ox.ac.uk/objects/ora:8033
Tarte, S.M., De Roure, D. and Willcox, P. 2014. Working out the Plot: the Role of Stories in Social Machines. SOCM2014: The Theory and Practice of Social Machines, Seoul, Korea, International World Wide Web Conferences pp. 909–914
Pip Willcox
Tarte, S. Willcox, P., Glaser, H. and De Roure, D. 2015. Archetypal Narratives in Social Machines: Approaching Sociality through Prosopography. ACM Web Science 2015.
SégolèneTarte
Scholarly Communication
Preface
Elizabeth Williamson
Richard O’Bierne
A computationally-enabled sense-making network of expertise, data, software,
models and narratives
Big Data, in a�Big Data Centre
Pip Willcox and Kevin Page
consume
produce
compose perform capture
distribute
Mark Sandler
Curate Preserve !
Notifications and automatic re-runs
Machines are users too
Autonomic Curation
Self-repair
New research?
The R Dimensions
Research Objects facilitate research that is reproducible, repeatable, replicable, reusable, referenceable, retrievable, reviewable, replayable, re-‐interpretable, reprocessable, recomposable, reconstructable, repurposable, reliable, respecful, reputable, revealable, recoverable, restorable, reparable, refreshable?”
@dder 14 April 2014
sci method
access
understand
new use
social
cura6on
Research Object
Principles
De Roure, D. 2014. The future of scholarly communications. Insights: the UKSG journal, 27, (3), 233-238. DOI 10.1629/2048-7754.171
http
s://w
ww
.gar
tner
.com
/tech
nolo
gy/re
sear
ch/d
igita
l-mar
ketin
g/tra
nsit-
map
.jsp
Intersection, Scale, and Social Machines: The Humanities in the Digital World
First Folio Social Machines
Metadata Story of the���First Folio
Social���Machines Annotation
David De Roure and Pip Willcox ‘“Coniunction, with the participation of Society”: Citizens, Scale, and
Scholarly Social Machines’ Beyond the PDF: Born-Digital Humanities, Boston, 27–28 April 2015
Pip Willcox
Pip
Will
cox
[email protected] @dder
Thanks to Tim Crawford, Mark d’Inverno, Stephen Downie, Iain Emsley, Ichiro Fujinaga, Chris Lintott, Grant Miller, Terhi Nurmikko-Fuller, Kevin Page, Carolin Rindfleisch, Glenn Roe, Mark Sandler, Ségolène Tarte, David Weigl, and Pip Willcox.
http://www.slideshare.net/davidderoure/humanities-in-the-digital-world
Supported by SOCIAM: The Theory and Practice of Social Machines, funded by the UK Engineering and Physical Sciences Research Council (EPSRC) under grant number EP/J017728/1; Fusing Semantic and Audio Technologies for Intelligent Music Production and Consumption (FAST) funded by EPSRC under grant number EP/L019981/1; and Transforming Musicology, funded by the UK Arts and Humanities Research Council under the Digital Transformations programme. Thanks also to the Andrew W. Mellon Foundation.
