enhancing the social web through augmented social cognition research

Post on 14-Jun-2015

1.969 Views

Category:

Technology

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

Keynote talk given at the International Conference on Asia-Pacific Digital Libraries (ICADL) 2008. December, 2008 in Bali, Indonesia ICADL 2008 link here We are experiencing the new Social Web, where people share, communicate, commiserate, and conflict with each other. As evidenced by Wikipedia and del.icio.us, Web 2.0 environments are turning people into social information foragers and sharers. Users interact to resolve conflicts and jointly make sense of topic areas from "Obama vs. Clinton" to "Islam." PARC's Augmented Social Cognition researchers -- who come from cognitive psychology, computer science, HCI, sociology, and other disciplines -- focus on understanding how to "enhance a group of people's ability to remember, think, and reason". Through Web 2.0 systems like social tagging, blogs, Wikis, and more, we can finally study, in detail, these types of enhancements on a very large scale. In this talk, we summarize recent PARC work and early findings on: (1) how conflict and coordination have played out in Wikipedia, and how social transparency might affect reader trust; (2) how decreasing interaction costs might change participation in social tagging systems; and (3) how computation can help organize user-generated content and metadata.

TRANSCRIPT

Image from: http://www.flickr.com/photos/ourcommon/480538715/

EnhancingtheSocialWebthroughAugmentedEnhancingtheSocialWebthroughAugmentedSocialCognitionresearchSocialCognitionresearch

EdH.Chi

PeterPirolli,LichanHong,BongwonSuh,GregorioConvertino,LesNelson,RowanNairn

AugmentedSocialCognitionAreaPaloAltoResearchCenter

Interns:TerrellRussell,BrynnEvans,BryanChan,KMRCstudentsAlumni:RalucaBudiu,BryanPendleton,NikiKittur,ToddMytkowicz

12008-11-07 Ed H. Chi ASC Overview

FOUNDINGVISIONFORPARCFOUNDINGVISIONFORPARC Boldstrategicinvestment

– Foundedbysemiconductors,software,systems– Xeroxin1970,recognitionofthecomingdigitalrevolution– Charteredtheorganizationtocreate“TheOfficeoftheFuture”– Challengedresearcherstobecomethe“architectsofinformation”

Uniquemulti‐disciplinaryculture– Physicists,electronicsengineers,computerscientists…theory&practice– Abletoseeproblemsandintegratesolutionsfrommultipleperspectives

2008-11-07 2Ed H. Chi ASC Overview

14 years of work in foraging and sensemaking InformationScent

– WUFIS/IUNIS(Basicscentmodelingalgorithms)[CHI2000,2001]

– Bloodhound(Simulationofwebnavigation)[CHI2003]– LumberJack(Loganalysisofuserneeds)[CHI2002]

InformationForaging– ScentTrails[TOCHI2003]– ScentIndex[CHI2004]– ScentHighlight[IUI2005]– Visualforagingofhighlightedtext[HCII]

Sensemaking– VisualizationofWebEcologies[CHI98]– VisualizationSpreadsheets[Infovis97,Infovis99]

32008-11-07 Ed H. Chi ASC Overview

WhatisWeb2.0?WhatisWeb2.0?WhatisAugmentedSocialCognition?WhatisAugmentedSocialCognition?

Andhowaretheyrelated?

42008-11-07 Ed H. Chi ASC Overview

WhatisWikipedia?WhatisWikipedia?

“Wikipedia is the best thing ever. Anyone in the world can writeanything they want about any subject, so you know you’re getting the

best possible information.”– Steve Carell, The Office

52008-11-07 Ed H. Chi ASC Overview

WikipediaWikipedia

62008-11-07 Ed H. Chi ASC Overview

High‐endofthecollaborationspectrumHigh‐endofthecollaborationspectrum

Groupsutilizesystemstomakesenseandsharecomplextopicsandmaterials.

Wikipedia(socialstatus) Slashdot(karmapoints) WikiHow.com Lostpedia.com

72008-11-07 Ed H. Chi ASC Overview

MiddleofthespectrumMiddleofthespectrum

Systemsthatevolvestructuresthatcanbeusedtoorganizeinformation.

Del.icio.us Flickr YouTube Friendster

82008-11-07 Ed H. Chi ASC Overview

LightweightsocialprocessesLightweightsocialprocesses

Countingvotes– Awaytoincreasesignal‐to‐noiseratio– Informationfaddishness

Examples:– Digg.com– Mostbookmarkeditemsondel.icio.us

– Estimatingtheweightofanoxortemperatureofaroom

– Thetruevalueofastock

– PageRankorHub/Authorityalgorithms

92008-11-07 Ed H. Chi ASC Overview

AwaytothinkaboutthesesystemsAwaytothinkaboutthesesystems

Voting systems Collaborative Co-Creation

Col. Information Structures

Naver

Heavier collaboration

Digg.comWikipedia

Slashdot

eHow.com

Del.icio.us

IBM dogearPageRank

Flickr

102008-11-07 Ed H. Chi ASC Overview

LayersofModelsNeededLayersofModelsNeeded

Voting systems Collaborative Co-Creation

Col. Information Structures

Naver

Heavier collaboration

Digg.comWikipedia

Slashdot

eHow.com

Del.icio.us

IBM dogearPageRank

Flickr

Understanding ofmicro-economics

• of foraging [PARC]

• Personal vs. group[Huberman, Adamic]

• Wisdom of Crowd[Surowieki]

• Information cascades[Anderson and Holt]

Understanding ofconflicts andcoordination

• Wikipedia coordinationcosts [PARC]

• Invisible Colleges [Sandstrom]• Interference effects [Pirolli]• Co-laboratories [Olson and

Olson]• Community networks / Col.

Problem solving [Carroll]

Understanding of infoand social networks

• Tag network analysis [PARC,Golder, Yahoo]

• Structural holes (info brokerage)[Burt]

• Network constraints andstructure [various]

• Semantic of semiotic structures /words [IR, LSA]

112008-11-07 Ed H. Chi ASC Overview

ResearchVisionResearchVision

AugmentedSocialAugmentedSocialCognitionCognition Cognition:theabilitytoremember,think,andreason;thefacultyof

knowing. SocialCognition:theabilityofagrouptoremember,think,and

reason;theconstructionofknowledgestructuresbyagroup.– (notquitethesameasinthebranchofpsychologythatstudiesthe

cognitiveprocessesinvolvedinsocialinteraction,thoughincluded)

AugmentedSocialCognition:Supportedbysystems,theenhancementoftheabilityofagrouptoremember,think,andreason;thesystem‐supportedconstructionofknowledgestructuresbyagroup.

Citation:Chi,IEEEComputer,Sept2008

122008-11-07 Ed H. Chi ASC Overview

UnderstandinganewareaUnderstandinganewarea……

2008-11-07 13

Characteriza*on Models

PrototypesEvalua*ons

Ed H. Chi ASC Overview

142008-11-07 Ed H. Chi ASC Overview

Characteriza*on Models

PrototypesEvalua*ons

2008-11-07 15

Conflict/CoordinationEffectsinWikipediaConflict/CoordinationEffectsinWikipedia[[KitturKitturetal.,CHI2007]etal.,CHI2007]

60%

65%

70%

75%

80%

85%

90%

95%

100%

2001 2002 2003 2004 2005 2006

Perc

enta

ge o

f to

tal edits

Article

User

Article Talk

User Talk

Other

Maintenance

(joint work with Niki Kittur, Bongwon Suh, Bryan Pendleton)(joint work with Niki Kittur, Bongwon Suh, Bryan Pendleton)

Ed H. Chi ASC Overview

ConflictinConflictinWikipediaWikipedia Conflictisgrowingatthegloballevel,andwehave

someideaaboutwhereitis. ButwhatdefinesconflictinsideWikipedia? Buildacharacterizationmodelofarticleconflict

– Identifymetricsrelevanttoconflict– Automaticallyidentifyhigh‐conflictarticles

162008-11-07 Ed H. Chi ASC Overview

MeasureofcontroversyMeasureofcontroversy “Controversial”tag

Use#revisionstaggedcontroversial

172008-11-07 Ed H. Chi ASC Overview

PagemetricsPagemetrics Possiblemetricsforidentifyingconflictinarticles

Metric type Page TypeRevisions (#) Article, talk, article/talkPage length Article, talk, article/talk

Unique editors Article, talk, article/talkUnique editors / revisions Article, talkLinks from other articles Article, talk

Links to other articles Article, talkAnonymous edits (#, %) Article, talk

Administrator edits (#, %) Article, talkMinor edits (#, %) Article, talk

Reverts (#, by uniqueeditors) Article

182008-11-07 Ed H. Chi ASC Overview

Performance:Cross‐validationPerformance:Cross‐validation 5xcross‐validation,R2=0.897

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000

Predicted controversial revisions

Actual contro

vers

ial re

vis

ions

192008-11-07 Ed H. Chi ASC Overview

Performance:Cross‐validationPerformance:Cross‐validation 5xcross‐validation,R2=0.897

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000

Predicted controversial revisions

Actual contro

vers

ial re

vis

ions

202008-11-07 Ed H. Chi ASC Overview

DeterminantsofconflictDeterminantsofconflict

Revisions(talk) Minoredits(talk) Uniqueeditors(talk) Revisions(article) Uniqueeditors(article) Anonymousedits(talk) Anonymousedits(article)

Highly weighted features of conflict model:

212008-11-07 Ed H. Chi ASC Overview

SurplusofAttentionSurplusofAttention[[ShirkyShirky]]

2008-11-07 Ed H. Chi ASC Overview 22

source: xkcd

RevertRevertGraphGraph[[SuhSuhetal.,IEEEVAST2007]etal.,IEEEVAST2007]

ResearchGoal– Howcanweidentifypointofviewsbetweenusers?– Grouppeopleshareacommonpointofview

Usingrevertasproxyfordisagreementbetweenusers– Revertedits:3,711,638 6.3%oftotaledits– Duetovandalism:577,643 0.99%oftotaledits(15.6%ofreverts)

Forcedirectedlayout– Node:user,Edge:revertrelationship

2008-11-07 23Ed H. Chi ASC Overview

OpinionsonOpinionsonDokdo/TakeshimaDokdo/Takeshima

Group A

Group B Group C

Group D

Number of users in user group A B C Total

Users with Korean point of view 10 6 0 16

Users with Japanese point of view 1 8 7 16

Neutral or Unidentified 7 3 6 172008-11-07 24Ed H. Chi ASC Overview

MediatorPattern‐TerriSchiavoMediatorPattern‐TerriSchiavo

Mediators

Sympathetic to parents

Sympathetic to husband

Anonymous(vandals/spammers)

2008-11-07 25Ed H. Chi ASC Overview

UsingInformationTheorytoModelSocialTaggingUsingInformationTheorytoModelSocialTagging[EdH.Chi,Todd[EdH.Chi,ToddMytkowiczMytkowicz,ACMHypertext2008],ACMHypertext2008]

TopicsConcepts

Users Documents

Tags

T1…TnEncodingDecoding

Noise

2008-11-07 26Ed H. Chi ASC Overview

H(Tag)showssaturationintagusageH(Tag)showssaturationintagusage

272008-11-07 Ed H. Chi ASC Overview

H(Doc|Tag),browsabilityH(Doc|Tag),browsability

282008-11-07 Ed H. Chi ASC Overview

Raiseinavg.tagperbookmarkRaiseinavg.tagperbookmark(noteparallelthedevelopmentinincreasing#ofquerywords)(noteparallelthedevelopmentinincreasing#ofquerywords)

292008-11-07 Ed H. Chi ASC Overview

2008-11-07 Ed H. Chi ASC Overview 30

II((DocDoc;;TagTag)MutualInformation)MutualInformation

Source: Hypertext 2008 study on del.icio.us (Chi & Mytkowicz)

UnderstandinganewareaUnderstandinganewarea……

2008-11-07 31

Characteriza*on Models

PrototypesEvalua*ons

Ed H. Chi ASC Overview

LivingLaboratory:LivingLaboratory:PrototypingSocialApplicationsonthePrototypingSocialApplicationsontheInternetInternet

CreateaLivingLaboratoryasaplatformtodevelop,test,andmarketinnovations

322008-11-07 Ed H. Chi ASC Overview

WikiDashboardWikiDashboard::SocialTransparencyforWikipediaSocialTransparencyforWikipedia

JointworkwithBongwonSuh,AniketKittur,BryanPendleton

BongwonSuh,EdH.Chi,AniketKittur,BryanA.Pendleton.LiftingtheVeil:ImprovingAccountabilityandSocialTransparencyinWikipediawithWikiDashboard.InProceedingsoftheACMConferenceonHuman‐factorsinComputingSystems(CHI2008).ACMPress,2008.Florence,Italy.

332008-11-07 Ed H. Chi ASC Overview

RisksinUsingWikipediaRisksinUsingWikipedia[Denningetal.2005][Denningetal.2005]

Factualaccuracy Motivesofeditors Uncertainexpertise Volatility Spottycoverage Unproven/non‐independentsource

342008-11-07 Ed H. Chi ASC Overview

SocialDashboardSocialDashboard Socialtranslucentforeffectivecommunicationandcollaboration

[EricksonandKellogg2002]– Makesociallysignificantinformationvisibleandsalient– Supportawarenessoftherulesandconstraints– Accountabilityforactions

Wikiscanbeaprimecandidate– Everyeditisloggedandretrievable– WikiScanner.com:analyzeanonymousIPedits– WikiRage.com:topedits

352008-11-07 Ed H. Chi ASC Overview

HillaryClintonHillaryClinton

2008-11-07 36Ed H. Chi ASC Overview

TopEditor‐WastedTimeRTopEditor‐WastedTimeR

2008-11-07 37Ed H. Chi ASC Overview

SubprimeMortgageCrisisSubprimeMortgageCrisis

2008-11-07 38Ed H. Chi ASC Overview

WikiDashboardWikiDashboard

Surfacinghiddensocialcontexttousers Forreaders

– Anyincidentsinthepaste.g.Asuddenburstofedits?– Whoarethetopeditors?– Whatistheirmotivation/pointofviews/expertise/topicsof

interest?– Helpthemjudgingthequality/trustworthiness/usefulnessofan

article.

Forwriters– Measureexpertise/contribution/reputation– Motivatethemtobemoreactive/responsible(?)

392008-11-07 Ed H. Chi ASC Overview

MrTaggy.comMrTaggy.com::socialsearchwithtagssocialsearchwithtags

JointworkwithRowanNairn,LawrenceLee,PeterLai,LichanHong

2008-11-07 40Ed H. Chi ASC Overview

2008-11-07 41

Guide

Web

Howto

TipsHelp

Tools

Tip

Tricks

Tutorial

Tutorials

Reference

Semantic Similarity Graph

TagSearchTagSearchhttphttp:/://mrtaggy.com/mrtaggy.com

Ed H. Chi ASC Overview

SparTag.usSparTag.us::SocialParagraph‐levelTaggingSocialParagraph‐levelTagging

JointworkwithLichanHong,RalucaBudiu,LesNelson,PeterPirolli

LichanHong,EdH.Chi,RalucaBudiu,PeterPirolli,andLesNelson.SparTag.us:ALowCostTaggingSystemforForagingofWebContent.InProceedingsoftheAdvanced

VisualInterface(AVI2008),(toappear).ACMPress,2008.

422008-11-07 Ed H. Chi ASC Overview

LoweringParticipation/InteractionLoweringParticipation/InteractionCostsCosts Interactioncosts

determinenumberofpeoplewhoparticipate

Surplusofattention&motivationatsmalltransactioncosts

Therefore… Importanttokeep

interactioncostslow

Cost of participation#

Peop

le w

illin

g to

pro

duce

for “

free

432008-11-07 Ed H. Chi ASC Overview

SparTag.usSparTag.us

In situ tagging while reading– No new window– Clicking vs typing

Tagging + highlighting

442008-11-07 Ed H. Chi ASC Overview

ParagraphTaggingParagraphTagging

Intuition:sub‐docnuggetsuseful– Entities,facts,concepts,paragraphs

Annotationsattachedtoparagraphs Portableacrosspagesandothercontents(e.g.

Worddocuments)– Dynamicpages– Duplicatecontent

452008-11-07 Ed H. Chi ASC Overview

Example:DuplicateContentExample:DuplicateContent

462008-11-07 Ed H. Chi ASC Overview

MyReadingNotebookMyReadingNotebook

472008-11-07 Ed H. Chi ASC Overview

SocialSharingSocialSharing

friendfriend’’s tagss tags

my tagsmy tags

my highlightsmy highlights friendfriend’’s highlightss highlights

482008-11-07 Ed H. Chi ASC Overview

ImportanceIndicatorImportanceIndicator

recallrecall first-visitfirst-visit

492008-11-07 Ed H. Chi ASC Overview

TwoSidesofTaggingTwoSidesofTagging

Encoding Retrieval

50

h>p://edge.org

“scienceresearchcogni*on”

h>p://www.ted.com/index.php/speakers

“videopeopletalkstechnology”

2008-11-07 50Ed H. Chi ASC Overview

AugmentedSocialCognitionquestions:AugmentedSocialCognitionquestions:

Crowdsourcing[collaborativeco‐creation]– IsthereawisdomofthecrowdinWikipedia?– Howdoesconflictdrivecontentcreation?

CollectiveIntelligence[folksonomy]– Aresocialtagscollectivelygatheredusefulfororganizationofalarge

documentcollection?

CollectiveAveraging[socialattention]– Doesvotingsystemsidentifythebestqualityandmostinteresting

informationforthatcommunity?

ParticipationArchitecture[interaction]– Doesloweringtheinteractioncostbarrierincreaseparticipation

productively?

Expertisefinding[socialnetworking]– Doesgettingexpertsthroughsocialnetworkgetsyoutobetterquality

informationsooner?

2008-11-07 51Ed H. Chi ASC Overview

TheTeamTheTeam

2008-11-07 Ed H. Chi ASC Overview 52

Image from: http://www.flickr.com/photos/ourcommon/480538715/

AugmentedSocialCognition:AugmentedSocialCognition:FromSocialForagingtoSocialSensemakingFromSocialForagingtoSocialSensemaking

ResearchVision:Understandhowsocialcomputingsystemscanenhancetheabilityofagroupofpeopletoremember,think,andreason.

LivingLaboratory:Createapplicationsthatharnesscollectiveintelligencetoimproveknowledgecapture,transfer,anddiscovery.

http://asc‐parc.blogspot.comhttp://www.edchi.netechi@parc.com

532008-11-07 Ed H. Chi ASC Overview

top related