interrelativity.com revelationary computing, proactive displays, & the experience ubicomp...
TRANSCRIPT
interrelativity.com
Revelationary Computing, Proactive Displays,
& The Experience UbiComp Project
Revelationary Computing, Proactive Displays,
& The Experience UbiComp Project
Joe McCarthyJoe McCarthy
Connector in ChiefConnector in Chief
Interrelativity, IncInterrelativity, Inc
11 January 2006
2interrelativity.com
OutlineOutline What’s the Problem?What’s the Problem?
ConvergenceConvergence Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online revelationOnline revelation
Proactive DisplaysProactive Displays
The Experience UbiComp ProjectThe Experience UbiComp Project
Future ExtensionsFuture Extensions
3interrelativity.com
OverviewOverview
Interrelativity develops softwarethat integrates sensing and display technologies
with online personal contentand promotional content
to help people relate to one anotherin shared physical spaces
Bringing the best of virtual communities to physical spaces.
4interrelativity.com
The ProblemThe Problem We are We are socialsocial: fundamental need : fundamental need
for a sense of belonging for a sense of belonging We are We are shyshy: 48% of US population : 48% of US population
is chronically shyis chronically shy We want to relate to and connect with others,We want to relate to and connect with others,
but are often unable or unwilling to do sobut are often unable or unwilling to do so EvenEven at times and places specifically designed to at times and places specifically designed to
encourage connections (“third places”)encourage connections (“third places”)
5interrelativity.com
The Solution: Proactive Displays
The Solution: Proactive Displays
+
OnlineProfiles
Physical Tokens
+
LargeDisplays
BetterReal-worldInteractions
=
6interrelativity.com
Convergence (1)Convergence (1) Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online revelationOnline revelation
7interrelativity.com
What is RFID?What is RFID?
Si
Coil
Encapsulation
RFID Transponder
Radio frequency identification (RFID) is a generic term that is used to describe a system that transmits the identity (in the form of a unique serial number) of an object or person wirelessly, using radio waves. [RFID Journal]
[Roy Want, Intel]
ComputerRFID
Interrogator
RFIDTransponder
Energy
Clock
Data
8interrelativity.com
RFID in Access ControlRFID in Access Control
Buildings
Ski resorts
Countries
Containers
9interrelativity.com
RFID in Asset TrackingRFID in Asset Tracking
Livestock Salmon Pets
Beer kegs Airline luggageDocuments& Folders
At school
On the bus
At the park
10interrelativity.com
RFID in HealthcareRFID in Healthcare
EquipmentMedications Patients
Blood Surgical sites
11interrelativity.com
RFID in TransactionsRFID in Transactions
ExxonMobil SpeedPass
MasterCard PayPass
Illinois Tollway I-Pass PowerPay
12interrelativity.com
RFID + Mobile PhonesRFID + Mobile Phones KDDIKDDI
RFID RFID readersreaders Active & PassiveActive & Passive
NTT DoCoMo n901iC FOMA®NTT DoCoMo n901iC FOMA® Sony FeliCa chip (+ surround sound, card scanner…)Sony FeliCa chip (+ surround sound, card scanner…)
13interrelativity.com
RFID + PeopleRFID + People VeriChip (Applied Digital Solutions)VeriChip (Applied Digital Solutions)
14interrelativity.com
Convergence (2)Convergence (2) Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online revelationOnline revelation
15interrelativity.com
Digital SignageDigital Signage WalkwaysWalkways
Bristol, UK
Glasgow, Scotland
Times Square, NYC
NYC Subways
16interrelativity.com
Digital SignageDigital Signage MallsMalls
Mall at Millenia, Orlando Las Vegas Sandton City, South Africa
DestiNY USA, Syracuse Flasma @ The Plaza, London
17interrelativity.com
Digital SignageDigital Signage TransportationTransportation
Elevators
Bus stops (Mequon, WI)
Buses (Milwaukee, WI)
Train cars, Kiev
Chicago O’Hare
Basel Airport (CH)
18interrelativity.com
Convergence (3)Convergence (3) Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online (& offline) revelationOnline (& offline) revelation
19interrelativity.com
Revelation in the Physical World
Revelation in the Physical World
20interrelativity.com
Revelation in the Digital World
Revelation in the Digital World
Instant Messaging Instant Messaging
WeblogsWeblogs
Social Network SystemsSocial Network Systems
Newsgroups Newsgroups
eCommerceeCommerce
Online DatingOnline Dating
21interrelativity.com
Revelationary ComputingRevelationary Computing Bridging the gap between digital & physical worldsBridging the gap between digital & physical worlds
Revealing Revealing digitaldigital representations of self representations of selfin shared spaces in the in shared spaces in the physicalphysical world world
Incorporating Incorporating physicalphysical world references world references into into digitaldigital representations of self representations of self
22interrelativity.com
Revelation viaProactive Displays
Revelation viaProactive Displays
Displays + sensors (+ algorithms + policies + …)Displays + sensors (+ algorithms + policies + …) Public displays that can Public displays that can sensesense & & respondrespond appropriatelyappropriately
to the to the peoplepeople & & activitiesactivities taking place nearby taking place nearby Implicit, ambient, background (periphery)Implicit, ambient, background (periphery)
Issues:Issues: Context(s)Context(s)
Where should they go?Where should they go?
Content Content What should they show?What should they show?
ControlControl How will they know?How will they know?
23interrelativity.com
Experience UbiComp Project
Experience UbiComp Project
Desire for Desire for mutual revelationmutual revelation show & tell about you & your workshow & tell about you & your work learn about others & their worklearn about others & their work
Restricted Restricted contextscontexts Paper / panel sessionsPaper / panel sessions Demo / poster sessionsDemo / poster sessions Reception / breaksReception / breaks
Available Available contentcontent Explicit: registration info Explicit: registration info Implicit: homepage data miningImplicit: homepage data mining
ControlControl Register, activate and wear tags during the conferenceRegister, activate and wear tags during the conference Opt out at any time (delete profile, discard tag)Opt out at any time (delete profile, discard tag)
24interrelativity.com
RegistrationRegistration
25interrelativity.com
ActivationActivation
26interrelativity.com
Experience!Experience!AutoSpeakerID
Ticket2Talk
Neighborhood Window
27interrelativity.com
NeighborhoodWindow
Ticket2Talk
Kiosk
AutoSpeakerID
28interrelativity.com
AutoSpeakerIDAutoSpeakerID Keynote/Paper/Panel Q&A “augmentation”Keynote/Paper/Panel Q&A “augmentation”
RFID: antenna (microphone), tag (badge)RFID: antenna (microphone), tag (badge) Display photo, name, affiliationDisplay photo, name, affiliation Visual augmentation of common [oral] practiceVisual augmentation of common [oral] practice
29interrelativity.com
AutoSpeakerIDAutoSpeakerID
30interrelativity.com
Ticket2TalkTicket2Talk Coffee BreakCoffee Break
ExplicitlyExplicitly provided content provided content SingleSingle person (at a time) person (at a time)
31interrelativity.com
Ticket2TalkTicket2Talk
32interrelativity.com
Ticket2TalkTicket2Talk Queue Management: balancing freshness & fairnessQueue Management: balancing freshness & fairness
Tag recency: +Tag recency: + Ticket recency: -Ticket recency: - Minimize thrashing Minimize thrashing ““5 seconds of fame”5 seconds of fame”
NumTickets
terTicketCounNumTicketsw
iodTimeOutPer
agSeenTimeSinceTiodTimeOutPerwP
i
ii
,min2
1
33interrelativity.com
Neighborhood WindowNeighborhood Window Demonstrations & Poster SessionDemonstrations & Poster Session
ImplicitImplicit content (mined from homepages) content (mined from homepages) GroupsGroups of people (& their words / phrases) of people (& their words / phrases)
34interrelativity.com
35interrelativity.com
Neighborhood WindowNeighborhood Window TouchGraph™ visualization toolTouchGraph™ visualization tool
People (picture, name)People (picture, name) Words from homepages (and/or interests)Words from homepages (and/or interests)
N “unique” words (TFIDF)N “unique” words (TFIDF) 2(N–1) “shared” words2(N–1) “shared” words
CrawlingCrawling Only within domainOnly within domain Issues: frames, size, languageIssues: frames, size, language
PhrasesPhrases NP = [adjective]* noun+ [PP]*NP = [adjective]* noun+ [PP]* PP = preposition NPPP = preposition NP
36interrelativity.com
EvaluationEvaluation Post-conference surveyPost-conference survey
500 attendees500 attendees 200 participants (registered + activated)200 participants (registered + activated) 95 respondents (61 were participants)95 respondents (61 were participants)
PositivePositive NegativeNegative No Impact / No Impact / Mixed ImpactMixed Impact
NullNull
AutoSpeakerIDAutoSpeakerID 7070 66 1313 66
Ticket2TalkTicket2Talk 4040 33 3333 1919
Neighborhood Neighborhood WindowWindow
2121 22 3939 3333
37interrelativity.com
ExperiencesExperiences AutoSpeakerIDAutoSpeakerID
50% of questioners’ tags detected50% of questioners’ tags detected Introductions: oral only, visual only, visual + oralIntroductions: oral only, visual only, visual + oral Spelling, intelligibility (international conference)Spelling, intelligibility (international conference)
Ticket2TalkTicket2Talk Conversations, awareness about new & oldConversations, awareness about new & old
Amarone, kitesurfing, scuba diving, PLAY StudioAmarone, kitesurfing, scuba diving, PLAY Studio
Neighborhood WindowNeighborhood Window Similar to T2T, though more of a novelty factor Similar to T2T, though more of a novelty factor
(and more noise)(and more noise) Common acquaintances (co-authors, conferences)Common acquaintances (co-authors, conferences) ““red bishops”red bishops”
38interrelativity.com
Unanticipated ExperiencesUnanticipated Experiences AutoSpeakerIDAutoSpeakerID
Ticket2TalkTicket2Talk
Neighborhood WindowNeighborhood Window ““death valley”, UbiDavedeath valley”, UbiDave
39interrelativity.com
Sample TicketsSample Tickets
40interrelativity.com
Sample TicketsSample Tickets
41interrelativity.com
Lessons LearnedLessons Learned Prepare for failurePrepare for failure
Networking issuesNetworking issues
Prepare for successPrepare for success No kiosks like more kiosks (5% vs. 50% vs. 95%)No kiosks like more kiosks (5% vs. 50% vs. 95%)
Don’t be overprotectiveDon’t be overprotective Expect unanticipated uses … within limitsExpect unanticipated uses … within limits
Design for noiseDesign for noise Expect noise, leverage it in the designExpect noise, leverage it in the design
Limits of “informed consent”Limits of “informed consent” Conflict between statistical paradigm and UI paradigmConflict between statistical paradigm and UI paradigm
42interrelativity.com
Future Work: Application Extensions
Future Work: Application Extensions
AutoSpeakerIDAutoSpeakerID Additional sensorsAdditional sensors
(floor)(floor)
Ticket2TalkTicket2Talk Queue management (> 4 people)Queue management (> 4 people)
Neighborhood WindowNeighborhood Window Mining algorithmsMining algorithms VisualizationsVisualizations
43interrelativity.com
New Sources of ContentNew Sources of Content RepositoriesRepositories
DevicesDevices
44interrelativity.com
New ContextsNew Contexts Digital HomesDigital Homes
Implicit sharingImplicit sharingof digital mediaof digital media
Family / visitors’ photosFamily / visitors’ photos
Digital WorkplacesDigital Workplaces Knowledge managementKnowledge management
through serendipitythrough serendipity Nameless faces / faceless namesNameless faces / faceless names
Digital Digital ThirdThird Places… Places…
45interrelativity.com
New ContextsNew Contexts The Great Good Place:The Great Good Place:
Cafes, Coffee Shops, Bookstores, Bars, Hair Salons, Cafes, Coffee Shops, Bookstores, Bars, Hair Salons, and Other Hangouts at the Heart of a Communityand Other Hangouts at the Heart of a Community
Ray OldenburgRay Oldenburg
46interrelativity.com
Related WorkRelated Work HighwaysHighways
Alaris E-boards(www.alaris.net)
47interrelativity.com
Looking forwardLooking forward Three key issues for Proactive DisplaysThree key issues for Proactive Displays
ContextContext Where should they go? Where should they go?
– Trust, desire to relate to others– Macro & micro
Content Content What should they show? What should they show?
– Type: images, text, video, audio, …– Storage: local vs. remote
ControlControl How will they know?How will they know?
– Implicit vs. explicit revelation– Anonymity vs. accountability
48interrelativity.com
Policy, Legal & Ethical IssuesPolicy, Legal & Ethical Issues ContentContent
Copyright issuesCopyright issues OffensivenessOffensiveness
ContextsContexts LiabilityLiability Ownership of Sensor dataOwnership of Sensor data
Physical association with digital contentPhysical association with digital content Risks (& rewards)Risks (& rewards) AccountabilityAccountability
49interrelativity.com
CollaboratorsCollaborators Experience UbiComp Project Experience UbiComp Project (Intel Research Seattle)(Intel Research Seattle)
InternsInterns David Nguyen (Nokia Research), David Nguyen (Nokia Research),
Al Rashid (Univ. Minnesota), Al Rashid (Univ. Minnesota), Suzi Soroczak (UW Information School)Suzi Soroczak (UW Information School)
EvaluationEvaluation David McDonald (UW Information School)David McDonald (UW Information School)
Interrelativity, Inc.Interrelativity, Inc. Khai Truong, Chief Technology OfficerKhai Truong, Chief Technology Officer
50interrelativity.com
For more informationFor more information Joe McCarthyJoe McCarthy
[email protected]@interrelativity.com
Proactive DisplaysProactive Displays http://interrelativity.com/http://interrelativity.com/
UbiCompUbiComp http://www.ubicomp.orghttp://www.ubicomp.org
Thanks! … Questions?