©2011 cscd 487/587 human computer interface winter 2013 lecture 9 social interaction
TRANSCRIPT
![Page 1: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/1.jpg)
©2011
CSCD 487/587Human Computer Interface
Winter 2013
Lecture 9Social Interaction
![Page 2: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/2.jpg)
©20112www.id-book.com
Overview
• Being social• Face to face conversations• Remote conversations• Tele-presence• Co-presence• Emergent social phenomena
![Page 3: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/3.jpg)
©20113www.id-book.com
Conversational mechanisms
• Various mechanisms and ‘rules’ are followed when holding a conversation, e.g.mutual greetings
A: Hi thereB: Hi!C: HiA: All right?C: Good, how’s it going?A: Fine, how are you?C: OKB: So-so. How’s life treating you?
![Page 4: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/4.jpg)
©20114www.id-book.com
Being social
• What do you think?1. Are F2F conversations being superseded
by our social media?2. How are the ways we interact with one
another changing?
![Page 5: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/5.jpg)
©20115www.id-book.com
Conversational rules
• Sacks et al. (1978) work on conversation analysis describe three basic rules:
Rule 1: Current speaker chooses next speaker by asking an opinion, question, or requestRule 2: Another person decides to start speakingRule 3: Current speaker continues talking
![Page 6: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/6.jpg)
©20116www.id-book.com
Conversational rules• Turn-taking used to coordinate
conversation– A: Shall we meet at 8?– B: Um, can we meet a bit later?
– A: Shall we meet at 8?– B: Wow, look at him?– A: Yes what a funny hairdo!– B: Um, can we meet a bit later?
• Back channeling to signal to continue and following– Uh-uh, umm, ahh
![Page 7: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/7.jpg)
©20117www.id-book.com
More conversational rules
•Farewell rituals– Bye then, see you, yer bye, see you later….
• Implicit and explicit cues– e.g. looking at watch, fidgeting with coat and
bags – Explicitly saying “Oh dear, must go, look at the
time, I’m late…”
![Page 8: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/8.jpg)
©20118www.id-book.com
Breakdowns in conversation
•When someone says something that is misunderstood:– Speaker will repeat with
emphasis:A: “this one?”B: “no, I meant that one!”
– Also use tokens:Eh? Quoi? Huh? What?
![Page 9: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/9.jpg)
©20119www.id-book.com
What happens in social media conversations?
• Think about this ….• Do same conversational rules apply?• Are there more breakdowns?• How do people repair them for:
– Phone?– email?– Instant messaging?– texting?– Skyping?
![Page 10: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/10.jpg)
©201110www.id-book.com
Remote Conversations
• Much research on how to support conversations when people are
‘at a distance’ from each other
• Many applications have been developed– e.g., email, videoconferencing, videophones,
videoconferencing, instant messaging, chatrooms
![Page 11: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/11.jpg)
©2011
Early videophone and visualphone
11www.id-book.com
![Page 12: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/12.jpg)
©201112www.id-book.com
VideoWindow system (Bellcore, 1989)
• Shared space that allowed people 50 miles apart to carry on a conversation as if in same room drinking coffee together
• 3 x 8 ft ‘picture-window’ between two sites with video and audio
• People did interact via the window but strange things happened (Kraut, 1990)
![Page 13: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/13.jpg)
©201113www.id-book.com
Sketch of VideoWindow
![Page 14: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/14.jpg)
©201114www.id-book.com
Findings of how VideoWindow System was used
• Talked constantly about the system
• Spoke more to other people in the same room rather than in other room
• When tried to get closer to someone in other place had opposite effect - went out of range of camera and microphone
![Page 15: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/15.jpg)
©201115www.id-book.com
Skype Success
• Global household name• Seeing others on screen enables
more intimacy than audio phone • Enables people to get to know
each other better (really?)• Less awkward for young children
– Like “to show, not tell” (Ames et al, 2010)
![Page 16: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/16.jpg)
©201116www.id-book.com
3D virtual worlds
• Second Life (2007)– Over 8 million users
• Are there advantages to meeting in a 3D world? (In Your opinion ...)
![Page 17: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/17.jpg)
©201117www.id-book.com
Second Life – The OU
![Page 18: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/18.jpg)
©201118www.id-book.com
Facebook and Twitter
• Everyone uses them so what's to learn?
• Used in Emergencies, demos, etc., – Emergency: Users spread up-to-the
minute info and retweet about how a wildfire or gas plume is moving
– Yet, can also start or fuel rumors, by adding news that is old or incorrect
– Perhaps, more confusing than helpful
![Page 19: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/19.jpg)
©201119www.id-book.com
Telepresence
• New technologies designed to allow a person to feel as if they were present in the other location – Projecting their body movements,
actions, voice and facial expressions to the other location or person
– e.g. superimpose images of the other person on a workspace
![Page 20: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/20.jpg)
©201120www.id-book.com
Portholes (Dourish and Bly, 1992)
Regularly updated digitized images of people in their offices appeared on everyone’s desktop machines
throughout day and night
![Page 21: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/21.jpg)
©201121www.id-book.com
Clearboard (Ishii et al, 1993)
• Transparent board that shows other person’s facial expression on your board as you draw
![Page 22: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/22.jpg)
©201122www.id-book.com
Hypermirror (Morikawa and Maesako, 1998)
– Allows people to feel as if they are in the same virtual place even though in physically different spaces
(woman in white sweater is in a different room to the other three)
People in different places are superimposed
on the same screento make them appear as if
in same space
![Page 23: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/23.jpg)
©201123www.id-book.com
Creating personal space in Hypermirror
2) Two in this room are invadingthe ‘virtual’ personal spaceof the other person by appearing to bephysically on top of woman in white sweater
3) Two in the room move apart to allow person in other space more ‘virtual’ personal space
![Page 24: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/24.jpg)
©201124www.id-book.com
Everyone happy
![Page 25: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/25.jpg)
©201125www.id-book.com
How much realism?
• Is needed in telepresence to make it compelling?
• Telepresence rooms try make the remote people appear to be life-like by using multiple high def cameras with eye-tracking features and directional microphones
![Page 26: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/26.jpg)
©201126www.id-book.com
A telepresence room
![Page 27: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/27.jpg)
©201127www.id-book.com
Coordination Mechanisms• When a group of people act or interact
together they need to coordinate themselves– e.g., playing football, navigating a ship
• They use:– Verbal and non-verbal communication– Schedules, rules, and conventions– Shared external representations
• Question is: What does it take to coordinate groups through technology?
![Page 28: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/28.jpg)
©201128www.id-book.com
Co-presence
• Technologies that enable co-located groups to collaborate more effectively– When working, learning and socializing
• Examples:– Smartboards,– Multi-user Surfaces,– Wii and Kinect
![Page 29: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/29.jpg)
©201129www.id-book.com
F2F Coordinating Mechanisms
• Talk is central• Non-verbal also used to emphasize and as
substitute– e.g. nods, shakes, winks, glances, gestures and
hand-raising
• Formal meetings– Explicit structures such as agendas, memos,
and minutes are employed to coordinate the activity
![Page 30: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/30.jpg)
©201130www.id-book.com
Shared External Representations
• Common methods used to coordinate collaborative activities, – e.g., checklists, tables, to-do lists
• They can provide external information on:– Who is working on what – When it is being worked on– Where it is being worked on– When a piece of work is supposed to be
finished – Whom it goes to next
![Page 31: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/31.jpg)
©201131www.id-book.com
Collaborative technologies to support coordination
• There are a variety of software tools designed to support scheduling, planning and coordinating – Group calendars – Google Calendar example– Group documents – Google docs, Dropbox – Project management tools, and Workflow tools
![Page 32: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/32.jpg)
©201132www.id-book.com
Awareness Mechanisms
• Involves knowing who is around, what is happening, and who is talking with whom
• In-Person Peripheral awareness– Keeping an eye on things happening in the periphery
of vision– Overhearing and overseeing - allows tracking of what
others are doing without explicit cues
![Page 33: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/33.jpg)
©201133www.id-book.com
Lo tech awareness mechanism
![Page 34: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/34.jpg)
©201134www.id-book.com
Designing technologies to support awareness
• Provide awareness of others who are in different locations
• Workspace awareness:– “Up-to-the-moment understanding of
another person’s interaction with the shared workspace”
(Gutwin and Greenberg, 2002)• Examples: ReacTable and Reflect Table
![Page 35: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/35.jpg)
©201135www.id-book.com
The Reactable experience
Create music together “on the fly”
![Page 36: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/36.jpg)
©201136www.id-book.com
The Reflect Table
Led's display person's contribution to the conversation visually !!!!
![Page 37: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/37.jpg)
©2011
Reflect Table
Study looked at group participation using Reflect Table
Results mixed Some people increased their
participation, others became frustrated and ignored the LED's
Those who spoke the most, changed the most, decreased their talking
![Page 38: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/38.jpg)
©2011
The Dynamo system
38www.id-book.com
Sharing large screen with their individual Devices.
![Page 39: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/39.jpg)
©201139www.id-book.com
Notification systems
• Users notify others as opposed to being constantly monitored
• Provide information about shared objects and progress of collaborative tasks
– Example: Babble, dynamic visualization of participants in chat rooms
![Page 40: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/40.jpg)
©201140www.id-book.com
Babble (IBM, Erickson et al, 1999)
Circle with marblesrepresents peopletaking part inconversation in a chatroom
Those in the middleare doing the mostchattingThose towardsthe outside are less active in the conversation
![Page 41: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/41.jpg)
©201141www.id-book.com
Whats next?
• Besides perpetual sharing and broadcasting of information, knowledge, and personal content?
• Lifelogging – Recording everything in one’s life and
sharing
• Micro-chatting – Beyond twittering and chatroulette?
![Page 42: ©2011 CSCD 487/587 Human Computer Interface Winter 2013 Lecture 9 Social Interaction](https://reader035.vdocuments.mx/reader035/viewer/2022062806/56649e215503460f94b0d167/html5/thumbnails/42.jpg)
©201142www.id-book.com
Summary
• Social mechanisms, like turn-taking, conventions, etc., enable us to collaborate and coordinate our activities
• Keeping aware of what others are doing and letting others know what you are doing are important aspects of collaborative working and socialising
• Many technologies systems have been built to support telepresence and co-presence