eswc2011 summer school: front-end to the semantic web
DESCRIPTION
This talk was given by Lora Aroyo at the ESWC2011 Summer SchoolTRANSCRIPT
“interface is the message”
on the path to a usable & personal Semantic Web
Lora AroyoVU University Amsterdam
@laroyo
1Wednesday, June 1, 2011
front-end to semantics: how do we interact with SemWeb Apps?
personalization: what do we need to adapt to users?
example applications: what good & bad is out there?
evaluation: why is continuous evaluation so important?
outline
2Wednesday, June 1, 2011
invisible computers
multitude of interaction modes
context-sensitive apps
networked devices: bridges between virtual & physical worlds
GUI become central
constantly increasing competition
why interfaces?
3Wednesday, June 1, 2011
combine content semantics with user context
integrate seamlessly physical & web worlds
identify relevance to user to rank & select information to present
continuous feedback cycle: to and from user
you need to deal with GUI on configuration level
perform continuous user testing
use real world data
take home message
4Wednesday, June 1, 2011
“interface is the message”
Aaron Koblin: Artfully visualizing our humanity, TED Talk, 2011
5Wednesday, June 1, 2011
FRONT-END TO SEMANTICShow do we interact with the SemWeb Apps?
6Wednesday, June 1, 2011
do SemWeb apps really differ?
7Wednesday, June 1, 2011
explicit semantics (often from open sources, e.g. LOD) used for system decisions and results
use facetted presentation, searching and browsing of information
use typically classifications, typologies or other structures of concepts
integrate data from different sources
aggregate data
semantics: what’s special?
8Wednesday, June 1, 2011
credits: Dan Brickley
9Wednesday, June 1, 2011
RDF data
10Wednesday, June 1, 2011
interaction with semantics
11Wednesday, June 1, 2011
© BBC MMVIIIhttp://twitpic.com/il1w/full
12Wednesday, June 1, 2011
http://www.bbc.co.uk/programmes/b00c06n2.rdf
13Wednesday, June 1, 2011
converting vocabularies
14Wednesday, June 1, 2011
PERSONALIZATIONwhat do we need to adapt to us?
15Wednesday, June 1, 2011
when we consider interaction & interfaces, then the user plays a key role
for good interface design, a good characterization of the user is needed
first, some concept from theory and literature
the user matters
16Wednesday, June 1, 2011
Definition: A ‘user profile’ is a data structure that represents a characterization of a user (u) at a particular moment of time (t)
So, a user profile represents what (from a given (system) perspective) there is to know about a user.The data in a user profile can be explicitly given by the user or have been derived.
user profile
17Wednesday, June 1, 2011
Personal dataFriend and relationsExperienceSystem accessBrowsing historyKnowledge (learning)Device dataLocation dataPreferences
user characteristics
18Wednesday, June 1, 2011
Definition: The ‘user model’ contains the definitions and rules for the interpretation of observations about the user and about the translation of that interpretation into the characteristics in a user profile.
So, a user model is the recipe for obtaining and interpreting user profiles.
user model
19Wednesday, June 1, 2011
Definition: ‘user modeling’ is the process of creating user profiles following the definitions and rules of the user model. This includes the derivation of new user profile characteristics from observations about the user and the old user profile based on the user model.
So, user modeling is the process of representing the user.
user modeling
20Wednesday, June 1, 2011
Stereotyping is one example of user modeling.
A user is considered to be part of a group of similar people, the stereotype.
Question: What could be stereotypes for conference participants (when we design the conference website)?
stereotyping
21Wednesday, June 1, 2011
Definition: A ‘user-adaptive system’ is a system that adapts itself to a specific user.
Often, a user-adaptive system (or adaptive system, in short) uses user profiles to base its adaptation on.So, designing an adaptive system implies designing the user modeling.
user-adaptive system
22Wednesday, June 1, 2011
User-adaptation is often used for personalization, i.e. making a system appear to function in a personalized way.
Question: What user profile characteristics would be useful in personalizing the conference’s registration site?Question: How would you obtain those characteristics?
user adaptation
23Wednesday, June 1, 2011
Device-dependenceAccessibility (disabilities)Location-dependenceAdaptive workflow
Question: Can you give concrete examples for interface adaptation, both the adaptation effect as the prior user modeling necessary?
examples: user adaptation
24Wednesday, June 1, 2011
Well-studied example of adaptation is ‘adaptive hypermedia’: a hypertext’s content and navigation are then adapted to the user’s browsing of the hypertext.
adaptive hypermedia
25Wednesday, June 1, 2011
DESIGNING INTERFACES
26Wednesday, June 1, 2011
Be cooperativeBe informativeBe truthfulBe relevantBe perspicuous (be clear)
dialog principles [Grice]
27Wednesday, June 1, 2011
Strive for consistencyEnable frequent users to use shortcutsOffer informative feedbackDesign dialog to yield closureOffer simple error handlingPermit easy reversal of actionsSupport internal locus of controlReduce short-term memory load
UI principles [Shneidermann]
28Wednesday, June 1, 2011
Visibility of system statusMatch between system and real worldUser control and freedomConsistency and standardsError preventionRecognition rather than recallFlexibility and efficiency of useAesthetic and minimalist designHelp users recognize, diagnose and recover from errorsHelp and documentation
usability heuristics [Nielsen]
29Wednesday, June 1, 2011
modeling the user: what are user’s preferences, interests, history, activities, etc.
modeling the user’s context: e.g. location, time, device
which of all the data available is relevant for this user in this context
also called context-aware
all about the user’s perspective
30Wednesday, June 1, 2011
switching between one context and another
doing things not only for him/herself, e.g. buying present for a girlfriend
user’s context distributed
31Wednesday, June 1, 2011
PERSONALIZED INTERACTIONs
32Wednesday, June 1, 2011
search, e.g. keyword, faceted
browse, story lines, narratives through collections
annotations of multimedia, e.g. (collaborative) tagging, professional annotation of text, images and video, tagging games
explanations, hints, user feedback, e.g. explanation of recommendation results, explanation of autocompletion suggestions
interaction modes
33Wednesday, June 1, 2011
recommendation systems, e.g. movies, music, art
user statistics and analysis, e.g. user usage data, profile, group profiles, etc.
social networking
typical examples
34Wednesday, June 1, 2011
Definition: A ‘recommender system’ is a system that recommends to a user, based on her individual interests, items that the user could find interesting.
Examples: music, movies, people, restaurantsTypes: collaborative (reason about similar users), content-based (reason about similar items)Problems: new users, new items, sparsity, gray sheep
recommender systems
35Wednesday, June 1, 2011
movies & TV programs, e.g. Netflix, MovieLens, TiVo, personalized TV guides
music, e.g. LastFM, Pandora, iTunes Genius
food & tourism, e.g. guides adapted to location, current time, preferences
news, e.g. Google reader, news filters
e-shopping, e.g. Amazon’s recommendations
advertisement, e.g. Facebook personalized ads
art, museums, e.g. personalized search, personalized museum guides
recommender systems
36Wednesday, June 1, 2011
Collection of activities/context/attention data
Derive interests from this data
Recommender-specific problems, e.g. cold start, over-specialization
Surface items of interest in the ‘long tail’
Cross-domain recommendations
Multi-person recommending
Granular control for users
considerations
37Wednesday, June 1, 2011
overview of user preferences, e.g. settings, privacy
overview of user interests, e.g. ranking of interests, links to content
overview of user/group activities, e.g. per topics, per activity, per date, over a period, overall
comparative views between users, e.g. LastFM, livingSocial movies user similarity, Twitter similar users to you
different views/visualization over the same set of user data
user profiles & stats
38Wednesday, June 1, 2011
39Wednesday, June 1, 2011
40Wednesday, June 1, 2011
professional networks & events, e.g. LinkedIn, Mendeley
people, organizations, e.g. Facebook, MySpace
social bookmarking, e.g. Delicious, StumbleUpon, Diggit
GetGlue
Books, e.g. LibabryThing
social networking
41Wednesday, June 1, 2011
EXAMPLE APPLICATIONSInterfaces & Personalization on SemWeb
42Wednesday, June 1, 2011
the big guys
43Wednesday, June 1, 2011
44Wednesday, June 1, 2011
45Wednesday, June 1, 2011
46Wednesday, June 1, 2011
47Wednesday, June 1, 2011
The Recommendation and Like plugins let users share any content they like back to their profile.
48Wednesday, June 1, 2011
The Activity Feed plugin shows users what their friends are doing on your site through likes and comments.
49Wednesday, June 1, 2011
50Wednesday, June 1, 2011
activity streams
http://xmlns.notu.be/aair/
51Wednesday, June 1, 2011
weighted interest
http://xmlns.notu.be/wi
52Wednesday, June 1, 2011
53Wednesday, June 1, 2011
EXAMPLE 1what do Gerrit Dou and Rembrandt have in common?
http://www.chip-project.org
54Wednesday, June 1, 2011
enriched Rijksmuseum collection
55Wednesday, June 1, 2011
style: Baroque
teacher of: Gerrit Dou
teacher of: Nicolaes Maes
teacher of: Ferdinand Bol
self-‐portrait
mili<a
place: Amsterdam,
1625 to 1650
56Wednesday, June 1, 2011
goal & central role of UM
57Wednesday, June 1, 2011
Personalized Web Access Online Tour Wizard
personalized experiencePersonalized Mobile Tour
Interactive user modeling
Recommendations of artworks & art topics
Semantic Search
Museum tour maps
Historic timeline
Interactive tours
On-the-fly adaptation
Synchronized user profile
58Wednesday, June 1, 2011
semantic recommendations
59Wednesday, June 1, 2011
semantic recommendations
60Wednesday, June 1, 2011
semantic recommendations
60Wednesday, June 1, 2011
semantic recommendations
61Wednesday, June 1, 2011
semantic recommendations
61Wednesday, June 1, 2011
personalized tours
62Wednesday, June 1, 2011
personalized tours
62Wednesday, June 1, 2011
Interactive Museum Guide
h"p://chip-‐project.org 63Wednesday, June 1, 2011
Interactive Museum Guide
64Wednesday, June 1, 2011
event-based browsing
65Wednesday, June 1, 2011
dynamic adaptationFor each artwork in the museum:
Related works
Include in the tour ( & recalculate the map/tour)
Indicate relevance in terms of e.g. personal interest, position, recommended by friends, by Rijks, on view
Rate to indicate interest
At any point of the tour:
Include/exclude artworks
Adjust tour length
Change navigation in and outside of the tour
Save for other tours
66Wednesday, June 1, 2011
EXAMPLE 2professionals vs. lay users on Web 2.0
semantic annotation of Rijksmuseum printshttp://e-culture.multimedian.nl/pk/annotate?
semantic tagging: http://waisda.nl
67Wednesday, June 1, 2011
Autocompletion with multiple vocabularies
http://slashfacet.semanticweb.org/autocomplete/demos/
http://slashfacet.semanticweb.org/wordnet/search
68Wednesday, June 1, 2011
69Wednesday, June 1, 2011
70Wednesday, June 1, 2011
70Wednesday, June 1, 2011
71Wednesday, June 1, 2011
71Wednesday, June 1, 2011
72Wednesday, June 1, 2011
72Wednesday, June 1, 2011
EXAMPLE 3semantic television
http://notube.tv
73Wednesday, June 1, 2011
74Wednesday, June 1, 2011
75Wednesday, June 1, 2011
76Wednesday, June 1, 2011
77Wednesday, June 1, 2011
watching TV in a group
for more details check out our blog at http://notube.tv
78Wednesday, June 1, 2011
watching TV in a group
for more details check out our blog at http://notube.tv
79Wednesday, June 1, 2011
watching TV in a group
80Wednesday, June 1, 2011
watching TV in a groupEnvironment
Interact with the second screen as a group Friend interaction at homeWatching as a group
SynchronizationTV & Second Screenbetween second screens between second screens & TV show content provider
Age15 - 35 years old
Type of Activitiesquiz and betting gameschange camera viewinformation regarding the content of the program textual captions
Type of ProgramSports
81Wednesday, June 1, 2011
observations
for more details check out our blog at http://notube.tv
82Wednesday, June 1, 2011
observations
for more details check out our blog at http://notube.tv
83Wednesday, June 1, 2011
second screen & TV functionalities
shared virtual space voice dubbing subtitles related information quizzes voting & bettingscene-grab & share social interaction live-chat parental advisory uncensored version different camera views
synchronization with second screen“overlay” on top of the main TV-picturecensoringdifferent camera viewsgroup alerts
84Wednesday, June 1, 2011
CONTINUOUS EVALUATION
85Wednesday, June 1, 2011
Target users’ characteristics
small groups with 2-4 persons and a male taking the leading role (67%)
middle-aged people in 30-60 years old (75%)
higher-educated (62%)
no prior knowledge about the Rijksmuseum collection (62%)
visit the museum for education (98%)
CHIP users
86Wednesday, June 1, 2011
87Wednesday, June 1, 2011
Define familiarity with the domain
Define familiarity with collections/vocabularies
Identify use cases
Identify navigation patterns
Identify requirements for user groups
Validate
Contextual observations
User interviews
Model user’s tasks
contextual analysis
88Wednesday, June 1, 2011
domain exploration
89Wednesday, June 1, 2011
usability testing
90Wednesday, June 1, 2011
91Wednesday, June 1, 2011
91Wednesday, June 1, 2011
92Wednesday, June 1, 2011
93Wednesday, June 1, 2011
results
94Wednesday, June 1, 2011
95Wednesday, June 1, 2011
95Wednesday, June 1, 2011
http://www.cs.vu.nl/intertain/
96Wednesday, June 1, 2011
combine content semantics with user context
integrate seamlessly physical & web worlds
identify relevance to user to rank & select information to present
continuous feedback cycle: to and from user
you need to deal with GUI on configuration level
perform continuous user testing
use real world data
take home message
97Wednesday, June 1, 2011