1313 final master presentationdepartment of computing science authoring of adaptive e-content for a...
TRANSCRIPT
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Adapting for AdaptivityAuthoring of Adaptive e-content for a Commercial Environment
Angelo [email protected]
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Supervisors
Commission members
Dr. A.I. Cristea (TU/e)
Ing. E. Heuvelman (Turpin Vision)
Prof. Dr. P.M.E. De Bra (TU/e)
Dr. J. Broekstra (TU/e)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Outline
1. Goal and Motivation2. Problem description3. Environment4. Theory and Systems5. Content-e/LAOS6. Demo7. Evaluation8. Conclusions
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Goal and Motivation
• Goal: a LAOS based Adaptive Hypermedia System (AHS) authoring tool that will see commercial use
• MOT is the only simple generic tool available, but not very user-friendly
• Turpin Vision wants to add adaptive capabilities to Content-e
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Problem description
• Adapt Content-e so it can be used to author LAOS layers
• Playable in AHA! (at the least)• Author existing MOT courses• Challenges: LAOS untested in
commercial environment; model conflicts with normal Turpin Vision approach
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Environment
• Turpin Vision is a SME (15 empl.)• Informal atmosphere• Clients: schools and publishers• Development primarily client-
demand driven• No clear picture of adaptivity; no
client-demand for adaptivity (yet)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
What is adaptivity?
• An adaptive system can adapt itself to a user automatically at runtime
• Transparent if done well• Applications: recommender
systems, online education, games• Different from adaptable!• Adaptive hypermedia system
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
What is adaptivity?
USERMODEL
ADAPTATIONENGINE
DOMAINMODEL
INTERFACEDomain model: describes the domain (the ‘subject matter’)User model: describes the user (e.g. knowledge of the domain)Adaptation engine: changes user model and view on domain, depending on user model and user actions, according to adaptation rules
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
‘Adaptive’ is not always really adaptiveCLIX
“How adaptive is CLIX?”“CLIX enables adaptation to a particular look and feel…”
(CLIX is actually adaptable)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
‘Adaptive’ is not always really adaptiveLearning Design
Claims adaptivity because a ‘live’ teacher can interact with users
(All humans are adaptive: this does not make the system adaptive)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
‘Adaptive’ is not always really adaptiveBlackboard
Adaptive release feature unlocks (releases) content based on certain criteria
(Actually pre-adaptation: learning paths are set beforehand and do not change)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
‘Adaptive’ is not always really adaptiveWebCT
“WebCT has incorporated adaptive technology into its products to comply with the US Rehabilitation Act”
(Not even close: talking about accessibility adjustments for the disabled)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Adaptivity is not always recognized• Kobsa’s experiment: fake
recommender system• Side effect: users ‘fell for it’• Like a placebo, the illusion of
personalization seems to be sufficient
• Conversely, real adaptivity is not always noticed!
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Environment: a ‘good’ system
• Academic: study, novelty• Stability or visual appeal not essential• Demonstrations often purely
theoretical
• Commercial: profit• Stability and visual appeal essential• Technology must be proven in
practice• Confidence
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Environment: authoring complexity• Linear: content and structure• Hypermedia: hyperspace• Adaptive hypermedia: knowledge
space, adaptation process (e.g. labeling)
• Not everything must be done by one person, still complex
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Environment: ‘selling’ AHS
• Graphical user interface, visual themes and metaphors
• Simplify authoring task (automation, presets)
• Facilitate transition between linear and adaptive (conversion, standards)
• Convincing demonstrations• Evaluations and user studies.
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Existing Theory and Systems
• LAOS / LAG• MOT• CAF• AHA!• Content-e
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
LAOS, MOT and AHA!
USERMODEL
ADAPTATIONENGINE
GOAL MODEL
INTERFACE
PRESENTA-TION MODEL
ADAPTATION MODEL
DOMAIN MODEL
•authoring framework
•Conceptual view of an AHS
•More parts
•Resulting AHS do not necessarily look like this
LAOS: Layered WWW Adaptive AHS Authoring Model and their corresponding Algebraic OperatorS
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
LAOS, MOT and AHA!
GM
AM
UM
DM
PM
Domain Model: concepts and relations
Goal Model: filters, reorders, annotates
Adaptation Model: adaptation rules
User Model: overlay, free variables
Presentation Model: visibility, style, display settings
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
LAOS, MOT and AHA!
GM
AM
UM
DM
PM
MOT CAF
(xml)
MOT: My Online Teacher
CAF: Common Adaptivity Format
• XML based
• Only DM and GM (so far)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
LAOS, MOT and AHA!
GM
AM
UM
DM
PM
MOT
Any text editor
CAF
(xml)
LAG
(txt)
LAG strategies
condition-action rules
programming language
Layers of Adaptation Granularity
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
LAOS, MOT and AHA!
Converter
GM
AM
UM
DM
PM
MOT
Any text editor
CAF
(xml)
LAG
(txt)
AHA! course
Adaptive Hypermedia Architecture
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e
Import modules
Paragraph editor
XMLeditor
Database
Interactive Reader
Custom
...
Word
Publishing modules
HTML
Custom
...
Word
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS
• Turpin Vision desired an extension to their Content-e tool
• New sub-goals:• At least replicate MOT functionality• Improve user interface significantly• Extend MOT functionality based on
LAOS• Evaluate result
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS: Initial solution
Converter
GM
AM
UM
DM
PM
Content-e
CAF
(xml)
LAG
(txt)
AHA! course
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS: Actual Solution
Converter
GM
AM
UM
DM
PM
Content-e
Any text editor
CAF
(xml)
LAG
(txt)
AHA! course
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS in more detail
• .ASP / JavaScript• Collection of add-ons:
• 2 ‘XML paragraphs’ (concept, goal model)
• 1 import module (from CAF)• 1 publish module (to CAF)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS: changes
Import modules
Paragraph editor
XMLeditor
Database
Interactive Reader
Custom
CAF
Word
Publishing modules
HTML
Custom
CAF
Word
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS: XML editor
XHTML form
XML (paragraph)
Form event handlers
DOM objectForm XSL
XML (template)
Preview XSL
Preview
Input Pane Preview Pane
Event handlers
change, save or preview
new edit save
previewchangeor init
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS: Publication to CAF• Concepts and goal models are
represented with XML already• Compose into single XML structure
(use XML Writer)• Transform Content-e
representation to actual CAF elements
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Content-e/LAOS: Import from CAF• Transform CAF to Content-e XML• Insert content (obtain id’s)• Postprocess: insert id’s into
references• Update content• Problem: existing code did not
function inside transaction
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Demo
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Evaluation: setup
• MOT vs Content-e/LAOS comparison• ‘Politehnica’ university, Bucharest• 1 week theory• Exam: 63 -> 43 students in 7 groups• 1 week project• System Usability Scale (SUS) and
custom questionnaires
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Evaluation: results
• MOT: more stable• Content-e/LAOS: more appealing• “if it had less bugs I would use
Content-e/LAOS”
• MOT: functional (SUS)• C-e/LAOS: overall impression
(specific questionnaire)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
SUS comparison
0
1
2
3
4
5use frequently
complex
easy
need support
well integrated
inconsistency
learn quickly
cumbersome
confident to use
need to learn a lot to use
MOT
Ce/LAOS
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Which system would students choose?
0
5
10
15
20
25
MOT No preference C-e/LAOS
# S
tud
ents
DM authoring
GM authoring
overall
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Evaluation
• Opinion not influenced by acquired skill with systems
• Opinion probably influenced by problems during project (book labels, server reinstall)
• Longer exposure to Content-e/LAOS might lead to better evaluation
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Conclusions: goals
• MOT functionality almost completely replicated
• Extensions: typed DM attributes, relation authoring, CAF import
• UI improvements: single-screen concept authoring, click and drag GM authoring
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Conclusions: other results
• Improvements to Content-e• Tree component• Transactions• ASP data limit
• Course material (Gipf, Sun-Tzu)• Practical evaluation• Two papers (AH’06, ICALT’06)
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Recommendations
• Content-e needs to be more stable• More tests and evaluations• Extensions to the system
• Graph author• Default adaptation and user models• Real “student view”• Adaptation model XML paragraph?• “Player”
Final Master Presentation
Department of Computing Science
Authoring of Adaptive e-content for a Commercial Environment
Adapting for Adaptivity
14/8/2006
Any questions?
http://www.stack.nl/~angelo/studie/thesis/