![Page 1: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/1.jpg)
chai:: Computer human adapted interac1on research group
Overview of emerging technologies to define, enhance, and measure health
literacy
Judy Kay
Human Centred Technology Group, Engineering and IT, University of Sydney SyReNs: Science and Technology of Learning
SyReNs: PLANET… Physical Ac;vity
![Page 2: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/2.jpg)
chai:: Computer human adapted interac1on research group
About me (and CHAI) … HCI-‐techo
• Inven1ng future technology to tackle important problems
• Personalisa1on • Personal data and its management • PuLng people in control • Interac1ve surfaces… walls, tables…
![Page 3: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/3.jpg)
chai:: Computer human adapted interac1on research group
Mental models
![Page 4: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/4.jpg)
chai:: Computer human adapted interac1on research group
Mental models
A set of beliefs that the user holds
![Page 5: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/5.jpg)
chai:: Computer human adapted interac1on research group
Mental models
A set of beliefs that the user holds eg. It is healthier not to take medica1ons
![Page 6: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/6.jpg)
chai:: Computer human adapted interac1on research group
Mental models
A set of beliefs that the user holds eg. It is healthier not to take medica1ons
![Page 7: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/7.jpg)
chai:: Computer human adapted interac1on research group
Mental models
A set of beliefs that the user holds eg. It is healthier not to take medica1ons
Vaccina1ons are dangerous Sta1ns are dangerous and useless
![Page 8: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/8.jpg)
chai:: Computer human adapted interac1on research group
Ra1onality?
![Page 9: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/9.jpg)
chai:: Computer human adapted interac1on research group
“Be able to keep two completely contradictory ideas alive and well inside
your heart and head at all 1mes”.
Bruce Springsteen (on 37signals)
![Page 10: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/10.jpg)
chai:: Computer human adapted interac1on research group
“Four out of five voices in my head say-‐ "Eat the Chocolate”.
PhD Student T-‐shirt
![Page 11: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/11.jpg)
chai:: Computer human adapted interac1on research group
Complexity?
![Page 12: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/12.jpg)
chai:: Computer human adapted interac1on research group
“I know that you should eat a lot of the Indian spice turmeric, as it fights cancer.
Also that you should avoid the Indian spice turmeric, as it might contain dangerous
levels of lead.
One or the other.”. A.J. Jacobs,
Drop Dead Healthy: One Man's Humble Quest for Bodily PerfecFon
![Page 13: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/13.jpg)
chai:: Computer human adapted interac1on research group
Mental models come from: • Formal educa1on • And so much else
– Experience – Cultural expecta1ons – Context – Emo1onal state – ….
• Determining what the user – Believes to be true – Trusts – Feels permiZed to consider and do – Feeling of competence
![Page 14: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/14.jpg)
chai:: Computer human adapted interac1on research group
Why do mental models maZer for interface designers?
![Page 15: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/15.jpg)
chai:: Computer human adapted interac1on research group
Why do mental models maZer for interface designers?
They define • what a user can “see” and “hear” • How they interpret informa;on Clashes between user, programmer, expert MMs
![Page 16: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/16.jpg)
chai:: Computer human adapted interac1on research group
Mental models for Health literacy so\ware and systems
• Design based on each user’s mental models – Q: Will this user be able to find the informa1on that is relevant to them (given their mental model)?
– Q: Will they understand that informa1on (given their mental model)?
• Systems that help people – Build awareness of their own mental model – And of alternate views – Be sa1sfied with their interac1on experience
![Page 17: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/17.jpg)
chai:: Computer human adapted interac1on research group
User models
And personalisa1on
![Page 18: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/18.jpg)
chai:: Computer human adapted interac1on research group
User model
• Computer systems “beliefs” about the user – eg User cannot read graphs – eg. User believes vaccina1on is dangerous
• Data about a person … big personal data • Drives personalisa1on
– Personalisa1on is pervasive in search engines and web sites
– can be dangerous …“filter bubbles” … confirma1on and valida1on of personal beliefs
![Page 19: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/19.jpg)
chai:: Computer human adapted interac1on research group
Example… dangerous filter bubbles
User belief: vaccina1on is dangerous
![Page 20: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/20.jpg)
![Page 21: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/21.jpg)
chai:: Computer human adapted interac1on research group
But personalisa1on is everywhere
And does help cope with complexity
![Page 22: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/22.jpg)
![Page 23: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/23.jpg)
chai:: Computer human adapted interac1on research group
Accountable personalisa1on?
PuLng users in control…
![Page 24: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/24.jpg)
chai:: Computer human adapted interac1on research group
User models, personal data, exploi1ng digital footprints….
Open user/learner models (OLMs)
![Page 25: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/25.jpg)
chai:: Computer human adapted interac1on research group
Visible digital footprints so I can compare myself with others
![Page 26: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/26.jpg)
chai:: Computer human adapted interac1on research group
Patina: Dynamic Heatmaps for Visualizing Application Usage (CHI2013) Justin Matejka, Tovi Grossman, and George Fitzmaurice
This user’s footprints
Overall population footprints
![Page 27: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/27.jpg)
chai:: Computer human adapted interac1on research group
Platforms that will give excellent foundations for individuals to learn
Community forma1on
MOOCs
Can create many… Different strokes for different folks
SPOCS
Lots of learning data so we can learn to improve learning
Self-‐paced simula1ons Discussion board
New online learning tools
![Page 28: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/28.jpg)
Kahn Academy, what a student sees after the pre-test
Model of learner
Gamification element
![Page 29: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/29.jpg)
Short video + self-test
![Page 30: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/30.jpg)
chai:: Computer human adapted interac1on research group
Learning Analy1cs and Educa1onal Data Mining
Popula1on level Classroom Teacher Individual
![Page 31: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/31.jpg)
chai:: Computer human adapted interac1on research group
SIV Lots of green means
learner doing well
Weak aspects visible as red
Overview visualisation
![Page 32: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/32.jpg)
Little detail
![Page 33: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/33.jpg)
chai:: Computer human adapted interac1on research group
User models, personal data, exploi1ng digital footprints….
Open user/learner models (OLMs)
![Page 34: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/34.jpg)
chai:: Computer human adapted interac1on research group
Technologies to help track and discover personal “reality”
![Page 35: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/35.jpg)
Sensors in our home – like Withings scales
![Page 36: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/36.jpg)
Sensors we wear – like Fitbit, Nike FuelBand,....
![Page 37: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/37.jpg)
Desktop sensors like slife, RSI-prevention sensors,.......
![Page 38: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/38.jpg)
chai:: Computer human adapted interac1on research group
Pervasive displays that help us see “reality”
Lots of displays, some calmer than others
![Page 39: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/39.jpg)
Opportunity
39
Ubiquitous Devices: personal, wearable, portable, pervasive.
![Page 40: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/40.jpg)
chai:: Computer human adapted interac1on research group
Example: pill taking aid
![Page 41: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/41.jpg)
Ambient displays, with subtle meaning, perhaps known only to the owner
Red glow – time to take medication
![Page 42: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/42.jpg)
Green glow .. All on track
![Page 43: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/43.jpg)
chai:: Computer human adapted interac1on research group
Also has mobile-‐phone reminder
![Page 44: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/44.jpg)
chai:: Computer human adapted interac1on research group
The inac1vity problem
Too much siLng For too long without breaks
![Page 45: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/45.jpg)
Blue… active
Inactive > 30 mins
![Page 46: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/46.jpg)
chai:: Computer human adapted interac1on research group
Sharing data
Peers to support each other And compete
![Page 47: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/47.jpg)
chai:: Computer human adapted interac1on research group
The power of peers
Reality is relative!!!
![Page 48: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/48.jpg)
chai:: Computer human adapted interac1on research group
Some new ways to learn
![Page 49: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/49.jpg)
Interactive walls for engaging health education
![Page 50: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/50.jpg)
![Page 51: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/51.jpg)
T. Apted, J. Kay, and A. Quigley. Tabletop sharing of digital photographs for the elderly. In CHI '06: SIGCHI Conf on Human Factors in Computing Systems, pp 781-790, New York, NY, USA, 2006. ACM Press
Older users too
![Page 52: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/52.jpg)
chai:: Computer human adapted interac1on research group
P. Dillenbourg. What do you mean by 'collabora1ve learning'?
discussion?
externalisa1on
diverse exper1se
affec1on
Two hands are beZer than one
building on others argumenta1on
Collabora1ve learning
![Page 53: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/53.jpg)
chai:: Computer human adapted interac1on research group
![Page 54: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/54.jpg)
chai:: Computer human adapted interac1on research group
![Page 55: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/55.jpg)
chai:: Computer human adapted interac1on research group
Summary from an HCI-‐techo
• User-‐centred design – Understanding users’ mental models – Crea1ng personalised so\ware to aid communica1on, based on user models
– Exploi1ng user models: OLMs, gamifica1on – Learning analy1cs and data mining
• Pervasive sensing and displays – Capturing “reality” – New learning contexts
![Page 56: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/56.jpg)
chai:: Computer human adapted interac1on research group
Acknowledgements
![Page 57: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/57.jpg)
chai:: Computer human adapted interac1on research group
Interac1ve surfaces
So\ware infrastructure user control, scrutability
Interfaces to user model
Acknowledgements Data mining
![Page 58: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/58.jpg)
chai:: Computer human adapted interac1on research group
Influences…
• Human-‐Computer Interac1on – Mental models – User models – Explicit assump1ons
• Open Learner Models (OLMs)
• Technology for learning – Pervasive devices for lifelong awareness, self-‐monitoring
– New places to learn, embedded everywhere – Personalisa1on, Learning Analy1cs, Data Mining
![Page 59: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/59.jpg)
![Page 60: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/60.jpg)
chai:: Computer human adapted interac1on research group
User models, personal data, exploi1ng digital footprints….
Open user/learner models (OLMs)
![Page 61: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/61.jpg)
Learning dashboards: an overview and future research opportunities Katrien Verbert • Sten Govaerts • Erik Duval • Jose Luis Santos • Frans Van Assche •
Gonzalo Parra • Joris Klerkx Pers Ubiquit Comput, 2013
![Page 62: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/62.jpg)
![Page 63: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/63.jpg)
![Page 64: Overview of emerging technologies to define, enhance, and measure health literacy. Professor Judy Kay](https://reader033.vdocuments.mx/reader033/viewer/2022051514/548766a05906b5ec0c8b459a/html5/thumbnails/64.jpg)