cognitive assistance in smart homes sylvain giroux and hélène pigot
TRANSCRIPT
![Page 1: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/1.jpg)
Cognitive
Assistance in
Smart
Homes
Sylvain Giroux Sylvain Giroux and Hélène and Hélène
PigotPigot
![Page 2: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/2.jpg)
Plan
Cognitive Assistance
Context, objectives, and approach
From homes…
Hardware level: networks, sensors, effectors
… to smart homes …
Middleware level: pervasive infrastructure
… to smart care !
Application level: cognitive assistance & tele-monitoring
Validation
Usability and clinical studies
Conclusion
![Page 3: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/3.jpg)
ContextP
eople suffering of cognitive impairments in Quebec Alzheimer disease : 5.1% of people over 65 years old Head trauma : 3000 new cases each yearSchizophrenia : 1% of the population
In many cases, they would be able to stay at home
if light assistance was provided.
But healthcare resources are scarce So relatives have to take responsibility for care
It then turns to an exhausting burdenHence relatives and caregivers urge for help.
![Page 4: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/4.jpg)
Objectives
Provide adapted and personalized environmental cues to
Foster the autonomy of cognitively impaired people
Reduce risks and hazards
Pervasive computing & Tangible user interfaces
Keep ensuring continuous cognitive assistance outside people’s home
Mobile computing & Location-based services
Help relatives and caregivers to stay in touch at distance with cognitively impaired people
Our intention is NOT to replace relatives and caregivers
![Page 5: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/5.jpg)
From homes…S
mart homes are augmented environments
Heterogeneous networks
Sensors networks
Embedded processors in devices, clothes, jewels…
Information devices
Networked communicating objects
![Page 6: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/6.jpg)
DOMUS: an augmented apartment
![Page 7: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/7.jpg)
… smart homes …S
mart homes are augmented environments
Heterogeneous networks
Wireless : WiFi, Bluetooth, RFID, UWB...Wired : Ethernet, Electrical wires, X10, power line…
ServersFull control over audio and video streams
![Page 8: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/8.jpg)
… smart homes …S
mart homes are augmented environments
Sensors networks
Identification and localization of objects and people
Ubisense tags, UWBSmart tags (RFID)
![Page 9: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/9.jpg)
… smart homes …S
mart homes are augmented environments
Embedded processors in devices and clothesUnder process
Perkowitz et al., Mining Models of Human Activities from the Web, WWW 2004, May 17-22, 2004, New York, NY USA.
![Page 10: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/10.jpg)
… smart homes …S
mart homes are augmented environments
Information devicesFixed: smart boards, Icebox… Mobile: laptop, wireless screen, PDAs…
![Page 11: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/11.jpg)
… smart homes …S
mart homes are augmented environments
Networked communicating objectsSightHearing
Smell (not yet investigated)Touch (not yet investigated)
Taste (is it possible ?)
![Page 12: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/12.jpg)
From homes to smart homes…
![Page 13: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/13.jpg)
… to smart care
Application level
Cognitive assistance
Tele-monitoring
![Page 14: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/14.jpg)
Cognitive deficits
Initiation
inactive periods whereas the person is supposed to perform actions
Memory
difficulties to remember the activity to perform, the steps, the locations of the objects involved
Planning
difficulties to perform an appropriate sequence of actions in the right order to achieve a goal
Attention
shifts of attention from the activity under progress to a stimulus causing interference
![Page 15: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/15.jpg)
Cognitive
Assistance: a
Demo
Cognitive deficits
Initiation, memory, planning, attention
User interfaces
Traditional GUI vs Tangible user interfaces : Transforming the whole house into a cognitive orthotic
Who initiate the interactions?
User vs Assistant
Telemonitoring
Asynchronous vs Synchronous
![Page 16: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/16.jpg)
Usability
& clinical studies
Where : Domus laboratory
Task : Meal preparation
Whom : Intellectually handicapped people
When : January 2007
![Page 17: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/17.jpg)
ConclusionGoing beyond the usual view of computing as “PC-based”
Pervasive computing enables a seamless integration of assistance in residents’ everyday life
Going beyond traditional human computer interfaces
Tangible user interfaces help to turn the whole house into a cognitive orthotic
Such smart homes can Provide cognitive assistanceFoster people’s autonomyLead to smarter care
![Page 18: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/18.jpg)
What’s next ?What’s next ?Current prototype
Monitoring of one activity by one personThe assistance system reacts after the user “error”
In a real environment, Must monitor many concurrent activities, many persons
Next issues Manage concurrent activities recognitionPredict the user behaviour (and ideally anticipating his “errors”)Disambiguate activities from observed eventsIdentify opportunities for assistance
![Page 19: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/19.jpg)
Cognitive assistance
What is the available information ?
Identification and location of people and objectsObjects involved in an activityPrimitive actions
Who the user is ?
personalization
What is the user doing ?
Activity recognitionHierarchical modelsLattice-theory
How to assist the user?
Highligth objectsTangible user interfaces
![Page 20: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/20.jpg)
Initiation deficitsInitiation deficits leads to inactive periods
whereas the person is supposed to perform actions
Wandering for a long time could be attributed to an initiation deficit
>> Prompt the resident
![Page 21: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/21.jpg)
Memory deficits
Difficulties to remember
the activity to perform the steps of the activity the locations of the tools and materials involved in that activity.
>> Show-me objects + « Follow-me » applied to objects
The lamp turns off when the object is too far away.
The lamp turns on to highlight the searched red book
![Page 22: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/22.jpg)
Planning deficitsD
ifficulties to perform an appropriate sequence of actions in the rightorder to achieve a goal.
>> Prepare_coffee = {take_milk, take_cup…}
>> Show to the user where to perform the next action
![Page 23: Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649edc5503460f94bec5fe/html5/thumbnails/23.jpg)
Usability
& clinical studies
Clinical studies using prototypes are in preparation and will soon be on-going at
Fernand-Séguin research center, L-H Lafontaine Hospital, Montreal
Dr Emmanuel Stip, psychiatristSchizophrenia
Centre de Réadaptation Estrie, SherbrookeHead trauma
Domus laboratoryIntellectually handicapped people