virtual and augmented reality - st. olavs hospital€¦ · virtual and augmented reality gabriel...
TRANSCRIPT
![Page 1: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/1.jpg)
Virtual and augmented reality
Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital
Researcher CIUS, NTNU
![Page 2: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/2.jpg)
![Page 3: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/3.jpg)
Overview
• Introduce VR/AR
• Medical applications for VR
• AR (in the OR)
• HoloLens
• Demo
![Page 4: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/4.jpg)
VR vs. AR
![Page 5: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/5.jpg)
VR vs. AR
• Computer generated environment• Fully immersive experience• Completely artificial world
• Augments the real world• User not cut off from reality
![Page 6: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/6.jpg)
VR - hardware
![Page 7: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/7.jpg)
VR – principle
1. Lenses 2. Display 3. Processing and tracking
![Page 8: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/8.jpg)
Is it the same as the real-world?
• Depends on hardware, but there is a catch!
Vergence accommodation conflict, Hoffman et al.
![Page 9: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/9.jpg)
Surgical training
NSALK - Norwegian National Advisory Unit on Advanced Laparoscopic Surgery
![Page 10: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/10.jpg)
Surgical simulators
Li et al. - Application of virtual reality technologyin clinical medicine
![Page 11: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/11.jpg)
Virtual operating room
• HTC Vive• Student training• Role play• Remote simulation setup
F. Lindseth et al.
![Page 12: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/12.jpg)
Virtual operating room
F. Lindseth et al.
![Page 13: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/13.jpg)
Pain management morphine or VR?
Hoffman, H.G et al.
![Page 14: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/14.jpg)
Phobia
Be Fearless app
![Page 15: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/15.jpg)
Stroke patients – spatial neglect
Fordell H. et al.
![Page 16: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/16.jpg)
Detection
Fordell H. et al.
![Page 17: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/17.jpg)
Rehabilitation
Fordell H. et al.
![Page 18: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/18.jpg)
Experience ageing – macular hole
https://youtu.be/pOW7oG6bIFI
![Page 19: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/19.jpg)
VR in the OR
GYN - FOR, 2015
+ Improved 3D perception- No direct eye contact with the surgical field
![Page 20: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/20.jpg)
Augmented reality
Lifewire
= computer-generated content overlaid on a real world environment
![Page 21: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/21.jpg)
Augmented reality
![Page 22: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/22.jpg)
Augmented reality is it new?
Sutherland et al., 1968
![Page 23: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/23.jpg)
Early example
State et al.
![Page 24: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/24.jpg)
Liver surgery
Fraunhofer, MEVIS
![Page 25: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/25.jpg)
Neurosurgery
D. Low et al.
![Page 26: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/26.jpg)
Vein finder
![Page 27: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/27.jpg)
Vein finder
https://youtu.be/3xeM-jfJsWg
![Page 28: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/28.jpg)
HoloLens – “the leader in mixed reality”
Microsoft
![Page 29: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/29.jpg)
Liver surgery planning
Intervensjonssenteret
![Page 30: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/30.jpg)
AR in remote emergency room
University of Maryland – ultrasound acquisitions
![Page 31: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/31.jpg)
Intraoperative AR
![Page 32: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/32.jpg)
Scopis medical
https://youtu.be/xvbWE4OsKxY
![Page 33: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/33.jpg)
HeartPad
Illustration by Steve Ford
![Page 34: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/34.jpg)
HeartPad
Illustrations by Steve Ford
![Page 35: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/35.jpg)
Model fusion under acquisition
![Page 36: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/36.jpg)
Fusion principle
![Page 37: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/37.jpg)
Real-time fusion in the echo lab
![Page 38: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/38.jpg)
Student test
![Page 39: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/39.jpg)
Student test
![Page 40: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/40.jpg)
HoloLens implementation
![Page 41: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/41.jpg)
HoloLens implementation
![Page 42: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/42.jpg)
HoloLens implementation
![Page 43: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/43.jpg)
Plans
![Page 44: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/44.jpg)
HoloLens alternatives
Apple - rumor
ODG
Meta
Sony, SmartEye glasses
![Page 45: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/45.jpg)
Demo
![Page 46: Virtual and augmented reality - St. Olavs hospital€¦ · Virtual and augmented reality Gabriel Hanssen Kiss Research coordinator FOR, St Olavs hospital Researcher CIUS, NTNU. Overview](https://reader034.vdocuments.mx/reader034/viewer/2022052613/5f82ab6ea2d89130b90d78ce/html5/thumbnails/46.jpg)
Demo