introduction to virtual reality (vr) rudy darken & michael zyda naval postgraduate school {...
TRANSCRIPT
Introduction to Virtual Reality (VR)Introduction to Virtual Reality (VR)
Rudy Darken & Michael ZydaRudy Darken & Michael Zyda
Naval Postgraduate SchoolNaval Postgraduate School
{ Darken, Zyda }@cs.nps.navy.mil{ Darken, Zyda }@cs.nps.navy.mil
Rudy Darken & Michael ZydaRudy Darken & Michael Zyda
Naval Postgraduate SchoolNaval Postgraduate School
{ Darken, Zyda }@cs.nps.navy.mil{ Darken, Zyda }@cs.nps.navy.mil
Intro to VR Overview
What constitutes a "virtual environment"?What constitutes a "virtual environment"?
What problems demand a virtual What problems demand a virtual environment interface?environment interface?
What are the important issues in What are the important issues in designing and building virtual designing and building virtual environment interfaces?environment interfaces?
What constitutes a "virtual environment"?What constitutes a "virtual environment"?
What problems demand a virtual What problems demand a virtual environment interface?environment interface?
What are the important issues in What are the important issues in designing and building virtual designing and building virtual environment interfaces?environment interfaces?
Virtual Environment Definitions
A Computer-Generated, 3D Spatial A Computer-Generated, 3D Spatial Environment in Which Users Can Environment in Which Users Can Participate in Real-timeParticipate in Real-time
Virtual Environments Can BeVirtual Environments Can Be
• Fully Immersive, Encompassing WorldsFully Immersive, Encompassing Worlds
• Augmentations (Overlay) to the Real WorldAugmentations (Overlay) to the Real World
• ““Through the Window” Worlds (Non-immersive)Through the Window” Worlds (Non-immersive)
A Computer-Generated, 3D Spatial A Computer-Generated, 3D Spatial Environment in Which Users Can Environment in Which Users Can Participate in Real-timeParticipate in Real-time
Virtual Environments Can BeVirtual Environments Can Be
• Fully Immersive, Encompassing WorldsFully Immersive, Encompassing Worlds
• Augmentations (Overlay) to the Real WorldAugmentations (Overlay) to the Real World
• ““Through the Window” Worlds (Non-immersive)Through the Window” Worlds (Non-immersive)
Virtual Environment Definitions
Many names for the same thingMany names for the same thing
• Artificial reality, Cyberspace, Virtual Reality, Virtual Artificial reality, Cyberspace, Virtual Reality, Virtual Worlds, Virtual Environments, Synthetic Worlds, Virtual Environments, Synthetic EnvironmentsEnvironments
Many names for the same thingMany names for the same thing
• Artificial reality, Cyberspace, Virtual Reality, Virtual Artificial reality, Cyberspace, Virtual Reality, Virtual Worlds, Virtual Environments, Synthetic Worlds, Virtual Environments, Synthetic EnvironmentsEnvironments
The origins of the terms for VR ...
Artificial realityArtificial reality• The first term we encounter historically.The first term we encounter historically.
• This is a term coined by Myron Krueger in the mid-This is a term coined by Myron Krueger in the mid-1970’s.1970’s.
• Krueger intended the term to mean “full-body Krueger intended the term to mean “full-body participation in computer events that is so participation in computer events that is so compelling that it is accepted as real experience”.compelling that it is accepted as real experience”.
– Is it live, or is it Memorex?Is it live, or is it Memorex?
Artificial realityArtificial reality• The first term we encounter historically.The first term we encounter historically.
• This is a term coined by Myron Krueger in the mid-This is a term coined by Myron Krueger in the mid-1970’s.1970’s.
• Krueger intended the term to mean “full-body Krueger intended the term to mean “full-body participation in computer events that is so participation in computer events that is so compelling that it is accepted as real experience”.compelling that it is accepted as real experience”.
– Is it live, or is it Memorex?Is it live, or is it Memorex?
Or…
““What is real? How do you What is real? How do you define real? If you're talking define real? If you're talking about what you can feel, about what you can feel, what you can smell, what what you can smell, what you can taste and see, then you can taste and see, then real is simply electrical real is simply electrical signals interpreted by your signals interpreted by your brain.”brain.”
- Morpheus - Morpheus
““What is real? How do you What is real? How do you define real? If you're talking define real? If you're talking about what you can feel, about what you can feel, what you can smell, what what you can smell, what you can taste and see, then you can taste and see, then real is simply electrical real is simply electrical signals interpreted by your signals interpreted by your brain.”brain.”
- Morpheus - Morpheus
The origins of the terms for VR ...
CyberspaceCyberspace
• The term cyberspace was coined by William Gibson The term cyberspace was coined by William Gibson in 1984 in his science fiction novel in 1984 in his science fiction novel NeuromancerNeuromancer..
• Gibson used the term to refer to a single artificial Gibson used the term to refer to a single artificial reality that could be experienced simultaneously by reality that could be experienced simultaneously by thousands of people worldwide.thousands of people worldwide.
CyberspaceCyberspace
• The term cyberspace was coined by William Gibson The term cyberspace was coined by William Gibson in 1984 in his science fiction novel in 1984 in his science fiction novel NeuromancerNeuromancer..
• Gibson used the term to refer to a single artificial Gibson used the term to refer to a single artificial reality that could be experienced simultaneously by reality that could be experienced simultaneously by thousands of people worldwide.thousands of people worldwide.
Cyberspace• Gibson described huge virtual structures of data in Gibson described huge virtual structures of data in
the “consensual hallucination” with millions of people the “consensual hallucination” with millions of people directly connected by “jacking in” their nervous directly connected by “jacking in” their nervous systems.systems.
• These blue pyramids of financial data or red These blue pyramids of financial data or red hemispheres of corporate records were protected hemispheres of corporate records were protected from eavesdroppers by visible walls of protection from eavesdroppers by visible walls of protection Gibson called “ice”.Gibson called “ice”.
• Gibson described huge virtual structures of data in Gibson described huge virtual structures of data in the “consensual hallucination” with millions of people the “consensual hallucination” with millions of people directly connected by “jacking in” their nervous directly connected by “jacking in” their nervous systems.systems.
• These blue pyramids of financial data or red These blue pyramids of financial data or red hemispheres of corporate records were protected hemispheres of corporate records were protected from eavesdroppers by visible walls of protection from eavesdroppers by visible walls of protection Gibson called “ice”.Gibson called “ice”.
Cyberspace• From Gibson, we get the idea of flying through data From Gibson, we get the idea of flying through data
space, where there are 3D icons in our visual space, where there are 3D icons in our visual display, with the 3D icons having assigned meaning display, with the 3D icons having assigned meaning and operators that can act on the icons...and operators that can act on the icons...
• From Gibson, we get the idea of flying through data From Gibson, we get the idea of flying through data space, where there are 3D icons in our visual space, where there are 3D icons in our visual display, with the 3D icons having assigned meaning display, with the 3D icons having assigned meaning and operators that can act on the icons...and operators that can act on the icons...
The origins of the terms for VR ...
Virtual reality (VR) Virtual reality (VR) • Coined by Jaron Lanier, founder/head of VPL Research, Coined by Jaron Lanier, founder/head of VPL Research,
to bring all of the virtual projects under a single title.to bring all of the virtual projects under a single title.
• His meaning for the term typically refers to three-His meaning for the term typically refers to three-dimensional realities implemented with a stereo head-dimensional realities implemented with a stereo head-mounted display and data gloves for input.mounted display and data gloves for input.
– The VPL system is driven by an IRIS workstation for The VPL system is driven by an IRIS workstation for each eye...each eye...
Virtual reality (VR) Virtual reality (VR) • Coined by Jaron Lanier, founder/head of VPL Research, Coined by Jaron Lanier, founder/head of VPL Research,
to bring all of the virtual projects under a single title.to bring all of the virtual projects under a single title.
• His meaning for the term typically refers to three-His meaning for the term typically refers to three-dimensional realities implemented with a stereo head-dimensional realities implemented with a stereo head-mounted display and data gloves for input.mounted display and data gloves for input.
– The VPL system is driven by an IRIS workstation for The VPL system is driven by an IRIS workstation for each eye...each eye...
The origins of the terms for VR ...
Virtual worldsVirtual worlds• Virtual world is defined in terms of the characteristics that Virtual world is defined in terms of the characteristics that
indicate such a system:indicate such a system:
– These characteristics are seeing and interacting with These characteristics are seeing and interacting with distant, expensive, hazardous, or non-existent 3D distant, expensive, hazardous, or non-existent 3D environments.environments.
– The technology for “seeing” is real-time, interactive 3D The technology for “seeing” is real-time, interactive 3D computer graphics and the technology for “interacting” computer graphics and the technology for “interacting” is evolving and varied.is evolving and varied.
Virtual worldsVirtual worlds• Virtual world is defined in terms of the characteristics that Virtual world is defined in terms of the characteristics that
indicate such a system:indicate such a system:
– These characteristics are seeing and interacting with These characteristics are seeing and interacting with distant, expensive, hazardous, or non-existent 3D distant, expensive, hazardous, or non-existent 3D environments.environments.
– The technology for “seeing” is real-time, interactive 3D The technology for “seeing” is real-time, interactive 3D computer graphics and the technology for “interacting” computer graphics and the technology for “interacting” is evolving and varied.is evolving and varied.
Virtual Worlds• Virtual worlds (alternate definition): Moving and Virtual worlds (alternate definition): Moving and
interacting with a three-dimensional model of a world interacting with a three-dimensional model of a world in real-time such that the experience is almost real in real-time such that the experience is almost real or a near-believable simulation of the real.or a near-believable simulation of the real.
• Virtual worlds (alternate definition): Moving and Virtual worlds (alternate definition): Moving and interacting with a three-dimensional model of a world interacting with a three-dimensional model of a world in real-time such that the experience is almost real in real-time such that the experience is almost real or a near-believable simulation of the real.or a near-believable simulation of the real.
The origins of the terms for VR ...
Virtual environmentVirtual environment
• Virtual environment is a safe alternative to virtual Virtual environment is a safe alternative to virtual world.world.
• The University of Washington Human Interface The University of Washington Human Interface Technology (HIT) Lab people are the first people to Technology (HIT) Lab people are the first people to use the term virtual environment to describe their use the term virtual environment to describe their work.work.
Virtual environmentVirtual environment
• Virtual environment is a safe alternative to virtual Virtual environment is a safe alternative to virtual world.world.
• The University of Washington Human Interface The University of Washington Human Interface Technology (HIT) Lab people are the first people to Technology (HIT) Lab people are the first people to use the term virtual environment to describe their use the term virtual environment to describe their work.work.
The origins of the terms for VR ...
Synthetic EnvironmentSynthetic Environment
• This is the term DARPA uses to describe its various This is the term DARPA uses to describe its various programs for seeing/interacting with 3D worlds.programs for seeing/interacting with 3D worlds.
Synthetic EnvironmentSynthetic Environment
• This is the term DARPA uses to describe its various This is the term DARPA uses to describe its various programs for seeing/interacting with 3D worlds.programs for seeing/interacting with 3D worlds.
The origins of the terms for VR ...
Metaverse and AvatarsMetaverse and Avatars
• Sometimes the 3D virtual world (Gibson matrix) is Sometimes the 3D virtual world (Gibson matrix) is called the Metaverse and the 3D icons or called the Metaverse and the 3D icons or appearance of characters (humans) in the appearance of characters (humans) in the Metaverse are called Avatars.Metaverse are called Avatars.
• This terminology is used in the book This terminology is used in the book Snow Crash,Snow Crash, by by Neal Stephenson.Neal Stephenson.
Metaverse and AvatarsMetaverse and Avatars
• Sometimes the 3D virtual world (Gibson matrix) is Sometimes the 3D virtual world (Gibson matrix) is called the Metaverse and the 3D icons or called the Metaverse and the 3D icons or appearance of characters (humans) in the appearance of characters (humans) in the Metaverse are called Avatars.Metaverse are called Avatars.
• This terminology is used in the book This terminology is used in the book Snow Crash,Snow Crash, by by Neal Stephenson.Neal Stephenson.
Visual Simulation & Virtual Environments
The key differentiator between visual The key differentiator between visual simulation and virtual environments simulation and virtual environments revolves around the term “accessibility”.revolves around the term “accessibility”.
• Much of the early work in virtual environments Much of the early work in virtual environments reproduced that previously done for visual simulation reproduced that previously done for visual simulation because the visual simulation work was not because the visual simulation work was not accessible, being locked up in proprietary technical accessible, being locked up in proprietary technical reports.reports.
The key differentiator between visual The key differentiator between visual simulation and virtual environments simulation and virtual environments revolves around the term “accessibility”.revolves around the term “accessibility”.
• Much of the early work in virtual environments Much of the early work in virtual environments reproduced that previously done for visual simulation reproduced that previously done for visual simulation because the visual simulation work was not because the visual simulation work was not accessible, being locked up in proprietary technical accessible, being locked up in proprietary technical reports.reports.
Telepresence
There are two kinds of telepresence:There are two kinds of telepresence:
Real-time telepresence:Real-time telepresence:
• A visual virtual world that you interact with. - A visual virtual world that you interact with. - Interactions are reflected in the movement of some Interactions are reflected in the movement of some real world object. i.e. a DataGlove being moved to real world object. i.e. a DataGlove being moved to control a robot hand that moves at the same time.control a robot hand that moves at the same time.
There are two kinds of telepresence:There are two kinds of telepresence:
Real-time telepresence:Real-time telepresence:
• A visual virtual world that you interact with. - A visual virtual world that you interact with. - Interactions are reflected in the movement of some Interactions are reflected in the movement of some real world object. i.e. a DataGlove being moved to real world object. i.e. a DataGlove being moved to control a robot hand that moves at the same time.control a robot hand that moves at the same time.
Telepresence
Delayed telepresence:Delayed telepresence:
• A visual, virtual world that you interact with while A visual, virtual world that you interact with while recording the interactions.recording the interactions.
• When you are satisfied with the results, play the When you are satisfied with the results, play the interactions across your communications delay.interactions across your communications delay.
Delayed telepresence:Delayed telepresence:
• A visual, virtual world that you interact with while A visual, virtual world that you interact with while recording the interactions.recording the interactions.
• When you are satisfied with the results, play the When you are satisfied with the results, play the interactions across your communications delay.interactions across your communications delay.
Immersion & Presence
There are two entangled terms in VR - There are two entangled terms in VR - immersion and presence.immersion and presence.
• Immersion is best thought of as “How am I Immersion is best thought of as “How am I interacting with the virtual world?”interacting with the virtual world?”
• ““Presence” is the notion that the user of the virtual Presence” is the notion that the user of the virtual world feels “present in the virtual world” such that the world feels “present in the virtual world” such that the user can perform a task or set of tasks.user can perform a task or set of tasks.
There are two entangled terms in VR - There are two entangled terms in VR - immersion and presence.immersion and presence.
• Immersion is best thought of as “How am I Immersion is best thought of as “How am I interacting with the virtual world?”interacting with the virtual world?”
• ““Presence” is the notion that the user of the virtual Presence” is the notion that the user of the virtual world feels “present in the virtual world” such that the world feels “present in the virtual world” such that the user can perform a task or set of tasks.user can perform a task or set of tasks.
Immersion & Presence
Sometimes the phrase “immersed in the Sometimes the phrase “immersed in the virtual world” is taken to mean the same virtual world” is taken to mean the same as “present in the virtual world”.as “present in the virtual world”.
Sometimes the phrase “immersed in the Sometimes the phrase “immersed in the virtual world” is taken to mean the same virtual world” is taken to mean the same as “present in the virtual world”.as “present in the virtual world”.
Measuring presence & immersion ...
There are papers that discuss the There are papers that discuss the measurement or quantification of measurement or quantification of “presence”.“presence”.• What is really important though is can human What is really important though is can human
performance be improved through the use of a performance be improved through the use of a virtual environment and can that improvement be virtual environment and can that improvement be measured?measured?
– Otherwise, we’re just playing with neat toysOtherwise, we’re just playing with neat toys
There are papers that discuss the There are papers that discuss the measurement or quantification of measurement or quantification of “presence”.“presence”.• What is really important though is can human What is really important though is can human
performance be improved through the use of a performance be improved through the use of a virtual environment and can that improvement be virtual environment and can that improvement be measured?measured?
– Otherwise, we’re just playing with neat toysOtherwise, we’re just playing with neat toys
Why an immersive interface?
The environment encompasses large The environment encompasses large virtual spacesvirtual spaces
A large number of parameters are to be A large number of parameters are to be manipulated by the operatormanipulated by the operator
Tasks are of a hands-busy natureTasks are of a hands-busy nature
Perspective is importantPerspective is important
The environment encompasses large The environment encompasses large virtual spacesvirtual spaces
A large number of parameters are to be A large number of parameters are to be manipulated by the operatormanipulated by the operator
Tasks are of a hands-busy natureTasks are of a hands-busy nature
Perspective is importantPerspective is important
1970's 1980's 1990's 2000's
50%
100%
x103
x106
TIME (YEARS)
C O M P U T E R
P E R F O R M A N C E
M F L O P
--------------------------------------------------------------
-------------------------------------------------------------
•CHARACTER
•WINDOWS
•VR
USER INTERFACE
Where did all the hype come from?
Video
Video selections
Show the Tom Defanti tape made for NSF.Show the Tom Defanti tape made for NSF.
Show the Jeff Goldblum episode of Show the Jeff Goldblum episode of FutureQuest.FutureQuest.
Show the entertainment VR videotape.Show the entertainment VR videotape.
Show the Tom Defanti tape made for NSF.Show the Tom Defanti tape made for NSF.
Show the Jeff Goldblum episode of Show the Jeff Goldblum episode of FutureQuest.FutureQuest.
Show the entertainment VR videotape.Show the entertainment VR videotape.