VR - The Historical ContextVR - The Historical ContextPart 2Part 2

Rudy Darken & Michael ZydaRudy Darken & Michael Zyda

Naval Postgraduate SchoolNaval Postgraduate School

{ Darken, Zyda }@cs.nps.navy.mil{ Darken, Zyda }@cs.nps.navy.mil

Rudy Darken & Michael ZydaRudy Darken & Michael Zyda

Naval Postgraduate SchoolNaval Postgraduate School

{ Darken, Zyda }@cs.nps.navy.mil{ Darken, Zyda }@cs.nps.navy.mil

NASA Ames Research Center• Mike McGreevy and Scott Fisher Mike McGreevy and Scott Fisher

developed the first affordable VE developed the first affordable VE system in the mid 1980’s.system in the mid 1980’s.

• Their system consisted of a head-Their system consisted of a head-mounted display (their own design mounted display (their own design but contracted out to Leep Optics) but contracted out to Leep Optics) and a VPL DataGlove (they and a VPL DataGlove (they contracted with VPL to build this contracted with VPL to build this under NASA’s specifications).under NASA’s specifications).

• Mike McGreevy and Scott Fisher Mike McGreevy and Scott Fisher developed the first affordable VE developed the first affordable VE system in the mid 1980’s.system in the mid 1980’s.

• Their system consisted of a head-Their system consisted of a head-mounted display (their own design mounted display (their own design but contracted out to Leep Optics) but contracted out to Leep Optics) and a VPL DataGlove (they and a VPL DataGlove (they contracted with VPL to build this contracted with VPL to build this under NASA’s specifications).under NASA’s specifications).

NASA’s VIEW Project

NASA’s Early HMD

NASA’s HMD

NASA’s BOOM Mounted Display

NASA Telerobotics

NASA VIEW Project - Spatial Sound - the Convolvotron• The purpose of the Convolvotron was to provide 3D The purpose of the Convolvotron was to provide 3D

sound.sound.

– Small microphones were mounted in the ears of a Small microphones were mounted in the ears of a dummy head.dummy head.

– Sounds were played at various positions around Sounds were played at various positions around the head and the amplitudes and phase the head and the amplitudes and phase differences between the sounds arrivals at the differences between the sounds arrivals at the microphones were recorded.microphones were recorded.

• The purpose of the Convolvotron was to provide 3D The purpose of the Convolvotron was to provide 3D sound.sound.

– Small microphones were mounted in the ears of a Small microphones were mounted in the ears of a dummy head.dummy head.

– Sounds were played at various positions around Sounds were played at various positions around the head and the amplitudes and phase the head and the amplitudes and phase differences between the sounds arrivals at the differences between the sounds arrivals at the microphones were recorded.microphones were recorded.

NASA VIEW Project - Spatial Sound - the Convolvotron• Those parameters were used in the construction of a Those parameters were used in the construction of a

device, the Convolvotron, that could provide real-time, 3D device, the Convolvotron, that could provide real-time, 3D positioning for sound that was otherwise not positioned.positioning for sound that was otherwise not positioned.

– i.e. the sound would be modified for the stereo i.e. the sound would be modified for the stereo channels to simulate the phase and amplitude channels to simulate the phase and amplitude differences that would exist “were” the sound really differences that would exist “were” the sound really where the Convolvotron placed it.where the Convolvotron placed it.

• This work was done by Beth Wenzel of NASA and Scott This work was done by Beth Wenzel of NASA and Scott Foster of Crystal River Engineering...Foster of Crystal River Engineering...

• Those parameters were used in the construction of a Those parameters were used in the construction of a device, the Convolvotron, that could provide real-time, 3D device, the Convolvotron, that could provide real-time, 3D positioning for sound that was otherwise not positioned.positioning for sound that was otherwise not positioned.

– i.e. the sound would be modified for the stereo i.e. the sound would be modified for the stereo channels to simulate the phase and amplitude channels to simulate the phase and amplitude differences that would exist “were” the sound really differences that would exist “were” the sound really where the Convolvotron placed it.where the Convolvotron placed it.

• This work was done by Beth Wenzel of NASA and Scott This work was done by Beth Wenzel of NASA and Scott Foster of Crystal River Engineering...Foster of Crystal River Engineering...

NASA VIEW Project - Spatial Sound - the Convolvotron

Outputs Spatialized Sound to Stereo Headphones

Inputs Sound Location of sound Location of viewer Head orientation of viewer

Convolvotron

SoundSource

NASA Video Suggestions• ACM SIGGRAPH Video ACM SIGGRAPH Video

Review 50, 1989, Entry 12: Review 50, 1989, Entry 12: VIEW: NASA/AMES Virtual VIEW: NASA/AMES Virtual Environment Workstation - Environment Workstation - Scott Fisher/NASA.Scott Fisher/NASA.

• ACM SIGGRAPH Video ACM SIGGRAPH Video Review 55, 1990, Entry 3: Review 55, 1990, Entry 3: VIEW: NASA/AMES Virtual VIEW: NASA/AMES Virtual Environment Workstation - Environment Workstation - Scott Fisher/NASA.Scott Fisher/NASA.

• ACM SIGGRAPH Video ACM SIGGRAPH Video Review 50, 1989, Entry 12: Review 50, 1989, Entry 12: VIEW: NASA/AMES Virtual VIEW: NASA/AMES Virtual Environment Workstation - Environment Workstation - Scott Fisher/NASA.Scott Fisher/NASA.

• ACM SIGGRAPH Video ACM SIGGRAPH Video Review 55, 1990, Entry 3: Review 55, 1990, Entry 3: VIEW: NASA/AMES Virtual VIEW: NASA/AMES Virtual Environment Workstation - Environment Workstation - Scott Fisher/NASA.Scott Fisher/NASA.

• ACM SIGGRAPH Video ACM SIGGRAPH Video Review 49, 1988/89, Review 49, 1988/89, Entries for “Mars the Movie” Entries for “Mars the Movie” and “Earth the Movie”. and “Earth the Movie”. Where is “LA the Movie” Where is “LA the Movie” (also good)?(also good)?

• ACM SIGGRAPH Video ACM SIGGRAPH Video Review 49, 1988/89, Review 49, 1988/89, Entries for “Mars the Movie” Entries for “Mars the Movie” and “Earth the Movie”. and “Earth the Movie”. Where is “LA the Movie” Where is “LA the Movie” (also good)?(also good)?

NASA Video Suggestions• ACM SIGGRAPH ‘92 ACM SIGGRAPH ‘92

Course #9, “Implementation Course #9, “Implementation of Immersive Virtual of Immersive Virtual Environments”. Good piece Environments”. Good piece of Hitchner “Virtual of Hitchner “Virtual Planetary Exploration Planetary Exploration Project”.Project”.

• ACM SIGGRAPH ‘92 ACM SIGGRAPH ‘92 Course #9, “Implementation Course #9, “Implementation of Immersive Virtual of Immersive Virtual Environments”. Good piece Environments”. Good piece of Hitchner “Virtual of Hitchner “Virtual Planetary Exploration Planetary Exploration Project”.Project”.

• ACM SIGGRAPH ‘93, ACM SIGGRAPH ‘93, Course #43 “Implementing Course #43 “Implementing VR”. Great NASA and UVA VR”. Great NASA and UVA footage. Show the complete footage. Show the complete tape. Virtual windtunnel tape. Virtual windtunnel project/Bryson. project/Bryson. UNC/Robinette (great UNC/Robinette (great piece). Univ of piece). Univ of Virginia/Pausch Brown Virginia/Pausch Brown University - 3D widgets.University - 3D widgets.

• ACM SIGGRAPH ‘93, ACM SIGGRAPH ‘93, Course #43 “Implementing Course #43 “Implementing VR”. Great NASA and UVA VR”. Great NASA and UVA footage. Show the complete footage. Show the complete tape. Virtual windtunnel tape. Virtual windtunnel project/Bryson. project/Bryson. UNC/Robinette (great UNC/Robinette (great piece). Univ of piece). Univ of Virginia/Pausch Brown Virginia/Pausch Brown University - 3D widgets.University - 3D widgets.

USAF Wright Patterson Armstrong Lab

The “Super The “Super Cockpit”Cockpit”The “Super The “Super Cockpit”Cockpit”

Super Cockpit - $1M HMD

Super Cockpit Design

VPL Research

VPL produced the first commercial VR VPL produced the first commercial VR hardware and system (RB2).hardware and system (RB2).

VPL developed the DataGlove and VPL developed the DataGlove and PowerGlove and eventually a tactile PowerGlove and eventually a tactile feedback glove.feedback glove.

VPL produced the first commercial VR VPL produced the first commercial VR hardware and system (RB2).hardware and system (RB2).

VPL developed the DataGlove and VPL developed the DataGlove and PowerGlove and eventually a tactile PowerGlove and eventually a tactile feedback glove.feedback glove.

VPL Research

They commercialized the NASA HMD They commercialized the NASA HMD technology - based on LCD displays and a technology - based on LCD displays and a special optics system.special optics system.

Produced software for the design of Produced software for the design of virtual environments.virtual environments.

Produced a commercial VR system that Produced a commercial VR system that can support one or two users.can support one or two users.

They commercialized the NASA HMD They commercialized the NASA HMD technology - based on LCD displays and a technology - based on LCD displays and a special optics system.special optics system.

Produced software for the design of Produced software for the design of virtual environments.virtual environments.

Produced a commercial VR system that Produced a commercial VR system that can support one or two users.can support one or two users.

VPL’s Reality Built for Two (RB2)

A development platform for designing and A development platform for designing and implementing real-time virtual realities.implementing real-time virtual realities.

• Development was rapid & interactive using a visual Development was rapid & interactive using a visual programming language.programming language.

– Behavior constraints and interactions were edited Behavior constraints and interactions were edited in real-time.in real-time.

A development platform for designing and A development platform for designing and implementing real-time virtual realities.implementing real-time virtual realities.

• Development was rapid & interactive using a visual Development was rapid & interactive using a visual programming language.programming language.

– Behavior constraints and interactions were edited Behavior constraints and interactions were edited in real-time.in real-time.

VPL’s Reality Built for Two (RB2)

Changes made to the interactions in the Changes made to the interactions in the world were seen immediately.world were seen immediately.

• For example, attach gravity to an object and see it For example, attach gravity to an object and see it fall.fall.

Changes made to the interactions in the Changes made to the interactions in the world were seen immediately.world were seen immediately.

• For example, attach gravity to an object and see it For example, attach gravity to an object and see it fall.fall.

VPL’s Reality Built for Two (RB2)

RB2 consisted of 3 software modules and RB2 consisted of 3 software modules and a variety of hardware.a variety of hardware.

• The design & control workstation was a Mac II The design & control workstation was a Mac II running a solid modeling application called RB2 running a solid modeling application called RB2 Swivel and a data flow/real-time animation control Swivel and a data flow/real-time animation control package called Body Electric.package called Body Electric.

RB2 consisted of 3 software modules and RB2 consisted of 3 software modules and a variety of hardware.a variety of hardware.

• The design & control workstation was a Mac II The design & control workstation was a Mac II running a solid modeling application called RB2 running a solid modeling application called RB2 Swivel and a data flow/real-time animation control Swivel and a data flow/real-time animation control package called Body Electric.package called Body Electric.

VPL’s Body Electric

VPL Devices

DataGlove EyePhones

VPL Video Suggestions• ACM SIGGRAPH Video ACM SIGGRAPH Video

Review 27, 1987, Entry 2: Review 27, 1987, Entry 2: DataGlove - George DataGlove - George Zachary/VPL. Also Entry 6: Zachary/VPL. Also Entry 6: The Alternate Reality Kit - The Alternate Reality Kit - Randy Smith/Xerox PARC. Randy Smith/Xerox PARC. An excellent piece of how An excellent piece of how one can interactively one can interactively manipulate a microworld’s manipulate a microworld’s forces.forces.

• ACM SIGGRAPH Video ACM SIGGRAPH Video Review 27, 1987, Entry 2: Review 27, 1987, Entry 2: DataGlove - George DataGlove - George Zachary/VPL. Also Entry 6: Zachary/VPL. Also Entry 6: The Alternate Reality Kit - The Alternate Reality Kit - Randy Smith/Xerox PARC. Randy Smith/Xerox PARC. An excellent piece of how An excellent piece of how one can interactively one can interactively manipulate a microworld’s manipulate a microworld’s forces.forces.

• ACM SIGGRAPH Virtual ACM SIGGRAPH Virtual Reality Applications Gallery Reality Applications Gallery Jury Reel ’91. The Boeing Jury Reel ’91. The Boeing demo is using the RB2 demo is using the RB2 system! The Matsushita system! The Matsushita Kitchen Design system Kitchen Design system uses RB2.uses RB2.

• ACM SIGGRAPH Virtual ACM SIGGRAPH Virtual Reality Applications Gallery Reality Applications Gallery Jury Reel ’91. The Boeing Jury Reel ’91. The Boeing demo is using the RB2 demo is using the RB2 system! The Matsushita system! The Matsushita Kitchen Design system Kitchen Design system uses RB2.uses RB2.