introduction to virtual reality lecture 2015

76
1 http://mikhailfominykh.com/ Introduction to Virtual Reality Mikhail Fominykh, PhD Molde University College, Norway Volga State University of Technology, Russia Europlan UK ltd., United Kingdom Invited lecture at Aksaray University, Turkey | 12.11.2015

Upload: mikhail-fominykh

Post on 10-Feb-2017

1.296 views

Category:

Education


1 download

TRANSCRIPT

Page 1: Introduction to Virtual Reality lecture 2015

1 http://mikhailfominykh.com/

Introduction to

Virtual RealityMikhail Fominykh, PhD

Molde University College, Norway

Volga State University of Technology, Russia

Europlan UK ltd., United Kingdom

Invited lecture at Aksaray University, Turkey | 12.11.2015

Page 2: Introduction to Virtual Reality lecture 2015

2 http://mikhailfominykh.com/

I. The term “Virtual Reality”

II. History

III. Effect

IV. Components

V. Application examples

Outline

Page 3: Introduction to Virtual Reality lecture 2015

3 http://mikhailfominykh.com/Photo from VR 2013 © Mikhail Fominykh

Page 4: Introduction to Virtual Reality lecture 2015

4 http://mikhailfominykh.com/

From latin virtuālis, Vir (man) Virtus

(connotations of valor, manliness,

excellence, courage, character, etc.)

The term “Virtual Reality”

Page 5: Introduction to Virtual Reality lecture 2015

5 http://mikhailfominykh.com/

Virtual = almost real

The term “Virtual Reality”

Page 6: Introduction to Virtual Reality lecture 2015

6 http://mikhailfominykh.com/

Movie examples

The term “Virtual Reality”

Page 7: Introduction to Virtual Reality lecture 2015

7 http://mikhailfominykh.com/

I. The term “Virtual Reality”

II. History

III. Effect

IV. Components

V. Application examples

Outline

Page 8: Introduction to Virtual Reality lecture 2015

8 http://mikhailfominykh.com/Photo from ISM 2013 © Mikhail Fominykh

Page 9: Introduction to Virtual Reality lecture 2015

9 http://mikhailfominykh.com/

View master

1939

Photo from wikipedia

Page 10: Introduction to Virtual Reality lecture 2015

10 http://mikhailfominykh.com/Photo from http://www.shortlist.com/

Page 11: Introduction to Virtual Reality lecture 2015

11 http://mikhailfominykh.com/Photo from http://amturing.acm.org/

Head-mounted display

1968

Page 12: Introduction to Virtual Reality lecture 2015

12 http://mikhailfominykh.com/Photo from wikipedia

Aspen

Movie

Map,

1977

Page 13: Introduction to Virtual Reality lecture 2015

13 http://mikhailfominykh.com/Photo from http://starwars.wikia.com/

Aspen Movie Map

1977

Star Wars. New hope, 1977

Page 14: Introduction to Virtual Reality lecture 2015

14 http://mikhailfominykh.com/Photo from http://p3.no/

Aspen Movie Map

1977

Tron, 1982

Page 15: Introduction to Virtual Reality lecture 2015

15 http://mikhailfominykh.com/

History

Page 16: Introduction to Virtual Reality lecture 2015

16 http://mikhailfominykh.com/

Photo from http://www.amazon.com/

History

Page 17: Introduction to Virtual Reality lecture 2015

17 http://mikhailfominykh.com/

Page 18: Introduction to Virtual Reality lecture 2015

18 http://mikhailfominykh.com/

1980–1990

o High price

o New competitor – the Internet

History

Page 19: Introduction to Virtual Reality lecture 2015

19 http://mikhailfominykh.com/Photo from http://www.telegraph.co.uk/

Page 20: Introduction to Virtual Reality lecture 2015

20 http://mikhailfominykh.com/

1990–2000

o CAVEs

o VRML

History

Page 21: Introduction to Virtual Reality lecture 2015

21 http://mikhailfominykh.com/

VR paper box

2015

Photo © Mikhail FominykhPhoto from http://www.umich.edu/

Page 22: Introduction to Virtual Reality lecture 2015

22 http://mikhailfominykh.com/

2000–>

o Desktop technologies

o Head-mounted displays

o Haptics

o Augmented reality

o Wearables

o Internet of things

o Price

History

Page 23: Introduction to Virtual Reality lecture 2015

23 http://mikhailfominykh.com/Photo © Mikhail Fominykh

http://secondlife.com

Page 24: Introduction to Virtual Reality lecture 2015

24 http://mikhailfominykh.com/Photo © Mikhail Fominykh

http://vacademia.com

Page 25: Introduction to Virtual Reality lecture 2015

25 http://mikhailfominykh.com/Photo from Wikipedia

Oculus Rift DK1

2013

Page 26: Introduction to Virtual Reality lecture 2015

26 http://mikhailfominykh.com/Photo from http://www.augmentedreality.org/

Oculus Rift DK1

2013

Page 27: Introduction to Virtual Reality lecture 2015

27 http://mikhailfominykh.com/

VR paper box

2015

Photo from http://www.aliexpress.com/

Page 28: Introduction to Virtual Reality lecture 2015

28 http://mikhailfominykh.com/

Oculus Rift DK1

2013

Page 29: Introduction to Virtual Reality lecture 2015

29 http://mikhailfominykh.com/

Oculus Rift DK1

2013

Photo from http://techcrunch.com/

Page 30: Introduction to Virtual Reality lecture 2015

30 http://mikhailfominykh.com/

I. The term “Virtual Reality”

II. History

III. Effect

IV. Components

V. Application examples

Outline

Page 31: Introduction to Virtual Reality lecture 2015

31 http://mikhailfominykh.com/Photo from https://www.youtube.com/watch?v=MP0Dg0B0bi0

Page 32: Introduction to Virtual Reality lecture 2015

32 http://mikhailfominykh.com/

Virtual Reality Effect

Senses

Consciousness

Reality

Action

Page 33: Introduction to Virtual Reality lecture 2015

33 http://mikhailfominykh.com/

Virtual Reality Effect

Virtual reality

Senses

Consciousness

Action

Output devices

Input devices

Senses

Consciousness

Reality

Action

Page 34: Introduction to Virtual Reality lecture 2015

34 http://mikhailfominykh.com/

Virtual reality I3

o Imagination

o Interaction

o Immersion

Virtual Reality Effect

Immersion

Interaction Imagination

T. B. Sheridan: Interaction, imagination and immersion some research needs

Page 35: Introduction to Virtual Reality lecture 2015

35 http://mikhailfominykh.com/

Virtual reality is

o Believable

o Interactive

o Computed-generated

o Explorable

o Immersive

Virtual Reality Effect

Inspired by http://www.explainthatstuff.com/virtualreality.html

Page 36: Introduction to Virtual Reality lecture 2015

36 http://mikhailfominykh.com/

o Believable: A user must feel and believe

that he/she is in a virtual reality. Otherwise,

the illusion disappears.

Virtual Reality Effect

Page 37: Introduction to Virtual Reality lecture 2015

37 http://mikhailfominykh.com/

o Interactive: When a user is moving in

virtual reality, the environment is moving

accordingly, it reacts to the actions of

users.

Virtual Reality Effect

Page 38: Introduction to Virtual Reality lecture 2015

38 http://mikhailfominykh.com/

o Computed-generated: Only computer

technologies can generate virtual reality

believable enough and interactive, so

that the users can fall into illusion.

Virtual Reality Effect

Page 39: Introduction to Virtual Reality lecture 2015

39 http://mikhailfominykh.com/

o Explorable: Virtual reality should be

explorable with multiple points of view

opening new perspectives depending on

the actions of users.

Virtual Reality Effect

Page 40: Introduction to Virtual Reality lecture 2015

40 http://mikhailfominykh.com/

o Immersive: Virtual reality should immerse

mind and body, affecting five main senses

and other senses.

Virtual reality should be immersive enough:

more complex technologies do not always

lead to a better effect

Virtual Reality Effect

Page 41: Introduction to Virtual Reality lecture 2015

41 http://mikhailfominykh.com/

o Sight – desktop / stereo / CAVE / HMD– http://en.wikipedia.org/wiki/Methods_of_virtual_reality

– http://en.wikipedia.org/wiki/Stereoscopy

– http://en.wikipedia.org/wiki/Cave_Automatic_Virtual_Env

ironment

– http://en.wikipedia.org/wiki/Head-mounted_display

o Hearing

o Taste

o Smell

o Touch

Virtual Reality senses: Sight

Page 42: Introduction to Virtual Reality lecture 2015

42 http://mikhailfominykh.com/

Desktop Virtual Reality

Page 43: Introduction to Virtual Reality lecture 2015

43 http://mikhailfominykh.com/

Stereoscopy

http://www.xdcam-user.com/alisters-blog/

Page 44: Introduction to Virtual Reality lecture 2015

44 http://mikhailfominykh.com/

Cave Automatic Virtual Environment (CAVE)

http://www0.cs.ucl.ac.uk/research/vr/Projects/Cave/

Page 45: Introduction to Virtual Reality lecture 2015

45 http://mikhailfominykh.com/http://en.wikipedia.org/wiki/Oculus_Rift

Head-mounted display (HMD)

Page 46: Introduction to Virtual Reality lecture 2015

46 http://mikhailfominykh.com/

Head-mounted display (HMD)

Page 47: Introduction to Virtual Reality lecture 2015

47 http://mikhailfominykh.com/

o Sight

o Hearing – 3D audio– http://en.wikipedia.org/wiki/Methods_of_virtual_reality

o Taste

o Smell

o Touch

Virtual Reality senses: Hearing

Page 48: Introduction to Virtual Reality lecture 2015

48 http://mikhailfominykh.com/http://www.stormaudio.com/en/technologies/3d-audio/spheraudio/

Virtual acoustics and sound

Page 49: Introduction to Virtual Reality lecture 2015

49 http://mikhailfominykh.com/

o Sight

o Hearing

o Taste – virtual taste– http://en.wikipedia.org/wiki/Immersive_technology

o Smell

o Touch

Virtual Reality senses: Taste

Page 50: Introduction to Virtual Reality lecture 2015

50 http://mikhailfominykh.com/

http://mixedrealitylab.org/projects/all-projects/digital-taste-

interface/

Digital taste interface

Page 51: Introduction to Virtual Reality lecture 2015

51 http://mikhailfominykh.com/

o Sight

o Hearing

o Taste

o Smell – virtual smell– http://en.wikipedia.org/wiki/Immersive_technology

o Touch

Virtual Reality senses: Smell

Page 52: Introduction to Virtual Reality lecture 2015

52 http://mikhailfominykh.com/http://www.epsrc.ac.uk/

Virtual Cocoon

Page 53: Introduction to Virtual Reality lecture 2015

53 http://mikhailfominykh.com/http://phys.org/news/2011-04-virtual-reality-scent-human.html

Meta cookie

Page 54: Introduction to Virtual Reality lecture 2015

54 http://mikhailfominykh.com/

o Sight

o Hearing

o Taste

o Smell

o Touch – haptic / force feedback– http://en.wikipedia.org/wiki/Haptic_technology

Virtual Reality senses: Touch

Page 55: Introduction to Virtual Reality lecture 2015

55 http://mikhailfominykh.com/http://homes.cs.washington.edu/~vikash/Hddn.html

Haptic glove - touch

Page 56: Introduction to Virtual Reality lecture 2015

56 http://mikhailfominykh.com/

https://www.kickstarter.com/projects/141790329/araig-as-real-

as-it-gets/

Multisensory suit prototype

Page 57: Introduction to Virtual Reality lecture 2015

57 http://mikhailfominykh.com/

Screenshot from http://www.virtuix.com/

Movement interface «Omni»

Page 58: Introduction to Virtual Reality lecture 2015

58 http://mikhailfominykh.com/

I. The term “Virtual Reality”

II. History

III. Effect

IV. Components

V. Application examples

Outline

Page 59: Introduction to Virtual Reality lecture 2015

59 http://mikhailfominykh.com/Photo from http://www.slate.com/

Page 60: Introduction to Virtual Reality lecture 2015

60 http://mikhailfominykh.com/

o Generated environment

real-time 3D graphics, sound

o Affect senses

Input/output devices

o Interaction

Interfaces and navigation

o Immersion

Scenario and task

Components: properties

Page 61: Introduction to Virtual Reality lecture 2015

61 http://mikhailfominykh.com/

Components: basics

Output device

Image generator

Input device

Oculus

PC

Page 62: Introduction to Virtual Reality lecture 2015

62 http://mikhailfominykh.com/

o Keyboard and mouse

o Joysticks and gamepads

o Position sensors

o Orientation sensors

o Force feedback/smart gloves

o Exoskeletons and suits

o Motion capture

o Brain activity sensors

Components: Input devices

Page 63: Introduction to Virtual Reality lecture 2015

63 http://mikhailfominykh.com/

o Video: monitors, projectors, helmets

o Audio: speakers, earphones

o Touch: force feedback gloves, suits

o Smell and taste?

o Additional senses (balance, temperature,

time, etc.)

o Artificial senses

Components: Output devices

Page 64: Introduction to Virtual Reality lecture 2015

64 http://mikhailfominykh.com/

o Real time, >25 frames/s

o Latency < 50 ms (performance, input)

o Large volumes of data (memory)

o 3D graphics, highest quality with given FPS

o High-speed Internet

o Price?

Components: requirements

Page 65: Introduction to Virtual Reality lecture 2015

65 http://mikhailfominykh.com/

I. The term “Virtual Reality”

II. History

III. Effect

IV. Components

V. Application examples

Outline

Page 66: Introduction to Virtual Reality lecture 2015

66 http://mikhailfominykh.com/Photo from https://medium.com/

Page 67: Introduction to Virtual Reality lecture 2015

67 http://mikhailfominykh.com/

Software market 2013 = US$407.3 bln + 4.8%

per year

Page 68: Introduction to Virtual Reality lecture 2015

68 http://mikhailfominykh.com/

Software market 2013 = US$407.3 bln + 4.8%

per year

+80 /+100%

Page 69: Introduction to Virtual Reality lecture 2015

69 http://mikhailfominykh.com/

Major application areas

o Military / defense

o Medicine / health

o Entertainment / games

o Industry– Communication / teleconferencing

– Education / training

– Collaborative work

Application

Inspired by http://www.explainthatstuff.com/virtualreality.html

Page 70: Introduction to Virtual Reality lecture 2015

70 http://mikhailfominykh.com/Future Immersive Training Environment_(FITE)

Page 71: Introduction to Virtual Reality lecture 2015

71 http://mikhailfominykh.com/nccastaff.bournemouth.ac.uk

Page 72: Introduction to Virtual Reality lecture 2015

72 http://mikhailfominykh.com/http://www.roadtovr.com/

Page 73: Introduction to Virtual Reality lecture 2015

73 http://mikhailfominykh.com/http://www.cobrasimulation.com/

Page 74: Introduction to Virtual Reality lecture 2015

74 http://mikhailfominykh.com/http://www.esi-group.com/

Page 75: Introduction to Virtual Reality lecture 2015

75 http://mikhailfominykh.com/

http://www.uni-weimar.de/de/medien/professuren/vr/research/display-

systems/c1x6-a-stereoscopic-six-user-display/

Page 76: Introduction to Virtual Reality lecture 2015

76 http://mikhailfominykh.com/

Q&A

[email protected]

http://www.mikhailfominykh.com/

http://slideshare.net/mfominykh/

Mikhail Fominykh, PhD

Molde University College, Norway

Volga State University of Technology, Russia

Europlan UK ltd., United Kingdom