vr controlled 3d city
TRANSCRIPT
![Page 1: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/1.jpg)
VR Controlled 3D City
![Page 2: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/2.jpg)
Problem Statement & Solution
![Page 3: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/3.jpg)
The Problem
Reality is a variable => different experience for each individual.
Several individuals have various constraints to have a basic experience with reality.
Constraints include => Old age, physical and mental disability, lack of funds to travel or not enough time.
![Page 4: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/4.jpg)
The Solution
Virtual reality attempts to deliver a constant experience to all.
Every individual, regardless of any kind of constraint can have a virtual experience of a simulated reality.
Virtual 3D city gives a virtual experience for all users.
Other use cases => vision training, cognitive training etc
![Page 5: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/5.jpg)
Architecture & Components
![Page 6: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/6.jpg)
Overall Architecture
LAMBDA Server
Alexa Handler (Node JS + Socket.io)
Node JS Chat App
AWS EC2 Server
Alexa Skill Settings
Voice to Text
Voice to Text Converted Message Command
Voice Message
![Page 7: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/7.jpg)
Data Flow Management
- Real-time 2 way communication b/w server & client
- Using TCP Socket
- Across browser & mobile device
- 100% JavaScript based
![Page 8: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/8.jpg)
Data Flow Management
- HTTP is stateless and not reliable
- Mechanism for browser-based app that does not rely on multiple HTTP connections
- Before socket.io …..
- Event emission on the server
- Client listeners listen in a bi-directional manner
![Page 9: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/9.jpg)
Data Flow Management
Server
Client
Client
Client
2
3
4
1
![Page 10: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/10.jpg)
Data Flow Management
Server
Client
Client
Client
2
3
4
1
![Page 11: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/11.jpg)
Data Flow ManagementServer
Client
Client
Client
2
3
4
1
![Page 12: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/12.jpg)
Data Flow Management
2
3
1
4
![Page 13: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/13.jpg)
Data Flow Management
2
3
1
4
![Page 14: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/14.jpg)
Data Flow Management
2
3
1
4
json
jsonjson
json
![Page 15: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/15.jpg)
Data Flow Management
![Page 16: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/16.jpg)
Data Flow Management
1
2
3
![Page 17: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/17.jpg)
![Page 18: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/18.jpg)
Unity 3D Virtual Interface
Virtual representation of a model 3D city is created.
User has a 360 degree view of his/her surroundings.
Several viewpoints included for the user.
These include => Home, Bridge, Mall etc.
Accessed using mobile assistant and voice assistant.
![Page 19: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/19.jpg)
![Page 20: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/20.jpg)
![Page 21: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/21.jpg)
![Page 22: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/22.jpg)
Voice Assistant
![Page 23: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/23.jpg)
Mobile Assistant and Voice Assistant
Used to shift between the different locations.
Mobile Assistant => 2 input modes => Text and Voice.
Text - identifies the name of the location.
Voice - Speech recognition used to decipher location.
Voice assistant => Alexa commands.
![Page 24: VR controlled 3d City](https://reader035.vdocuments.mx/reader035/viewer/2022062412/58d005e71a28abad3e8b48bb/html5/thumbnails/24.jpg)
Web Interface