distributed tuple-space server for ubiquitous video conferencing faculty advisors dr. charles liu...
Post on 19-Dec-2015
215 views
TRANSCRIPT
![Page 1: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/1.jpg)
Distributed Tuple-space Server for Ubiquitous Video Conferencing
Faculty Advisors
Dr. Charles Liu
Dr. Helen Boussalis
Student Assistants:
Aleksander MilshteynNeil ArellanoSergio MendozaEvan TsaiGabriel NunezJohnPaul AdigwuJorge EstradaAdrienne LamSergio BeltranAlexander Alegre
NASA Grant URC NCC NNX08BA44A 104/18/23
![Page 2: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/2.jpg)
Why ?
• Information and tools are scattered
• Traditional technologies have difficulty in meeting collaborative working environments
• Displaying objects in a 2-Dimensional space is not practical for concepts that exist in 3-Dimensional space
04/18/23 2NASA Grant URC NCC NNX08BA44A
![Page 3: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/3.jpg)
Overview
NASA Grant URC NCC NNX08BA44A 3
Hardware Layout
•Distributed server network
•Multi-platform compatibility
Application Layout
Organizing and relating nodes of information based on their meaning
Connecting users across different platforms & network access capabilities
Synchronizing data across servers
04/18/23
![Page 4: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/4.jpg)
Component Dependency Diagram
04/18/23 4NASA Grant URC NCC NNX08BA44A
![Page 5: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/5.jpg)
Application Process Diagram
Server
TupleSpace
DatabaseQT
Fileserver
Active Directory
04/18/23 5NASA Grant URC NCC NNX08BA44A
![Page 6: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/6.jpg)
<results><tablename=“uvc_users”><row=“1”><cname=“id”>23</cname><cname=“City”>Los Angeles</cname><cname=“Dept”>Aerospace</cname> </row><row=“2”><cname=“id”>24</cname><cname=“City”>Los Angeles</cname><cname=“Dept”>Electrical</cname> </row></results>
ID City Dept
23 Los Angeles
Aerospace
24 Los Angeles
Electrical
25 San Diego Chemical
“Select * from uvc_users where City = ‘Los Angeles’”;
QSqlQuery Query( QString Query)
XmlResultsWriter(QSqlQuery Result)
XML Code
(Sent via QTcpSocket using TupleSpace supplied parameters)
DatabaseDB API
DB API-Database Interaction: Queries
04/18/23 6NASA Grant URC NCC NNX08BA44A
![Page 7: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/7.jpg)
Tuple SpaceQT
Tuple Space-DB API Interaction
•Qt interprets tuple parameters to carry out appropriate DB query (Tuple parser function)
•Tuple provides information to QT including: sql query, ipaddress, portQT
04/18/23 7NASA Grant URC NCC NNX08BA44A
![Page 8: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/8.jpg)
DB API-Database Interaction: Status
Component % Completed Dependencies
XmlWriter 100% None
QSqlQuery 100% QSqlDriver Postgres
QTcp Client Comm. 100% Tuple ParametersQTcpSocket class methods for TCP transmission
Database
DB API PostGre SQL
04/18/23 8NASA Grant URC NCC NNX08BA44A
![Page 9: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/9.jpg)
Tuple Space-Qt Interaction Status
Component % Completed Dependencies
TupleParser 15% Knowledge of Tuple- Space code (incoming hash tag)
Tuple Space
QT
04/18/23 9NASA Grant URC NCC NNX08BA44A
![Page 10: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/10.jpg)
Semantic Network Component Update
Scraping Tool (Client Side)
Tuple Space Q
Key Features•Video playback of dragged video
•Thumbnail preview of dragged images
•Objects can be created without internet connection (locally)
04/18/23 10NASA Grant URC NCC NNX08BA44A
![Page 11: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/11.jpg)
Semantic Network Component Update
(continued)Key Features•Basic Object Tables
Complete
•Allows table
inheritance
•Commutates with
Client (QT) application)
•Communication with
Tuple Space successful04/18/23 11NASA Grant URC NCC NNX08BA44A
![Page 12: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/12.jpg)
Main Pending Tasks:
- Audio Transmission/Compression MP3
- FTP Client/Server Establishment
Ubiquitous Video Conferencing
Present Status:- Memory (RAM) Measurements (Completed)- Bandwidth Measurements(Completed)
Encoded Video/Audio Streams
01/13/2011 12NASA Grant URC NCC NNX08BA44A
![Page 13: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/13.jpg)
Memory Tests on the Client System
• The experiment was conducted in order to calculate the memory utilization per single FFMPEG stream in the UVC Application.
• Several other non-UVC applications where left on purpose to simulate multi-tasking environment.
01/13/2011 NASA Grant URC NCC NNX08BA44A13
Number of Parallel
Decoded Video Files
RAM
(MB)
Exp. 1
RAM
(MB)
Exp. 2
RAM
(MB)
Exp. 3
Average
RAM
(MB)
2 28 30 31 22.8
3 54 42 42 46.0
4 64 67 60 63.7
5 71 73 74 72.0
![Page 14: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/14.jpg)
Multiple Video Streaming
01/13/2011 NASA Grant URC NCC NNX08BA44A 14
![Page 15: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/15.jpg)
Memory Tests on the Client System
01/13/2011 NASA Grant URC NCC NNX08BA44A 15
![Page 16: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/16.jpg)
Bandwidth Tests on the Client System
• Network Utilization was used to determine the activity state of the network port on the client system.
• Three experiments have been performed in order to find the average ratio of the network usage to the maximum traffic for a LAN with 100Mbps.
• When Network Utilization exceeds threshold of 100%, it causes problems such as the drop in transmission speed, and increases the chances of intermittence and request delay.
01/13/2011 NASA Grant URC NCC NNX08BA44A 16
![Page 17: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/17.jpg)
Bandwidth Experiment # 1 -100Mbps Network
01/13/2011 NASA Grant URC NCC NNX08BA44A 17
FPS
Net
wor
k U
tiliz
atio
n (M
bps)
![Page 18: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/18.jpg)
Bandwidth Experiment # 2 – 25 fps
01/13/2011 NASA Grant URC NCC NNX08BA44A 18
Number of Parallel Video
Streams
Network Utilization
Exp. 1 (Mbps)
Network Utilization Exp.
2 (Mbps)
Network Utilization
Exp. 3(Mbps)
Average Network
Utilization (Mbps)
1 9.49 9.08 9.87 9.52 22.99 23.51 23.04 23.23 38.29 36.55 35.62 36.84 42.20 43.0 40.70 42.0
.
![Page 19: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/19.jpg)
Average Network Utilization versus Number of Parallel Video Streams
01/13/2011 NASA Grant URC NCC NNX08BA44A 19
![Page 20: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/20.jpg)
Audio
1) Audio Needs
2) FFMPEG
3) Phonon
4) QtMultimedia
2004/18/23 NASA Grant URC NCC NNX08BA44A
![Page 21: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/21.jpg)
Audio Needs
2104/18/23 NASA Grant URC NCC NNX08BA44A
• Synchronization
• Quality
![Page 22: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/22.jpg)
FFserver
2204/18/23 NASA Grant URC NCC NNX08BA44A
• Multimedia streaming server for live broadcasts • Limited to conventional audio players• Limited sync window• Limited update time• Different behavior on different players and versions
![Page 23: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/23.jpg)
Phonon
2304/18/23 NASA Grant URC NCC NNX08BA44A
• Multimedia framework class module (MediaSource)• “basic functions” • Limited but open for specific needs
![Page 24: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/24.jpg)
QtMultimedia
2404/18/23 NASA Grant URC NCC NNX08BA44A
• Low-level multimedia function class module (QAudioInput, QAudioOutput)
• More options to expand on Phonon• Conflict with current version
![Page 25: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/25.jpg)
Audio
2504/18/23 NASA Grant URC NCC NNX08BA44A
![Page 26: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/26.jpg)
Audio
Key Goals• Phonon/Qt compatibility // Complete• Successfully record/play an analog signal using Phonon // Complete• Successfully open audio files // Complete• Transmit encoded audio stream // In Progress• Decode received streamed audio // In Progress• Negate/minimize sync problems // Future Implementation
2604/18/23 NASA Grant URC NCC NNX08BA44A
![Page 27: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/27.jpg)
3D
2704/18/23 NASA Grant URC NCC NNX08BA44A
• Applications
• iTV Googles
• NVIDIA 3D Vision
![Page 28: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/28.jpg)
Applications
2804/18/23 NASA Grant URC NCC NNX08BA44A
• Educational
• Visual
![Page 29: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/29.jpg)
iTV Goggles
2904/18/23 NASA Grant URC NCC NNX08BA44A
• 80” Virtual Screen
• 3D Support
• Testing environments/applications
![Page 30: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/30.jpg)
iTV Goggles
3004/18/23 NASA Grant URC NCC NNX08BA44A
![Page 31: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/31.jpg)
NVIDIA 3D Vision
3104/18/23 NASA Grant URC NCC NNX08BA44A
• Shutter Glasses
• Panasonic HDC-SDT750 3D Camcorder
• MAGIX Movie Edit Pro 17 Plus
• Testing environments/applications
![Page 32: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/32.jpg)
NVIDIA 3D Vision
3204/18/23 NASA Grant URC NCC NNX08BA44A
![Page 33: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/33.jpg)
NVIDIA 3D Vision
3304/18/23 NASA Grant URC NCC NNX08BA44A
![Page 34: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/34.jpg)
3D
Key Goals• NVIDIA operational // Complete• Successfully record/play 3D files using Panasonic
camera // Complete• iTV operational // In Progress• Initialize 3D applications/functions // Future Implementation
3404/18/23 NASA Grant URC NCC NNX08BA44A
![Page 35: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/35.jpg)
What is OpenGL?
Open Graphics Library (OpenGL) is a cross platform, C based standard Application Programming Interface (API) for rendering 3D graphics.
OpenGL is used in CAD, virtual reality environments, and flight simulators.
Purpose: To implement a touch screen enabled Graphical User Interface (GUI) that facilitates the interaction amongst application components.
04/18/23 NASA Grant URC NCC NNX08BA44A 35
![Page 36: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/36.jpg)
InvestigationFlash vs. OpenGL
• Flash is a multimedia platform that can render 3D graphics, audio, and video content.
• Our target audience is everyone connected to the web, even cell phone users. Qt allows us this flexibility. On the other hand not all phones use Flash as a means to render their graphics.
• We will be implementing OpenGL since it is a library that is part of the Qt platform and will allow easy integrate any 3D rendering that we will need.
04/18/23 NASA Grant URC NCC NNX08BA44A 36
![Page 37: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/37.jpg)
Implementation and Future Work
04/18/23 NASA Grant URC NCC NNX08BA44A 37
![Page 38: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/38.jpg)
2010-2011 Timeline
38NASA Grant URC NCC NNX08BA44A04/18/23
![Page 39: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/39.jpg)
2011 Timeline
04/18/23 NASA Grant URC NCC NNX08BA44A 39
![Page 40: Distributed Tuple-space Server for Ubiquitous Video Conferencing Faculty Advisors Dr. Charles Liu Dr. Helen Boussalis Student Assistants: Aleksander Milshteyn](https://reader035.vdocuments.mx/reader035/viewer/2022062714/56649d3f5503460f94a1900c/html5/thumbnails/40.jpg)
Questions?
04/18/23 NASA Grant URC NCC NNX08BA44A 40