Transcript
Page 1: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Computer Supported Collaborative Visualization

C S C VSun-In Lin

[email protected]

Page 2: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

<I>

Introduction

Page 3: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Traditional Scientific-Visualization software can only help one man visualize some data on his desktop.

Scientific Visualization

Visualize

Page 4: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Collaboratively Visualizing data set on a desktop at different LOCATIONS, even at different TIME -- CSV.

Single Host Visualization

<< Multi-User Mode >>

Surface Rendering Stereo Rendering

Wireframe RenderingNPR Rendering

CV Server

<< Single-User Mode >> import

Network

com

prise

Collaborative Scientific Visualization

Page 5: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

WCV: Collaborative visualization system using web-styled user interface. WCV extended from Computer Supported Co-operative Work (CSCW).

VideoConferencing

E-Mail

VisualizationWorkShifts

Time

Place

Same Different

Sam

eDiff

eren

t

Web-Based Collaborative Visualization

Page 6: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

<II>

System Design Goal

Page 7: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Developing a collaborative visualization system enabling to support both “synchronous” and “asynchronous” operations.

※ System Design Goal (1) ※

Visualization+

Network

Visualization+

Neowork+

Record

VisualizationVisualization

+Record

Time

Plac

e

Same Different

Sam

eDiff

eren

t

Page 8: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Shared-Screen: Remote Display (X-Window) Shared-Image: Sending Rendered Images

(centralized Approach) Shared-Control: Sending Control Parameters (Distributed

Approach) Sharing viewpoint、 camera、 visualization attributions

、 collaboration contents, etc.

LAN

LAN

WAN

gateway (router or bridge)

※ System Design Goal (2) ※

Page 9: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Requiring a cross-platform system supporting various operating systems for several hardware platforms.

MAC OS

OS/2

Windows 98

SolarisFree BSD

IBM AIX

Linux

Windows NT

Server

NetWork

※ System Design Goal (3) ※

Page 10: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

<III>

System Architecture

Page 11: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Member Service: Member Server and Member Client. CV Service: CV Server and CV Client. Advantages: two services are with independency. Adopting Visualization Toolkits (VTK)

※ System Architecture (1) ※

MemberServer

MemberClient

CVServer

CVClient

Server

Client

Page 12: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Dual servers with three execution modes.

※ System Architecture (2) ※

Member Server CV Server

Tcl/TkJava (socket)

Member Server + CV Server Member Server

CV Server

(II) LAN

(I) Single Host

(III) WAN

Tcl/Tk

Java

(socke

t)

Page 13: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Double View-Windows: Global and Local View.

※ System Architecture (3) ※

Global ViewGlobal View Local ViewLocal View

IBM 相容型

CV Server

CV Client

Page 14: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw
Page 15: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Member Server Side.

※ System Architecture (4): Member Server※

Connection Control

Condition Check

SystemKernel WWW Server

Java Socket

Mem

ber Cl

ient

CV Server

CommunicationUnit

Control Unit

Service Process

Administrator GUI

Process Unit

Database Access

File Access

Access Unit

Page 16: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Member Client Side.

※ System Architecture (5): Member Client ※

Dynamic HTML

BrowserHTTP

CommunicationUnit

Control Unit

Service GUI

Display Unit

MIME Type

Access Unit

Page 17: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

CV Server Side.

※ System Architecture (6) ※

Connection Control

Condition Verify

SynchronizeCenter Tcl/Tk Socket

Java Socket

CV C

lient

Mem

ber Server

CommunicationUnit

Control Unit

Administrator GUI

RemoteManagement

Management Unit

CollaborativeContent

Log File

Access Unit

Page 18: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

CV Client Side.

※ System Architecture (7) ※

Refresh Control

Synchronize Control

MessageParser

Tcl/Tk Socket

Java Socket

CommunicationUnit

Control Unit

Global View

Local View

Display Unit

CollaborativeContent

Log File

Access Unit

CollaborativeAction

Collaboration Mode

Operation Unit

Basic Feature

Advanced Feature

Function Unit

Page 19: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Security Issues.

※ System Architecture (8) ※

1

2

4

3

ConfigFile

LocalAdministrator

RemoteAdministrator

MemberServer

MemberTable

AllowTable

CVServer

CVClient

CVClient

CVClient

Verify

Verify

Modify

Page 20: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Qualification Table Maintenance.

※ System Architecture (9) ※

MemberTable

MemberServer

ConfigFile

GUI

CV Server

JAV

A S

ock

et

JAV

A S

ock

et

I / O

LocalAdministrator

Command

Command

RemoteAdministrator

DeleteCommand

Close the

sockets

dependent

on

the deleted

set of

"IP and User"

Page 21: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Global Execution Architecture: an overview.

※ System Architecture (10) ※

MemberClient

CVClient

MemberServer

CVServer

Server

Client

LocalAdministrator

RemoteAdministrator

Internet

Internet

Page 22: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

<IV>

Execution Procedure

Page 23: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Global execution procedure: an overview.

Member Server CV Server

bro

wse

r (http

)

Log

in R

eq

uest

bro

wse

r (h

ttp

)M

em

ber

Veri

fied

bro

wse

r (http

)

CV

Req

uest

Tcl/Tk or Java (socket)Member and Host Data

bro

wse

r (h

ttp

)C

V S

erv

er

Loca

tion

Stereo Glass

End User

Tcl/Tk (so

cket)

CV

Login Tc

l/Tk (

sock

et)

Client

Veri

fied

Tcl/Tk (socket)

CV Cycle

Tcl/Tk (socket)

CV C

ycle

Tcl/Tk (socket)

CV Cycle

Tcl/T

k (s

ocke

t)

CV Cyc

le

Page 24: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

※ Development Components ※

VTK Mesa

C/C++Java

Script

OpenGL

Java

Java

Tcl/Tk

vtkdll.dll vtktcl.dll

Browser

ASP

WWWServer

Database

Java Tcl/Tk

Tcl/Tk Java

JavaScript

Mesa

C/C++ Tcl/Tk

OpenGL

JavaVTK

ASP

NewVTKLib

Browser

VBScript

WWWServer

Database

Java

Client Side(Member + CV)

Member Server Side

CV Server Side

CSCV System

Page 25: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

※ Implementing NPR Function (1) ※

Reader Filter Mapper

ActorRenderer

RenderWindow RenderWindowInteractor

Property

Data

Set

Visualization

New Actor

NPR

Page 26: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Critical techniques

※ NPR Functions (2) ※

VTK

Mapper

Property

GLMmodel

GLMmodel

GLMmodel

GLMmodel

GLMmodel

GLMmodel

GLMmodel

NPR

Page 27: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

※Model Editing ※

Reader Filter Mapper

ActorRenderer

RenderWindow RenderWindowInteractor

Property

Data

Set

Visualization

New Actor

Mapper Mapper Mapper

Page 28: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

※ Converting Scripts to C Source ※

子選取並在此輸入標題

CSCV System

Tcl/TkCode

TclInterp

TkWindow

Tcl/TkRunTime

LibMemory

Executable File

Tcl/Tk Script

Other Data

Tcl/Tk Call

Other Code

RunTime

Page 29: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

<V>

Performance Analysis

Page 30: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

(Contrived)

Performance Impact Factors 1. Network Transmission Speed

2. Numbers of Collaborative Member

3. Collaborative Model Complexity

4. Hard Disk Access Speed in the CV Server

5. Processing Speed in the CV Client

6. Collaborative Operations

Page 31: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Name Value Meaning

Response Time RTReceiver:GlobalView finish action (T3) –Sender:LocalView begin sending operation (T1)

Communication Time CTReceiver:GlobalView finish receiving data (T2) –Sender:LocalView begin sending data (T1)

Rendering Time RT – CT Receiver:GlobalView synchronization renderingcost (T3 – T2)

Definition of Collaboration Time

Page 32: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Test Scene

Page 33: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Test Environment

Machine Machine Network Memory Clock

Name Locations (MBps) (MB) (MHz)

Server 國高中心 100 512 250

M-1 中興大學 100 128 392

M-2 中興大學 100 256 450

M-3 中興大學 100 128 700

M-4 中興大學 100 128 700

M-5 中央大學 10 128 450

M-6 中山大學 10 128 167

Page 34: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Network Traffic Time

Heaviest 12:00 PM

Lightest 06:00 AM

Network Traffic

Page 35: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

網路 工作 M-1 M-2 M-3 M-4 M-5 M-6

時刻 時間 (中興) (中興) (中興) (中興) (中央) (中山)

反應時間 11.39 10.55 8.41 8.28 15.03 18.03

尖峰 通訊時間 5.53 5.51 5.4 5.39 7.72 7.93

成圖時間 5.86 5.04 3.01 2.89 7.31 10.1

反應時間 11.37 10.57 8.43 8.33 14.93 17.95

離峰 通訊時間 5.5 5.47 5.4 5.36 7.66 7.92

成圖時間 5.87 5.1 3.03 2.97 7.27 10.03

Timing for 200 Operations in Seconds

Page 36: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

※ Bottleneck of Real Time Collaboration ※

Network Transmission Speed Collaboration is proceeded by sending the control parameters with small amounts of data, being independent on the network transmission speed.

Hardware in the Client Side Complex models require high-performance hardware in the client side to reach real time collaboration.

System Bottleneck System bottleneck is at the speed of hardware capability in the client side, not depending on network transmission speed.

Page 37: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

<VI>

CSCV Snapshots

Page 38: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw
Page 39: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw
Page 40: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw
Page 41: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw
Page 42: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

An Example for NPR Rendering

Page 43: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw
Page 44: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

<VII>

Future Work

Page 45: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Collaborative Model-Editing.

More NPR Rendering.

Further Performance Analysis.

Security Improvement.

System Maintenance.

※ Future Work (1) ※

Page 46: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

Middle Tier

Business Logic

User Interface

EIS Tier

EnterpriseInformation

Service

Client Tier

Web Browser

ASP

Middle Tier

Business Logic

User Interface

EJB

JSP

EIS Tier

EnterpriseInformation

Service

Client Tier

Web Browser

Tran

sp

lan

t

※ Future Work (2) ※

Page 47: Computer Supported  Collaborative Visualization C S C V Sun-In Lin lsi@cs.nchu.tw

T D C S V SThanks!Q & A


Top Related