processing services in visual information...

Processing Services in

Visual Information Systems

Eleni Kaldoudi

Institute of Computer Science

Foundation for Research and Technology - Hellas

work done in collaboration with

Marios Zikos

Invited Presentation

German Cancer Research Center,

Heidelberg, Germany

July 1, 1997

Institute of Computer Science - Foundation for Research and Technology - Hellas

visual information management

• pattern recognition

• image processing & analysis

• computer vision

• graphics

• information retrieval

• data base techniques

• human-computer interface issues


image processing - current state

• toolkits

• software packages

• visual language environments

• systems & environments


processing services

distributed execution of

processing algorithms

plug-n-play integration

of third party software

software development

testing, & evaluation

macro construction &

processing

integration with other

services & systems

charging: ‘renting’

algorithms and resources

computational

resource management

management & retrieval

of available software


… in the quest of an environment

• scaleable & extensible environment

• robust & persistent execution

• easy access

• user transparency in terms of

– software and hardware platforms

– network technologies


design issues

• modularity

• interactive components

• emerging functionality

• code re-use

• customization - adaptibility


DIPE

other

application

execution agent

user

application

execution agent

manager

manager

manager

manager

execution agent

an environment

for image

processing

services


coordination model

temp storage

cache execution

execution

execution

execution

execution

request & data

response & data

manager

algorithm

repository

execution agent

application


algorithm repository

virtual repository, distributed over the network

each segment consists of a machine-specific

collection of algorithms

algorithms:

new and third party (only executable)

algorithms:

private or public (at various user group levels)


generic algorithm structure

command line

execution

output data

read input data

execution

loop1

loop2

loopN

write output data

command line

output data


communication library for developers

start-up

end-phase

user-call-back

main-loop

read input data

execution

loop1

loop2

loopN

write output data

command line

output data


algorithm wrapper

communicate

with

application

receive request for algorithm execution

send results to the application

convert input data

execute algorithm

convert output data

execution

output data

command line


generic algorithm description

types of I/O data & arguments

image, vector, parameter, string, set of any of the above

configuration file

name: argument name

data type: e.g. IMAGE, SET_IMAGE, POINT, ...

data format: specify appropriate converter

requirement: YES / NO

input: YES / NO

prefix: prefix string


algorithm configuration file

[param 1] name = SEED type = POINT format = POINT_CDM_LN required = YES input = YES prefix = -s [param 3] name = IMAGE_IN type = IMAGE format = RAW2RAS required = YES input = YES

[segment-tree]

exepath = /usr/local/bin/segment-tree $SEED $PAR $IMAGE_IN $IMAGE_OUT

numparams = 4

[param 2] name = PAR type = INT format = INT_CDM_LN required = NO input = YES prefix = -l [param 4] name = IMAGE_OUT type = IMAGE format = RAS2RAW required = YES input = NO

segment-tree -s x y -l l file-in file-out


execution profile (...work in progress)

• I/O data size

• processing element memory

• execution time

I/O


algorithm retrieval (…future work)

• software related characteristics (static)

• execution characteristics (dymanic)

• user goals

• user preferences


resource management

distributed decision making

process

based on the market metaphor

realized through the cooperation

of execution agents

manager

execution agent

execution agent

execution agent

execution agent


resource management

bid

• performance of local CPU

• current state of local CPU

• network characteristics

• cached data

• algorithm profile

• self-confidence

• general policy

manager

execution agent

execution agent

execution agent

execution agent

estimated execution

time and cost


resource management

task assignment

• minimum cost

• minimum execution time

• reliability of bidder


• general policy

manager

execution agent

execution agent

execution agent

execution agent


macros

algo 1

1.i.1

1.i.2

1.i.3

1.i.4

1.o.1

4.i.1

4.i.2

4.i.3

4.o.1

algo 2

algo 4

algo 5

5.i.1

5.i.2

5.i.3

2.o.1

2.o.2

2.o.3

algo 3

I.3

I.2

I.1

I.6

I.5

I.4

I.7

5.o.1

5.o.2

2.i.1

3.o.1

3.o.2

3.i.1

3.i.2

O.2

O.3

O.1

input output execution


macro agent

execution agent

macro

agent

execution agent

application

execution agent

execution agent

manager


agents’ policy

on

• accepting execution

• allocating execution

• charging

in terms of

• user priority

• execution priority

• user id and origin


• time and date

• system state

• ...


execution agent - roles

execution wrapper • execution spawning

• data conversions

• intermediate communication

data management • status of cache

• intelligent data delivery

• data prefetching

execution management • status of current processes

• estimate remaining execution time

• calculate actual execution time

repository manager • execution profile

• statistical analysis of profiles

• (algorithm retrieval)

resource monitoring • information on local platform

• current status of local platform

execution agent

algos

execution control resource

monitor

data mgt.


manager - roles

manager

directory algo info

directory • local execution agents

• other managers

virtual repository • algorithm information

authentication • user authentication

• manager authentication

resource management • bid evaluation

• charging


user application

…..

GUI

pre-processing

vizualization

real-time local

processing

embbed algos

• unique image ids

• image pre-processing and

vizualization functionalities

• multi-level help

• toolkits for

algorithm development

algorithm integration

macro recording and visualization

… etc.


scripting & plug-ins

support new types of data

create dialogues for intermediate

communication

instruction macros

extend roles and policies of agents

add new breeds of agents


implementation issues

• ACE operating system transparency network transparency

• CORBA integration

• zApp

graphical user interface transparency


applications

best use of computational resources &

quality of service

integration of heterogeneous algorithms,

and software/hardware platforms

‘renting’ processing algorithms and

resources

processing services within a ‘virtual’

enterprise

added value service over various

information services networks


distributed processing within the same

organization

PC - linux

other

application

SUN - solaris

execution agent

manager

user

application algorithm

repository

execution agent

algorithm

repository

SGI - irix

PC windows NT/95

user

application

SUN - sunOS

user

application

execution agent

algorithm

repository

SGI - irix

user

application

execution agent

algorithm

repository

execution agent

algorithm

repository

SUN - solaris

execution agent

algorithm

repository PC windows NT/95


other

application

execution agent

user

application

execution agent

execution agent

web-enabled

application

user

over the

internet

‘renting’

processing algorithms and

computational resources

over the internet

manager

Internet


other

application

execution agent

user

application

execution agent

execution agent

manager

supercomputing center

manager

industry

manager

research institute

manager

research institute

transparent

processing services

within a ‘virtual’ enterprise


image processing services

telemedicine services network

an added value service

offered by other information

services networks


work in progress

• advanced graphical user

interface tools

• web-enabled application

• charging mechanisms

• algorithm management and

retrieval


cite as

• E. Kaldoudi, “Processing Services in Visual Information

Systems”, Invited Talk, MBI Seminar Medizinische

Bildverarbeitung”, Division of Medical and Biological

Informatics, German Cancer Research Center,

Heidelberg, Germany, July 1, 1997

processing services in visual information...

Documents