grid 2000 - focale1 towards a grid view of generic components based distributed applications g....

19
GRID 2000 - FOCALE 1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France [email protected] http://corbaweb.lifl.fr

Upload: bennett-snow

Post on 31-Dec-2015

214 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 1

Towards a GRID view ofgeneric components baseddistributed applications

G. Scotto di Apollonia

LIFL, [email protected]

http://corbaweb.lifl.fr

Page 2: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 2

Motivations

Large-scale distributed applications made of components distributed everywhere

Intensive computations mathematics , virtual reality, data warehousing

Use of supercomputersUse of high-speed networks

Page 3: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 3

Definitions

Computation component Program doing a specified task

Genericity => any language

Input/output channelsGenericity => any stream

Distributed application: Graph of components:

Link between inputs and outputs

Page 4: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 4

Facilities needed

Easy and intuitive application construction Focus on algorithm rather than distribution

Management of generic components Any language, any communication mean Reusable programs Automatic deployment Factory design pattern

Page 5: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 5

Factory design pattern (basic)

Knows a component descriptor and its instances

One method: Instanciate

Factory

InstanceInstanciate

Componentdescription

Page 6: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 6

Generic component description

Trader entry properties (name = value) “name”=“mycomp”

Binary file path command line

I/O streams spec. Type, location...

Trader entry

Properties

Binary

File

Input Output

Factory

Page 7: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 7

Separate targets

For applications:

Federation of computation serverson a large scale

Execution platform Launches applications Components

deployment

For developers:

Environment helping the development of distributed applications

Graphical tool Application construction Displays state & results

Page 8: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 8

Platform levels

Top-down architecture elements: Federation Server structure Application description Component factory Connector

Page 9: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 9

What do we need ?

Federation (conceptual view)

Distributed intelligencedeployment, trading service (yellow pages)

C1 C2 C3

S1S2

S3S4

C1 C2 C3

Page 10: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 10

Federation (servers view)

Interconnected

Factories

Applications Client

Interconnected

Factories

Applications

Interconnected

Interconnected

What do we have to provide ?

Factories

Applications Factories

Applications

Page 11: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 11

Server

ServerC

lients

C

OR

BA

CO

RB

A

Running instances

Applications

FactoriesOth

er s

erve

rs

Inte

rcon

nec

ted

Tra

der

Connectors

Page 12: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 12

Application

DataEntry

Transpose

Invert Storage

Display

Component graphApplication description server

Page 13: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 13

Instanciating an application

Instanciate

A

B

C

D

Application description

B

Application instance

A

D

C

instanciating and linking all components

Page 14: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 14

ConnectorC

omp

onen

t p

rod

uci

ng

dat

a

Com

pon

ent

con

sum

ing

dat

a

File

Socket

Console

Method

File

Socket

Console

Method

Con

nec

torO

utp

ut

Con

nec

torI

np

ut

CORBA

Any stream to any stream connectors

Page 15: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 15

machine A machine B

Connector instance

Created after component instanciation

resource

resource

write

watch

update

readsend

producer thread

output thread consumer thread

input thread

Page 16: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 16

Implementation

To this day, we have servers, managing component installation application management and deployment component interconnection with file and

stream

user graphical console

Choices: Java and CORBA

Page 17: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 17

Related work

Java-based Ajents, ProActive

Components-based NetPebbles, Comet, Regis

CORBA incoming proposals Parallel CORBA, Aggregated Computing

Page 18: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 18

Environment

Page 19: GRID 2000 - FOCALE1 Towards a GRID view of generic components based distributed applications G. Scotto di Apollonia LIFL, France scottoda@lifl.fr

GRID 2000 - FOCALE 19

Overview