Grid Architecture

William E. Johnston

Lawrence Berkeley National Lab and NASA Ames Research Center

wejohnston@lbl.gov

(These slides are available at grid.lbl.gov/~wej/Grids)

Distributed Resources

Condor poolsof workstations

tertiary storageclusters

national supercomputer facilities

scientific instruments

Internet optical networks space-based networks

Grid Communication Functions

Communications

Ba

sic

Gri

dF

un

cti

on

s

...

Resource Discovery

Scheduling and Access to Computing

Uniform Data Access

Monitoring and Events

security servicestransport services

Op

eration

al Su

pp

ort

Po

rta

ls

Resource Brokering

Fault Management

AccountingData Management:

replication and metadata

Encapsulation as Web Services

Encapsulation for Script Based Services

Encapsulation as Java Based Services

Web Portal Access to Application and Grid Services

Specialized Portal Access (high performance displays, PDAs, etc.)

. . .

Se

rvi c

es

B

uil

din

g

Blo

ck

s

Se

rvic

es

Workflow Management

Applications

Grids: An Emerging, Common Computing and Data Infrastructurefor Science and Engineering

Application Domain Specific Portals

Application Domain Independent Portals

Grid Common Services: Uniform Access, Security, and Management of Compute, Data, and Instrument Resources

MER/CIPSTS/SLI MissionAnalysis

ES Modeling

ISS Training

Aviation Capacity

User Environment

Portals

Collaboration Portals

Domain Specific Web Services –Encapsulated Applications

Domain IndependentGrid Web Services

Vis

ua

liza

tio

n

Da

ta P

roc

es

sin

g &

A

na

lys

is

Da

ta M

an

ag

em

en

t

Co

lla

bo

rati

on

S

erv

ice

s

Mo

nit

ori

ng

Ev

en

ts

Wo

rkfl

ow

Ma

na

ge

me

nt

Pro

gra

mm

ing

S

erv

ice

s

Ex

pe

rim

en

tM

an

ag

em

en

t

Ins

tru

me

nt

&

Se

ns

or

Ga

tew

ay

s

Sy

ste

m M

od

els

Fli

gh

t S

imu

lati

on

Co

mp

uta

tio

na

l S

imu

lati

on

Arc

hiv

e G

ate

wa

ys

Zo

om

ing

Co

up

lin

g

Portals: Services Presented to the Users to Accomplish Tasks

Grid Web Services: Grid Functions and Application Functions Packaged for Building Portals

Multi-Site Compute, Data, and Instrument Resources

Grids: A Common Computing and Data Infrastructure forScience and Engineering

Gri

d P

roto

co

ls a

nd

Gri

d S

ec

uri

ty I

nfr

as

tru

ctu

re

Combining Grid and Web ServicesC

lien

tsApplication

PortalsWeb

ServicesGrid Services:

Collective and Resource AccessResources

Compute(many)

Storage(many)

Communi-cation

Instruments(various)

GRAM

GridFTPData Replica and Metadata Catalog

GridMonitoring

Architecture

GridInformation

Service

We

b B

row

se

r

Grid Web ServiceDescription (WSDL)& Discovery (UDDI)

Grid X.509Certification

Authority

SRB/MetadataCatalogue

Condor-G

CORBA

MPI

Secure, Reliable

Group Comm.

Discipline /Application

SpecificPortals

(e.g. SDSCTeleScience)

ProblemSolving

Environments(AVS, SciRun,

Cactus)

EnvironmentManagement(LaunchPad,

HotPage)

Job Submission /Control

File Transfer

Data Management

CredentialManagement

Monitoring

Events

WorkflowManagement

other services:•visualization•interface builders•collaboration tools•numerical grid generators•etc.

Apache Tomcat&WebSphere&Cold Fusion=JVM + servlet

instantiation + routing

CoG Kits implementing Web Services in

servelets, servers, etc.Python, Java, etc.,

JSPs

compositionframeworks(e.g. XCAT)

XM

L /

SO

AP

ov

er

Gri

d S

ec

uri

ty I

nfr

as

tru

ctu

re

Gri

d P

roto

co

ls a

nd

G

rid

Sec

uri

ty I

nfr

astr

uct

ure

Apache SOAP,.NET, etc.

……

htt

p,

htt

ps

. e

tc.

X W

ind

ow

sP

DA

Grid ssh