DWDM-RAM vs Layered Grid Architecture

Application

Fabric“Controlling things locally”: Access to, & control of, resources

Connectivity

“Talking to things”: communication (Internet protocols) & security

Resource

“Sharing single resources”: negotiating access, controlling use

Collective

“Coordinating multiple resources”: ubiquitous infrastructure services, app-specific distributed servicesData Transfer

Service

NetworkResource

Service

Data Path ControlService

Layered DWDM-RAM Layered Grid

’s

Application

Optical Control Plane

Application MiddlewareLayer

ResourceMiddlewareLayer

ResourceLayer

OGSI-ification API

NRS Grid Service API

DTS API

Backup slides

Problem Solving Environment

Applications and Supporting Tools

Application Development Support

Common Grid

Services

LocalResources

Gri

d

Info

rmat

ion

S

ervi

ce

Un

ifo

rmR

eso

urc

eA

cces

s

Bro

keri

ng

Glo

bal

Q

ueu

ing

Glo

bal

Eve

nt

Ser

vice

s

Co

-S

ched

uli

ng

Dat

a C

atal

og

uin

g

Un

ifo

rm D

ata

Acc

ess

Co

mm

un

icat

ion

Se

rvic

es

Au

tho

riza

tio

n

Grid Security Infrastructure (authentication, proxy, secure transport)

Au

dit

ing

Fau

lt

Man

ag

emen

t

Mo

nit

ori

ng

Communication

ResourceManager

CPUs

ResourceManager

Tertiary Storage

ResourceManager

On-Line Storage

ResourceManager

Scientific Instruments

ResourceManager

Monitors

ResourceManager

Highspeed Data

Transport

ResourceManagernet QoS

layers of increasing abstraction taxonomy

Grid access (proxy authentication, authorization, initiation)

Grid task initiation

Collective Grid

Services

Fabric

Dat

a R

epli

cati

on

High performance computing and Processor memory co-allocationSecurity and Generic AAAOptical NetworkingResearched in other programlinesImported from the Globus toolkit

Source: Case De Latt

DataCenter

1

n

1

n

DataCenter

Data-Intensive Applications

Dynamic Lambda Grid serviceODIN

Dynamic Optical Network OMNInet

DataTransfer Service

Basic NetworkResource

Service

NetworkResource Scheduler

Network Resource Service

DataReceiverService

Information S

erviceApplication MiddlewareLayer

ResourceMiddlewareLayer

ResourceLayer

OGSI-ification API

NRS Grid Service API

DTS API

DWDM-RAM Architecture

Layered Architecture

La

mb

da

Da

ta

Gri

d -

G

lob

us

S

erv

ice

s

CONNECTION

Fabric

SABUL

UDP

ODIN

OMNInetStorage Bricks

Grid FTP

GRAM

GSI

Particle Physics

Multidisciplinary Simulation

SOAP

TCP/HTTP

Grid Layered Architecture

NRS

Storage Service

DTS

IP

Connectivity

Application

Resource

CollaborativeGARA

Layered Grid Architecture and Lambda Service

Application

InternetTransport

Application

Link

Inte

rnet P

roto

col

Arch

itectu

re

FabricOmniNet

ConnectivityOGSI communication

ResourceLambda, Lambda path, storage, and CPU resources

CollectiveDMSNRM – OGSA/OGSI compliant

DWDM-RAM Application

My rough mapping

Ian Foster’s Layer Architecture

Data Transmission Plane

L3 router

Data storageswitch Data

Center

1

n

1

n

DataPath

DataCenter

Applications

Dynamic Lambda Grid service

Dynamic Optical Network

DataTransfer Service

Basic NetworkResource

Service

NetworkResource Scheduler

Network Resource Grid Service

DataReceiverService

External GridServices

Information S

erviceApplication MiddlewareLayer

ResourceMiddlewareLayer

ResourceLayer

ReplicaService

WorkFlow

Service

DWDM-RAM Generalized Architecture

What is Lambda Data Grid?

• A service architecture– comply with OGSA– Lambda as an OGSI service– GRAM extension

• add parameter of network resource

• net resource co-allocation

– on-demand and scheduled Lambda

• GT3 implementation – contribute code back to GT3

Data Grid Service Plane

Network Service Plane

Centralize Optical Network Control

Lambda Service

Grid Computing Applications

Grid Middleware

GeneralizedLabel

Multiplexing: Lambda,OBS, Fiber Switching,..

Fiber

Grid Service Optical Interconnection

TCP UDP …

Applications

HTTP SOAP …

Lambda Hourglass• Data Intensive (DI) app

requirements– HEP

– Astrophysics/Astronomy

– Bioinformatics

– Computational Chemistry

• Inexpensive disk – 1TB < $1,000

• DWDM– Abundant optical bandwidth

• One fiber strand– 280 λs, OC-192

Data-Intensive Applications

Lambda Data Grid

Abundant Optical Bandwidth

CERN 1-PB

2.8 Tbs on single fiber strand

Lambda Data Grid details• A framework providing optical

paths for Data-Intensive applications

• Service architecture – interacts w/ optical control– dedicated on-demand optical

path– not on the public Internet – novel data-networking

scheduling scheme

OGSI OGSA

GT3 Services

GR

AM

GA

RA

Co-

allo

catio

n

Co-

rese

rvat

ion

DTS

IntelligentMidlewareservices

Ext Ext

Ext

Ext Ext

NRS

Service ArchitectureGRAM Net Ext

Data Grid Service

Network Service

Centralize OpticalNetwork Control

Grid MiddlewareOGSA/OGSI

GARA Net Ext Co-allocation

Lambda OGSI-ification

Intelligent Services

NRS

DTS

Generic DI Infrastructure

Co-reservation