nextgrid gmb v2 gmb 9may2007… · the financial support of the european commission is gratefully...

The NextGRID Architecture

Guy LonsdaleC&C Research Laboratories, NEC Europe Ltd.

The financial support of the European Commission is gratefully acknowledged. Material in this presentation reflects only the author’s views and the Commission is not liable for any use that may be made of the information contained herein.

OGFOGF--20, 20, ““Grid Means BusinessGrid Means Business””, Collaborative Grids Session , 9.5.07, Collaborative Grids Session , 9.5.07

Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.

2

Presentation Overview

Intro to the NextGRID projectSummary of Key Architectural FeaturesExamples of use/impact in NextGRID application experiments


3

The Grid “Today”Is a huge success for both business and scienceSignificant business adoption of cluster Grids -“mature technology” – Merrill LynchBut we see different facets

The scientific community has embraced collaboration and new applicationsThe business community has embraced resource management and provision

Since 2002 the research community has been working on combining the above…


4

Grid Research Vision

Grid serviceproviders Grid

offering services

Transparent and reliable Persistent, pervasive and ubiquitous

Open to wide user & provider communitiesSecure, with trust across multiple domains

Easy to use, configure and managePerson-centric yet Scalable

Standards based

Next Generation Grid Experts group: ftp://ftp.cordis.lu/pub/ist/docs/ngg_eg_final.pdf

European citizens

Private sectorPublic sector


5


6

Tomorrow’s (Next)GRIDNextGRID focuses on Grid for businessVision is of future Grids:

that are economically viable;in which new and existing business models are possible;in which development, deployment and maintenance are easy; andin which the provisions for security and privacy give confidence to businesses, consumers and the general public.


7

Creating the next generation GridNextGRID Project Cycles

conceptualisationdesignexperimentationanalysis

Design

Analysis

Conceptualisation

Experimentation

Identification of Fundamental Requirements NextGRID architectural principles


8

Requirements – Architectural PrinciplesFlexible Business ModelsSpecific Quality of Service Terms

Open to extension, flexible and able to allow business relationship management

Dynamic SecurityComms & operational security + dynamically changing trust relationships.

Dynamic Compositionlate in the service provisioning lifecycle, linked to dynamic security

Economic SustainabilityPrivacyFacilitated Management

semi-automatic and at minimal cost, integration with business infrastructure

Interactive Supportimpacting both the service level agreements & basic infrastructure

Primary PrinciplesSLA-Driven DynamicsDynamic FederationMinimal Grid Infrastructure:

Balancing simplicity with sufficient features to support viable business models

Secondary PrinciplesDynamic Service LifetimeDynamic Content Support

Service content able to evolve during service lifetime

ManageabilityAutonomously, encompassing large-scale Grids

DiscoveryOpen Design and Development Process:

Interoperable Grids, subject to some commonalities of design.

For further details – NextGRID White Paper


9

Presenting/representing the ArchitectureNextGRID is a Service Oriented Architecture

Some NextGRID Approaches

NextGRID ServiceNextGRID Service

SLA

SLA

SLA

SLA

SLA

SLA?

SLA SLA

NextGRID ServiceNextGRID Service

SLA

SLA

SLA

SLA

SLA

SLA?

SLA SLA

service provider

service

UserSLA

ConfigurationPolicy

MonitoringPolicy

EventEvent

Business layer

Technology layer

service provider

service

UserSLA

ConfigurationPolicy

MonitoringPolicy

EventEvent

Business layer

Technology layer

Highly CompositionalAll the pieces are not needed all the timeThe interactions are not (statically) defined

Flat Rather than Hierarchal

Encapsulation rather than layering


10

Enabling Dynamics: SLAs

service provider

service

SLA

Business layer

Technology layer

service provider

service

SLA

Business layer

Technology layer

service provider

service

SLA

Business layer

Technology layer

BusinessContext

ServiceContext

SystemsContext

ApplicationsContext

Produ

ct an

d ser

vice

deve

lopmen

t

Negoti

ation

and

sales

Imple

mentat

ion

Execu

tion

Asses

smen

t

Decom

mission

Continuous Feedback

TerminateMonitorSurveillanceMaintain, Bill

Take ordersProvision

NegotiateIndividualcontracts

DevelopTemplates,Parametricboundaries

Reassess

Produ

ct an

d ser

vice

deve

lopmen

t

Negoti

ation

and

sales

Imple

mentat

ion

Execu

tion

Asses

smen

t

Decom

mission

Continuous Feedback





Reassess

Produ

ct an

d ser

vice

deve

lopmen

t

Negoti

ation

and

sales

Imple

mentat

ion

Execu

tion

Asses

smen

t

Decom

mission

Continuous FeedbackContinuous Feedback





Reassess

Bi-partite SLAs: Key NextGRID Innovation – supports the full service provisioning lifecycle

Corner Stone of the Architecture

Evolution of existing SLA structures

More Collaborative

in Nature

Linked to high level business goals

Key business and market enabler

Bi-partite SLAs


12

Negotiation Example

<discover><publish>

SLAT<id>NGE1SLAT</id>

NGE<id>1</id><requirements><capabilities>


SLA<id>NGE1SLA</id>

Fn<id>NGE1Fn</id>

<instantiate>

SLA<id>NGE2SLA</id>

Fn<id>NGE2Fn</id>

<instantiate>

offer(SLA)

accept(SLA)


NextGRIDEntity


13

Business Value: Dual UseManagement Efficiency

Improved Data Center AutomationFrequent management functions can be automated more easily through SLA driven dynamics

Greater Flexibility in Deploying ResourcesUnderutilized resources are easily detected

New Business ModelsPersistent “On Demand” Services

With SLA managed QoS

Dynamic, Distributed, Transient PartnershipsThrough integration of dynamic security and SLAs.


14

Architectural components

Dynamic Orchestrators(discovery, workflow, invocation, etc)

ManagementSystemsand SLAs

Data-centricFunctionalSystems

DynamicTrust andSecurity

Base standards (http, wsdl, soap, naming,notification, addressing, policy, security…)

Defines services provided over

bipartite relationships

Allows composed services to deliver

business value

Allows consistent description and

management of all applications

Protects services and bipartite relationships

Provides basic facilities and

interoperability


15

Primary RelationshipsRegistry

Functional

SLAManagement

Trust andSecurity

Naming andAddressingOrchestration

Register Discover

Resolve

Mint

Administer policy

Monitor/Control

Get tokens

Negotiate SLA

Invoke

Get tokenassertions

Register /Discover

Get tokenassertions

Get tokenassertions

Get tokenassertions

Schemas


16

Key outputs

Grid Standards resulting from and

influenced by NextGRID

Generalised Specifications

Architectural Component

Designs

Software Components

Case Studies

Generalised Specifications

Download Generalised Specifications at: http://www.nextgrid.org


17

Generalized Specifications


18

Cookbook Example:Grid Virtual Infrastructure Model

<<component>>Prioritiser

<<component>>Discoverer

<<component>>Selector

<<component>>VIM Enactor

<<component>>Grounding



<<component>>Application service

<<component>>QoS History



<<component>>Security Token Service


19NextGRID Application Areas

Digital MediaDigital Media(DM)(DM)

FinancialFinancialApplications:Applications:

Supply Chain Management (SCM)Supply Chain Management (SCM)Electronic Data Record (EDR)Electronic Data Record (EDR)

ProcessingProcessing

Images provided by Dreamstime.com, SAP, Kino, GridSystems


20

Financial Applications: Implied VolatilityScenario A Financial Services Grid involving 4 parties:

Compute resource providerFinancial service providerFinancial data providerFinancial service customer

Objectives:orchestrate interactions between these partiesallow them to centrally register and discover resources.

Uniform method of describing numerousheterogeneous resourcesCommon interface allows parties using different languages, tools, software to interact and simplifies the processSystem flexibility allowing new schemas and intermediaries to be added without affecting existing operation

Application Benefits


21

Financial Applications: Derivative PricingScenario

Pricing of complex optionsResults should be available within seconds or lessin order to

adapt prices, hedging strategies to market changesallow fast and reliable pricing of products tailored to the needs/demands of potential customers

Application Benefits & Experiment Feedback Viability of NextGRID-relevant security components & interoperability across Windows-Linux/OSS systems Secure data transfer: a necessary condition for use of external servicesA bank could dynamically manage and enforce who is able to access the service under which SLA.Feedback on handling security (token re-use) for interactivity


22

ScenarioCustomer with huge data sets to be processed under time-constraints (not possible locally)Data set published as a NextGRID secure service &service provider (for processing) sought.Service provider receives a job submission & URL of the customer data service.The service provider distributes jobs across machines, each to receive only subset for processing.

End to End data transmission highly improves scalability and performance.NextGRID provides a coherent set of specifications to manage security, trust, service discovery, SLA negotiation and QoS management (covers the whole “transaction” life-cycle).


Electronic Data Record (EDR) Processing


23

ScenarioSupply Chain Management

Customer:Runs an SAP SCM solution & seeks to outsource Dialogue instances running on SAP WebAS.Seeks Provider offering hosting of Dialogue Instances while the business data remains at the customer site.Given an existing SLA, initiates the use of the service by sending application specific configuration data.

Provider:Offers hosting of Dialogue Instances & utilizes NextGRID Operational Mngmt Framework.Installs SAP binaries and the SAP Application Management Framework.SAP Dialogue Instances are deployed dynamically based on NextGRID

policies with a threshold on the mean response time of the system.

Dynamic management of Dialogue Instance will reduce TCO.Policy controlled management introduces high flexibility.Event driven operations of business applicationsSecurity



24

ScenarioSelection of service providersfor a job submissionDecision supported byanalysis of QoE (Quality of Experience) datafrom previous job executions

Rating of the service providers

Rating of service providers based on QoE parametersDifferent/customized rating for each job typeEffective expenditure of consumer’s budget ( providers)Achieving higher QoS for the consumers

Digital Media Production



25

The Grid of the futureService orientation brings collaborative Grids within reach of businessIn NextGRID we’ve focussed on

Flexible Business Models Specific QoS TermsDynamic Security Dynamic CompositionEconomic Sustainability PrivacyFacilitated Management Interactivity Support

Next steps are to create Service Oriented Knowledge Utilities - SOKUs


26

The Future

See http://www.cordis.europa.eu/ist/grids


27

Acknowledgements

All NextGRID PartnersFor direct contributions to the presentation:

Applications teams at First Derivatives, GridSystems, KINO, NEC, NTUA, QUB,SAPPaul McKee (BT), Mark Parsons (epcc), Dave Snelling (Fujitsu Labs Europe)

The financial support of the European Commission is gratefully acknowledged. Material in this presentation reflects only the author’s views and the Commission is not liable for any use that may be made of the information contained herein.

nextgrid gmb v2 gmb 9may2007… · the financial support of the european commission is gratefully...

Documents