services in fraunhofer enterprise grids julian bart, anette weisbecker cracow grid workshop ’07...

Services in Fraunhofer Enterprise Grids

Julian Bart, Anette Weisbecker

Cracow Grid Workshop ’07

16.10.2007

2

© Fraunhofer IAO, IAT Universität Stuttgart

Outline Introduction Fraunhofer Enterprise Grids (EPG)

Overview Services in Fraunhofer EPG Business sector-specific Grid solutions Structure Grid Check Process model Portal

Outlook PartnerGrid

3


Fraunhofer Alliance Grid Computing

The Fraunhofer Grid Alliance manages the Fraunhofer Resource Grid and combines the grid research activities of eight IT research institutes within the Fraunhofer Society.

The Fraunhofer Resource Grid (FhRG) is the

operational basis for Grid Research

and Grid Applications within the

Fraunhofer Grid Alliance.

4


Evolution of Grid Computing in industry

short term

long term

medium term

•Inter Grids: Wide Area Service Grids– Global Grid Service Infrastructure– international, global Grids – Semantic Grids– Service Oriented Knowledge Utilities (SOKU)

• Extra Grids: Distributed Partner Grids– Distributed Enterprise and Campus Environments– Integration of Partners, inter organisational Collaboration,– Virtual Organisation– Security, inter organisational load balancing

• Intra Grids: Enterprise Grids– process management across departments– Authentification, Authorisation, Security, Accounting– additional options e.g. load balancing

Time

Evolu

tion

5


Fraunhofer Enterprise Grids: Overview Economy-oriented research project by Fraunhofer

Project aims:

Preparation of sector-oriented Best-Practice grid solutions

Use cases, to show enterprises the possibilities of grid computing

Analysis of existing free and commercial grid middleware solutions

Process method for the introduction and usage of grids in enterprises

Development of a Grid check, to analyse the grid-capability of an enterprise including a cost-benefit model

Enhancements of the Fraunhofer grid software components

Grid middleware software (i.e. data management, workflow management and portal components)

Grid-relevant applications (Simulations, financial analysis, …)

6


Fraunhofer Enterprise Grids: Services Services in Enterprise Grids:

Introduction-Services for a Grid infrastructure in enterprises

Process model for the planning and realisation Grid Check

Middleware-Services in a Grid-based environment Portal

User-Management Data-Management Security based on X509 certificates

Workflow Execution System with Scheduler Calana – Auction-based Grid Resource Broker XenBEE – Virtualisation Environment

7


Development of business sector-specific grid solutions

Automotive/ Mechanical engineering/ Shipbuilding

Data exchange, collaboration I.e. Application coupling, distributed data

access I.e. Access to a distributed simulation

application

Oil and gas industries

Simulation, optimisation, data exchange, collaboration

I.e. Application coupling, distributed data access

Life Sciences Process acceleration, high data volumes, high computing requirements

I.e. Drug-design-simulation

Media Collaboration of many small- and medium-sized enterprises, digital content, high data volumes

Distribution of high data volumes on the movie market

Banks and insurances

Virtualisation of resources, real-time applications Throughput calculations (market data

analyses), real-time analysis

8


Fraunhofer Enterprise Grids: Structure

9


Fraunhofer Enterprise Grids: Process model Process model for the integration of Grid middleware in the

enterprise IT infrastructure

Strategy Analysis

Strategy Concept

Analysis Organisation

Analysis Processes

Analysis Information

Analysis Existingsystems

Requirementsidentification

Identification ofeconomicpotential

Rough concept

Specification

Technologyselection

Economicfeasibility

study

Providerselection

Fine concept

RequirementsSpecification

Realisation

Change Management

Trainingconcept

Introductionmonitoring

Training

Introductionconcept

Evaluation

Strategy Analysis Concept Realisation Introduction

S1.0

S2.0

A1.0

A2.0

A3.0

A5.0

A6.0

K1.0

K2.0

K3.0

K4.0

K5.0

K6.0

K7.0

R1.0

R2.0

R3.0

R4.0

R5.0

E1.0

E2.0

A4.0

10


Fraunhofer Grid Check Analysis of the IT-infrastructures and the processes Potential analysis of grid computing considering the business

objectives

Strategy Analysis

Strategy Concept

Analysis Organisation

Analysis Processes

Analysis Information

Analysis Existingsystems

Requirementsidentification

Identification ofeconomicpotential

Rough concept

Specification

Technologyselection

Economicfeasibility

study

Providerselection

Fine concept

RequirementsSpecification

Realisation

Change Management

Trainingconcept

Introductionmonitoring

Training

Introductionconcept

Evaluation

Strategy Analysis Concept Realisation Introduction

S1.0

S2.0

A1.0

A2.0

A3.0

A5.0

A6.0

K1.0

K2.0

K3.0

K4.0

K5.0

K6.0

K7.0

R1.0

R2.0

R3.0

R4.0

R5.0

E1.0

E2.0

A4.0

Normierung/Ergänzung

Verteilung Zusammen-fassung

Erhebung Erfassung Verarbeitung Analyse

Normierung /Ergänzung

Modul HHard FactorsModul SSoft Factors

Modul KKosten/Nutzenmodell

Modul AAnalyse-verfahren

TCOdiverse

Ergebnisse

DatenbasisDatenbasis Eingabe

Methoden

Ausgabe

Kunde

andererVerwendung

Normierung/Ergänzung

Verteilung Zusammen-fassung

Erhebung Erfassung Verarbeitung Analyse

Normierung /Ergänzung

Modul HHard FactorsModul SSoft Factors

Modul KKosten/Nutzenmodell

Modul AAnalyse-verfahren

TCOdiverse

Ergebnisse

DatenbasisDatenbasis Eingabe

Methoden

Ausgabe

Kunde

andererVerwendung

Extended Cost-Benefit model

11


Fraunhofer Grid Check Workshop(s) with developers/user Criteria Analysis Check List:

Applications Number and knowledge of current / potential users Licence problems Requirements Bottlenecks

Hardware infrastructure Network topology Existing hardware Security infrastructure (firewalls, policies…) Administration Planned changes Bottlenecks

Data infrastructure File Server Databases

…. Advantages/Disadvantages of Grid Computing

Analysis of the abilities to improve Cost-benefit model comparing current/potential infrastructure

12


Fraunhofer Grid Check Committing the objectives of a middleware introduction:

New business processes/models Performance improvement Providing access to the application via:

GUI Portal Console

Administration model/ Monitoring Costs Service Level Agreements Scalability Virtualisation grade

13


Fraunhofer Enterprise Grids: Portal Enterprise Grid portal in the Fraunhofer Resource Grid with

special focus on the requirements of enterprises: Variety of applications of different sectors Certificate-based Sign-On

New Users as guest users Role-based access to the applications via portlets Location-independent access to the Grid User-specific data storage on the portal

Input/Output files Parameter files

14


Fraunhofer Enterprise Grids: Portal Enterprise Grid portal:

Grid Workflow execution service Composition of several services to a new, more complex

service incl. data management based on Web services Resource broker/ Scheduler

Resource virtualisation Administration portlets

White list for new users by a Distinguished Name certificate-list

Script Templates to keep the resources up-to-date

15


Fraunhofer Enterprise Grids: Calana Agent-based Resource Broker

Broker starts auction by user request

Fast & expensive vs. Slow & cheap

Latest beginning

No. of CPUs

Agents bid for the order

BrokerBroker

Agent1Agent1 Agent2Agent2

16


Virtualisation infrastructure »XenBEE« Xen-Based Execution Environment

xbe – User client xbed – Management daemon xbeinstd – Instance control daemon (inside the Virtual Machine)

Workflow: The user can create and upload or use an existing virtual machine image Starting the machine via the xbed, waiting for xbeinstd to send Up-Message The user sends a file with the Job execution description (XSDL) incl. Data

Setup xbeinstd runs the application and returns the data when done

Images can be encrypted and compressed for transport

17


Evolution of Grid Computing in industry

short term

long term

medium term

•Inter Grids: Wide Area Service Grids– Global Grid Service Infrastructure– international, global Grids – Semantic Grids– Service Oriented Knowledge– Utilities (SOKU)

• Extra Grids: Distributed Partner Grids– Distributed Enterprise and Campus Environments– Integration of Partners, inter organisational Collaboration,– Virtual Organisation– Security, inter organisational load balancing

• Intra Grids: Enterprise Grids– process management across departments– Authentification, Authorisation, Security, Accounting– additional options e.g. load balancing

Time

Evolu

tion

18


PartnerGrid: Projectgoal

The goal is the development of a collaboration software platform based on Grid

– Management of distributed, virtual organisations und their protection by the realisation of integrated security concepts

– Accounting and billing function– Transparent access to distributed data in the form of file

systems and data bases passing firewalls– Interface to service providers for the execution of very compute

intensive application– Passing firewalls between partner by the integration of an

Application-level-gateway– Definition and execution of complex and distributed process flows– Simple usage interface for the access and the usage of the

software infrastructure via portal technology

19


PartnerGrid: Projectgoal

Realisation of two scenarios:– Founding process simulation

– Optimisation with parallel workflows on distributed resources

– Deployment of Grid middleware in a big enterprise– Online-Support by the software producer in customer-

projects– Plastic forming process simulation

– Project processing between customer, supplier and service provider

– Application sharing environment, Communication modules

20


Thank you for your interest!

Contact: Julian BartFraunhofer IAOBusiness Unit Software TechnologyE-Mail: [email protected]

http://www.swm.iao.fraunhofer.dehttp://www.enterprisegrids.fraunhofer.de

Questions?Questions?

services in fraunhofer enterprise grids julian bart, anette weisbecker cracow grid workshop ’07...

Documents

grid infrastructure

grid applications

fraunhofer iao

fraunhofer resource

grid research activities

fraunhofer society

usage of grids

data management