grid enabled services infrastructure (gesi)

16
Grid Enabled Services Infrastructure (GESI)

Upload: curt

Post on 19-Mar-2016

72 views

Category:

Documents


0 download

DESCRIPTION

Grid Enabled Services Infrastructure (GESI) ‏. Transformation from the Global Information Grid (GIG) to Net-Centric Environment (NCE) ‏. DoD NCE Grid Computing - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Grid Enabled  Services Infrastructure (GESI)

Grid Enabled Services Infrastructure

(GESI)

Page 2: Grid Enabled  Services Infrastructure (GESI)

Transformation from the Global Information Grid (GIG) to Net-Centric Environment (NCE)

Background

Office of the Secretary of Defense for Networks & Information Integration (OSD NII) presented a roadmap for transformation of the Global Information Grid (GIG) to the Net-Centric Environment (NCE).

DoD NCE Grid Computing The Net-Centric Environment (NCE) “grid” is envisioned as a federation of distributed computing resources available over local and wide area networks that appear to an end user or application as one large virtual computing system.

NCE Grid Computing will be built on pervasive services oriented Internet standards which will allow the DoD to share computing and information resources across departmental and organizational boundaries in a secure, highly efficient manner.

source: John Daly Department of Defense Computing Infrastructure Brief NCOIC Stakeholder Outreach Working Group, 6 December 2007 http://colab.cim3.net/file/work/SICoP/Virtualization/2007-12-06/JDaly12062007.pdf

Page 3: Grid Enabled  Services Infrastructure (GESI)

Technology Enablers of the NCE

Technology

NCE will be based on business approaches and technology solutions.

Clustering• Collection of computer, storage and application resources in a

fixed configuration designed to be operated and managed in a unified, high-performance manner.

Server Virtualization• Provides the ability to deploy a discrete number of “virtual

machines” on a single hardware platform.Network Virtualization

• Allows for the establishment of Virtual LANs (VLANs) between servers.

Storage Virtualization• Pooling of physical storage from multiple network storage

devices into what appears to be a single storage device that is managed from a central console

Agile Architectural Framework• Providing a very agile grid framework upon which to build a

Service Oriented Architecture (SOA)

Page 4: Grid Enabled  Services Infrastructure (GESI)

An enterprise system:• 7-node Oracle Real Application Clusters (RAC)• 70TB total storage available, 30TB used for database and

content storage• High-Availability Clustered JBoss Application Servers

Recognized for its success and quality:• Recognized for Technical Achievement, noting superior

operational support• OCIO confirmed SOA implementation compliance, supporting

scalable, cost-effective architecture goalsDeployed Architecture continues to successfully demonstrate:

• Scalability – Increased workload from 18k documents per day in 3/06 to over 100k in 3/07.

• User Buy-In - A 600% increase in unique users since going operational

• Technology enhancement

Booz Allen Hamilton Has Proven Expertise in Document Management within Federal Government spaces

BackgroundIn April 2004, our Document Management pilot capability became an accredited and operational capability

Page 5: Grid Enabled  Services Infrastructure (GESI)

Approaching power/AC/space limitations

Handling increasing data and growing user base

Inevitable system load spikes

Peak load can be orders of magnitude greater than the average load

Satisfying stability, availability, and agility requirements

Updating antiquated technology solutions

Paying unreasonable maintenance costs, which tie up budgets

IT professionals / expertise unavailable

What are your current technical challenges?

In 2006, humans created 161 exabytes of data, 3 million times the information in all

books ever written.- IDC US Green IT Survey

“”

The demand for computing, network and storage resources shows no signs of decreasing

Page 6: Grid Enabled  Services Infrastructure (GESI)

Facts Individual components are not

expensive enough…yet:

Compute Power, Storage, Energy

Hardware used to compensate for poor software design

Demand for Information Technology is still growing

Effectiveness ≠ Efficiency

source: “Improving Data Center Energy Efficiency: A Holistic Approach”, Andrew Kurz, Burton Group (September 2007)

The significant problems we face cannot be solved by the same level of thinking that

created them.- Albert Einstein

“”

How did we get to this point?

Fallacies The network is reliable

Latency is zero

Bandwidth is infinite

The network is secure

Topology doesn’t change

There is one administrator

Transport cost is zero

The network is homogenousPeter Deutsch’s 8 Fallacies of Distributed Computing

Enterprise systems are struggling with the accidental complexity

Page 7: Grid Enabled  Services Infrastructure (GESI)

Current Data Center Capacity Planning

Current Data Center development paradigms lead to large amounts of under-utilized siloed resources

5% UtilizationDedicated

Servers

DedicatedStorage

System A

Pre-Apportioned Storage

Operating Sys

Application 1

Application 27%

Utilization

DedicatedServers

DedicatedStorage

System B BIOS

Pre-Apportioned Storage

Application 3

Systems Hosted in Typical Data Center

Operating Sys

Application 1

Application 2

BIOS

Page 8: Grid Enabled  Services Infrastructure (GESI)

Capacity Planning and GESI Architecture

Modular ArchitectureGESI allows servers and storage to be more efficiently utilized, reducing use of power and cooling resources

Operating Sys Dom 0

70% UtilizationShared Servers

Shared Storage

System ASystem B

BIOS

Systems Hosted on GESI Architechture

VM Node B1

Application BOperating Sys

VM B1

VM Node B2

Application BOperating Sys

VM B2

VM Node A1

Application AOperating Sys

VM A1

VM Node A2

Application AOperating Sys

VM A2

Node B1

Node B2

Node A1

Node A2

Operating Sys Dom 0

50% Utilization

BIOS

VM Node B3

Application BOperating Sys

VM B3

VM Node B4

Application BOperating Sys

VM B4

VM Node A3

Application AOperating Sys

VM A3

Node B4

Node B3

Node A3

Dynamically Allocated

Shared Storage

Page 9: Grid Enabled  Services Infrastructure (GESI)

Task Centric Business Services

Entity Centric Business Services

Application Wrapper Services

Enterprise Services

SANs, Servers, Power, Cooling

Virtual Processing

Virtualization of Database

Virtual File System/Network

Storage, Processing, Throughput, Memory

Business Process Layer

Service Interface Layer

Applications Layer

Virtual Services Layer

Foundation Layer

Physical Layer

QO

S M

onito

ring/

Secu

rity

Complex heterogeneous entities can be decomposed Into simpler, individual components and responsibilities

How do you decouple the system components in your Enterprise Architecture?

First and foremost, a loosely coupled architecture allows you

to replace components, or change components, without

having to make reflective changes to other components in

the architecture/systems.- David Linthicum, SOA Magazine, October 2007

Page 10: Grid Enabled  Services Infrastructure (GESI)

Commodity based approach

Low Start-Up and Maintenance Costs

Lower Technology Refresh Expenses

Open Source Promotes Faster Deployment

High Availability

Energy Efficient System Scaling – “Green”

Encourages Standardization

Open Standards = Business Process Agility

Reuse of Business Components

Agile Infrastructure

Virtualized Pools of Resources

Transparent Sharing of Distributed Resources by Multiple Clients

Realign current infrastructure

Reduce current footprint by powering down excess equipment

Reclaim previously wasted resources

Distributed Processing / Storage

An open architecture allows for the ability to add, upgrade and swap components

Page 11: Grid Enabled  Services Infrastructure (GESI)

GESI Infrastructure

GESI is customizable to users’ initial requirements and scalable to users’ future requirements

An Integrated Architecture Solution

SOAOpen SourceOpen Standards InteroperabilityBusiness AgilityVirtualization –

Maximizing Resource Use

More SW across Less Hardware

High Availability

Extensible Load

Balancing Ability to Host

Multiple Databases and Legacy Databases

Remote Mgmt. Capability

Online Growth

Store File as a Globally Unique Identifier (Store once and only once)

Database StorageServices Integration

Architecture to Host:

Business Processes, Tools, Data Workflow

UI Components

Web Mash-Up (Ability to access multiple systems through single UI)

Multi-Tenants

Legacy Capabilities

Legacy Databases“By 2010, Enterprise Web Mash-Ups will be dominant (80%) for composite enterprise applications”

-Gartner Symposium, Orlando, October 2007

Page 12: Grid Enabled  Services Infrastructure (GESI)

Cluster multiple physical servers to gain failover capabilities

source: “Automated failover and recovery of virtualized guests in Advanced Platform”, Rob Kenna, Redhat Magazine

What new challenges will server consolidation introduce?

Virtualization success depends on tight

cooperation between server, storage, network and

security teams.-Chris Wolf, Burton Group

CIO Magazine, “Virtualization in the Enterprise Survey”

“”

Share resources across physical servers

The combination of service, virtualization and grid techniques can reduce cost while also improving flexibility

Page 13: Grid Enabled  Services Infrastructure (GESI)

GESI is part of a Service Oriented Architecture Foundation

Infrastructure Architecture is part of the SOA Alliance's SOA Foundation

As the Open Group Architecture Framework (TOGAF) states, good enterprise architecture brings important business benefits:

A more efficient IT operation: – Lower software development, support, and maintenance costs – Increased portability of applications – Improved interoperability and easier system and network management – Improved ability to address critical enterprise-wide issues like security – Easier upgrade and exchange of system components

Better return on existing investment, reduced risk for future investment: – Reduced complexity in IT infrastructure – Maximum return on investment in existing IT infrastructure – The flexibility to make, buy, or out-source IT solutions – Reduced risk overall in new investment, and the costs of IT ownership

Faster, simpler, and cheaper procurement: – Buying decisions are simpler, because the information governing

procurement is readily available in a coherent plan. – The procurement process is faster - maximizing procurement speed and

flexibility without sacrificing architectural coherence.

Page 14: Grid Enabled  Services Infrastructure (GESI)

GESI provides the essential elements of a Service Oriented Infrastructure

SOI delivers bottom-line benefits to the enterprise. It

provides the basis for greater IT automation whichresults in higher IT

productivity and lower operational costs.

SOA Practitioner's Guide, part 2

Service Oriented InfrastructureMoving from a dedicated infrastructure to a dynamic infrastructure

Addresses all the aspects of the infrastructure– Networks, servers, data centers, and firewalls– Application infrastructure, security, monitoring,

middleware, etc.

Key elements – Life cycle support to manage the deployment of SOI

components– Virtualization of infrastructure resources to SOI users– Service management to assure the SOI solution provides

the required service characteristics

Combines architecture building blocks and role-based portals – High reuse of common services– Reuse of infrastructure and foundational components– Reduction in time needed to deliver capabilities

Page 15: Grid Enabled  Services Infrastructure (GESI)

Benefits of the GESI Solution

Improve performance, availability, and cost-effectiveness of compute- and data-intensive applications

Run growing volume of complex, resource-intensive, high-performance computing jobs within existing distributed infrastructure

Provision additional capacity dynamically as it becomes available, and failover gracefully around unavailable capacity, without interrupting jobs in progress

Reduces total cost of ownership of ongoing information technology (IT) operations by making more efficient use of available computing , storage, and network capacity

Postpone the need for deployment of additional capacity to support growing transaction loads

Provision, scale, and reconfigure virtualized computing resources within a service-oriented environment

What are the benefits of a GESI solution?

Grids enable more flexible, dynamic resource sharing among diverse physical or

logical computing environments.

- Burton Group Grid Services, “Pooling Distributed Resources

for Virtual Supercomputing”

“”

Page 16: Grid Enabled  Services Infrastructure (GESI)

GESI Physical LayerChristopher Dale [email protected]

Isaac Christoffersen [email protected]

Doug Johnson [email protected]

David Schillero [email protected]