satya priya

8/9/2019 Satya Priya

1/27


2/27

Problem

Lack of uniform and friendly accessibility fromany location within secure networktopologies to utilize the high performance

computing resources efficiently


3/27

Solution

Construct complex scripts which chain

together multiple applications withslow I/O-bound file system interfaces


4/27

Web Services and IntegratedTechnologies for Large Scale Dataservices

Presented by:

Satya Priya Patnala


5/27

About the paper. . .

Integrating Web Service and Grid Enabling Technologies to ProvideDesktop Access to High-Performance Cluster-Based Components forLarge-Scale Data Services byVictor P. Holmes, Wilbur R.Johnson, David J. Miller atSandia National Laboratories


6/27

Goal Of The Authors

Web services technologyWeb services technology

Grid enabling softwareGrid enabling software

Component framework for parallel computingComponent framework for parallel computing

Service Oriented ArchitectureService Oriented Architecture


7/27

Birds eye view . . .

Web

Services

Grid Technology

Data Services


8/27

Web Services


9/27

Web Services

Definition:Aweb service is an application or application

component accessible on the web and intendedfor use by another application a client application


10/27

Web Services HTTP protocol acts as the base for the running

of web services

Use XML as a standard language They follow a set of standardized rules and

specifications, making it more portable

Unique from CORBA, RMI,COM

Eureka No learning Curve !!!!!


11/27

Web Services

Component Technology

Web services provide a set of XML-based protocols andprocesses for service discovery (UDDI), description(WSDL), and interaction (SOAP).

In general, we can say

SOAP + UDDI + WSDL = Web Services


12/27

Component Technology in Web

Services

SOAP (Simple Object Access Protocol) Sendsmessage across different modules

UDDI (Universal Description, Discovery andIntegration) is the global lookup for locating theservices

WSDL (Web Service Definition Language)method through which different services aredescribed


13/27

Grid Technologies According to Gartner AGrid is a collection

of resources owned by multiple organizations

which are coordinated to allow them to solvea common problem

To provide a rich set of Data Services,

common grid environments arebeginning to accommodate dataintensive, application-specific, needs


14/27

Grid Technologies Grid services provides access to

distributed resources, such as a high-

performance computing cluster forexecution of individual Data Services, in amanner that is independent of theapplications or computing systems being

utilized.


15/27

Grid Technologies Any application that wishes to use grid services does so by

submitting one or more workflow definitions to a workflowmanager service that knows how to:

Locate and construct a request specific to a resource.

Discover what services are available on a resource.

Construct a request for a service on a resource.

Reliably manage one or more requests once it has beensubmitted.

Transfer data between resources in a single request.


16/27

Data ServicesData Services = Web services + Grid Services

Transform large data sets to visualize criticaldata areas within large simulation outputs

Take very large data sets as input andreduce them to produce data sets that aresmaller


17/27

Data Services

Parallel processing services which sharedata objects in memory and minimizedisk I/O

Common thread among users = intranet


18/27

Data Services


19/27

Component Framework for High

Performance Cluster Based Data Services

Common ComponentArchitecture

Services on the cluster are implemented asCCA components

One component = Data Service algorithm


20/27

Ccaffeine Framework Common ComponentArchitectures existing

framework is Ccaffeine

Ccaffeine consists of - Command line controller

Muxer

Framework itself


21/27

Ccaffeine Framework Command line controller Accepts

commands on standard input and passes

them to the muxer Muxer- provide a mechanism for fanning out

the commands to each of the computenodes associated with a particular parallelrun of the framework

Framework on the whole


22/27

WSDL (Web Service Description Languages )

Uses XML document for describing webservices

Basic Elements Data description

Abstract interface definitions

Binding to actual implementations


23/27

Elements In Network Definition

Types a container for data type definitions usingsome type system (such as XSD).

Message an abstract, typed definition of the data

being communicated. Operation an abstract description of an action

supported by the service. Port Typean abstract set of operations supported

by one or more endpoints. Binding a concrete protocol and data format

specification for a particular port type. Port a single endpoint defined as a combination of

a binding and a network address. Service a collection of related endpoints


24/27

Data Service for large scale data

manipulation and visualization


25/27

End Results To provide end users the ability to

manage and understandsimulation results from very largecomplex problems

Integration of hardware andsoftware components to supportlarge scale simulations to analysis

and ensure safety and reliability ofthe nations nuclear weaponstockpile


26/27

Future Work To populate the suite of Data Services

demanded by the end users

To augment the architecture for multiplecluster deployment, fault tolerance andmulti-site access


27/27

Thank you

satya priya

Documents