GEM Portal and SERVOGrid for Earthquake Science

PTLIU Laboratory for Community GridsGeoffrey Fox, Marlon Pierce

Computer Science, Informatics, Physics

Indiana University, Bloomington IN 47404

http://grids.ucs.indiana.edu/ptliupages

Solid Earth Research Virtual Observatory Grid• A number of simulation methods for studying earthquakes are being

developed by GEM consortium including:– Simplex, Disloc (JPL)– Virtual California (UC-Davis)– PARK codes (Brown)

• As codes become more robust and accepted, problems emerge:– Need to manage information about distributed data sources:

multiple databases, sensors, simulated data.– Need to organize, manage information about multiple code

installation sites.– Need to simplify access to data, use of codes, and use of

visualization/analysis tools for broad range of users– Need to link together

• NASA funded activity to develop SERVOGrid Interoperability framework

SERVOGrid Architecture

Database Database

Closely Coupled Compute Nodes

Analysis and Visualization

RepositoriesFederated Databases

Sensor NetsStreaming Data

Loosely Coupled Filters

Grid Web Service and Portlet based Portal Architectures

• Web services are part of a broad industry and academic initiative to build distributed computing infrastructure around existing standards (HTTP, XML, etc).

• Web services can be used to provide lightweight service descriptions and send messages between components in XML.

• OGSA (Open Grid Service Architecture) builds on basic Web Services– Component model for Grid replacing/building on CORBA,

COM, Enterprise Javabeans etc.

• Portlets provide component model for user interfaces

Computing Portal Grid Web Services• We have built a suite of general purpose Grid Web services

for managing distributed applications.• Core Computing services define general purpose functions:

– Ex: job submission, file transfer, job monitoring, management of jobs and results

– Described as a GridShell as plays same role to Grid that Shell does for UNIX on a single machine

• Application Grid Web services include metadata about applications.– Built on top of core services.– Original application NOT changed

• We have developed a toolkit that allows one to convert general software packages into Grid Web Services and manage application collections

Raw (HPC) Resources

Middleware

Database

PortalServices

SystemServices

SystemServices

SystemServices

Application Service

SystemServices

SystemServices

GridComputing

Environments

UserServices

“Core”Grid

Application Metadata

Actual Application

Application Grid Web Services

• AGWS are designed to make scientific applications (i.e. earthquake modeling codes) into Grid Resources

• AGWS services are described by two XML Schemas:– Abstract descriptors describe application options.

Used by the application developer to deploy his/her service into the portal.

– Instance descriptors describe particular user choices and archive them for later browsing and resubmission.

ClientBrowser

User InterfaceServer

Service Provider

InformationRepository

Service Provider

ServiceProvider

ServiceProvider

(SOAP/HTTP)

(HTTP)

Publish ServicesBind and Use Service

Find Service

Client Requests

(1)

(2)

(0)(3)

Portals Aggregate Access to Distributed Services

JSP + Client Stubs

DB Service 1

JDBC

DB

Job Sub/Mon And FileServices

Operating andQueuing Systems

Browser Interface

DB Service 2

JDBC

DB

Host 1 Host 2 Host 3

GEM Portlets and Portal Stacks

• User interfaces to GEM services (Code Submission, Job Monitoring, File Management for Host X) are all managed as portlets.

• Users, administrators can customize their portal interfaces to just precisely the services they want.

Core Grid Services

User facing Web Service Ports

Application Grid Web Services

Aggregation Portals

Messa

ge S

ecu

rity, In

form

atio

n

Serv

ices

File Selector Screenshot• Users can view files on remote hosts

– Shown is user file list for host noahsark. – Host solar is also shown.

• Files can be uploaded or downloaded between PC and remote host.

• Files may be crossloaded between two remote hosts.• Same interface definition may be used to access

databases.

Lists user files on selected host, noahsark.File operations include

Upload, download, Copy, rename, crossload

Tabs indicate availableportlet interfaces.

File management

Application Selection Screen Shots

• Users can select from available codes (Simplex, Disloc, various VirtualCalifornia)

• Users also select from available hosts for particular code (grids, noahsark, solar shown).

• Selecting solar (Sun 64 Node E10000) prompts user for information needed to use PBS script generating service.

Select desired application and

host

Generatescript for jobsubmission

User Application Selection and Submission

Application Administrator Interfaces

• Application Administrators deploy and manage applications

• Update screen shows various application and host parameters that are set by the user.

• These are used to generate user interfaces for the selected codes.

Provide information about application

andhost parameters

Select applicationto edit

Administer Grid Portal

Futures I: General Capabilities• System builds on Gateway Portal developed for NCSA Alliance

and DoD HPCMO. This project intends to:• Integrate portlets from other groups in collaborations (common

interoperability framework for all tiers)• Continue developing message-based security system (currently

available as demonstration) that signs SOAP messages.• Integrate AGWS and Results Manager with arbitrary Schema

Wizard/Storage/Browser system used in Indiana XML newsgroups.• Add negotiation capabilities to Web Services for version control • Track evolving OGSA service standards and implementations.• Add dynamic information service and monitoring capabilities for

transient Web Services. • Distributed, ant-based tools to simplify service upgrades of

distributed servers (and simplify our lives).

Futures II: SERVOGrid• Assist with design of common data format and

associated tools for GEM codes.– i.e. SERVOGrid Object Model defined in XML

• Add support for service linkage (workflow) for specific GEM applications– e.g. Disloc<->Simplex interoperation).

• Add support for Web-based visualization with portlet interface.

• SERVOGrid portal will be publicly available