Database Taskforce and the OGSA-DAI Project

Norman PatonUniversity of Manchester

Outline Database Taskforce (DBTF):

who, what and why. Databases and the Grid:

context and capabilities. OGSA Database Access and

Integration Project: what, where and when.

Relevant Web Pages http://www.cs.man.ac.uk/grid-db

Membership Malcolm Atkinson (NESC) Vijay Dialani (Southampton

University) Norman Paton (Manchester

University) Dave Pearson (Oracle UK) Tony Storey (IBM Hursley) Paul Watson (Newcastle University)

Aims/Actions: Requirements To identify the

requirements of database and information management applications within a Grid setting.

Requirements analysis underway, with visits to Grid projects.

Preliminary report by Dave Pearson tabled at GGF4 and on Web.

Series of meetings at NESC.

Aims/Actions: Roadmap To develop a

roadmap for research and development of database functionalities in a Grid setting.

Proposal involves a collection of Grid Database services.

Initial collection of Grid Database Services tabled at GGF4 and on Web.

Aims/Actions: Standards To propose

standards for Grid/Database links through the GGF.

Birds of a Feather Session run as part of GGF4.

Hope to establish a Working Group before GGF5, involving wider community.

Aims/Actions: Implementation To foster the

development of reference implementations of proposed Grid standards.

OGSA-DAI (Database Access and Integration Project just funded through Core Programme).

GGF WG to encourage wider involvement with reference implementations.

Aims/Actions: Architecture To advise the

Architecture Task Force on architectural requirements for database support.

Meet periodically with ATF.

In line with ATF in terms of services focus.

Aims/Actions: Education To encourage

greater awareness of needs and best practice in respect to databases and the Grid.

Requirements analysis building links with users.

Series of meetings at NESC on Database/Grid issues.

Input on use of developed software, plus good practice.

Outline Database Taskforce (DBTF):

who, what and why. Databases and the Grid:

context and capabilities. OGSA Database Access and

Integration Project: what, where and when.

Databases in the Grid

Computational Complexity

DataComplexity

Grid Middleware

Gri

d P

roto

co

ls a

nd

Gri

d S

ec

uri

ty I

nfr

as

tru

ctu

re

Combining Grid and Web ServicesC

lien

ts

ApplicationPortals

WebServices

Grid Services:Collective and Resource Access

Resources

Compute(many)

Storage(many)

Communi-cation

Instruments(various)

GRAM

GridFTPData Replica and Metadata Catalog

GridMonitoring

Architecture

GridInformation

Service

We

b B

row

ser

Grid Web ServiceDescription (WSDL)& Discovery (UDDI)

Grid X.509Certification

Authority

SRB/MetadataCatalogue

Condor-G

CORBA

MPI

Secure, Reliable

Group Comm.

Discipline /Application

SpecificPortals

(e.g. SDSCTeleScience)

ProblemSolving

Environments(AVS, SciRun,

Cactus)

EnvironmentManagement(LaunchPad,

HotPage)

Job Submission /Control

File Transfer

Data Management

CredentialManagement

Monitoring

Events

WorkflowManagement

other services:•visualization•interface builders•collaboration tools•numerical grid

generators•etc.

Apache Tomcat&WebSphere&Cold Fusion=JVM + servlet

instantiation + routing

CoG Kits implementingWeb Services in

servelets, servers, etc.Python, Java, etc.,

JSPs

compositionframeworks(e.g. XCAT)

XM

L /

SO

AP

ov

er

Gri

d S

ec

uri

ty In

fra

str

uc

ture

Gri

d P

roto

co

ls a

nd

G

rid

Sec

uri

ty I

nfr

astr

uct

ure

Apache SOAP,.NET, etc.

……

htt

p,

htt

ps

. e

tc.

X W

ind

ow

sP

DA

Grid ssh

Scope of Database Services Discovery. Statements. Delivery. Metadata. Transactions. Distributed queries.

Statement Service For queries involves:

The query notation. The query to be evaluated. The parameters for the query. The result delivery mechanism.

Invoking a query operation: Prepares and validates the query, reporting

back success or failure. Provides access to the results collection.

Query Operation Specified here even more abstractly than in

WSDL. Several operations: synchronous,

asynchronous, etc. Service descriptions start off data model and

language independent, then instantiated.

query( IN queryNotation, IN query, OPTIN values, OPTIN expires, INOUT resultHandle, OUT fail)

Outline Database Taskforce (DBTF):

who, what and why. Databases and the Grid:

context and capabilities. OGSA Database Access and

Integration Project: what, where and when.

OGSA-DAI Project OGSA - Data Access and Integration

Services project. IBM (Tony Storey, Brian Collins). Oracle (Dave Pearson). NESC/EPCC (Malcolm Atkinson, Rob Baxter). Manchester University (Norman Paton). Newcastle University (Paul Watson).

£1.5 Million (plus matching industrial contributions) over 18 months.

Project Plan Well defined deliverables for first 6 months:

Core Relational Services. Core XML Services.

Less well defined deliverables over following 12 months: Intercept emerging GT3 releases. Comprehensive delivery services. Metadata. Specialist data types. Distributed queries.

Short Term Deliverables GGF5:

DAI Framework Document. Instantiation for RDBs and XML repositories.

Provisional dates for core services (given resolution of licensing/collaboration agreements):

Early-adopters

Public

XML 1st May 19th July

RDB 1st July 1st Sept

Short Term Tensions Multiple database

paradigms/platforms. Multiple language interfaces. Users contexts:

Web services. Globus 2. Globus 3.

Relationship to GGF WG To be established, but:

Contribute insights into design of DAI services.

Contribute to documents that feed into the GGF standardisation activity.

Provision of reference implementations of standard proposals.

Contribute to the development of OGSA proposal as early adopters.

Relationship to other UK e-Science Projects To be established, but:

Seeks to address requirements found in (UK) e-Science projects.

Development activity designed to provide core functionality early.

Formal relationship with some as early adopters (myGrid, AstroGrid).

Could be possible to collaborate on certain development activities.

Summary: DBTF Interfaces

Working GroupRecommendations

Database ServiceDevelopmentRequirements

Community-building