1 cyberinfrastructure for the geosciences igeon 2007 at the university of hyderabad, india, august...

27
1 www.geongrid.org CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation Ashraf Memon San Diego Supercomputer Center University of California, San Diego

Upload: mark-freeman

Post on 17-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

1www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Web Services – The Motivation

Ashraf MemonSan Diego Supercomputer CenterUniversity of California, San Diego

Page 2: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

2www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

AcknowledgmentAcknowledgment

• National Science Foundation for funding this institute

• National Science Foundation for funding GEON project

Page 3: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

3www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

SummarySummary The GEON Portal – Quick run through What is below the skin Web Services The reason why Some simple services GEON Applications using web services Questions and Discussion

Page 4: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

4www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

What is GEON portal?What is GEON portal?

• A window to your view of the resources– Public data and tools– Your private data and tools

• Your own workspace to collaborate on science projects

• Personalization of resources• User-friendly access to distributed and

privileged resources

Page 5: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

5www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

The GEON Portal The GEON Portal (Standard Edition)(Standard Edition)

– Data Registration (GEON Registration)– Data Search (Geon Search)– Collaboration (GEON Workspace)– Integration (Integration CartTM)

Page 6: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

6www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Data Provider / Contributor

Data Registration System Data Repository

Data Store

1. Hosted

Catalog

Refe

ren

ce

Reference Contributor

Data Registration System

Remote DataRemote Data

Reference

2. Non Hosted Data

Catalog

Reference

GEON Data Registration System

Local DataLocal Data

GEON Data RegistrationGEON Data Registration

Page 7: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

7www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

GEON SearchGEON Search

ResearcherSearch System Data Repository

GEON Search

Keyword

SpatialTemporal

Concept

References

Remote Data

Remote Data

Local DataLocal Data

Page 8: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

8www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

GEON WorkspaceGEON Workspace

Workbench System

1. Workspace

Catalog

2. Collaboration

myGEON

Researcher

ReferencesQ

uery

Ren

der

Inte

gra

te

Workbench System

Catalog

Researcher / Collaborators

References

Qu

ery

Ren

der

Inte

gra

te

Sh

are

Page 9: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

9www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Page 10: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

10www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Science ApplicationsScience Applications

• SYNSEIS (SYNthetic SEISmogram) is a synthetic seismogram computational tool

• LiDAR (Light Distance And Ranging) data processing

• PIP (Paleo Integration Project)

• Gravity Data processing

Page 11: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

11www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

What is below the skin?

MiddlewareMiddleware

Data Node 2.0Data Node 2.0

MEDIATOR WEB SERVICE

MEDIATOR MIDDLEWARE

SPATIAL DATA WEB

SERVICE

RESOURCE MANAGEMENT MIDDLEWARE

Portal Node 2.0Portal Node 2.0

SEARCH WEB SERVICE

MyProject WEB SERVICE

USER ACCOUNTING MIDDLEWARE

PORTAL SERVICES

GIS Node 2.0GIS Node 2.0

MAPPING WEB SERVICS

OGC COMPLIANT MIDDLEWARE

OTHER SERVICES ARVICE

ESRI SPATIAL MIDDLEWARE

SYNSEIS Node

2.0

SYNSEIS Node

2.0

SAC WEB SERVICE

SYNSEIS WEB

SERVICES

LIDAR Node

2.0

LIDAR Node

2.0

KEPLER SERVICE

GRIDDINGWEB

SERVICES

Page 12: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

12www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

12

What are Web servicesWhat are Web services

Piece of Code

Database

Files

Tool

MS COM

C

Java

Perl

Fortran

Other tools

• Web service is any piece of code that can be made available over the Internet, so that other applications can invoke it and utilize its functionality.

Page 13: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

13www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

13

Benefits of Web ServicesBenefits of Web Services

• Facilitates reuse of existing assets• Lower cost of maintenance• Reduced impact of change• Example

– GEONgrid• AsciiToMap, XMLToMap, ShapeToMap• Benefits include availability of useful functionality on the

web– Arcweb Services

• Pool of web services that provide mechanism to access data and GIS functions on demand.

• Benefits include, access to terabytes of spatial data, complex GIS functionality, etc.

Page 14: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

14www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Simple Web Services

• ASCIIToMap– Have tab delimited file, don’t have

expertise/technology to create maps.

• ShapetoMap– Have the dataset in shape file format, don’t

have expertise/technology to create maps.• ESRI Grid Ascii to Map (GeoTiff)

– Have a GRID ASCII file, want to create map.

Page 15: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

15www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

ASCIIToMap

• Tab delimited file with spatial information– Example from the SCEC website (lat, lon,

magnitude)– Only point dataset supported at this points

• Upload the ASCII file and create map• View and analyze the results• ASCII2Map Web Service

– takes an ASCII file as Input– creates GIS map as output– creates shape file as output

Page 16: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

16www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Sample ASCII File

• Column 1: Longitude• Column 2: Latitude• Columns 3 : Elevation• Column 4: Name of the

place 

• Column 1: Longitude• Column 2: Latitude• Columns 3 : Elevation• Column 4: Name of the

place 

Lon Lat Elev Place78.3344 17.4615 1961 MainGate78.3319 17.4597 1963 ShopCompTPoint78.3286 17.4574 1939 HostelATurn78.3271 17.4562 1930 SNSchoolTPoint78.3265 17.4551 1928

GuestHouseGarden78.3232 17.4550 1902 HostelG78.3116 17.4509 1918 GopanpalliGate78.3301 17.4547 1940 DSTCCXing78.3294 17.4528 1929 IGMLibrary78.3300 17.4530 1931 SMS78.3315 17.4544 1947 LibraryLHCXing78.3320 17.4550 1955 DCIS78.3335 17.4551 1959 BdayCircle78.3353 17.4521 1968 LHCompound

ASCII Files Map

Page 17: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

17www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

ShapeToMap

• Zip the file associated with a zip file• Upload the shape file and create map• View and analyze the results• Live examples in GEON portal search and

myGEON

.shp.dbf.shx

Shape FileMap

Page 18: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

18www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

GridAsciiToMap

• ESRI Grid Ascii format• Upload the Grid Ascii file and create map• View and analyze the results• Live example in GEON Lidar workflow

Grid ASCII Files

Map

Page 19: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

19www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

GEON Applications using Web Services

• GEON Synseis• GEON Lidar• GEON PIP

Page 20: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

20www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

SYNSEIS

Page 21: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

21www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

www.geongrid.org

GASSGRAM

GridFTPGSI

SYNSEIS Architecture

SYNSEIS(FLASH GUI)

SYNSEIS(FLASH GUI)

IRISDMC

TeraGridNCSA

SynSeisEngine

TeraGridSDSC

LLNLMCR

GEON Portal

Cornell Map Server

CrustalModels

CrustalModels

CrustalModels

Corba

Web service

Web service

SOAP

Web s

erv

ice

SO

AP

Web serviceSOAP

Page 22: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

22www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Same Principle as RADARThe lidar instrument transmits light out to a target. The transmitted light interacts with and is changed by the target. Some of this light is reflected / scattered back to the instrument where it is analyzed. The change in the properties of the light enables some property of the target to be determined.

Same Principle as RADARThe lidar instrument transmits light out to a target. The transmitted light interacts with and is changed by the target. Some of this light is reflected / scattered back to the instrument where it is analyzed. The change in the properties of the light enables some property of the target to be determined.

Full Feature Digital Elevation Model

Bare EarthDigital Elevation Model

Researchers: Ramon Arrowsmith, Chris Crosby, Arizona State

LiDAR Applications

▪ Natural Resource & Forest Management

▪ Telecommunications

▪ Planning & Analysis

▪ Hydrology & Floodplain Mapping

▪ Urban Development

▪ Transportation Engineering

LiDAR Applications

▪ Natural Resource & Forest Management

▪ Telecommunications

▪ Planning & Analysis

▪ Hydrology & Floodplain Mapping

▪ Urban Development

▪ Transportation Engineering

Northern San Andreas Fault

LIDAR - LIGHT DISTANCE AND RANGING

Page 23: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

23www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

IBM DB2

GEON Portal

NFS Mounted Disk

Data ProcessingAlgorithms

Compute Cluster

x,y,z and attribute

raw data

process output

maps/data

Client

WWW

GEONSearchPortlet

LiDARProcessPortlet

OtherPortlet

LiDARProcessing

Service

LiDARProcessing

Service

SpatialQuery

Service

SpatialQuery

Service

GEONSearchService

GEONSearchService

Software Tools

DB2Spatial

FunctionGRASS ARCINFO GMT

GEON Catalog

Lidar DATA PROCESSING

Page 24: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

24www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Paleo Integration Project

Page 25: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

25www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Rapid and seamless data retrieval, enabling users to focus on geoscience questions:

- Paleoclimate interpretations

- Biotic responses to global change

PALEOINTEGRATION PROJECT

Page 26: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

26www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

26

Benefits of Web Services -- AgainBenefits of Web Services -- Again

• Facilitates reuse of existing assets• Lower cost of maintenance• Reduced impact of change

Page 27: 1  CYBERINFRASTRUCTURE FOR THE GEOSCIENCES IGEON 2007 at the University of Hyderabad, India, August 02-08 2007 Web Services – The Motivation

27www.geongrid.orgCYBERINFRASTRUCTURE FOR THE GEOSCIENCES

IGEON 2007 at the University of Hyderabad, India, August 02-08 2007

Questions?Questions?

More [email protected]