1 web services usgs/epa collaboration november 27, 2007 dwane young, u.s. epa nate booth, usgs
Post on 19-Dec-2015
215 views
TRANSCRIPT
11
Web ServicesWeb ServicesUSGS/EPA USGS/EPA
CollaborationCollaboration
November 27, 2007November 27, 2007
Dwane Young, U.S. EPADwane Young, U.S. EPANate Booth, USGSNate Booth, USGS
22
USGS NWIS* & STORET Over TimeUSGS NWIS* & STORET Over Time
1999: Modern STORET
2003:USGS / EPAAgreement 2007:
Water-QualityData Exchange
1960s: NWPCA(WATSTORE)
NWIS*
LegacySTORET
Data copied from NWIS to STORET
1972EPA created
* USGS National Water Information System
33
Why Now?Why Now?
Business: Business: Water-quality data standards (NWQMC)Water-quality data standards (NWQMC) Move towards monitoring network partnershipsMove towards monitoring network partnerships
Technical: Technical: Industry move towards data and process Industry move towards data and process
sharingsharing Technology standardsTechnology standards
44
OverviewOverview
EPA and USGS are working together to EPA and USGS are working together to develop a commons suite of web servicesdevelop a commons suite of web services
These services will allow for sharing of These services will allow for sharing of water monitoring data via a common water monitoring data via a common format and common terminologyformat and common terminology
The initial project is underway, and the The initial project is underway, and the new web services are now available, some new web services are now available, some work remains to accommodate WQX 2.0 work remains to accommodate WQX 2.0 and to ensure final compatibilityand to ensure final compatibility
55
What is a Web Service?What is a Web Service?
USGS
EPA
Internet (XML)
•Computer-to-computer
•Uses Input parameters and outputs XML
•Can be used in multiple ways by many applications
66
A common web service A common web service exampleexample
Input Parameter: Zip Code
Weather Network
Returns XML
Weatherbug translates XML into information for the task bar
Weatherbug is an example that many are familiar with
This is all done via a Web Service
77
An example using Monitoring DataAn example using Monitoring Data
88
NWIS Water-Quality Web ServicesNWIS Water-Quality Web Services
99
XML XMLXML XML
1010
XML XLSXML XLS
1111
XML Google Earth (KML)XML Google Earth (KML)
1212
What Web Services are planned?What Web Services are planned?
Four core services are being developed:Four core services are being developed: Stations service Stations service – – provides specific station provides specific station
informationinformation Results service Results service – – provides results for modeling, provides results for modeling,
analysis, and decision makinganalysis, and decision making Watershed/Station Catalog service Watershed/Station Catalog service – –
provides summary information on what data are provides summary information on what data are availableavailable
Project Catalog service Project Catalog service – – provides summary provides summary information by projects based on an input of min/max information by projects based on an input of min/max latitude/longitudelatitude/longitude
1313
So What?So What?
Web Services allow for more accessibility Web Services allow for more accessibility to the data. You are no longer limited to to the data. You are no longer limited to EPA or USGS interfaces for interacting EPA or USGS interfaces for interacting with the data.with the data.
Web Services makes a STORET/NWIS Web Services makes a STORET/NWIS collaboration possible.collaboration possible.
1414
So What? (cont’d)So What? (cont’d)
Web services can:Web services can: potentially serve as feeds for other state potentially serve as feeds for other state
reporting or analysis databasesreporting or analysis databases provide a commonly formatted dataset for provide a commonly formatted dataset for
data analysis and modelingdata analysis and modeling serve as the backbone for project data serve as the backbone for project data
applications (mashups)applications (mashups)
1515
A Theoretical ApplicationA Theoretical Application
A user zooms into an area of interest
The Stations Web Service returns the list of stations with lat/longs for that area of interest
The Application draws the stations on the map and then callsthe catalog web service to get summary information
The Application also calls the Projects catalog web service so that it can display project summary information
The user can then interact with the data, retrieving data by:StationDate RangeChemical Nameetc.
1616
STORET/NWIS CollaborationSTORET/NWIS Collaboration
A USGS/EPA workgroup has been formed A USGS/EPA workgroup has been formed to work through collaboration issues:to work through collaboration issues: Mapping the Parameter Codes to EPA’s Mapping the Parameter Codes to EPA’s
Substance Registry SystemSubstance Registry System Defining common site characteristics and Defining common site characteristics and
sample mediasample media Identifying a common schema (based on Identifying a common schema (based on
WQX)WQX) Developing common web services with Developing common web services with
common input parameterscommon input parameters
1717
ScheduleSchedule
EPA services are now available and EPA services are now available and USGS services are in testingUSGS services are in testing
Some final work needs to be done to Some final work needs to be done to ensure final compatibilityensure final compatibility
Expect full implementation by early next Expect full implementation by early next yearyear
1818
What’s Next?What’s Next?
A common portal for interacting with these A common portal for interacting with these services will need to be developedservices will need to be developed
Expanding the net:Expanding the net: These methodologies could grow beyond the These methodologies could grow beyond the
current collaboration, and potentially include:current collaboration, and potentially include:• Sharing data with other countries (Canada, Sharing data with other countries (Canada,
Mexico)Mexico)• NOAANOAA• Army Corps of EngineersArmy Corps of Engineers• National Science FoundationNational Science Foundation• Other EPA offices running monitoring operations Other EPA offices running monitoring operations
(Great Lakes, Chesapeake Bay)(Great Lakes, Chesapeake Bay)
1919
What’s Next? (cont’d)What’s Next? (cont’d)
Define a common spatial framework:Define a common spatial framework: Streams: NHDStreams: NHD Groundwater: AquiferGroundwater: Aquifer
Choose a common methods dictionary (NEMI)Choose a common methods dictionary (NEMI) Expand schema to better describe suspended Expand schema to better describe suspended
sediment and groundwater datasediment and groundwater data Deal with duplicated dataDeal with duplicated data USGS considering Exchange Network node USGS considering Exchange Network node
(2.0)(2.0) USGS “closing loop” with faster data refreshUSGS “closing loop” with faster data refresh Other USGS web services: Daily, Unit valuesOther USGS web services: Daily, Unit values
2020
Q&AQ&A