the cuahsi hydrologic information system
DESCRIPTION
The CUAHSI Hydrologic Information System. http://his.cuahsi.org/. CUAHSI HIS Sharing hydrologic data. Support EAR 0622374. Consortium of Universities for the Advancement of Hydrologic Science, Inc. 110 US University members 6 affiliate members 12 International affiliate members - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/1.jpg)
The CUAHSI Hydrologic Information System
SupportEAR 0622374
CUAHSI
HISSharing hydrologic data
http://his.cuahsi.org/
![Page 2: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/2.jpg)
Consortium of Universities for the Advancement of Hydrologic Science, Inc.
An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S.
http://www.cuahsi.org/
• 110 US University members
• 6 affiliate members• 12 International
affiliate members (as of March 2009)
![Page 3: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/3.jpg)
HIS Team and Collaborators• University of Texas at Austin – David Maidment (PI), Tim Whiteaker,
Ernest To, Bryan Enslein, Kate Marney• San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine,
Tom Whitenack• Utah State University – David Tarboton, Jeff Horsburgh, Kim
Schreuders, Justin Berger• Drexel University – Michael Piasecki• University of South Carolina – Jon Goodall, Tony Castronova• Idaho State University – Dan Ames, Ted Dunsford, Teva Veluppillai• CUAHSI Program Office – Rick Hooper, David Kirschtel, Conrad
Matiuk, Yoori Choi• WATERS Network – Testbed Data Managers• HIS Standing Committee • USGS – Bob Hirsch, David Briar, Scott McFarlane• NCDC – Rich Baldwin
![Page 4: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/4.jpg)
What is HIS• The CUAHSI Hydrologic Information System
(HIS) provides web services, tools, standards and procedures that enhance access to more and better data for hydrologic analysis.
http://his.cuahsi.org
PrecipitationWater quantity MeteorologyWater quality
![Page 5: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/5.jpg)
Data Searching – What we used to have to do
NWIS
NARR
NAWQANAM-12
request
request
request
request
request
requestrequest
request
request
return
return
return
return
return
returnreturn
return
return
Searching each data source separately
Michael PiaseckiDrexel University
![Page 6: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/6.jpg)
What HIS enablesSearching all data sources
collectively
NWIS
NAWQA
NARR
generic
request
GetValues
GetValues
GetValues
GetValues
GetValues
GetValuesGetValues
GetValues
GetValues ODM
Michael PiaseckiDrexel University
![Page 7: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/7.jpg)
Base StationComputer(s)
Telemetry Network
Sensors
Query, Visualize, and Edit data using ODM Tools
Excel, text
ODMDatabase
ODM Data
Loader
Streaming Data
Loader GetSitesGetSiteInfoGetVariableInfoGetValues
WaterOneFlowWeb Service
WaterML
DiscoveryHydroseek
AccessAnalysis
GISMatlabSplus
RIDL
JavaC++VB
HIS Desktop
HydroExcel
Water Metadata Catalog
Harvester
Service Registry Hydrotagger
HIS Central
CUAHSI Water Data Services System
USGS NWIS
EPA STORET
NCDC Others
![Page 8: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/8.jpg)
Hydroseekhttp://www.hydroseek.org
Supports search by location and type of data across multiple observation networks including NWIS and Storet
Bora Beran, Drexel
![Page 9: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/9.jpg)
Desktop Hydrologic Information System Harvesting and analyzing data from web services
Observations
Models
Climate
GIS
Remote Sensing
Goal for 2009
![Page 10: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/10.jpg)
Direct analysis from your favorite analysis environment. e.g. Excel
![Page 11: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/11.jpg)
Direct analysis from your favorite analysis environment. e.g. Matlab
% create NWIS Class and an instance of the classcreateClassFromWsdl('http://river.sdsc.edu/wateroneflow/NWIS/DailyValues.asmx?WSDL');WS = NWISDailyValues;% GetValues to get the datasiteid='NWIS:02087500';bdate='2002-09-30T00:00:00';edate='2006-10-16T00:00:00';variable='NWIS:00060';valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');
1920 1930 1940 1950 1960 1970 1980 1990 2000 20100
0.5
1
1.5
2
2.5x 10
4
cfs
Daily Discharge NEUSE RIVER NEAR CLAYTON, NC
![Page 12: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/12.jpg)
• Set of query functions • Returns data in WaterML
Slide from David Valentine
WaterML and WaterOneFlowWaterML is an XML language for communicating water dataWaterOneFlow is a set of web services based on WaterML
![Page 13: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/13.jpg)
What are the basic attributes to be associated with each single data value and how can these best be organized?
Streamflow
Flux towerdata
Precipitation& Climate
Groundwaterlevels
Water Quality
Soil moisture
data
Observations Data Model (ODM)• A relational database at the single observation level (atomic model)• Stores observation data made at points• Metadata for unambiguous interpretation• Traceable heritage from raw measurements to usable information• Standard format for data sharing• Cross dimension retrieval and analysis
Space, S
Time, T
Variables, V
s
t
Vi
vi (s,t)“Where”
“What”
“When”
A data value
![Page 14: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/14.jpg)
Horsburgh, J. S., D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), A Relational Model for Environmental and Water Resources Data, Water Resour. Res., 44: W05406, doi:10.1029/2007WR006392.
CUAHSI Observations Data Model http://his.cuahsi.org/odmdatabases.html
![Page 15: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/15.jpg)
Site Attributes
SiteCode, e.g. NWIS:10109000SiteName, e.g. Logan River Near Logan, UTLatitude, Longitude Geographic coordinates of siteLatLongDatum Spatial reference system of latitude and longitudeElevation_m Elevation of the siteVerticalDatum Datum of the site elevationLocal X, Local Y Local coordinates of siteLocalProjection Spatial reference system of local coordinatesPosAccuracy_m Positional AccuracyState, e.g. UtahCounty, e.g. Cache
![Page 16: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/16.jpg)
Feature
Waterbody
HydroIDHydroCodeFTypeNameAreaSqKmJunctionID
HydroPoint
HydroIDHydroCodeFTypeNameJunctionID
Watershed
HydroIDHydroCodeDrainIDAreaSqKmJunctionIDNextDownID
ComplexEdgeFeature
EdgeType
Flowline
Shoreline
HydroEdge
HydroIDHydroCodeReachCodeNameLengthKmLengthDownFlowDirFTypeEdgeTypeEnabled
SimpleJunctionFeature
1HydroJunction
HydroIDHydroCodeNextDownIDLengthDownDrainAreaFTypeEnabledAncillaryRole
*
1
*
HydroNetwork
*
HydroJunction
HydroIDHydroCodeNextDownIDLengthDownDrainAreaFTypeEnabledAncillaryRole
HydroJunction
HydroIDHydroCodeNextDownIDLengthDownDrainAreaFTypeEnabledAncillaryRole
1
1
CouplingTable
SiteIDHydroID
Sites
SiteIDSiteCode
SiteNameLatitudeLongitude…
Observations Data Model
1
1
OR
Independent of, but can be coupled to Geographic Representation
ODM Arc Hydro or NHD+
![Page 17: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/17.jpg)
Stage and Streamflow Example
![Page 18: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/18.jpg)
Loading data into ODM
• Interactive ODM Data Loader– Loads data from spreadsheets and
comma separated tables in simple format
• Streaming Data Loader (SDL)– Loads data from datalogger files on
a prescribed schedule– Interactive configuration
• SQL Server Integration Services (SSIS)– Microsoft application accompanying
SQL Server useful for programming complex loading or data management functions
ODM Data Loader
SDL
SSIS
![Page 19: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/19.jpg)
Dynamic controlled vocabulary moderation system
Local ODMDatabase
Master ODM Controlled Vocabulary
ODM Website
ODM ControlledVocabulary Moderator
ODM Data Manager
ODMControlled Vocabulary
Web Services
ODM Tools
Local Server
XMLXML
http://his.cuahsi.org/mastercvreg.html From Jeff Horsburgh
![Page 20: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/20.jpg)
• Publishers– Register a data service
• Users– Find a data service
• Supported by– Metadata Catalog
HIS Central
http://hiscentral.cuahsi.org
![Page 21: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/21.jpg)
HydroTaggerOntology: A hierarchy of concepts
Each Variable in your data is connected to a corresponding Concept
![Page 22: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/22.jpg)
National Web Services implemented to date
• NWIS daily value data (e.g., daily average streamflow) • NWIS groundwater data • NWIS real time data • NWIS instantaneous irregular data (field measurements,
water quality) • ORNL Daymet Meteorological model • NCEP North American Mesoscale (NAM) Weather
Research and Forecasting (WRF) model • EPA STORET water quality data• NASA MODIS Atmospheric data derived from remote
sensing
![Page 23: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/23.jpg)
• 11 WATERS Network test bed projects• 16 ODM instances (some test beds have more than one ODM
instance)• Data from 1246 sites, of these, 167 sites are operated by WATERS
investigators
National Hydrologic Information ServerSan Diego Supercomputer Center
HIS Implementation in WATERS Network Information System
![Page 24: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/24.jpg)
Prototype Texas HIS• TWDB is supporting a small project at
University of Texas to start building a prototype Texas Hydrologic Information System
Texas Hydrologic Information Server (at TNRIS)Texas Observations Catalogs and some state water datasets
HIS servers atdata sources
(State agencies,River authorities,
Water Districts, Cities,Counties….)
Web Services
![Page 25: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/25.jpg)
Intermountain Constellation of Experimental WATERsheds (ICEWATER)
The Inland Northwest Research Alliance (INRA) Water Research Consortium is establishing a HIS Network to share experimental
watershed data to address regional water resources
challenges
![Page 26: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/26.jpg)
How CUAHSI works with agencies1. Establish an agreement with the agency2. Identify the scope of the service3. Translate the semantics of the service to WaterML4. Include agency personnel in OGC/WMO Hydrology Domain
Working Group5. Develop a first draft of the web service6. Perform unit testing, over a series of validation cases7. Harvest an observations metadata catalog for agency data8. Develop a procedure for catalog updates9. Document and register the water data service at HISCentral10. Review and test the service together with the agency, for
possible approval as “operational”
![Page 27: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/27.jpg)
Demonstrations
• Hydroseek: http://www.hydroseek.net• Little Bear River: http://littlebearriver.usu.edu/
• HydroExcel
![Page 28: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/28.jpg)
Ideas for SWSI application
• HIS Server display of SWSI– ODM of SWSI
• Input data used to calculate SWSI• Calculated SWSI values
– WaterML based Web Services – Web Map/Feature/Raster geospatial data services– Map based display of SWSI
![Page 29: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/29.jpg)
Ideas for SWSI application
• SWSI viewer as HIS Desktop/Mapwindow plugin– Access SWSI calculation inputs– Access published SWSI values– Access published SWSI maps– Compute and display custom SWSI products
![Page 30: The CUAHSI Hydrologic Information System](https://reader036.vdocuments.mx/reader036/viewer/2022062322/568145ad550346895db2a6ac/html5/thumbnails/30.jpg)
Conclusions• Data Storage in an Observations Data Model
(ODM)• Data Access through internet-based Water Data
Services using a consistent data language, called WaterML
• Data Indexing through a National Water Metadata Catalog
• Data Discovery through federated map and thematic keyword search system
The combination of these capabilities creates a common window on water observations data for the United States unlike any that has existed before.