Hydrologic Information System

GIS – the water environment

Water Resources – the water itself

CUAHSI HIS: NSF-supported collaborative project: UT Austin + SDSC + Utah State + Drexel + South Carolina (www.cuahsi.org/his/). PI: David R. Maidment (UT-Austin) Goals:. provide rapid uniform access to heterogeneous hydrologic data, and facilities for data publishing;. develop a framework for synthesizing data and models in a region (support for observatories); . strengthen place-based hydrologic science. quantify and visualize the movement of water and chemicals continuously in space and time. hydrologic education CyberInfrastructure project

Point Observations Information Model

Data Source

Network

Sites

Variables

Values

{Value, Time, Qualifier, Offset}

USGS

Streamflow gages

Neuse River near Clayton, NC

Discharge, stage (Daily or instantaneous)

206 cfs, 13 August 2006

• A data source operates an observation network• A network is a set of observation sites• A site is a point location where one or more variables are measured• A variable is a property describing the flow or quality of water• A value is an observation of a variable at a particular time• A qualifier is a symbol that provides additional information about the value• An offset allows specification of measurements at various depths in water

http://www.cuahsi.org/his/webservices.html

GetSites

GetSiteInfo

GetVariables

GetVariableInfo

GetValues

Locations

Variable Codes

Date Ranges

WaterML and WaterOneFlow

GetSiteInfoGetVariableInfoGetValues

WaterOneFlowWeb Service

Client

STORET

NAMNWIS

DataRepositories

Data

DataData

EXTRACTTRANSFORMLOAD

WaterML

WaterML is an XML language for communicating water dataWaterOneFlow is a set of web services based on WaterML

WaterOneFlow• Set of query functions • Returns data in WaterML

NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, ODM (multiple sites)

Observation Stations

Ameriflux Towers (NASA & DOE) NOAA Automated Surface Observing System

USGS National Water Information System NOAA Climate Reference Network

Map for the US

http://river.sdsc.edu/DASH

Multiscale Information System

• Global data• National data• State data

• Project in region ….

• Principal investigator data

HISServers

WATERS Network Information System

NSF has funded work at 11 testbed sites, each with its own science agenda. A CUAHSI

Hydrologic Information Server is installed at each site.

Utah State University

Texas A&M Corpus Christi

National HIS Server atSan Diego SuperComputer Center

Corpus Christi Bay WATERS Testbed site

Montagna stations

SERF stations

TCOON stations

USGS gages

TCEQ stations

Hypoxic Regions

NCDC station

National Datasets (National HIS) Regional Datasets (Testbed HIS)

USGS NCDC TCOON Dr. Paul Montagna TCEQ SERF

Hydrologic Information Server

• Supports data discovery, delivery and publication– Data discovery – how do I

find the data I want?• Map interface and

observations catalogs• Metadata based Search

– Data delivery – how do I acquire the data I want?

• Use web services or retrieve from local database

– Data Publication – how do I publish my observation data?

• Use Observations Data Model

Hydrologic Information Server

Microsoft SQLServer Relational Database

Observations Data & Catalogs Geospatial Data

GetSites

GetSiteInfo

GetVariables

GetVariableInfo

GetValues

DASH – data access system for hydrologyWaterOneFlow services

ArcGIS Server

SQL Server

ODMs and catalogs. All instancesexposed as ODM (i.e. have standard ODM tables or views: Sites, Variables, SeriesCatalog, etc.)

NWIS-IID

NWIS-DV

ASOS

STORET

TCEQ

BearRiver

. . .

Spatial store

Geodatabase or collection of shapefilesor both

NWIS-IID points

NWIS-DV points

ASOS points

STORET points

TCEQ points

BearRiver points

. . .

My new ODM

My new points

More databases

More synced layers

DASH Web Application

Background layers

(can be in the same or separate spatial store)

WOF services

Web services from a common template

NWIS-IID WS

NWIS-DV WS

ASOS WS

STORET WS

TCEQ WS

BearRiver WS

. . .My new WS

More WS fromODM-WS template

USGS

NCDC

EPA

TCEQ

Web Configuration fileStores information about registered networks

MXDStores information about layers

WSDLs

, web

serv

ice U

RLs Connection

strings

Layer info,

symbology, etc.

ODMDataLoader

2

6

5

3

1

4

WORKGROUPHISSERVERORGANIZATION

STEPS FORREGISTERINGOBSERVATIO

NDATA

Data Heterogeneity

• Syntactic mediation– Heterogeneity of format– Use WaterML to get data

into the same format

• Semantic mediation– Heterogeneity of meaning– Each water data source

uses its own vocabulary– Match these up with a

common controlled vocabulary

– Make standard scientific data queries and have these automatically translated into specific queries on each data source

• Search multiple heterogeneous data sources simultaneously regardless of semantic or structural differences between them

Objective

NWIS

NARR

NAWQANAM-12

request

request

request

request

request

requestrequest

request

request

return

return

return

return

return

returnreturn

return

return

What we are doing now …..

Michael PiaseckiDrexel University

Semantic MediatorWhat we would like to do …..

NWIS

NAWQA

NARR

generic

request

GetValues

GetValues

GetValues

GetValues

GetValues

GetValuesGetValues

GetValues

GetValues HODM

Michael PiaseckiDrexel University

HydroSeek: http://www.hydroseek.org

HydroseekDemo

What’s coming• Integrated real time data management

– SDL (Utah State)– DataTurbine (SDSC)

• Creating a community vocabulary for parameters, and tagging your variables

• More agency data sources• Analysis of catalogs: towards spatial history of

hydrologic observations• Standards compliance• A flexible modeling framework• Integration with gridded data, and with other CI

projects: LTER, GEON, NEON, etc.• Towards digital watershed management

TaggerDemo

• Scalable, secure, programmable, versatile for different data types and vendor interfaces,developer community, with many applications written (e.g. data viewers and plug-ins), open source, high performancestreaming (10mb/s, 1000 frames/s)

• Typical scenarios:

DBMS

Monitoring and

management apps

CS loggers

NI loggers

Other proprietary or in-house

CS loggersLoggernet

RBNB DataTurbine (Ring Buffered Network Bus)

UCSD-DASHDemo

Work with us• Building a larger network of hydrologic data

servers– Install a HIS server at your site– Contribute data and services– Join development team– Create hydrologic mashups– Provide feedback

• Web sites:– www.cuahsi.org/his/ project info, downloadable

software, manuals, workbook– river.sdsc.edu/wiki/ developer notes, issues/bugs

tracking, CVS instructions, etc.