ocean sciences cuahsi-hydrologic information systems cuahsi – consortium of universities for the...
Post on 18-Jan-2018
220 Views
Preview:
DESCRIPTION
TRANSCRIPT
Ocean Sciences
CUAHSI-Hydrologic Information Systems
• CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc
• Formed in 2001 as a legal entity
• 100 member universities (May 2005)
• Program office in Washington (5 staff)
• Rick Hooper is Executive Director
Earth Sciences
AtmosphericSciences
NSF Geosciences Directorate
UCAR
CUAHSI
Unidata
HIS
DataHypotheses
Needs
Tools
Data
Models
Exogenous DataTechnologicalAdvances
CommunitySupport
Multi-DisciplinaryTeams
HydrologicSynthesis
HydrologicObservatories
MeasurementTechnology
HydrologicInformation
Systems
CommunitySupport
AdditionalHypotheses
CUAHSI Hydrologic Information Systems
Project co-PI
Collaborator
CUAHSI Hydrologic Information System
Environmental Cyberinfrastructure
• Part of NSF Cyberinfrastructure program
• CUAHSI Hydrologic Information Systems is one of several pilot projects – CUAHSI, CLEANER, ORION, NEON, GEON, …..
Cyberinfrastructure Components
Workflow Sequencing using ModelBuilder
HIS Goals
• Data Services for Hydrologists – get me the data I want quickly and painlessly
• Support for Observatories – data structure for Digital Watersheds
• Advancement of Hydrologic Science – flux coupler, HydroObjects
• Hydrologic Education – how to get data into the classroom
Digital Watershed
Hydrologic Observation
Data
GeospatialData
Remote SensingData
Weather and ClimateData
(NetCDF)
(GIS)(Relational database
or delimited ascii)
(EOS-HDF)
Digital Watershed
CUAHSI HIS Overview
• HIS User Assessment
• Hydrology Data Portal
• Digital Watershed• Hydrologic Analysis
HIS User Assessment
• First survey done for HIS White Paper (2003)
• HIS Symposium in March – 4 institutional surveys and a survey of participants
• CUAHSI Web Surveyor – developed by David Tarboton and Christina Bandaragoda (75 responses from 38 institutions)
• Summary paper circulated by email yesterday
Please rank these four HIS service categories for helping you.
Conclusion: Data services are the highest priority
Val
ue S
core
(cou
ntin
g 4
for f
irst,
4 fo
r se
cond
, 2 f
or th
ird a
nd 1
for f
ourth
).
% of time spent preparing data
Which operating systems do you use for your research? If you use more than one operating system, select all that apply.
Please indicate one dataset that you believe would most benefit from increased ease of access through a Hydrologic Information System (HIS).
0% 2% 4% 6% 8% 10% 12% 14% 16% 18%
SNOTEL
National Elevation Dataset and derivatives (EDNA)
National Hydrography Dataset
USGS National Geology data
NCDC Pan Evaporation
PRISM Precipitation data
Climate Model Reanalysis data (e.g. NARR)
NCDC Precipitation
Soils Data (STATSGO/SSURGO)
USGS Groundwater levels
National Land Cover dataset (NLCD)
National Water Quality Assessment (NAWQA)
not applicable to my research
NEXRAD Radar Precipitation
Remote Sensing data (e.g. LANDSAT, GOES, AVHRR)
USGS Streamflow
EPA STORET Water Quality
Conclusion: EPA STORET Water Quality, Streamflow and Remote Sensing Data are perceived to be able to benefit from improved access.
I am surprised USGS streamflow is up there. Is this an indication of importance over difficulty?
How we use software (Austin Symposium)
4.0
3.9
3.3
3.2
2.7
2.6
2.5
2.4
2.4
2.3
Excel
ArcGIS/ArcView
FORTRAN
C/C++
J ava
MS Access
Visual Basic
Matlab
SQL/Server
Modflow
1 =Never use 2=do not rely on 5= find indispensable4=Use often3=Use occasionally
Which of the following data analysis difficulties are most important for HIS to address?
Conclusion: High priorities are:- Data formats- Metadata- Irregular time steps
Val
ue S
core
(cou
ntin
g 3
for f
irst,
2 fo
r sec
ond
and
1 fo
r thi
rd).
How we use software (Web Surveyor)
• Programming (85% of respondents): Fortran, C/C++, Visual Basic
• Data Management (93%): Excel, MS Access• GIS (93%): ArcGIS• Mathematics/Statistics (98%): Excel, Matlab,
SAS, variety of other systems• Hydrologic models (80%): Modflow, HEC models• A general, simple, standard, and open interface
that could connect with many systems is the only way to accommodate all these
CUAHSI HIS Overview
• HIS User Assessment
• Hydrology Data Portal
• Digital Watershed• Hydrologic Analysis
Hydrologic Observations Database
• A relational database stored in Access, PostgreSQL, SQL/Server, ….
• Stores observation data made at points
• Access data through web interfaces
• Fill using automated data harvesting
Streamflow
Flux towerdata
Precipitation& Climate
Groundwaterlevels
Water Quality
Soil moisture
data
Hydrologic Observations Data Model
Review conducted by David Tarboton with 22 responses – redesign of this model is now being done
Relationships
ProposedCUAHSI Observations Database Schema(for details see chap 6 at http://www.cuahsi.org/docs/HISStatusSept15.pdf)
Example: Lake Water ChemistryWater Chemistry from a profile in a lake
Data Access and Viewing System in ArcMap
CUAHSI Data Portal
CUAHSI Data Portal
Plot from the Hydrology Data PortalProduced using a CUAHSI Hydrology Web Service: getDailyStreamflowChart
CUAHSI Hydrology Web Services for NWIShttp://water.sdsc.edu/HydrologicTimeSeries/NWIS.asmx
Documentation: getDailyStreamflowCharthttps://webspace.utexas.edu/jgoodall/HydrologicTimeSeriesWebServices.htm
Applications and Services
Web ServicesLibrary
Web application: Data PortalYour application• Excel, ArcGIS, Matlab• Fortran, C/C++, Visual Basic• Hydrologic model• …………….
Your operating system• Windows, Unix, Linux, Mac
Internet
Utah State University Streamflow Analyst
CUAHSI HIS Overview
• HIS User Assessment
• Hydrology Data Portal
• Digital Watershed• Hydrologic Analysis
Digital WatershedHow can hydrologists integrate observed and
modeled data from various sources into a single description of the environment?
Digital WatershedHydrologic Observation
Data
GeospatialData
Remote SensingData
Weather and ClimateData
(NetCDF)
(GIS)(Relational database
or delimited ascii)
(EOS-HDF)
Digital Watershed
A digital watershed is a synthesis of hydrologic observation data, geospatial data, remote sensing data and weather
and climate data into a connected database for a hydrologic region
Created first for the Neuse basin
Digital Watershed:An implementation of the CUAHSI Hydrologic Data
Model for a particular region
Neuse Atmospheric Water• Daily precipitation
data from NCDC gages
• Nexrad daily rainfall rasters
• Land surface – atmosphere fluxes from North American Regional Reanalysis of climate
Neuse Surface Water• Streamflow, water quality
hydrologic observational data
• GIS: River network, water bodies, watersheds, monitoring points
• Land cover, soils, • MODIS remote sensing
(Praveen Kumar)
MODIS
Terrain and Land Cover
ArcIMS Web Server displaying data compiled in Neuse HO Planning Study
http://neuse.crwr.utexas.edu/
Neuse Basin: Coastal aquifer system
* From USGS, Water Resources Data Report of North Carolina for WY 2002
Section line
Beaufort Aquifer
Neuse Groundwater
Geovolumes of hydrogeologic unitsfrom US Geological survey (GMS)
Create a 3 dimensional representation
Geovolume
Each cell in the 2D representation is transformed
into a 3D object
Geovolume with model cells
Page 3
Drexel University, College of Engineering
Data Centers
NCDC
USGSNWIS
NCEP
NWS NGDC
Sensor Arrays
Numerical ModelsPrediction
HSPF
Air-Q
MM5
IndividualSamples
METADATA
The Demands
ISO 19103 Units/Conversion
Page 21
Drexel University, College of Engineering
Ontology Examples
Hydrologic Metadata
We currently have
ISO 19108 Temporal Objects
USGS Hydrologic Unit CodeISO 19115 Geospatial
Hydrologic ProcessesSedimentation
ARCHydro
What we need is
Many More
Many More
Many More
Many More
Upper Hydrologic Ontology
Michael Piasecki is ourexpert in this subject!
CUAHSI HIS Overview
• HIS User Assessment
• Hydrology Data Portal
• Digital Watershed• Hydrologic analysis
Hydrologic Analysis
HydrologicProcess Modeling
Statistics andHypothesis Testing
Visualization Data Miningand Knowledge Discovery
Digital Watershed
Data Driven
DiscoveryTools
Praveen Kumar is ourexpert on this subject!
Data Files
FebJan
4-D Data Model
Space, L
Time, T
Variables, V
D
Geostatistics
Time Series Analysis
Multivariate analysis
D
Image to Knowledge
Data to Knowledge
Hydrologic Flux Coupler
Hydrologic Fluxes and Flows
Digital Watershed(Atmospheric, surface and subsurface water)
We want to do water,mass, energy and water balances
Neuse Observatory Prototype Study
HydroVolumes
Take a watershed and extrude it vertically into the atmosphereand subsurface
A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed”
Watershed Hydrovolumes
Geovolume is theportion of a hydrovolumethat contains solidearth materials
USGS Gaging stations
Hydrovolume
Stream channel Hydrovolumes
Atmospheric science – hydrology
• Weather and climate fields are the drivers – continuous in space and time across the nation
• Local watersheds are the reactors – each behaving according to its location and characteristics
GeoTemporal Reference Frame
• A defined geospatial coordinate system for (x,y,z)
• A defined time coordinate system (UTC, Eastern Standard Time, ….)
• A set of variables, V• Data values v(x,y,z,t)
Space (x,y,z)
Time, t
Variables, V
v – data values
Data Cube
Continuous Space-Time Model -- NetCDF
Space, L
Time, T
Variables, V
D
Coordinate dimensions
{X}
Variable dimensions{Y}
Space, FeatureID
Time, TSDateTime
Variables, TSTypeID
TSValue
Discrete Space-Time Data Model
Geospatial Time Series
Value
Time
Shape
Time SeriesProperties
(Type)A Value-Time array
A time series that knows what geographic feature it describes and what type of time series it is
Neuse Water Balance
Precipitation
Evaporation
Streamflow
Define the fluxes and flows associated with each hydrovolume
Groundwater recharge
Coupling Table – Connects fluxes and flows with hydrovolumes
A geospatial time series object
A geospatial time series object vector
Hydrovolume object
Coupling FeatureID
SourceSinkIDTSTypeIDDirection
FeatureID SourceSinkID TSTypeID Direction
1 02092500 1 -1
1 1 2 1
1 1 3 -1
1 1 4 1
TSTypeID Variable
1 Daily Streamflow
2 Daily Precipitation
3 Daily Evaporation
4 Daily Subsurface Recharge
Monthly Fluxes and Flows
P, E, RQ
Net Inflow and Cumulative Storage
Net Inflow
Storage
This water balance does not close very well – we need better data!
Monthly water balance for one watershed hydrovolume for 2001
HydroObjects Class Library
HydroObjectsAPI
Remote and local Data sources
ArcGIS
Excel
Matlab
Custom ModelsWeb Services
Backbone of a Hydrologic Information System
• Hydrology Data Portal is a common data window on point observation data sources
• CUAHSI web services library supports the data portal and local applications on your computer
• Digital watershed is a data fusion of point observations, GIS, remote sensing and weather and climate grids
• Hydrologic Flux Coupler key to integrating atmospheric, surface and subsurface water
Conclusions
In production
In development
In research
top related