water quality data publishing from an ogc web feature service jonathan doig nsw department of...
TRANSCRIPT
Water Quality Data Publishingfrom an OGC Web Feature Service
Jonathan DoigNSW Department of Natural Resources
DIMWG SDISC - 22 May 2006
Context
From CANRI program NRAtlas web portal, catalogue, WMS 2002-03 WFS pilot with ESRI and
Social Change Online
Toward NSW SDI Initial focus on NRM indicator reporting
DIMWG SDISC - 22 May 2006
Standards ...what we're using and why
Web Feature Service (WFS)
WFS
Mandatory:
Optional:
GetCapabilities Feature Types, GML Object Types, Filter Capabilities
DescribeFeatureType GML schema
GetFeature[WithLock] (queries) Feature Collection
Transaction (Insert, Update, Delete) Status
LockFeature Lock ID, Features Locked
GetGmlObject (by ID) GML element
Request Response
DIMWG SDISC - 22 May 2006
Standards ...what we're using and why
For graphs, download, thematic maps Other agencies can use our data in
their reporting (local, catchment, state, national SoE, ...)
Already supported by GIS vendors
Web Feature Service (WFS)
DIMWG SDISC - 22 May 2006
Observations & Measurements framework
Based on Measurement Theory Application profile of GML, from WFS Standard patterns (where, when, how, etc)
Just insert the bits we need Support by SCOTS software Minimal customisation and maintenance Integrate with other systems (semantic web)
Standards ...what we're using and why
DIMWG SDISC - 22 May 2006
Observations & Measurements frameworkStandards ...what we're using and why
Observations & Measurements framework - detail
ESCAWRI TWG - 12 Oct 2005
DIMWG SDISC - 22 May 2006
Geoserver WFS software
Used in Australian SEEGRID geochemistry demonstrator – all geoscience agencies
Supports complex data & maps from internal tables to community schema
Open source WFS reference implementation geoserver.sourceforge.net
Standards ...what we're using and why
Deployed componentsIntranet DMZ Internet
Config
GeoserverWFS
3rd-partyApplication
WFSTest
Harness
NRAtlasPortal
SDIRegistryDatabase
SDIRegistry
3rd-partyApplication
End user
Applicationdeveloper
FeatureTypes
Queries
Stylesheets
DatasetsContextsServices
Water quality operational
database
Exportscript
Water qualitydistribution
database
DIMWG SDISC - 22 May 2006
1. Select map from home page
[Live demo – test.nratlas.nsw.gov.au] [Skip slides]
DIMWG SDISC - 22 May 2006
2. Click feature on map
DIMWG SDISC - 22 May 2006
3. Choose/confirm query
DIMWG SDISC - 22 May 2006
4. View time-series graph
DIMWG SDISC - 22 May 2006
5. Change query
DIMWG SDISC - 22 May 2006
6. View graph
DIMWG SDISC - 22 May 2006
7. Download data
Contexts
Water qualitydistribution
database
GeoserverWFS
3rd-partyApplication
WFSTest
Harness
NRAtlasPortal
SDIRegistryDatabase
SDIRegistry
3rd-partyApplication
End user
Applicationdeveloper
FeatureTypes
Queries
Stylesheets
DatasetsServices
Walk-through: Select map from home pageIntranet DMZ Internet
Config
Water quality operational
database
Exportscript
Config
DIMWG SDISC - 22 May 2006
Catalogue-driven WFS workflow
Why use a WFS? To get related or more detailed data for
a selected feature To download data to user To generate a report for an areaTo use a WFS Need to generate a query Do something with results
DIMWG SDISC - 22 May 2006
Overview of main workflow
1. Map locations (using mappable feature type)2. Select site3. “Chain”
Mode (graph/download/report) Target feature (e.g. time-series feature type) Configuration
4. Where configuration not specified in request, look up catalogue for feature type
Query Portrayal configuration Data transform (e.g. to graph syntax)
DIMWG SDISC - 22 May 2006
Views into data
Related Feature Types
Stations(map)
Station id
Time-series(graph)Time-series(download)
DIMWG SDISC - 22 May 2006
Information model Retro-fitted to existing catalogue: all just
METADATA & CLASSIFICATIONS Heterogeneous XML documents in catalogue
(type=DAQM – Data Access Query Model) 1:N Classifications:
FEATURE_TYPE (“relevant to”) ROLE – what part of binding process RESULT_TYPE (for download – to control browser
handling of results) Text/html Text/xml KML (etc)
DIMWG SDISC - 22 May 2006
Existing catalogue/registry design
CLASSIFICATIONCodeSpaceValueReadable_TermFK_ID
1
METADATAIDTitleDescriptionResourceURLTypeX, Y, X1, Y1BeginDate, EndDateCreator, CreateDatePreviewURLMetadataHTMURLXML_CharStream
n
DIMWG SDISC - 22 May 2006
1. Click feature on map
DIMWG SDISC - 22 May 2006
DiscoveredData Service
Catalogue
Form
DAQM
Query
Vocab
CataloguedMetadataDocument
Process
Data transfer(standard format)
DIMWG SDISC - 22 May 2006
2. View time-series graph
Graph
GraphConfig
Graph Defn
XSLT
Data
Query
Data AccessService
DiscoveredData Service
DIMWG SDISC - 22 May 2006
3. Download data DiscoveredData Service
(Feature Type)
Catalogue
XSL
Transform(XSL)
DownloadFormat
Viewer
DIMWG SDISC - 22 May 2006
Key to detailed information model
Catalogue Query:
Classifier.X=Y
CODESPACE=XAnd VALUE=Y
XML doc
queryTemplate=URL
HTTP query parameters override defaults
This provides information to set up catalogue contents and bookmarkable query forms
DIMWG SDISC - 22 May 2006
DiscoveredData Service
Catalogue
Form
DAQM
Query
Vocab
1. Initiate query (eg click feature on map)
MapContext/Layer or catalogued service
(feature_type)
Type=DAQMClassifier.ROLE=modeQuery(graphQuery | reportQuery |
downloadQuery)Classifier.FEATURE_TYPE=feature_type
Referenced by DAQM
queryTemplate=URL
mode=graph | download | report
DIMWG SDISC - 22 May 2006
Catalogue contents
Detail from Catalogue Maintenance utility
DIMWG SDISC - 22 May 2006
2. View time-series graph
Graph
GraphConfig
Graph Defn
XSLT
Data
Query
Data AccessService
DiscoveredData Service Default: same as original
service(extension – search for
services)
Type=DAQMClassifier.ROLE=graphConfig
Classifier.FEATURE_TYPE=feature_type
DataReformat
graphConfig=URL
graphPackage=URL
service=URL
Type=DAQMClassifier.ROLE=graphPackage
Classifier.FEATURE_TYPE=feature_type
DIMWG SDISC - 22 May 2006
3. Download data
DAQM
Catalogue
XSL
Transform(XSL)
DownloadFormat
Viewer
Type=DAQMClassifier.ROLE=downloadPackage
Classifier.FEATURE_TYPE=feature_type
Mime-type = Classifier.RESULT_TYPE
downloadStylesheet=URL
downloadFeatureType=feature_type
downloadQueryModel=DAQM
DIMWG SDISC - 22 May 2006
Water quality data publishing–other outputs
DNR Web Feature Servicehttp://wfs.test.dnr.nsw.gov.au
Developer doco - for standards-based data models
Project website (below) > Architecture > OandMCookbook
National demonstrationhttp://awdip-demo.socialchange.net.au/wmc/savedapps/awdip
Project websitewww.seegrid.csiro.au > NRInfo > WaterML > WQDP
DIMWG SDISC - 22 May 2006
National alignment
Commonwealth Observer on our project Co-sponsored standards doco Native veg reporting pilot Funded project completion, pilot with NSW & SA Developing Australian water data infrastructure
Northern Territory Co-sponsored Geoserver software development
DIMWG SDISC - 22 May 2006
Indicator governance–who owns what?
Indicator definition
Monitoring results
NameAnalyteUnitsFrequencySampling methodSummary methodRationaleIssue background
Target
Baseline dateTarget dateTarget value
Summarise
AnalyteDate/timeSiteValue
Indicator results
IndicatorTime periodRegionValue/rating
Interpret
Interpretation
TrendPressureResponse
Dataset
NameCustodianOther metadata…
DIMWG SDISC - 22 May 2006
Questions?
Project websitewww.seegrid.csiro.au > NRInfo > WaterML
ContactJonathan Doig +61 2 9895 [email protected]