co presentation on ecodata

32
____________ ____________ EcoData EcoData

Upload: earthsoft

Post on 26-Jun-2015

677 views

Category:

Technology


0 download

DESCRIPTION

This presentation by Candy Thompson from Colorado HMWMD discusses CO's efforts to share data and set up data standards. This presentation discusses why, who, what kind of data, and other issues regarding the "Data Monster."

TRANSCRIPT

Page 1: CO Presentation on EcoData

________________________EcoDataEcoData

Page 2: CO Presentation on EcoData

ECODATA Includes Participation by these ECODATA Includes Participation by these Groups of CDPHEGroups of CDPHE

Hazardous Materials and Waste Management Hazardous Materials and Waste Management DivisionDivision

–– Superfund/CERCLASuperfund/CERCLA–– Hazardous Waste Sites RCRAHazardous Waste Sites RCRA–– Solid Waste LandfillsSolid Waste Landfills

Water Quality Control DivisionWater Quality Control Division–– Waste Water Discharge (NPDES)Waste Water Discharge (NPDES)–– Drinking WaterDrinking Water–– Stream and Groundwater Classification and Stream and Groundwater Classification and

MonitoringMonitoring

Air Pollution Control DivisionAir Pollution Control Division–– Stationary Sources of Air PollutionStationary Sources of Air Pollution

Consumer Protection DivisionConsumer Protection Division–– Limited Distribution Drinking Water WellsLimited Distribution Drinking Water Wells

Page 3: CO Presentation on EcoData

VISION: VISION: TOWARDS TRANSPARENT TOWARDS TRANSPARENT

GOVERNMENTGOVERNMENTEasily Share and Display Data Across:Easily Share and Display Data Across:DIFFERENT DATABASESDIFFERENT DATABASES, , and from:and from:

FederalFederalTribesTribesStateStateCountyCountyCityCityIndustryIndustryCitizen GroupsCitizen Groups

Page 4: CO Presentation on EcoData

Environmental Monitoring Environmental Monitoring DataData

Includes: Laboratory and Field Analysis Includes: Laboratory and Field Analysis for Chemical for Chemical AnalytesAnalytes, Flow, Water , Flow, Water Levels, Biologic, etc.Levels, Biologic, etc.Media: Groundwater, Surface Water, Media: Groundwater, Surface Water, Air, Soils, Drinking Water Air, Soils, Drinking Water For: Ambient environmental conditions, For: Ambient environmental conditions, regulatory compliance, site cleanup, regulatory compliance, site cleanup, etc.etc.

Page 5: CO Presentation on EcoData

Why Share Environmental Why Share Environmental DataData

Minimize costs of collecting dataMinimize costs of collecting dataAllow Government to discern and focus on Allow Government to discern and focus on most pressing environmental problemsmost pressing environmental problemsDetermine historic or baseline conditions in Determine historic or baseline conditions in an areaan areaMap chemical contaminants across wider Map chemical contaminants across wider areas to determine exposure risks and areas to determine exposure risks and communicate to the publiccommunicate to the publicMore completely depict the environmental More completely depict the environmental conditions in an area of interestconditions in an area of interest

Page 6: CO Presentation on EcoData

Currently Data Sharing is Currently Data Sharing is Nearly ImpossibleNearly Impossible

No methods to determine who has what dataNo methods to determine who has what dataNo common chemical/No common chemical/analyteanalyte parameter parameter codes codes No common data formatNo common data formatIf pertinent data is found, 90% of the project If pertinent data is found, 90% of the project managermanager’’s time is spent manipulating and s time is spent manipulating and converting the data into a different systemconverting the data into a different system

Page 7: CO Presentation on EcoData

THE DATA MONSTERTHE DATA MONSTER

Questionable Quality or Unknown Questionable Quality or Unknown Quality of Parameter ResultsQuality of Parameter ResultsNo Standard Format of DataNo Standard Format of DataLittle Use of Standard Coding for Little Use of Standard Coding for ParametersParametersInconsistent Spatial Projection Inconsistent Spatial Projection Systems for LocationsSystems for Locations

Page 8: CO Presentation on EcoData

PresentPresent

TIMETIME

DATA

DATAHISTORICHISTORIC EDDEDD

Page 9: CO Presentation on EcoData

Rocky Flats ArcIMS Web Rocky Flats ArcIMS Web Mapping of Environmental Mapping of Environmental

Monitoring DataMonitoring Data

http://www.http://www.cdphecdphe.state.co.us/.state.co.us/hmhm//rfrf//rfrfmapsmaps.asp.asp

Page 10: CO Presentation on EcoData
Page 11: CO Presentation on EcoData
Page 12: CO Presentation on EcoData
Page 13: CO Presentation on EcoData
Page 14: CO Presentation on EcoData
Page 15: CO Presentation on EcoData
Page 16: CO Presentation on EcoData

ECODATAECODATA

Data Streamlining and Sharing Method at Data Streamlining and Sharing Method at Colorado Dept. of Public Health and Colorado Dept. of Public Health and Environment (CDPHE)Environment (CDPHE)Transfer System for Environmental Monitoring Transfer System for Environmental Monitoring DataDataStreamlines data input to storage databases Streamlines data input to storage databases from laboratory and field from laboratory and field Streamlines output from databases for data Streamlines output from databases for data sharing through common web interfacessharing through common web interfaces

Page 17: CO Presentation on EcoData

ECODATA PROMISEECODATA PROMISE

Save money for CDPHE and Regulated Save money for CDPHE and Regulated Community by creating one lab Electronic Community by creating one lab Electronic Data Deliverable (EDD) format across all Data Deliverable (EDD) format across all environmental programs environmental programs Create the ability to share data across the Create the ability to share data across the major databasesmajor databasesSave time by minimizing data conversion to Save time by minimizing data conversion to storage databasestorage databaseAccommodates different databases, database Accommodates different databases, database models, and parameter codingmodels, and parameter coding

Page 18: CO Presentation on EcoData

Streamlining Data Input and Streamlining Data Input and SharingSharing

Based upon the concept that no matter for Based upon the concept that no matter for what media or purpose, all environmental what media or purpose, all environmental monitoring sampling and analysis can be monitoring sampling and analysis can be accommodated by one large electronic accommodated by one large electronic wrapperwrapperSampling, Chain of Custody, and Laboratory Sampling, Chain of Custody, and Laboratory procedures are all similar and can be procedures are all similar and can be accommodated by one Universal Electronic accommodated by one Universal Electronic Data Deliverable (EDD) formatData Deliverable (EDD) format

Page 19: CO Presentation on EcoData

Current SituationCurrent Situation

Page 20: CO Presentation on EcoData

SolutionSolution

Page 21: CO Presentation on EcoData

Universal Electronic Data Universal Electronic Data Deliverable FormatDeliverable Format

Based on study of all participating Based on study of all participating groups needs.groups needs.Incorporates EPA StandardsIncorporates EPA StandardsOne standard list of reference valuesOne standard list of reference valuesExpandableExpandable

Page 22: CO Presentation on EcoData

EDDEDDElectronic Data DeliverableElectronic Data Deliverable

Consists of Consists of -- ROSETTA STONE ROSETTA STONE -- Universal Parameter Code Universal Parameter Code

Universal Parameter List includes 3500 Parameter codes Universal Parameter List includes 3500 Parameter codes based upon CAS ID, IRPMS, and EPA STORET ID in that based upon CAS ID, IRPMS, and EPA STORET ID in that orderorderActs as a translator between universal and program Acts as a translator between universal and program specific reference values. specific reference values.

–– Universal Data Element Mapping (Format)Universal Data Element Mapping (Format) --Data Element Mapping creates one format Data Element Mapping creates one format accommodating the largest, most detailed needs accommodating the largest, most detailed needs for data, I.e., quality control (QC) for data for data, I.e., quality control (QC) for data qualificationqualification

Across all participating databasesAcross all participating databases

Page 23: CO Presentation on EcoData

Universal EDD Format Universal EDD Format IncludesIncludes

XML or Comma delimited formatsXML or Comma delimited formatsLocation informationLocation informationField Sampling informationField Sampling informationLaboratory Test informationLaboratory Test informationField Readings informationField Readings information

Page 24: CO Presentation on EcoData

Diagram of Program Diagram of Program vs vs UniversalUniversal

UniversalSAMS/EQuIS

STORET

PM10

PM2.5

SDWIS/State

Fluoridation

CPD

Page 25: CO Presentation on EcoData

Next StepsNext Steps

Work with data providers to facilitate Work with data providers to facilitate their submission of data in correct their submission of data in correct formats.formats.Require submittal of formats for Require submittal of formats for participating systemsparticipating systemsExpand deliverables to include geologic, Expand deliverables to include geologic, water level formats, and others.water level formats, and others.

Page 26: CO Presentation on EcoData

CDPHE EDDCDPHE EDD

Based upon the EDD developed by EPA Based upon the EDD developed by EPA Region II and the EPARegion II and the EPA’’s Environmental Data s Environmental Data Registry Registry -- Chemical Identification StandardChemical Identification StandardIncludes data qualifiers (blanks, Includes data qualifiers (blanks, dupsdups, lab , lab batch, and instrument calibration) allowing batch, and instrument calibration) allowing data validationdata validationExpanded to include Air, Safe Drinking Water Expanded to include Air, Safe Drinking Water Information System (SDWIS), and Biological Information System (SDWIS), and Biological DataData

Page 27: CO Presentation on EcoData

WHAT EDD USE REQUIRESWHAT EDD USE REQUIRES

Formatting a conversion from the EDD to Formatting a conversion from the EDD to underlying Databaseunderlying DatabaseCan accept as few or as many elements/fields Can accept as few or as many elements/fields of the Universal EDD as applicableof the Universal EDD as applicableAlthough Lab format utilizes the Universal Although Lab format utilizes the Universal EDD format, Lab only analyzes and submits EDD format, Lab only analyzes and submits data requested for the sampledata requested for the sample

Page 28: CO Presentation on EcoData

WHAT EDD USE REQUIRES, WHAT EDD USE REQUIRES, cont.cont.

Does not force changes in underlying Does not force changes in underlying databasesdatabasesDoes require translation between Does require translation between Parameter List and the underlying Parameter List and the underlying database parameter nomenclaturedatabase parameter nomenclatureSame process can be used to extract Same process can be used to extract and share data between underlying and share data between underlying databasesdatabases

Page 29: CO Presentation on EcoData

Web Applications for Data Web Applications for Data SharingSharing

A Universal EDD and the A Universal EDD and the synchronization afforded across synchronization afforded across individual databases sets the stage individual databases sets the stage to share environmental data across to share environmental data across agencies, industry, and the publicagencies, industry, and the public

Page 30: CO Presentation on EcoData

InternetInternet

Washington

Oregon

EPA

Data AccessApplication

NODEDataSource

Alaska

Idaho

STORETData

Warehouse

NODEDataSource

HostDatabase

DataCatalog

NODE DataSource

NODE DataSource

CDX

.xml

.xml

.xml

.xml

.xml

Pacific Northwest Pacific Northwest Water Quality Data ExchangeWater Quality Data Exchange

Page 31: CO Presentation on EcoData

Pacific Northwest Pacific Northwest Water Quality Data ExchangeWater Quality Data Exchange

Provides a single point of access to a Provides a single point of access to a comprehensive source of ambient water quality comprehensive source of ambient water quality monitoring data across the Pacific Northwest monitoring data across the Pacific Northwest region.region.Demonstrates the national Network concept and Demonstrates the national Network concept and principles.principles.Illustrates mechanism and benefits of StateIllustrates mechanism and benefits of State--toto--State information exchanges.State information exchanges.Implements a Implements a ““networknetwork--basedbased”” approach.approach.Will facilitate StateWill facilitate State--toto--EPA data exchange of dataEPA data exchange of dataIllustrates rapid data exchange development Illustrates rapid data exchange development possibilities inherent in the Network principles.possibilities inherent in the Network principles.h //htt // i d l ii d l ti bi /bi / dd //

Page 32: CO Presentation on EcoData

________________________EcoDataEcoData