NJ iMap 2.0 and NJ NJ iMap 2.0 and NJ BASINSBASINS

Paul MortonPaul MortonWater Monitoring & StandardsWater Monitoring & Standards

Marzooq Al-EbusMarzooq Al-EbusDivision of Watershed Division of Watershed

ManagementManagement

Overall Use of STORET in Overall Use of STORET in NJNJ Began using STORET in 1970sBegan using STORET in 1970s Currently storing ambient chemical, Currently storing ambient chemical,

benthic macroinvertebrate, fish and data benthic macroinvertebrate, fish and data logger resultslogger results

Since 1998, over Since 1998, over 3,3003,300 stations, stations, 600,000600,000 resultsresults

Used for required Used for required Integrated Water Integrated Water Quality ReportQuality Report (303 (d) & 305(b)) to (303 (d) & 305(b)) to USEPA and for USEPA and for TMDLTMDL development development

NJDEP/USGS-NJ NWIS DataNJDEP/USGS-NJ NWIS Data Entered 3 years of cooperative network Entered 3 years of cooperative network

results in NJ STORET (only a part of results in NJ STORET (only a part of NJDEP’s monitoring program)NJDEP’s monitoring program)

Eliminated practice w/Region 2’s approvalEliminated practice w/Region 2’s approvalDuplicate entryDuplicate entry = skewed results for users = skewed results for users

retrieving data from both databasesretrieving data from both databasesNo proofreadingNo proofreading and USGS staff limitations and USGS staff limitationsShifted resourcesShifted resources to getting data not in a to getting data not in a

public database into STORET so publicly public database into STORET so publicly available for Integrated Assessment Reportavailable for Integrated Assessment Report

Window to My Window to My EnvironmentEnvironment Advantages: Advantages:

““One stop shop” for One stop shop” for NWIS & STORETNWIS & STORET data dataAccess to data not in NJ-STORET (DRBC, EPA, Access to data not in NJ-STORET (DRBC, EPA,

IEC)IEC)Map based and available to the Map based and available to the publicpublic

Disadvantages:Disadvantages:Different data formatsDifferent data formats: must reformat to merge: must reformat to mergeOnly Only one stationone station of data per retrieval of data per retrievalNo No LegacyLegacy STORET data STORET data

Will be applying for FY06 NEIEN Grant Will be applying for FY06 NEIEN Grant funding for multiple data flows to NJ-STORETfunding for multiple data flows to NJ-STORET• NJ State LabNJ State Lab NJ-STORETNJ-STORET (expanding (expanding

eDWR)eDWR)• NJ-STORETNJ-STORET EPA-STORETEPA-STORET??• May create a Web site/May create a Web site/Web serviceWeb service for receiving for receiving

319(h) grant & volunteer data from groups not 319(h) grant & volunteer data from groups not running STORET per Region 2 guidancerunning STORET per Region 2 guidance

Learn from Learn from Pacific Northwest and USGS Pacific Northwest and USGS XMLXML-based data sharing efforts so don’t -based data sharing efforts so don’t reinvent the wheelreinvent the wheel

Plans for NJ-STORET and Plans for NJ-STORET and CDXCDX

Business ObjectsWeb Intelligence

NJEMSFacility Data

(DMRs, Permits,Violations)

GIS SpatialData

i-MapNJBRIDGEBRIDGE

NJSTORET

AmbientWater Quality

& Bio Data

i-MapNJ ArcIntelligence 2.0i-MapNJ ArcIntelligence 2.0““Integrating GIS with NJDEP Databases”Integrating GIS with NJDEP Databases”

Basic Function of i-MapNJ Basic Function of i-MapNJ (Intranet)(Intranet)

Builds a Bridge between Tabular Data and Spatial Data Improves Environmental Decision-Making Puts GIS & Data Viewer on Every NJDEP Desktop Introduces a “User Profile” concept Integrates additional environmental data Deploys additional GIS tools; Improves performance Employs State-of-the-Art Intranet Mapping Software Answers spatial questions that were previously

unanswerable (not having a discoverable answer)

iMap NJ iMap NJ InterfaceInterface

f

You Can Manage the Layers in You Can Manage the Layers in Your ProfileYour Profile

Pre-Defined WEBI Query Pre-Defined WEBI Query forfor

Water Monitoring and Water Monitoring and StandardsStandards

ResultsResults ofof thethe QueryQuery - Now- Now RunRun thethe WEBIWEBI ReportReport

WEBIWEBI ReportReport

Set Filters on WEBI Report to find Results Exceeding Set Filters on WEBI Report to find Results Exceeding the Standardthe Standard

Result Set - Now Show These Result Set - Now Show These Stations in iMapStations in iMap

Download a Comma Delimited File Download a Comma Delimited File to your PCto your PC

Open with Excel or Open with Excel or AccessAccess

NJ Perspective on Needed NJ Perspective on Needed National STORET & Related National STORET & Related EnhancementsEnhancements Common formatCommon format for data exchange (XML schema for STORET) to for data exchange (XML schema for STORET) to

eliminate current wasteful practice of manually reformatting dataeliminate current wasteful practice of manually reformatting data Automate 2-way data exchangeAutomate 2-way data exchange (CDX client node] between Federal (CDX client node] between Federal

agencies (STORET and NWIS] and states/tribes to eliminate wasteful agencies (STORET and NWIS] and states/tribes to eliminate wasteful manual process manual process

NEIEN Grant fundsNEIEN Grant funds for states to implement STORET CDX nodes or we for states to implement STORET CDX nodes or we won’t be able to implement efficiencies offered by NEIEN initiativeswon’t be able to implement efficiencies offered by NEIEN initiatives

STORET GIS Web ServiceSTORET GIS Web Service to make monitoring stations available via to make monitoring stations available via common format and eliminate manual creation of GIS data layers. common format and eliminate manual creation of GIS data layers. Multiple agencies create GIS data clearinghouses that point to Web Multiple agencies create GIS data clearinghouses that point to Web Services = broadest possible exposure for STORET dataServices = broadest possible exposure for STORET data

Web links for reportsWeb links for reports currently disappear after 30 days. Make Web currently disappear after 30 days. Make Web links for Data Logger files permanent so we can link to them from links for Data Logger files permanent so we can link to them from our Web sites rather than having to store the data on our Web sitesour Web sites rather than having to store the data on our Web sites

NJ Perspective on Needed NJ Perspective on Needed National STORET/WME National STORET/WME EnhancementsEnhancements

STORET/Window to My Environment STORET/Window to My Environment • Add ability to Add ability to download multiple stationdownload multiple station results rather than results rather than

the exhausting “one at a time” processthe exhausting “one at a time” process• Normalize output formats for STORET and NWISNormalize output formats for STORET and NWIS (ex: units (ex: units

of measure, how “Non-detects” are treated, etc.) so end of measure, how “Non-detects” are treated, etc.) so end user can spend less time reformatting data and more time user can spend less time reformatting data and more time assessing results and developing TMDLSassessing results and developing TMDLS

• Add link to Legacy STORET dataAdd link to Legacy STORET data for users needing to do for users needing to do long term trend analysis and indicator/surrogate studies long term trend analysis and indicator/surrogate studies rather than forcing them to go to 2 Web sites and reformat rather than forcing them to go to 2 Web sites and reformat data.data.

Needed STORET Needed STORET EnhancementsEnhancements Make STORET a fully functional databaseMake STORET a fully functional database by eliminating wasteful by eliminating wasteful

practices and enhancing processing of batches of information practices and enhancing processing of batches of information freeing resources to enter additional data:freeing resources to enter additional data:• Add the ability to change a group of results (Add the ability to change a group of results (batch processingbatch processing) from ) from

““PreliminaryPreliminary” results that are not visible on the Web to “” results that are not visible on the Web to “FinalFinal” ” results that are, without having to manually change each result or results that are, without having to manually change each result or delete/reenter results.delete/reenter results.

• Ability to Ability to add add, change or delete resultsadd add, change or delete results for a group of existing for a group of existing samples (batch processing) rather than doing it “one at a time”samples (batch processing) rather than doing it “one at a time”

• Ability to share custom set-ups that increase the efficiency of data Ability to share custom set-ups that increase the efficiency of data entry (entry (share Preference & Defaultsshare Preference & Defaults) between agencies) between agencies

Needed STORET ToolsNeeded STORET Tools Web based application (Web based application (SIM WebSIM Web?) for ?) for

accepting/reformatting data for groups (contractors, accepting/reformatting data for groups (contractors, grantees, academia, volunteers] not using STORET so grantees, academia, volunteers] not using STORET so they can make their data publicly available and therefore they can make their data publicly available and therefore valid for inclusion in Water Quality Assessments.valid for inclusion in Water Quality Assessments.

Application to Application to include all necessary information for include all necessary information for STORETSTORET including Organization information, and including Organization information, and preference/default codes that must be entered manually preference/default codes that must be entered manually into a local copy of STORET (problem for those who don’t into a local copy of STORET (problem for those who don’t have STOREThave STORET

Update SIMUpdate SIM (the STORET Interface Module) so it can (the STORET Interface Module) so it can accept this additional information saving time and effort accept this additional information saving time and effort from manual steps and freeing resource to enter other from manual steps and freeing resource to enter other data that doesn’t exist in a public database.data that doesn’t exist in a public database.

BASINS-NJBASINS-NJ Customized version of EPA BASINS 2.0 for WQ Customized version of EPA BASINS 2.0 for WQ

data analysis, TMDL modeling and data analysis, TMDL modeling and implementationimplementationAdditional GIS data (Land Use, Impervious Cover, Additional GIS data (Land Use, Impervious Cover,

etc.)etc.)Additional models (Mercury and Sediment)Additional models (Mercury and Sediment)Additional assessment toolsAdditional assessment tools

Low flow analysis toolLow flow analysis toolWatershed characterization reportWatershed characterization report Improved target and assess toolImproved target and assess tool

Download and/or compile water quality data from Download and/or compile water quality data from multiple sources (USGS-NWIS, NJ-STORET, third-multiple sources (USGS-NWIS, NJ-STORET, third-party data sourceparty data source

Basins-NJ version 1 was delivered on June, Basins-NJ version 1 was delivered on June, 2004 and is currently undergoing testing2004 and is currently undergoing testing

BASINS-NJ IssuesBASINS-NJ Issues ArcGISArcGIS

NJDEP switching from ArcView 3.x NJDEP switching from ArcView 3.x environment to ArcGIS 8.x, 9.x and environment to ArcGIS 8.x, 9.x and establishing ArcGIS as the only GIS establishing ArcGIS as the only GIS approved platform for the agency. approved platform for the agency.

An option is to create a version of BASINS-NJ An option is to create a version of BASINS-NJ that runs on ArcGIS - this will involve a that runs on ArcGIS - this will involve a significant rewrite of the BASINS-NJ ArcView significant rewrite of the BASINS-NJ ArcView 3x Avenue scripts to VBA and ArcObjects or 3x Avenue scripts to VBA and ArcObjects or migrating to BASINS 4.0 when released by migrating to BASINS 4.0 when released by EPA. EPA.

BASINS-NJ Issues During BASINS-NJ Issues During Testing PhaseTesting Phase

System errors Error Codes- No user-interpretable information

BASINS Extensions may lock the system when multiple extensions are loadedSome extensions use common dialogs and

same name Low Flow Analysis

Single day low flow is greater than an average 7 day low flow- 1Q10> 7Q10

BASINS Avenue BASINS Avenue ErrorError

BASINS-NJ IssuesBASINS-NJ Issues Data Duplication Data Duplication

NWIS and Legacy STORET dataNWIS and Legacy STORET data Data entered into both data systemsData entered into both data systems BASINS-NJ was not designed to handle BASINS-NJ was not designed to handle

this automatically. this automatically. User has to review combined data User has to review combined data

manually to remove data duplicates.manually to remove data duplicates.

Potential BASINS-NJ Potential BASINS-NJ EnhancementsEnhancements Update data and provide tools to Update data and provide tools to

automatically update dataautomatically update data PopulationPopulation Water quality and flow stationsWater quality and flow stations Meteorological data (new WDM files)Meteorological data (new WDM files) Automatically refresh stations list from Automatically refresh stations list from

USGS-NWIS and EPA-STORETUSGS-NWIS and EPA-STORET

Potential BASINS-NJ Potential BASINS-NJ EnhancementsEnhancements Include new modelsInclude new models

STEPLSTEPL GWLFGWLF AQUATOXAQUATOX

Enhance current download tools to include:Enhance current download tools to include: Refresh/update NWIS stationsRefresh/update NWIS stations Connect and download EPA-STORET data and stationsConnect and download EPA-STORET data and stations Provide tools to identify potential data duplicates from Provide tools to identify potential data duplicates from

multiple data sourcesmultiple data sources

Tools to archive and restore BASINS projects Tools to archive and restore BASINS projects (available in BASINS 3.1)(available in BASINS 3.1)

NJ’s Perspective on STORET NJ’s Perspective on STORET & BASINS & BASINS Now, and its promise for Now, and its promise for

future.future. NJ has used STORET for multiple water quality networks and NJ has used STORET for multiple water quality networks and

types of monitoring (chemical & biological) for over 4 types of monitoring (chemical & biological) for over 4 decades, decades,

NJ enthusiastically supports STORET as a National Water NJ enthusiastically supports STORET as a National Water Quality Data Base useful for meeting EPA requirements, Quality Data Base useful for meeting EPA requirements, especially Integrated Assessments, trends and TMDLs.especially Integrated Assessments, trends and TMDLs.

Urgent need to develop automated data exchange between Urgent need to develop automated data exchange between EPA/STORET, USGS/NWIS and states, tribes, academia and EPA/STORET, USGS/NWIS and states, tribes, academia and volunteers to eliminate extremely wasteful current practice volunteers to eliminate extremely wasteful current practice of reformatting data and manual data sharing. of reformatting data and manual data sharing.

Key enhancements are needed in the areas of importing Key enhancements are needed in the areas of importing data, editing and deleting results so that STORET is a fully data, editing and deleting results so that STORET is a fully functional national DB and BASINS is a comprehensive functional national DB and BASINS is a comprehensive assessment tool for states, tribes, academia, volunteers and assessment tool for states, tribes, academia, volunteers and public.public.

Thank you!Thank you!