advocating and achieving regional monitoring collaborations · advocating and achieving regional...
TRANSCRIPT
Advocating and AchievingRegional Monitoring Collaborations
Advocating and AchievingRegional Monitoring Collaborations
Robert Brown
Natasha Dickrell
Dr. David Karlen
Keith Kibbey
Robert Brown
Natasha Dickrell
Dr. David Karlen
Keith Kibbey
NWQMC Conference 2016Examples from the Success of the Southwest Florida
Regional Ambient Monitoring Program(SWF RAMP)
What’s a Regional Monitoring Program?What’s a Regional Monitoring Program?
Definition of“Together” versusThe 3 C’s
SWF Examples
SeagrassMonitoring
Bay BenthicMonitoring
Florida SeaGrant Initiatives
BathymetricLake Maps
Definition of“Together” versusThe 3 C’s
SWF Examples
SeagrassMonitoring
Bay BenthicMonitoring
Florida SeaGrant Initiatives
BathymetricLake Maps
To foster cooperativeparticipation of regional
monitoring program staffs toimprove comparability of
surface water samplecollection, in situ fieldmeasurements, and
laboratory methods used bysurface water quality
monitoring programs inSouthwest Florida marine and
freshwater systems.
To foster cooperativeparticipation of regional
monitoring program staffs toimprove comparability of
surface water samplecollection, in situ fieldmeasurements, and
laboratory methods used bysurface water quality
monitoring programs inSouthwest Florida marine and
freshwater systems.
SWF-RAMP Mission Introduction
Facilitate Communication &Information Sharing
Promote Partnerships
Focus on Data Comparability
Facilitate Communication &Information Sharing
Promote Partnerships
Focus on Data Comparability
Dedicated to Collaboration
Three Generations of RAMP LeadershipThree Generations of RAMP Leadership
“The beauty of collaborationbetween [mentor and neophyte]generations is that we combine
strength with wisdom—a surefireway to accomplish more ...”
― Brett Harris
Presented by:
Rob Brown
Manatee County
Presented by:
Rob Brown
Manatee County
SWF-RAMPHISTORY &
IMPACTin the
Southwest FloridaRegion
20+ Years of SWF-RAMP History20+ Years of SWF-RAMP History
Formation andGenesis
Early Goals &Objectives
RAMP Impact onthe Status ofTampa Bay
Tampa Bay in the1970s-Early 1980sTampa Bay in the1970s-Early 1980s
Poorly-treated Domestic PointSources, Untreated IndustrialPoint Sources & Stormwater,Rampant Dredge & Fill Activities
Phytoplankton and Periphytondominated basins
50% loss of seagrass coveragebetween 1950 and 1980
Newspapers declared TampaBay “dead”
Poorly-treated Domestic PointSources, Untreated IndustrialPoint Sources & Stormwater,Rampant Dredge & Fill Activities
Phytoplankton and Periphytondominated basins
50% loss of seagrass coveragebetween 1950 and 1980
Newspapers declared TampaBay “dead”
Introduction of theTampa Bay Estuary Program
Introduction of theTampa Bay Estuary Program
9
• 1980s-1990s regionalefforts provided minimalBay improvements
• 1990 - Tampa Baydeclared an “Estuary ofNational Significance” byCongress
• 1991 - Unique federal-local partnership begins
• Enhanced Bay recoveryefforts ensue
TBNEP Monitoring Assessment:Available Data Sources in 1990’s
TBNEP Monitoring Assessment:Available Data Sources in 1990’s
Regulatorycompliance data
Local programambient or sitespecific
Short-term specialstudies
Pre-developmentbaseline
Regulatorycompliance data
Local programambient or sitespecific
Short-term specialstudies
Pre-developmentbaseline
TBNEP Assessment:Regional Monitoring GoalsTBNEP Assessment:Regional Monitoring Goals
Early Goals and Objectives
Establish baseline conditions
Monitoring chemical andbiological parameters
Data to establish and verify models
Measure effectiveness ofmanagement actions
Estimate long-term trends
Early Goals and Objectives
Establish baseline conditions
Monitoring chemical andbiological parameters
Data to establish and verify models
Measure effectiveness ofmanagement actions
Estimate long-term trends
to Measure the Effectivenessof Management Actions andPrograms Implemented Underthe CCMP and
to Provide Information thatcan be used to Redirect andRefocus the ManagementPlan over time.
to Measure the Effectivenessof Management Actions andPrograms Implemented Underthe CCMP and
to Provide Information thatcan be used to Redirect andRefocus the ManagementPlan over time.
Long-term Benefits
Tampa Bay Regional Objectives:Nitrogen Management StrategyTampa Bay Regional Objectives:Nitrogen Management Strategy
ReduceNitrogen
Loads
ReduceChlorophyll
IncreaseSeagrass
Cover
IncreaseWaterClarity
TBNEP Monitoring Action:Genesis of RAMP
TBNEP Monitoring Action:Genesis of RAMP
1994 - First Southwest
Florida RAMP meeting
Discussion of state andlocal monitoringprograms
Who, what, when, why!
Initial RAMP intercalibration
core parameter
evaluate field/labmethods
1994 - First Southwest
Florida RAMP meeting
Discussion of state andlocal monitoringprograms
Who, what, when, why!
Initial RAMP intercalibration
core parameter
evaluate field/labmethods
Regional Collaboration:SWF -RAMP Objectives
Regional Collaboration:SWF -RAMP Objectives
1. Establish Core Parameters (Analytes)
2. Standardize Monitoring Activities
3. Evaluate/Standardize Methodologies
4. Minimize Duplication and Economize
1. Establish Core Parameters (Analytes)
2. Standardize Monitoring Activities
3. Evaluate/Standardize Methodologies
4. Minimize Duplication and Economize
Regional Collaboration:Adopted Water Quality TargetsRegional Collaboration:Adopted Water Quality Targets
TBEP Management TargetsEstablished ~2000
RegulatoryThreshold
Adopted 2002
Bay Segment Chl-aManagementTarget (ug/L)
Kd (m-1)Management
Target
Chl-aRegulatoryThreshold
(ug/L)
Old Tampa Bay 8.5 0.83 9.3
Hillsborough Bay 13.2 1.58 15.0
Middle Tampa Bay 7.4 0.83 8.5
Lower Tampa Bay 4.6 0.63 5.1
Annual WQ Report Card AssessAnnualTN Load
ReductionEffectiveness
Agreement to “Hold the Line” on TN Loads:Preclude 17 tons/yr to offset future growth
Improving Water Quality:Improving Water Quality:
StormwaterRegulations
Enacted
TBEP Partner &NMC ActionsImplemented
Citizen Actions
Power PlantUpgrades
Port FacilityUpgrades
AWT & ReuseStandards
Implemented
Ch
loro
ph
yll
–a
(ug
/L)
SustainingSuccess:AdaptivelyManaging TB
SustainingSuccess:AdaptivelyManaging TB
•Can recovery bemaintained w/increasingpopulation?
•Expected todouble by 2050
•New Actions /Offsets will callfor SWF-RAMP &RegionalCoordination
Year1940 1950 1960 1970 1980 1990 2000 2010
Po
pu
lati
on
(milli
on
s)
0.0
0.5
1.0
1.5
2.0
2.5
3.0
Ta
mp
aB
ay
An
nu
alA
vera
ge
Ch
loro
ph
yll-a
(ug
/L)
4
6
8
10
12
14
16
18
20
Hillsborough CountyPinellas CountyManatee CountyTampa Bay Chlorophyll-a
Split SamplingandData
Comparability
Split SamplingandData
Comparability
Presented by:
Dr. David Karlen
Environmental ProtectionCommission of Hillsborough County
Presented by:
Dr. David Karlen
Environmental ProtectionCommission of Hillsborough County
PurposePurpose
Check comparability oflab and field method andequipment results
Validation of the data toensure the science issound and data isdefensible
Discuss procedures ifresults are different
Provide feedback
Check comparability oflab and field method andequipment results
Validation of the data toensure the science issound and data isdefensible
Discuss procedures ifresults are different
Provide feedback
MethodMethod
Collect common source ofwater
40 gallon trash can w/circulation pump
Alternate marine andfreshwater sources
Individual labs fill samplebottles from homogenizedsource water
Collect common source ofwater
40 gallon trash can w/circulation pump
Alternate marine andfreshwater sources
Individual labs fill samplebottles from homogenizedsource water
Samples analyzed intriplicate for internalcomparison
Identify 2x SD as apotential outlier
Averages are used tocalculate regionaldeviation and mean forcomparison
Raw data submittedby labs
Field Equipment:Semi-AnnualComparison
Field Equipment:Semi-AnnualComparison
Comparison conductedsimultaneously using splitsample water.
Ability to compare brandsand models as desired.
Outlet for industryadvancements to bepresented and discussed.
Comparison conductedsimultaneously using splitsample water.
Ability to compare brandsand models as desired.
Outlet for industryadvancements to bepresented and discussed.
Quarterly Study:Averaged data
comparison
Quarterly Study:Averaged data
comparison
Ability to depictcomparability amongdifferent methods (e.g. bothturbidity methods result incomparable outcomes)
Ability to justify analysischoices – based onregulatory, legislative, orresource managementobligations (e.g. cost savingmethods, client requests,compliance measures)
Ability to depictcomparability amongdifferent methods (e.g. bothturbidity methods result incomparable outcomes)
Ability to justify analysischoices – based onregulatory, legislative, orresource managementobligations (e.g. cost savingmethods, client requests,compliance measures)
RAMP 67April 2013
Alafia River (Estuarine)
Lab Id
1701 201 901 702 1001 1301 1501 1504 2201 1901 2004 1201 101 1
Tu
rbid
ity(N
TU
)
0
2
4
6
8
SM 2130BEPA 180.1
Long-termData
Comparability:Chlorophyll
Long-termData
Comparability:Chlorophyll
Chlorophyll was the primaryanalyte to launch SWF-RAMP activities
Chlorophyll was the primaryanalyte to launch SWF-RAMP activities
SW Florida RAMPStudies 66 -77
RAMP Study
65 66 67 68 69 70 71 72 73 74 75 76 77 78
Ch
loro
phyl
la(c
orr
ect
ed
)S
tan
da
rdS
core
-3
-2
-1
0
1
2
3
DataComparability:
Standard Scores
DataComparability:
Standard Scores
Lab Mean − Overall Mean
Overall Standard Deviation
Z >1 or <-1 exceed ±1 SD
Z>2 or <-2 exceed ±2 SD
Lab Mean − Overall Mean
Overall Standard Deviation
Z >1 or <-1 exceed ±1 SD
Z>2 or <-2 exceed ±2 SD
SW Florida RAMPStudies 66 -77
Lab Id
B F G H I K P Q R W AA AC AD AE AF AG AH AI
Ch
loro
phyl
la(c
orr
ect
ed
)S
tan
da
rdS
core
-2
-1
0
1
2
Z=
BenefitsBenefits
Collaboration and “CrowdSourcing” improves theprocess for all
Option for proactive“audits” (either field or labamong participants)
SWF-RAMP provides adedicated monitoringaudience
Valuable feedbackprovided by a variety ofparticipants on technicaland regional monitoringoptions
Collaboration and “CrowdSourcing” improves theprocess for all
Option for proactive“audits” (either field or labamong participants)
SWF-RAMP provides adedicated monitoringaudience
Valuable feedbackprovided by a variety ofparticipants on technicaland regional monitoringoptions
LaboratoryBenefits
fromSWF-RAMP
Participation
LaboratoryBenefits
fromSWF-RAMP
Participation
Presented by:Keith KibbeyLee County
Benefits to RAMP ParticipationBenefits to RAMP Participation
Justify:
Regulatory Compliance
Quality System
Management Strategy
Justify:
Regulatory Compliance
Quality System
Management Strategy
Regulatory Justification TNIRegulatory Justification TNI
Review of Requests,Tenders and Contracts
Management Reviews
Quality Assurance forEnvironmental Testing
Review of Requests,Tenders and Contracts
Management Reviews
Quality Assurance forEnvironmental Testing
RegulatoryJustification:NELAC
RegulatoryJustification:NELAC
Laboratory uses data frommeetings to comply with NELACStandard 5.5.6.2.2 for chlorophyllanalysis.
Laboratory uses data frommeetings to comply with NELACStandard 5.5.6.2.2 for chlorophyllanalysis.
“Where traceability tonational standards ofmeasurement is notapplicable, thelaboratory shall providesatisfactory evidenceof correlation of results,for example byparticipation in asuitable program ofinter-laboratorycomparisons,proficiency testing, orindependent analysis.”
“Where traceability tonational standards ofmeasurement is notapplicable, thelaboratory shall providesatisfactory evidenceof correlation of results,for example byparticipation in asuitable program ofinter-laboratorycomparisons,proficiency testing, orindependent analysis.”
RegulatoryJustification:TNI
RegulatoryJustification:TNI
Review of Requests, Tenders and Contracts(ISO/IEC 17025:2005(E), Clause 4.4)
4.4.1 The laboratory shall establish and maintainprocedures for the review of requests, tendersand contracts. The policies and procedures forthese reviews leading to a contract for testingand/or calibration shall ensure that:
Review of Requests, Tenders and Contracts(ISO/IEC 17025:2005(E), Clause 4.4)
4.4.1 The laboratory shall establish and maintainprocedures for the review of requests, tendersand contracts. The policies and procedures forthese reviews leading to a contract for testingand/or calibration shall ensure that:
NOTE 2: The review of capabilityshould establish that thelaboratory possesses thenecessary physical, personneland information resources, andthat the laboratory's personnelhave the skills and expertisenecessary for the performance ofthe tests and/or calibrations inquestion.
The review may also encompassresults of earlier participation ininter-laboratory comparisons orproficiency testing and/or therunning of trial test or calibrationprogrammes using samples oritems of known value in order todetermine uncertainties ofmeasurement, limits of detection,confidence limits, etc.
NOTE 2: The review of capabilityshould establish that thelaboratory possesses thenecessary physical, personneland information resources, andthat the laboratory's personnelhave the skills and expertisenecessary for the performance ofthe tests and/or calibrations inquestion.
The review may also encompassresults of earlier participation ininter-laboratory comparisons orproficiency testing and/or therunning of trial test or calibrationprogrammes using samples oritems of known value in order todetermine uncertainties ofmeasurement, limits of detection,confidence limits, etc.
RegulatoryJustification:TNI
RegulatoryJustification:TNI
4.15 Management Reviews (ISO/IEC17025:2005(E), Clause 4.15)
4.15.1 In accordance with a predeterminedschedule and procedure, the laboratory's topmanagement shall periodically conduct areview of the laboratory's managementsystem and testing and/or calibrationactivities to ensure their continuing suitabilityand effectiveness, and to introducenecessary changes or improvements.
4.15 Management Reviews (ISO/IEC17025:2005(E), Clause 4.15)
4.15.1 In accordance with a predeterminedschedule and procedure, the laboratory's topmanagement shall periodically conduct areview of the laboratory's managementsystem and testing and/or calibrationactivities to ensure their continuing suitabilityand effectiveness, and to introducenecessary changes or improvements.
The review shall take accountof:
the suitability ofpolicies andprocedures;
reports frommanagerial andsupervisory personnel;
the outcome ofrecent internal audits;
corrective andpreventive actions;
assessments byexternal bodies;
the results ofinterlaboratorycomparisons orproficiency tests;
The review shall take accountof:
the suitability ofpolicies andprocedures;
reports frommanagerial andsupervisory personnel;
the outcome ofrecent internal audits;
corrective andpreventive actions;
assessments byexternal bodies;
the results ofinterlaboratorycomparisons orproficiency tests;
RegulatoryJustification:TNI
RegulatoryJustification:TNI
5.9 Quality Assurance for EnvironmentalTesting (ISO/IEC 17025:2005(E), Clause 5.9)
5.9.1 The laboratory shall have quality controlprocedures for monitoring the validity of testsand calibrations undertaken. The resultingdata shall be recorded in such a way thattrends are detectable and, wherepracticable, statistical techniques shall beapplied to the reviewing of the results.
5.9 Quality Assurance for EnvironmentalTesting (ISO/IEC 17025:2005(E), Clause 5.9)
5.9.1 The laboratory shall have quality controlprocedures for monitoring the validity of testsand calibrations undertaken. The resultingdata shall be recorded in such a way thattrends are detectable and, wherepracticable, statistical techniques shall beapplied to the reviewing of the results.
This monitoring shall be plannedand reviewed and may include,but not be limited to, thefollowing:
regular use of certifiedreference materials and/orinternal quality controlusing secondary referencematerials;
participation in inter-laboratory comparison orproficiency-testingprogrammes;
replicate tests orcalibrations using the sameor different methods;
retesting or recalibration ofretained items;
correlation of results fordifferent characteristics ofan item.
NOTE: The selected methodsshould be appropriate for thetype and volume of the workundertaken.
This monitoring shall be plannedand reviewed and may include,but not be limited to, thefollowing:
regular use of certifiedreference materials and/orinternal quality controlusing secondary referencematerials;
participation in inter-laboratory comparison orproficiency-testingprogrammes;
replicate tests orcalibrations using the sameor different methods;
retesting or recalibration ofretained items;
correlation of results fordifferent characteristics ofan item.
NOTE: The selected methodsshould be appropriate for thetype and volume of the workundertaken.
Quality System JustificationQuality System Justification
Audits are mostly a paperand procedural look at alaboratory, RAMP isoutcome based.
Makes data moredefensible.
Voice and clout when wespeak as a group.
Real sample matrix.
The TNI ISO 17025laboratory standard isbuilt upon a philosophy ofContinuous improvement.
Audits are mostly a paperand procedural look at alaboratory, RAMP isoutcome based.
Makes data moredefensible.
Voice and clout when wespeak as a group.
Real sample matrix.
The TNI ISO 17025laboratory standard isbuilt upon a philosophy ofContinuous improvement.
Quality SystemJustificationQuality SystemJustification
Florida EnvironmentalLaboratory Quality System(FELQS)
Florida EnvironmentalLaboratory Quality System(FELQS)
A network ofenvironmental testinglaboratories throughoutsouthern Florida.
Private labs, county &city labs, utilities labsand watermanagement districtlabs meet quarterly.
All, or most, areNELAC/TNI certified andtherefore sharecommon concerns withregard to meeting themandates of theNELAC/TNI Standard.
Several members participateon TNI Expert Committees
A network ofenvironmental testinglaboratories throughoutsouthern Florida.
Private labs, county &city labs, utilities labsand watermanagement districtlabs meet quarterly.
All, or most, areNELAC/TNI certified andtherefore sharecommon concerns withregard to meeting themandates of theNELAC/TNI Standard.
Several members participateon TNI Expert Committees
Management JustificationsManagement Justifications
Watersheds do not always follow geopolitical boundaries.
Funds saved by ideas from the group
Equipment selection
Process changes
Makes data more defensible.
Private labs joined due to contractual requirements, then learnedto use a as bragging rights and a sales tool.
Voice and clout when we speak as a group.
The more people or agencies using you data make it morevaluable. Valuable programs are less likely to be reduced oreliminated.
Provides a model for other collaborative efforts
Watersheds do not always follow geopolitical boundaries.
Funds saved by ideas from the group
Equipment selection
Process changes
Makes data more defensible.
Private labs joined due to contractual requirements, then learnedto use a as bragging rights and a sales tool.
Voice and clout when we speak as a group.
The more people or agencies using you data make it morevaluable. Valuable programs are less likely to be reduced oreliminated.
Provides a model for other collaborative efforts
Cost to LaboratoryCost to Laboratory
Staff time to attend
4 to 8 days/year
Lab time to processsamples
Return on investment
Credibility
Better Data
Collaborative groupfor other efforts
Priceless
Staff time to attend
4 to 8 days/year
Lab time to processsamples
Return on investment
Credibility
Better Data
Collaborative groupfor other efforts
Priceless
Advocating& Achievinga RegionalProgram
Advocating& Achievinga RegionalProgram
Presented by:
Natasha Dickrell
Pinellas County
Presented by:
Natasha Dickrell
Pinellas County
Why is voluntary collaborationfor monitoring so attractive?
Why is voluntary collaborationfor monitoring so attractive?
“If you don’t know whereyou’re going, you’llprobably end up
somewhere else and spenda lot of money getting
there.”
Why does SWF-RAMPwork?
KnowledgeFrameworkKnowledgeFramework
Saliency
Credibility
Legitimacy
Saliency
Credibility
Legitimacy
Enduring FrameworkEnduring Framework
SALIENCY: SWF-RAMP answers questions by proactively identifing regional data
comparability objectives and considering regional management impacts.
CREDIBILITY: SWF-RAMP succeeds through information sharing in a suggestive forum that
addresses issues and recommends solutions to build trust and promote partnerships.
LEGITIMACY: SWF-RAMP supports the efforts and quality of every program.
Investigating data comparability is highly recommended for monitoring programs which havelocal, State, or Federal management, assessment, and/or regulatory obligations.
SALIENCY: SWF-RAMP answers questions by proactively identifing regional data
comparability objectives and considering regional management impacts.
CREDIBILITY: SWF-RAMP succeeds through information sharing in a suggestive forum that
addresses issues and recommends solutions to build trust and promote partnerships.
LEGITIMACY: SWF-RAMP supports the efforts and quality of every program.
Investigating data comparability is highly recommended for monitoring programs which havelocal, State, or Federal management, assessment, and/or regulatory obligations.
SWF- RAMP relies on participation and achieves continued successbecause data acquired through monitoring supports the decision-
making framework for Federal, State, and local regions.
Saliency: Answering QuestionsSaliency: Answering Questions
1. Evolved from answeringquestions to askingquestions!
2. Expanded regionalinvolvement (upon request)to include freshwater andgroundwater systems.
3. Science, legislation,technology, and funding allchange and the programevolves based on thecurrent decision-making.
1. Evolved from answeringquestions to askingquestions!
2. Expanded regionalinvolvement (upon request)to include freshwater andgroundwater systems.
3. Science, legislation,technology, and funding allchange and the programevolves based on thecurrent decision-making.
Incomparable results mayprovide more questions thananswers…but
“…leads to the best science!”Judy Ott
Charlotte Harbor NEP
The program answers questionsthrough discussion and
assessment using split sampleresults to support credibility.
Saliency Challenges: Data ComparabilitySaliency Challenges: Data Comparability
1. Individual definition for what is good for business.
2. Work to overcome apprehension about puttingprocedures and process under scrutiny.
“Over time you see the needfor anonymity dissolvebecause the benefits ofimproved comparability arepowerful.”
-Matt JablonskiSWF-RAMP Co-chair (SWFWMD)
Credible Practice: Eliminating UncertaintyCredible Practice: Eliminating Uncertainty
SWF-RAMP maintains asuggestive environment.
Individual programs continueto determine their ownpractices based on currentstandards and guidelines.
Program is primarily a tool forinternal management purposes.
Credible Sources: Ensuring TrustCredible Sources: Ensuring Trust
“You’re not alone.”-Kerry Harkinson
Manatee CountyRepresentative
Supports the call forregional participationin State and Federal
decision-making.
“We can handle thisregionally.”
Contrary, if a regioncan’t coordinate avoluntary program
then mandates will beseen as the necessity!
“Street” Credibility: Building Trust“Street” Credibility: Building Trust
How does your organization,firm, or company’s vision align?
Do your results comparein your region?
“…but we pass our audits!”
“We follow the method andSOPs and we are right!”
“If our data is a potentialoutlier how is that going to
look?”
Existing Legitimacy: ChallengesExisting Legitimacy: Challenges
Does your work benefityour monitoring region?
Overcoming Challenges
Determining Consensus
Implementing Solutions
Justifying Actions
Expanded LegitimacyExpanded Legitimacy
INSPIRE Activities(by overcoming challenges)
SUPPORT Initiatives(by determining consensus)
DEVELOP Solutions(through communicating concerns)
SHARE Success
(to justify actions)
Legitimate Activities
Regionally, we have benefited bymeeting increasing programrequirements with voluntary
collaboration and coordination!
Specific Examples Include:
Regulatory Compliance (NPDES)
Equipment & Method Selection
Academic Partnerships
Regionally, we have benefited bymeeting increasing programrequirements with voluntary
collaboration and coordination!
Specific Examples Include:
Regulatory Compliance (NPDES)
Equipment & Method Selection
Academic Partnerships
Legitimate Long-term Benefits