Evolution of Peer Reviewat EPAJeff MorrisAssociate Director for ScienceOffice of Science PolicySymposium on Peer Reviewof Risk Assessments and Related ActivitiesSeptember 30, 2003

Scientific Peer Review1995112 work products identified2002859 work products identified750 identified as needing peer review91% identified for external peer review

Dr. Matanowski of JHU, I think EPA has taken massive steps to improve their peer review, and the Science Advisory Board is not the only placefrom what we have looked at in the EPA, they have done an extremely good job getting almost everything that they look at now peer reviewed. (House Science Committee April 2002)

More Scientists and Engineers in EPAs Decision Process

Prog Sup Chart

4

8.5

15.5

&R&D

# of FTEs

Change in # of FTEs - Program Support

Prog Supp Data

November 2000April 2001February 2003

48.515.5

Total FTEs Chart

8.515.5

168319

&R&D

2001

2003

# of FTEs

Total Change in # of FTEs Engaged in Regulatory Process

Total FTEs Data

HeadquartersLab/Centers

20018.5168

200315.5319

Peer Review Is a Cornerstoneof EPAs Information Quality GuidelinesInfluential InformationDisseminated in support of top Agency actions (including precedent-setting or controversial scientific or economic issues)Disseminated in support of economically significant actionsMajor work products undergoing peer review as called for under the Agencys Peer Review PolicyOther information on a case-by-case basis

Products Subject to Peer Review: OMB Proposal and EPAs PolicyOMBs ProposalSignificant Regulatory Information Influential under OMB IQG and is relevant to regulatory policies.Internal or external peer reviewEspecially Significant Regulatory Information Support of a major regulatory actionClear and substantial impact on important public policies or important private sector decisions with a possible impact of more than $100 million in any year,OMB determines to be of significant interagency interest or relevant to an Administration policy priority.Formal, independent external peer review.

EPAs GuidanceScientific and technical work products used to support a regulatory program or policy position, and one or more of the following:Establishes a significant precedent, model, or methodologyAddresses significant controversial issuesFocuses on significant emerging issuesHas significant cross-Agency/inter-agency implicationsInvolves a significant investment of Agency resourcesConsiders an innovative approach for a previously defined problem/process/methodologySatisfies a statutory or other legal mandate for peer review

To Summarize

In the past three years:The number of EPA peer reviews has increased significantlyAgency decisions receive greater scrutiny for peer review needsPeer review linked to information qualityOMB proposal consistent with EPAs current peer review policy

OMB: Mechanism (internal v. external) tied to $100 million threshold. EPA looks at a variety of factors, including economic significance.