operational experience metrics task team

Operational Experience Metrics Task Team

August 7, 2009

2 U.S. Department of Energy

Operational Experience Metrics Task Team

Goals:

• Identify key performance indicators (metrics) that can demonstrate effectiveness of Operating Experience/Lessons Learned Programs

• Determine what organizational culture approaches might assist in establishing a “learning” organization.

• Determine usefulness across sites

3 U.S. Department of Energy

Recommended Metrics

Effective OE Program

Feedback/Utilization

Timeliness

LL SearchesPreventable Events

OE/LL Origins

Success Stories/Continuous

Improvements

4 U.S. Department of Energy

5 U.S. Department of Energy

Feedback / Utilization (cont.)

6 U.S. Department of Energy

Feedback / Utilization (cont.)

Other Applications

To supplement work planning and work control plans

To supplement pre-job briefs and/or safety reviews

To prevent reoccurence of an adverse event

To promote good work practices

To share with staff

0 10 20 30 40 50 60 70

Adopting Lessons Learned into ORNL Work Activities

Qtr. 1 Qtr. 2 Qtr. 3

7 U.S. Department of Energy

Feedback / Utilization (cont.)

8 U.S. Department of Energy

Feedback / Utilization (cont.)

9 U.S. Department of Energy

.

OE/LL incorporated into a work process or research with documented evidence of continuous improvements

.

Success Stories / Continuous Improvements

10 U.S. Department of Energy

SANDIA DAILY NEWSfor Tuesday, June 9, 2009

ES&H Lesson Learned applied: The Sandia ES&H Lessons Learned program really works. The Lessons Learned program recently sent a notice on a lesson learned concerning a severe employee injury potential related to a truck hydraulic lift-gate “pinch point.”  After reviewing the lessons learned, the ES&H Safety Engineering organization forwarded it to Jane Doe (Fleet services), who took immediate action. Fleet Services notified all Sandia users of trucks with lift gates and asked that they be brought in for immediate inspection and repair.  To date, Fleet Services has found this issue on two lift gates. The brackets were removed, which eliminated the pinch points making these lift gates safer to use.

11 U.S. Department of Energy

January 2009• An ORNL Heavy Equipment

Maintenance Supervisor reviews a Brookhaven National Lab LL titled “Inspect E-Ride Vehicles for Maintenance Defects” and immediately contacts the manufacturer. Both the supervisor, procurement, and LL Coordinator work in tangent to identify all E-ride vehicles on the ORNL campus. The Supervisor contacts all ORNL vehicle owners and schedules in-house maintenance to correct the defect. All four vehicles repaired by February 2009.

Success Story

12 U.S. Department of Energy

295

76

1838

746055

867776

143

300 306 296

241 235 264 250

0

50

100

150

200

250

300

350

FY 2001 FY 2002 FY 2003 FY 2004 FY 2005 FY 2006 FY 2007 FY 2008 FY 2009*

Data from DOE Complex Issued Lessons Learned

(*10/ 01/ 08 - 03/ 31/ 08)

BJC Lessons Learned DOE Complex Lessons Learned

Success Story / Continuous Improvements

BJC has successfully shared Operating Experiences and Lessons Learned with the DOE Complex for over a

decade. In the past 8 years, BJC has annually contributed an average of 25% of the lessons in the DOE LL Program.

13 U.S. Department of Energy

Lessons Learned and Operational Experiences

14 U.S. Department of Energy

Origins

OE/LL sources

including significant

day-to-day operating

experiences

15 U.S. Department of Energy

Operating Experience “Origins”

Lessons Learned Safety Flash

10

9

8

31

3

11

Occurrence Report Daily Operational Experience

Assessment External Source

Management System Observation Emergency Management Drill

Trending Other

16 U.S. Department of Energy

Operating Experience “Origins”

17 U.S. Department of Energy

Timeliness

• LL feedback received within a site specific time period

• LL from internal events issued within site specific time period

• Subject Matter Expert (SME) review of LL or external events for applicability

• LL corrective actions completed timely

18 U.S. Department of Energy

SME Feedback Timeliness

19 U.S. Department of Energy

Preventable Events

Occurrence Reports

Lessons Learned

Trending

Corrective Action Tracking

20 U.S. Department of Energy

Lesson Learned Searches

• LL CoordinatorSearches

• LL Webpage Hits

21 U.S. Department of Energy

Learning Organizations OverallProgram Performance

22 U.S. Department of Energy

Lessons Learned Effectiveness Performance Indicators

23 U.S. Department of Energy

Questions