pod (probability of detection) evaluation of ndt ...pod evaluation was carried out by bam in a joint...

22
POD (Probability of Detection) Evaluation of NDT Techniques for Cu-Canisters for Risk Assessment of Nuclear Waste Encapsulation Christina MÜLLER, Mstislav ELAGUINE, Carsten BELLON, Uwe EWERT, Uwe ZSCHERPEL, Martina SCHARMACH, Bernhard REDMER, BAM - Federal Institute for Materials Research and Testing, Berlin, Germany, Hakan RYDEN, Ulf RONNETEG, SKB – Svensk Kärnbränslehantering AB; Oskarshamn; Sweden Abstract. In order to handle long living radioactive waste Sweden is planning to build a deep repository that requires no monitoring by future generations. The spent nuclear fuel will be encapsulated in copper canisters consisting of a graphite cast iron insert shielded by an outer 30-50 mm thick copper cylinder for corrosion and radiation protection. The cast iron insert provides the necessary strength and shielding of radiation. The critical part of the encapsulation of spent fuel is the sealing of the canister which is done by welding the copper lid to the cylindrical part of the canister. Two welding techniques have been developed in parallel at the canister lab in Oskarshamn, Electron Beam Welding (EBW) and Friction Stir Welding (FSW). Mid 2005 SKB decided that FSW is the preferred sealing technique. A subpart of the final risk assessment for the deep repository is to determine the risk of premature canister leak caused by discontinuities in the insert, in the sealing weld or elsewhere in the copper shielding. Therefore the quality of the production processes and the reliability of the NDT system must be satisfactorily determined and combined to derive assumptions regarding the frequency of undetected production discontinuities in relation to the acceptance criteria for the ensemble of canisters. The reliability of the NDT systems can be derived from POD curves which are investigated for X-ray and ultrasonic techniques applied by SKB. The POD evaluation was carried out by BAM in a joint project for SKB and is evaluated within the common “â versus a” approach according to the MIL1823 and some extensions due to the more complex flaw situations in the canisters compared to the original aerospace applications. 1 The Swedish Deposit Project Figure 1: Svensk Kärnbränslehantering AB (SKB, Swedish Nuclear Fuel and Waste Management Co) is responsible for the final disposal of spent nuclear fuel in Sweden. ECNDT 2006 - Fr.2.5.1 1

Upload: others

Post on 27-Apr-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

POD (Probability of Detection) Evaluation of NDT Techniques for Cu-Canisters for Risk

Assessment of Nuclear Waste Encapsulation

Christina MÜLLER, Mstislav ELAGUINE, Carsten BELLON, Uwe EWERT, Uwe ZSCHERPEL, Martina SCHARMACH, Bernhard REDMER,

BAM - Federal Institute for Materials Research and Testing, Berlin, Germany, Hakan RYDEN, Ulf RONNETEG,

SKB – Svensk Kärnbränslehantering AB; Oskarshamn; Sweden

Abstract. In order to handle long living radioactive waste Sweden is planning to build a deep repository that requires no monitoring by future generations. The spent nuclear fuel will be encapsulated in copper canisters consisting of a graphite cast iron insert shielded by an outer 30-50 mm thick copper cylinder for corrosion and radiation protection. The cast iron insert provides the necessary strength and shielding of radiation. The critical part of the encapsulation of spent fuel is the sealing of the canister which is done by welding the copper lid to the cylindrical part of the canister. Two welding techniques have been developed in parallel at the canister lab in Oskarshamn, Electron Beam Welding (EBW) and Friction Stir Welding (FSW). Mid 2005 SKB decided that FSW is the preferred sealing technique. A subpart of the final risk assessment for the deep repository is to determine the risk of premature canister leak caused by discontinuities in the insert, in the sealing weld or elsewhere in the copper shielding. Therefore the quality of the production processes and the reliability of the NDT system must be satisfactorily determined and combined to derive assumptions regarding the frequency of undetected production discontinuities in relation to the acceptance criteria for the ensemble of canisters. The reliability of the NDT systems can be derived from POD curves which are investigated for X-ray and ultrasonic techniques applied by SKB. The POD evaluation was carried out by BAM in a joint project for SKB and is evaluated within the common “â versus a” approach according to the MIL1823 and some extensions due to the more complex flaw situations in the canisters compared to the original aerospace applications.

1 The Swedish Deposit Project

Figure 1: Svensk Kärnbränslehantering AB (SKB, Swedish Nuclear Fuel and Waste Management Co) is responsible for the final disposal of spent nuclear fuel in Sweden.

ECNDT 2006 - Fr.2.5.1

1

Page 2: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

Svensk Kärnbränslehantering AB (SKB, Swedish Nuclear Fuel and Waste Management Co) is responsible for the final disposal of spent nuclear fuel in Sweden.

Figure 2: The canisters will then be deposited in the bedrock, embedded in bentonite clay, at a depth of 500 meters.

In order to handle the long living radioactive waste (spent nuclear fuel) SKB is planning to build a deep repository that requires no monitoring by future generations. The spent nuclear fuel will be encapsulated in copper canisters consisting of a graphite cast iron insert. The KBS-3 system is based on a multi barrier system where the canister is the primary barrier. The cast iron insert gives the canister the necessary strength and the outer shell that gives corrosion protection is made of oxygen free copper. SKB’s efforts are based on a stepwise program for the implementation of deep geological disposal of spent fuel including concurrent activities in the areas of deep repository- and encapsulation technology. Major milestones in the program are application for construction and building of an encapsulation plant in 2006 and a deep repository in 2008. According to the program initial operation for the system will start in 2017. The most critical part of the encapsulation process is the sealing of the canister, which is done by welding the copper lid to the cylindrical part of the copper shell. The canisters will then be deposited in the bedrock, embedded in bentonite clay, at a depth of 500 meters.

Figure 3: Outfit of the Copper Canister

The safety and reliability of the whole systems i.e. the well sealed deposit of the radioactive material under all possible influencing scenarios will be guaranteed by modern means of risk assessment and management.

2 Weldings and risk assessment

The welding techniques studied are electron beam welding (EBW) and friction stir welding (FSW). Both techniques are developed in parallel at the SKB Canister Laboratory

2

Page 3: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

(see Figure 1) in Oskarshamn (Sweden) [1]. According to the different metallurgical welding processes they reveal a quite different variety of discontinuitys to be detected by NDT techniques and different material micro-structure.

a: Principle of the electron beam welding b: Principle of the friction stir welding

Figure 4: Principe of the Electron beam welding and Stir friction welding

A subpart of the final risk assessment of the deep repository construction is to determine the risk of premature canister leak caused by discontinuities in the sealing weld. The discontinuities occurring during the production welding process create a diminishing of the wall thickness. The possible additional reduction of the wall thickness by ground water corrosion makes a minimum rest wall thickness of 15 mm copper necessary. A consequence for the applied NDT methods is to detect all critical discontinuities which would reduce the wall thickness to an amount near or below the 15 mm with a validated high reliability the value of which needs to be known for the further risk assessment.

Figure 5: The weld with possible discontinuity configurations

The NDT techniques applied and adapted by SKB are high energy (9 MeV) X-ray-technique and mechanized ultrasonic phased array technique (2…5 MHz) according to the material structure [1]. Since the materials structures and connected possible discontinuity scenarios created by the welding techniques are different the development of NDT techniques and reliability measurement has also been tailored to the particular welding methods – e.g. higher frequencies for UT were possible for FSW. Mid 2005 SKB decided that FSW is the preferred sealing technique.

3

Page 4: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

a: Radiographic testing b: Mechanized ultrasonic testing with phased

array technique

Figure 6: Non-destructive testing methods used in the project.

The BAM was providing its expertise in optimizing non-destructive testing to a

certain extent and the corresponding reliability assessment to the project during 2004-2005. The applied non-destructive testing methods are in a first step checked and optimized concerning the physical parameters and set up according to the latest European and American standards. For the detailed optimization of the radiographic technique the BAM “X-ray” simulation tool [2] is applied to various parameter options thus saving lots of expensive experiments. BAM UT-simulation was used to understand the UT-signal response from special discontinuities types better as input for the POD. [3]

3 Reliability Assessment using POD

Steered by the plan of experiments for the welding procedure optimization and verification, the POD (Probability of Detection) for the discontinuities is determined using a systematic statistical methodology. The POD method, where the detection probability is determined as a function of discontinuity size, was originally developed for the US military aerospace sector [4] for 1-dimensional signals. For the more complex 3-dimensional discontinuity situation in the canister welds and 2-dimensional data fields the method needs to be developed further. From the POD curve and its lower confidence bound the discontinuity size is derived that will be detected with sufficient reliability and compared to the demand for integrity. This procedure includes a series of experiments with the SKB X-ray and ultrasonic methods foreseen for the production.

4

Page 5: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

(a) SKB UT-scan(JLH+wormhole)

(b) SKB-RT scan(wormhole)

(c) CT of wormholes

(d) Wormhole cross section FSW5-136

Figure 7: Example: Weld FSW5 Section 136°

These results have to be compared to true discontinuity configurations in the welds.

To determine these “true discontinuity configurations” the welds have to be tested destructively or tested with a more comprehensive non-destructive reference method. To save the parts and the effort for the destruction, the BAM selected a high energy computed tomography (HECT, or CT) method as reference completed by focussed ultrasonic transmission measurement. Finally all reference measurements were verified or corrected by destructive tests. Figure 7 shows all the results for a wormhole in weld No. FSW 5 at 136° position. IN figure part a) a JLH is seen in addition (green color).

5

Page 6: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

For automated thresholding systems a forecast of the POD is possible from the statistics of the response signals

a â POD

defect size signal magnitude probability of detection

experiments or modelling

calculations withlog-normal-distribution

(or other statistical model)

response

typical POD

POD

a

100 %

log a

log â

linear or more general relationship

For automated thresholding systems a forecast of the POD is possible from the statistics of the response signals

a â POD

defect size signal magnitude probability of detection

experiments or modelling

calculations withlog-normal-distribution

(or other statistical model)

response

typical POD

POD

a

100 %

log a

log â

linear or more general relationship

For automated thresholding systems a forecast of the POD is possible from the statistics of the response signals

a â POD

defect size signal magnitude probability of detection

experiments or modelling

calculations withlog-normal-distribution

(or other statistical model)

response

typical POD

POD

a

100 %

log a

log â POD

a

100 %

log a

log â

linear or more general relationship

Figure 8: Quantify the risk: „â versus a“

The basic principle of the signal response analysis or “â versus a” evaluation is shown in Figure 8. A discontinuity of size a (crack depth in Figure 8) is causing a signal of height â. The statistical distribution of the signals in dependence of the discontinuity size yields a certain POD curve which is described in more exact terms in the following section.

3.1 â versus. a analysis

3.1.1 General description [2]

Consider a quantitative NDT system. As a result of the investigation of a discontinuity having size , it generates a signal . If the signal exceeds a certain decision threshold , the system registers a flaw detection. As the NDT system is influenced by uncontrolled factors, discontinuities of the same size can cause signals of different strength. For this reason the strength of the signal to the discontinuity of size is considered as a random value and associated with a probability density . The relation between and can be expressed as follows:

(1)

Here equals the mean value of and is the random error whose distribution determines the probability density .

In practice, it is often assumed that is distributed normally with zero mean and constant (independent of ) variance. is then the normal density function with mean

and variance equal to that of . The probability of detection (POD) as function of the size of the discontinuity is:

(2)

Figure 9 illustrates this formula. The probability of detection is represented as hatched part of the area under the bell curve.

6

Page 7: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

Discontinuity size, a

Sign

al,a

Decision threshold, adec

a1

POD(a1)

a2

POD(a2)

ga1(a)

ga2(a)

Figure 9: Probability of detection

3.1.2 Calculation of the POD

Source data are and – arrays of length that contain sizes of the discontinuities and response magnitudes, respectively, and the decision threshold . Note that the theory for dealing with censored data has been developed (see [5]) but is not used here, because the data sets available to us do no contain censored data. The censored data are the signals that cannot be registered by the system because they are either under the recording threshold or above the saturation threshold.

3.1.3 Calculation of the POD function parameters

The following formula is commonly used to model the relation between and :

(3)

Here is normally distributed with zero mean and constant variance . Under the assumptions of the model, the POD function has the following form:

(4)

where is the standard normal distribution function, and

(5)

(6)

7

Page 8: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

The parameters , and describe the linear dependency of on and have the following meaning:

Intercept Slope Standard deviation of the residuals

Their values are estimated from the arrays and using the method of maximum likelihood.

3.1.4 The 95% lower confidence POD

The 95% lower confidence bound is given by the following formula:

(7)

where lnˆ az μσ

−= and the variable reflects the sample size and the scatter of the source

data. The calculation of is thoroughly described in [5]. This general formalism has now to be applied to the discontinuity detection problem within the scope of welding optimization and risk assessment.

3.2 POD - The Original Task (full programs)

The original task (together with the welding optimization) is to make sure that only one of 1000 canisters might contain a critical discontinuity situation where in total more or equal 35 mm of the Cu-wall is missing.

From the naturally real existing POD as a function of all possible influencing parameters we have to extract the POD as function of the flaw radial dimension by a dedicated „Plan of Experiments“ and reasonable mean value operations (see Formula 1). The full program is only feasible with a number of additional experiments. But in order to learn where we are with our current NDT technique and where to optimize, we need a POD assessment of the state of the art using an “Adapted POD Assessment”.

1 radialPOD ( ,..., ) POD ( )nf a a g a= → = (8)

Formula 1: Extraction of the POD as a function of the radial size.

3.3 „Adapted POD Assessment“

Volumetric flaws and area-like (non-volumetric) flaws will be treated separately – for EB as well as for FSW

• Volumetric flaws RT • area like flaws UT

The physically reasonable „â versus a“ PODs are applied to the parameter configurations shown on 13.

8

Page 9: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

Figure 10: Input parameters to the POD

We determine the a90/95 magnitudes i.e. the size a of the flaw for which the lower 95% confidence bound crosses the 90% POD level i.e. it is guaranteed that flaws with a size of a90/95 will be detected with 90% probability where only 5% might fall outside this confidence limit in case the experiment is repeated. We work with the assumption – given by the manufacturing experts -- that only one of 100 canisters might have a critical flaw. Then the above argumentation yields: Only each of 1000 canisters might have a leakage.

3.4 Integrity Requirement

The flaw radial size has to be limited so that a remaining wall thickness of 15 mm is guaranteed against ground water corrosion. The maximum allowed flaw size in the radial direction is 35 mm. Together with the above POD an additional flaw geometry statistics has to provide for the four groups

• FSW volumetric area-like • EB volumetric area-like

separately, no flaws of ar ≥ 35 mm will be present. No flaw of radial size ar ≥ 35 mm can be among the flaw assembly below a90/95, that means no a ≤ a90/95 should have at the same time an ar ≥ 35 mm. This would yield a reasonable justification of the system to meet the above integrity requirement, as long as the existing flaw configurations are representative for the welds. Look for the “correlation” in the scatter diagrams:

• penetrated flaw length by X-ray radial dimension • area perpendicular to UT beam radial dimension

3.5 Results

In the following diagrams we illustrate the results for several examples of flaws for EBW and FSW detected by X-rays (RT) and ultrasound (UT).

3.5.1 Results for Electron Beam Welding (EBW)

Figure 11 shows the basic “â versus a” logarithmic diagram for the radiographic maximum contrast as a function the discontinuity size penetrated by the X-rays. The dependence is quite linear but shows a considerable scatter. The original values are shown in the diagram on the upper side. The lower diagram shows the values without outliers. This version is more reasonable because the discontinuities behind the outliers were created with perturbations to the welding process far outside the normal parameter window.

The corresponding probability of detection and its lower confidence bound (Figure 12) yield an a90/95 value of about 2 mm for the penetrated size (2.3 with outliers and 1.9 without). Now we have to make sure the corresponding radial dimension will not exceed the critical size for all penetrated sizes below a90/95.

Figure 13 shows the discontinuity size statistics, where the penetrated sizes are plotted against the radial dimensions for all observed volumetric discontinuities for the EBW. The critical region is the red hatched area, where discontinuities with critical radial dimensions above the critical size would occur belonging to sizes a below a90/95. As seen in

9

Page 10: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

Figure 13, the real discontinuity configurations are far away from this. The radial discontinuity dimension ar belonging to a90/95 is about 3.6 mm. For an exact determination of the corresponding radial dimension a complete geometrical model for the discontinuities shape would be necessary. The data points were too few for this. That is why we turned to an empirical assessment: The value ar is taken as the maximum radial size between the discontinuities with the area/penetrated length less than a90/95 plus 1 mm. The 1 mm is for the uncertainty in the radial dimension from destructive testing/reference methods.

Saturation threshold = 4333Detection threshold = 250

010

0020

0030

0040

0050

00

0 2 4 6 8 10 12

Penetrated size (BAM-CT) [mm]

Con

tras

t(SK

B-R

T)

Saturation threshold = 4333Detection threshold = 250

010

0020

0030

0040

0050

000

1000

2000

3000

4000

5000

0 2 4 6 8 10 120 2 4 6 8 10 12

Penetrated size (BAM-CT) [mm]

Con

tras

t(SK

B-R

T)

with-outliers

0 2 4 6 8 10 12

010

0020

0030

0040

0050

00

Penetrated size (BAM-CT) [mm]

Con

tras

t(SK

B-R

T)

Saturation threshold = 2517Detection threshold = 250

0 2 4 6 8 10 120 2 4 6 8 10 12

010

0020

0030

0040

0050

000

1000

2000

3000

4000

5000

Penetrated size (BAM-CT) [mm]

Con

tras

t(SK

B-R

T)

Saturation threshold = 2517Detection threshold = 250

no-outliers

Figure 11: L025 RT scatter diagram

10

Page 11: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

0 1 2 3 4

0.0

0.2

0.4

0.6

0.8

1.0

Penetrated size (BAM-CT) [mm]

POD

PODlower 95% conf. bound

POD = 0.9

a 90/

95=

2.26

0 1 2 3 40 1 2 3 4

0.0

0.2

0.4

0.6

0.8

1.0

0.0

0.2

0.4

0.6

0.8

1.0

Penetrated size (BAM-CT) [mm]

POD

PODlower 95% conf. bound

POD = 0.9

a 90/

95=

2.26

with-outliers

0 1 2 3 4

0.0

0.2

0.4

0.6

0.8

1.0

Penetrated size (BAM-CT) [mm]

POD

PODlower 95% conf. bound

POD = 0.9

a 90/

95=

1.91

0 1 2 3 40 1 2 3 4

0.0

0.2

0.4

0.6

0.8

1.0

0.0

0.2

0.4

0.6

0.8

1.0

Penetrated size (BAM-CT) [mm]

POD

PODlower 95% conf. bound

POD = 0.9

a 90/

95=

1.91

no-outliers

Figure 12: L025 RT POD

11

Page 12: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

0 10 20 30 40 50 60

02

46

810

12

Radial size (BAM−CT), mm

Pen

etra

ted

size

(B

AM

−C

T),

mm

a90 95 = 2.26

criti

cal s

ize

=35

a r=

3.61

with-outliers

0 10 20 30 40 50 60

02

46

810

12

Radial size (BAM−CT), mm

Pen

etra

ted

size

(B

AM

−C

T),

mm

a90 95 = 1.91

criti

cal s

ize

=35

a r=

3.61

no-outliers

Figure 13: L025 RT critical region

The Figure 14 to Figure 16 show the same types of diagrams (as presented in

Figure 11 to Figure 13 for RT) for the UT- investigation of area like discontinuities for EBW. The â is the ultrasonic echo height and a is the reflecting area of the discontinuity. The scatter of signals is wider and the a90/95 is larger. When the area is plotted in a logarithmic scale the “â versus a” looks quite linear even when the bigger flaws of the right hand side are taken into account which are not so typical for the EBW process. As seen in Figure 16, again all observed discontinuities are far away from the critical region.

12

Page 13: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

0 200 400 600 800 1000 1200

5010

015

020

0

Area, mm²

Am

plitu

de (S

KB

), %

Decision threshold = 12

0 200 400 600 800 1000 12000 200 400 600 800 1000 1200

5010

015

020

050

100

150

200

Area, mm²

Am

plitu

de (S

KB

), %

Decision threshold = 12

Figure 14: L025 UT scatter diagram

0 5 10 15 20 25 30

0.0

0.2

0.4

0.6

0.8

1.0

Area, mm²

POD

POD = 0.9

a 90/

95=

20.4

5

0 5 10 15 20 25 300 5 10 15 20 25 30

0.0

0.2

0.4

0.6

0.8

1.0

0.0

0.2

0.4

0.6

0.8

1.0

Area, mm²

POD

POD = 0.9

a 90/

95=

20.4

5

Figure 15: L025 UT POD

13

Page 14: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

0 10 20 30 40 50 60

020

040

060

080

010

0012

00

Radial size, mm

Are

a, m

m^2

a90 95 = 20.45

criti

cal s

ize

=35

a r=

7

Figure 16: L025 UT critical region

These results should be taken as a rough confirmation that the SKB NDT system is

able to detect the volumetric discontinuities with X-ray technique and the area like discontinuities with UT phased array technique with high probability already far below all critical values. Since for EBW no destructive tests have been carried out the a90/95 might change a couple of millimetres due to the uncertainty of the true a values determined via reference methods.

3.5.2 Results for Friction Stir Welding (FSW)

Below the “Adapted POD Results” for the wormholes for RT- and UT-inspection are presented with the following pattern: First we present the “â versus a” scatter diagrams where the â’s in terms of maximum radiographic contrast and the maximum echo height, respectively are plotted in dependence of the “a” in terms of penetrated length and area perpendicular to the sound beam. For these signal sizes the actual thresholds are applied yielding the mean POD curves and the 95% confidence bound and the a90/95 as key parameter. As discussed above the additional scatter diagram showing the statistics of the “a” dimension in dependence of the radial dimension reveals for all cases that the “critical” region with critical radial dimensions belonging to “a”-values below a90/95 are far away from the actually occurring configurations.

14

Page 15: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

RT wormhole

Figure 17: Volumetric Discontinuity

0 2 4 6 8 10 12

050

010

0015

00

Penetrated size (BAM-CT) [mm]

Con

tras

t(SK

B-R

T)

Saturation threshold = 1494Detection threshold = 250

0 2 4 6 8 10 120 2 4 6 8 10 12

050

010

0015

000

500

1000

1500

Penetrated size (BAM-CT) [mm]

Con

tras

t(SK

B-R

T)

Saturation threshold = 1494Detection threshold = 250Saturation threshold = 1494Detection threshold = 250

Figure 18: FSW5 RT scatter diagram

Figure 18 shows the “â versus a” scatter diagram in terms of maximum

radiographic contrast versus the by the X-rays penetrated length. A linear behaviour can be seen but with considerable scatter which might be due to the zig-zag shape (see Figure 17) causing uncertainties in the determination of the penetrated length.

15

Page 16: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

0 1 2 3 4

0.0

0.2

0.4

0.6

0.8

1.0

Penetrated size (BAM-CT) [mm]

POD

PODlower 95% conf. bound

POD = 0.9

a 90/

95=

2.60

0 1 2 3 40 1 2 3 4

0.0

0.2

0.4

0.6

0.8

1.0

0.0

0.2

0.4

0.6

0.8

1.0

Penetrated size (BAM-CT) [mm]

POD

PODlower 95% conf. bound

POD = 0.9

a 90/

95=

2.60

Figure 19: FSW5 RT POD

The resulting POD curve and the 95% confidence bound in Figure 19 indicate an

a90/95 of 2.6 mm for the penetrated length. The corresponding radial dimension of the discontinuities “to detected for sure” is 4 mm as indicated in Figure 20.

0 10 20 30 40

02

46

810

Radial size, mm

Pen

etra

ted

size

(B

AM

−C

T),

mm

Destr. inspectionNon−destr. inspection

a90 95 = 2.6

criti

cal s

ize

=35

a r=

4

Figure 20: Critical region based on radiographic inspection of volumetric discontinuities with the threshold 250 levels.

16

Page 17: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

UT Wormhole

2 4 6 8 10

2030

4050

60

Square root of the area

Am

plitu

de, %

2 4 6 8 10

2030

4050

60

Square root of the area

Am

plitu

de, %

Figure 21: FSW5 UT scatter diagram

The same set of wormhole discontinuities as investigated above were inspected by

ultrasound with “a” as area perpendicular to the sound beam and â as maximum echo amplitude. The reference value for the area was taken from results from destructive tests (cubes). The scatter diagram in Figure 21 indicates the already known fact that these discontinuities are not ideal reflectors of ultrasound and that the echo amplitude is affected by a number of other factors than the discontinuity size as listed in [6] for UT. The corresponding POD curve in Figure 22 and the “critical region”- Figure 23 reveals for a90/95 12.5 mm² and a corresponding detectable radial dimension of 6.3 mm. The crosses in Figure 23 represent results from destructive testing.

Both methods are capable to detect the wormholes far below the required critical size but show even a potential to detect smaller discontinuities in studying the detection processes in more detail.

17

Page 18: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

Area, mm² (cubes)

POD

0 5 10 15 20 25

0.0

0.4

0.2

0.6

0.8

1.0

POD = 0.9

a 90/

95=

12.5

Area, mm² (cubes)

POD

0 5 10 15 20 25

0.0

0.4

0.2

0.6

0.8

1.0

POD = 0.9

a 90/

95=

12.5

Figure 22: POD curve based on ultrasonic inspection of volumetric discontinuities (threshold 15%).

0 10 20 30 40 50

020

4060

8010

0

Radial size, mm (destr.)

Are

a, m

m^2

(cu

bes)

a90 95 = 12.5 criti

cal s

ize

=35

a r=

6.3

Non−destr. inspectionDestructive inspection

Figure 23: Critical region based on ultrasonic inspection of volumetric discontinuities (threshold 15%).

18

Page 19: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

JLH

Figure 24: Cross section of a JLH (Joint Line Hooking)

Figure 24 shows a typical cross section of a JLH (Joint Line Hooking)

discontinuity. It is clear that this shape not easily matching the empirical POD approach. The investigation was refined step by step: The first approach in investigating the JLH discontinuities was to apply the POD method in an empirical way. For this approach, the maximum echo amplitude was used as â as before. First, a totally empirical “â versus a” scatter (Figure 25) diagram and POD (Figure 26) were created. These included all the values of the SKB experiments which yields the a90/95 equal to the detectable radial dimension of 4.0. In the next step, outliers (too small and too big values compared to a "normal" amplitude versus size behaviour ), were excluded. This resulted in detectable radial dimension is 3.2 mm due to the decreased scatter.

2 3 4 5

25

1020

5010

0

Radial size (destr.), mm

UT

am

plitu

de (

−9

dB),

%

ln(y) = 0.57 + 2.4ln(x)

Sat. threshold = 125

Dec. threshold = 6

Figure 25: Scatter diagram of the amplitude vs. radial size for the JLH-type discontinuities (log. axes).

19

Page 20: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

0 2 4 6 8 10 12

0.0

0.2

0.4

0.6

0.8

1.0

Radial size (destr.), mm

PO

D

PODlower 95% conf. bound

POD = 0.9

a 90

95=

4.0

Figure 26: POD curve for the JLH-type discontinuities (with outliers).

1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0

25

1020

5010

0

Radial size (destr.), mm

UT

am

plitu

de (

−9

dB),

%

ln(y) = −0.0019 + 2.8ln(x)

Sat. threshold = 125

Dec. threshold = 6

Figure 27: Scatter diagram of the amplitude vs. radial size for the JLH-type discontinuities (log. axes, without outliers).

0 2 4 6 8 10 12

0.0

0.2

0.4

0.6

0.8

1.0

Radial size (destr.), mm

PO

D

PODlower 95% conf. bound

POD = 0.9

a 90

95=

3.2

Figure 28: POD curve for the JLH-type discontinuities (outliers excluded).

20

Page 21: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

We looked deeper into the JLH geometry and echo heights and recognized that the "hook" part is in almost all cases indicated by the 0° or -10° sound beam and the straight part, the inclined plane or rectangle by the 10° and 20° sound beam. Consequently we should consider the forming of the POD separately for hook and rectangle with the corresponding angle of the sound beam. Because the number of data points becomes too small after separation we did not carry out this procedure yet. It might be considered as a future investigation to look deeper to the forming of the POD for the two parts of the JLH and the different angles separately in combining experimental and modelling insight after all the influencing factors has been listed carefully. It will depend on the importance of the JLH in the future welding process.

3.6 Consideration of the total reliability

The PODs considered so far reveal the basic, or intrinsic capability of the NDT methods and do not yet take into account the final industrial application factors and the human factor. The situation for general NDT systems – as outlined in the formula (2) - is described in detail in [7] and [8] and will be applied to the canister welds on a later stage of the project. Though it is planned to set up the NDT-system as automatic as possible to mimimize the human factors or to apply double evaluation.

Figure 29: Modular approach: the reliability formula

4 Conclusions

A Probability of Detection evaluation for the SKB-NDT processes has been successfully established to make sure the applied NDT techniques are able to reveal the occurring discontinuities, which might be overseen by NDT as an input for the final risk assessment. A generalization of the existing prescription for the signal response POD from the MIL 1823 standard was necessary because the EBW and FSW welds of 50 mm thick Cu-canister-welds are more complex than thin aerospace structures.

21

Page 22: POD (Probability of Detection) Evaluation of NDT ...POD evaluation was carried out by BAM in a joint project for SKB and is evaluated ... ECNDT 2006 - Fr.2.5.1 1. Svensk Kärnbränslehantering

The physical reasonable a90/95 values as discontinuity sizes, which are detected for sure need to be set in correspondence to the corresponding radial dimensions of discontinuities to provide the expected wall thickness reduction, which is of importance for the integrity requirement. For EBW these values are below 4 mm for volumetric flaws detected by radiography and are not larger than 7 mm for area like flaws detected by UT. Subject of consideration for FSW was the detectability of volumetric like wormholes and area like “Joint line hooking” with the SKB radiographic and ultrasonic methods. At the current state of the art all observed a90/95 values are for the wormholes for radiographs not larger than 3 mm and for UT not larger than 13 mm2. The corresponding radial dimension are at maximum 4 mm for RT and 6 mm for UT in case the flaw configurations investigated here represent the full possible scale which might occur in the welds under production conditions.

The empirical detectable radial dimension with UT for the “joint line hooking” is 4 mm.

As result of this SKB-BAM project optimized testing techniques will be provided which are validated for the production process and which will guarantee the required rest wall thickness with sufficient reliability. The NDT reliability investigation is continued now for the iron cast insert and the copper shield. The joint SKB-BAM project is a contribution for the long term European public safety.

Acknowledgment

The authors like to thank Dr. Gerd-Rüdiger Jaenisch for fruitful scientific discussions and Dr. Jürgen Goebbels for providing the reference - CT-measurements on “High energy - CT”. We are also indebted to the colleagues from the ultrasonic group at BAM (Dr. Gerhard Brekow, Dr. Dirk Tscharntke) for ultrasonic reference measurements and Mrs. Sylke Bär for helpful assistance in flaw extraction from data sets.

References

[1] N. N. RD & D-programme 2001. Technical Report TR-01-30, Svensk Kärnbränslehantering AB,

September 2001. [2] Gerd-Rüdiger Tillack, Christina Nockemann, and Carsten Bellon. X-ray modelling for industrial

applications. NDT & E International, 33:481–488, 2000. [3] Dirk TSCHARNKTKE, Rainer Boehm, Christina Müller, Ulf Ronneteg, Hakan Ryden, Ultrasonic

investigation on copper canister welds in preparation for the storage of spent nuclear fuel in a deep repository, to be published in proceedings of the 6th ECNDT

[4] US Department of defense. Nondestructive evaluation system. Reliability assessment, 1999. Handbook. [5] Alan P. Berens. NDE reliability data analysis. In Metals Handbook, volume 17. ASM International, 9

edition, 1989. [6] ASNT Nondestructive Testing Handbook, Second Edition, Volume 7: Ultrasonic Testing pp. 445

(Factors Determining Amplitude of Discontinuity Echo Signal) [7] Christina Müller, Thomas Fritz, Gerd-Rüdiger Tillack, Carsten Bellon, and Martina Scharmach. Theory

and applications of the modular approach to NDT reliability. Materials Evaluation, 59(7):871–874, 2001.

[8] Christina Müller, Mstislav Elagin, Martina Scharmach, Bernhard Redmer, Uwe Ewert, Lloyd Schaefer, and Peter-Theodor Wilrich. Reliability investigation of NDE systems by modular analysis of recorded data. In Proceedings of the 8th European Conference on Non-Destructive Testing, 2002.

22