a new proficiency testing scheme for asbestos analysis by … · 2015. 5. 5. · health &...

1
Health & Safety Laboratory An agency of the Health & Safety Executive www.hsl.gov.uk © Crown Copyright 2014 Table 1: Summary of Round 3 results Fig 5: Round 3 - Sample 4; total fibre density measurements from 52 laboratories that took part Figure 5 presents the total fibre density measurements in Round 3 (Sample 4) from 52 laboratories. Some laboratories reported consistently higher (labs 2, 4, 21, 30, 48) or lower (labs 12, 41) than average counts, with some being more consistent than others (labs 1, 13, 45). Fig 6: Round 3 - Random Effects of 37 Laboratories That Took Part in the Scheme Fig. 6 shows a visual inspection of the random effects plots shows that some labs have consistently submitted higher/lower counts than the ‘average’. The deviation of lab-specific counts from the ‘average’ has also generally declined between rounds 1 and 3 (as seen by the green dots generally being closer to zero than the black dots). A New Proficiency Testing Scheme for Asbestos Analysis by Scanning Electron Microscopy Laurie Davies, Emma Tan Health & Safety Laboratory, Harpur Hill, Buxton, SK17 9JN, UK Introduction A new proficiency testing scheme has been established which aims to improve laboratory measurement of asbestos and other inorganic fibres by scanning electron microscopy (SEM) and energy dispersive X-ray analysis (EDX). The scheme is in its fourth year and includes over 50 European laboratories. Participating laboratories are recommended to use either the ISO 14966 or VDI 3492 methods, although any appropriate analytical method may be used. Sample Preparation Scheme samples are produced in the laboratory using a novel combination of a modified dustiness tester (Fig 1) and a multi-port sampling “Sputnik” device (Figs 2 & 3). Pre-gold coated filters are loaded with different densities of amphibole asbestos fibres, chrysotile, other inorganic fibres or mixtures of fibre types. Non-fibrous particulate material can also be included by choosing an appropriate “source” material (Fig 4). Data Analysis Variation is present in fibre counting, with some of this variation due to differences between laboratories (e.g. differences in equipment), and some due to variation within laboratories (e.g. different analysts within a laboratory). When laboratories submit more than one result per round, taking simply the average of all the submitted results to estimate the true density of the sample may lead to a biased estimate. A more appropriate method is to use a random effects model to estimate the true density. Let y ij be the j th observed density from the i th laboratory. These fibre densities are assumed to follow a Poisson distribution with unknown mean µ ij. As several labs submitted more than one count per sample, the mean count over all the samples may be not be an unbiased estimate for µ ij . To account for variability between labs and reduce bias, we assume the following model: Where a represents the logarithm of the true density, b i are random effects produced by lab i (the b i are normally distributed with mean 0 and variance s b 2 ). 1410003 Number of measurements Measured density range Estimate of fibre density Between- laboratory variability ( ) Within- laboratory variability Sample 1 83 0 – 6.2 0.49 0.98 0.71 Sample 2 85 10 - 92 30.9 0.40 1.29 Sample 3 87 53 - 312 149.4 0.38 1.81 Sample 4 89 18 - 240 102.4 0.43 1.64 250 200 150 100 50 0 0 1 2 3 4 5 6 7 8 9 10 11 12 13 Laboratory Density (fibres/mm 2 ) 250 200 150 100 50 0 27 28 29 30 31 32 33 34 36 37 38 39 40 Laboratory Density (fibres/mm 2 ) 250 200 150 100 50 0 40 41 42 43 44 45 46 47 48 49 50 51 52 Laboratory Density (fibres/mm 2 ) 250 200 150 100 50 14 15 16 17 18 19 20 21 22 23 24 25 26 Laboratory Density (fibres/mm 2 ) Random effects Random effects Random effects 2 1.5 1 0.5 0 -0.5 -1 -2 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 16 17 18 19 20 -1.5 2 1.5 1 0.5 0 -0.5 -1 -2 -1.5 31 32 33 34 35 36 37 2 1.5 1 0.5 0 -0.5 -1 -2 -1.5 Laboratory Random effects 2 1.5 1 0.5 0 -0.5 -1 -2 21 22 23 24 25 26 27 28 29 30 -1.5 Laboratory Laboratory Laboratory Fig 1: Modified dustiness Tester Fig 3: Sputnik Loaded with 114 Sampling Heads Fig2: Sputnik Multiport Sampler Fig 4: Amosite Asbestos E (Y ij ) = µ ij log ij ) = a + b i b i ~ N (0,s b 2 )

Upload: others

Post on 22-Aug-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A New Proficiency Testing Scheme for Asbestos Analysis by … · 2015. 5. 5. · Health & Safety Laboratory, Harpur Hill, Buxton, SK17 9JN, UK Introduction A new proficiency testing

Health & Safety LaboratoryAn agency of the Health & Safety Executive

www.hsl .gov.uk© Crown Copyright 2014

Table 1: Summary of Round 3 results

Fig 5: Round 3 - Sample 4; total fibre density measurements from 52 laboratories that took part

Figure 5 presents the total fibre density measurements in Round 3 (Sample 4) from 52 laboratories. Some

laboratories reported consistently higher (labs 2, 4, 21, 30, 48) or lower (labs 12, 41) than average counts,

with some being more consistent than others (labs 1, 13, 45).

Fig 6: Round 3 - Random Effects of 37 Laboratories That Took Part in the Scheme

Fig. 6 shows a visual inspection of the random effects plots shows that some labs have consistently submitted

higher/lower counts than the ‘average’. The deviation of lab-specific counts from the ‘average’ has also

generally declined between rounds 1 and 3 (as seen by the green dots generally being closer to zero than

the black dots).

A New Proficiency Testing Scheme for Asbestos Analysis by Scanning Electron Microscopy

Laurie Davies, Emma TanHealth & Safety Laboratory, Harpur Hill, Buxton, SK17 9JN, UK

IntroductionA new proficiency testing scheme has been established which aims to improve laboratory measurement of

asbestos and other inorganic fibres by scanning electron microscopy (SEM) and energy dispersive X-ray

analysis (EDX). The scheme is in its fourth year and includes over 50 European laboratories. Participating

laboratories are recommended to use either the ISO 14966 or VDI 3492 methods, although any appropriate

analytical method may be used.

Sample PreparationScheme samples are produced in the laboratory using a novel combination of a modified dustiness tester

(Fig 1) and a multi-port sampling “Sputnik” device (Figs 2 & 3). Pre-gold coated filters are loaded with

different densities of amphibole asbestos fibres, chrysotile, other inorganic fibres or mixtures of fibre types.

Non-fibrous particulate material can also be included by choosing an appropriate “source” material (Fig 4).

Data Analysis

Variation is present in fibre counting, with some of this variation due to differences between laboratories

(e.g. differences in equipment), and some due to variation within laboratories (e.g. different analysts within

a laboratory). When laboratories submit more than one result per round, taking simply the average of all

the submitted results to estimate the true density of the sample may lead to a biased estimate. A more

appropriate method is to use a random effects model to estimate the true density.

Let yij be the jth observed density from the ith laboratory. These fibre densities are assumed to follow a

Poisson distribution with unknown mean µij. As several labs submitted more than one count per sample,

the mean count over all the samples may be not be an unbiased estimate for µij . To account for variability

between labs and reduce bias, we assume the following model:

Where a represents the logarithm of the true density, bi are random effects produced by lab i (the bi are

normally distributed with mean 0 and variance sb2 ).

1410003

Number of measurements

Measured density range

Estimate of fibre density

Between-laboratory

variability ( )

Within-laboratory variability

Sample 1 83 0 – 6.2 0.49 0.98 0.71

Sample 2 85 10 - 92 30.9 0.40 1.29

Sample 3 87 53 - 312 149.4 0.38 1.81

Sample 4 89 18 - 240 102.4 0.43 1.64

250

200

150

100

50

0 01 2 3 4 5 6 7 8 9 10 11 12 13

Laboratory

Den

sity

(�br

es/m

m2 )

250

200

150

100

50

027 28 29 30 31 32 33 34 36 37 38 39 40

Laboratory

Den

sity

(�br

es/m

m2 )

250

200

150

100

50

040 41 42 43 44 45 46 47 48 49 50 51 52

Laboratory

Den

sity

(�br

es/m

m2 )

250

200

150

100

50

14 15 16 17 18 19 20 21 22 23 24 25 26Laboratory

Den

sity

(�br

es/m

m2 )

1 2 3 4 5 6 7 8 9 10-2

-1.5

-1

-0.5

0

0.5

1

1.5

2

Ran

do

m e

ffec

ts

Laboratory

11 12 13 14 15 16 17 18 19 20-2

-1.5

-1

-0.5

0

0.5

1

1.5

2

Ran

do

m e

ffec

ts

Laboratory

21 22 23 24 25 26 27 28 29 30-2

-1.5

-1

-0.5

0

0.5

1

1.5

2

Ran

do

m e

ffec

ts

Laboratory

31 32 33 34 35 36 37-2

-1.5

-1

-0.5

0

0.5

1

1.5

2

Ran

do

m e

ffec

ts

Laboratory

Round 1 Round 2 Round 3

Rand

om e

�ect

s

Rand

om e

�ect

sRa

ndom

e�e

cts

2

1.5

1

0.5

0

-0.5

-1

-21 2 3 4 5 6 7 8 9 10 1 2 3 4 5 16 17 18 19 20

-1.5

2

1.5

1

0.5

0

-0.5

-1

-2

-1.5

31 32 33 34 35 36 37

2

1.5

1

0.5

0

-0.5

-1

-2

-1.5

Laboratory

Rand

om e

�ect

s

2

1.5

1

0.5

0

-0.5

-1

-221 22 23 24 25 26 27 28 29 30

-1.5

Laboratory

Laboratory

Laboratory

Fig 1: Modified dustiness Tester

Fig 3: Sputnik Loaded with 114 Sampling Heads

Fig2: Sputnik Multiport Sampler

Fig 4: Amosite Asbestos

E (Yij) = µij

log (µij) = a + bi

bi ~ N (0,sb2)