theory of sampling (tos) – the missing link in chemical ...usermeeting.camo.com/publications for...

64
Theory of Sampling (TOS) – the missing link in chemical analysis, process monitoring & quality control (PAT) Kim H. Esbensen ACABS: Applied Chemometrics, Analytical Chemistry, Applied Biotechnology, Bioenergy & Sampling research group, University of Aalborg Esbjerg (AAUE) Denmark

Upload: trinhbao

Post on 06-Mar-2018

216 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Theory of Sampling (TOS) –the missing link in chemical analysis,

process monitoring & quality control (PAT)

Kim H. EsbensenACABS: Applied Chemometrics, Analytical Chemistry,

Applied Biotechnology, Bioenergy & Sampling research group, University of Aalborg Esbjerg (AAUE)

Denmark

Page 2: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- ”samples” for analysis …

- usually treated identically

- ABSOLUTELY not identical !!!

- matrix is different –

- internal compositional

heterogeneity: CHS

”population thinking …”

A traditional view of analyticalchemistry: samples in the lab.

And neither was the lot … … …

from where all were sampled …

- all ”units” are identical

Heterogeneity at different scales !

Page 3: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- very high CHL

- high CHL

Primary stage ”representative sampling” … ?- External (spatial) heterogeneity -

Page 4: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Apparently a homogenous lot … …

Sneak preview of coming horrors …

- very low CHL

Grab sampling … there is nothing worse !

Page 5: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- state-of-the-art NIR monitoring !

- state-of-the-art pipe-line sampling ?

- severely TOS-incorrect !

By-pass: - ”practical solution”

Page 6: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- examples from NIR-monitored processes

- grab-sampling for at-line NIR

- structurally incorrect primary sampling (TOS)

Page 7: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Process Analytical Technologies (PAT)

PAT - a system for design, analysis and control of manufacturing …

- a system for designing, analyzing, and controlling manufacturing through timely measurements (i.e., during processing) of critical quality and performance attributes of raw and in-process materials and processes with the goal of ensuring final product quality

- it is important to note that the term analytical in PAT is viewed broadly toinclude chemical, physical, microbiological, mathematical, and risk analysis conducted in an integrated manner … (? role of representative sampling ?)

The current context for analytical chemistry...

Page 8: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Process Analytical Technology (PAT): (tools)

There are many current and new tools available that enable scientific, risk-managed (pharmaceutical) development, manufacture, quality assurance. These tools….. when used within a system can provide effective and efficient means for acquiring information to facilitate process understanding, develop risk-mitigation strategies, achieve continuous improvement, and share information and knowledge.

In this framework, PAT tools can be categorized as:

* Multivariate data acquisition and analysis tools * Modern process analyzers or process analytical chemistry tools* Process and endpoint monitoring and control tools * Continuous improvement and knowledge management tools

An appropriate combination of some, or all, of these tools may be applicable to a single-unit operation, or to an entire manufacturing process and its quality assurance.

Page 9: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Process Analytical Technology: PAT – Process Understanding

A process is well understood when:

* ALL CRITICAL sources of variability are identified and understood* VARIABILITY is managed by the process * Product quality attributes can be accurately and reliably PREDICTED

Page 10: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Although TOS has been known for > 50 years- very little appreciated and/or implemented in:

- PAC: Process Analytical Chemistry- PAT: Process Analytical Technologies

- QC: Quality Control- or in the analytical laboratory (sic)

This despite the fact that sampling errors form the dominant part of what is erroneously termed "measurement errors” –

sampling errors reach 50-100+ * the analytical error s.s.

Page 11: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Critical issues:Samples are but a portion of original material, a source ... ... a lot

Samples usually originate from heterogeneous material ... ...

Samples are mandated to be representative of the lot ...

Critical issue - How to draw a representative sample for all lot types ?

General principles: Theory of Sampling (TOS)

PRINCIPLES of REPRESENTATIVE SAMPLING + analysis

Page 12: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- - Sampling is NOT ”a simple materials handling” operation

- - Sampling is a 50+ year old theory (TOS)

Focus is ”naturally” on sample size: MS

Page 13: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Taking the primary sample ….

- is not when to decide on: MS !!

- Different materials are of different

intrinsic heterogeneities .… .…

TOS’ first surprise: - a paradox:

- Focus is ”naturally” on sample size: MS

Page 14: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- very difficult to avoid conventional

statistical population thinking … …

TOS is different !!!

”True” lot concentration … aLOT ?

”Heterogeneity” does not follow ANY statistical distributions !!

Page 15: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- A few necessary definitions:

- let’s begin here … …

- TOS

Page 16: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

50 ppm - showcase

”True” lot concentration – aLOT ??

Page 17: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

50 ppm100 ppm - showcase

”True” lot concentration – aLOT ??

Page 18: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

50 ppm100 ppm 500 ppm - showcase

”True” lot concentration – aLOT ??

Page 19: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

50 ppm100 ppm500 ppm500 ppm – realistic lot distribution

Reality is a harsh mistress … … …

Page 20: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

50 ppm100 ppm 500 ppm - showcase1000 ppm – realistic lot distribution

Reality is a harsh mistress … … …

Page 21: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

50 ppm100 ppm 500 ppm - showcase1000 ppm – real distribution5000 ppm – realistic lot distribution

Reality is a harsh mistress … … …

Page 22: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

50 ppm100 ppm 500 ppm - showcase1000 ppm – real distribution5000 ppm – real lot distribution10.000 ppm (1%) – realistic lot distribution

- trace concentration: below 1% … …

N.B. - note sample size MS vs. lot size ML

Page 23: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Heterogeneity- as a function of:• concentration• spatial distribution• constitutional dist.

• sampling tool size• sampling process• sample handling &

preparation

material (lot)characteristics

sampling processcharacteristics

Page 24: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- only a partial, idealistic model

Page 25: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- Real life: significant to extreme heterogeneity !!!

Is this, then, the company’s

most highly trained personel?

Page 26: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- TOS: the lot … …

Page 27: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Sampling is closely related to thenature (form, material) of the lot

It is necessary to discriminatebetween the ”effectivedimensionality” of the lot to besampled …

Page 28: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- Historical document #4

n.b.

which means

- worst of all …NOT regarding PAT !!!!!!

Page 29: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- sampling is ALWAYS:

n.b. different sampling rate

1. Primary sampling

2. Secondary sampling

3. Tertiary sampling

4. ( … rare, but … )

5. ( sample preparation )

6. Analysis

a multi-staged process …

First step solutions .....

Page 30: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

The possibilities for successfulsampling is closely related to thenature (form, material) of the lot

Lot transformation …

Page 31: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

TOS – synopsis:

- error systematics

- three sources !!!

1

2

Page 32: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

– Mixing / blending– Particle Size Reduction (comminution)

– Composite Sampling– Representative Mass Reduction

• The ultimate summary of TOS• 3 principles and 4 practical procedures

– Heterogeneity Characterization– Variography (1-D ditto)– Lot Dimensionality Reduction

Seven Sampling Unit Operations

Normally used once in planning / optimization of a sampling process

Used as active steps in the sampling process (often used several times)

Page 33: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- archetype grab-sampling

Page 34: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- very often used: grab-samplingGrab sampling is NEVER acceptable

Page 35: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Conventional ”process sampling” … …

NB: This is also grab sampling!

Page 36: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

ARCHETYPE grab sampling

- - - - - - - - - of reactors ....

Page 37: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Grab sampling – Hall of Shame

15 industrial process lots: 1D, 3D

All assumed to be homogeneous!

Care to take a grab sample .. .. ..

Anyone ?

Page 38: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

… even in laboratory life …

$ 64.000 question: homogeneous? - not at all – very heterogeneous!

- the world’s worst sampling method

Page 39: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Brief introduction to process sampling … - ”easy”: relatively

homogeneous stuff(s) …

Page 40: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Server

What’s the situation regarding process sampling (1D lots) ?

Instrumental signals & reference samples ..

Pipeline sampling or conveyor belt ….

Page 41: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Server

- issue: HETEROGENEITY (…. gravity & flow segregation ….)

Multivariate Calibration (PLS-R)

Chemometric Data Analysis - -

Solve this problem ??

Not a chance, unfortunately !

Page 42: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Many instrumental analytical methods (X) are based on"analysis by proxy” - for which the representativity of

reference data (Y) is critical w.r.t. underlyingmultivariate calibrations

(X,Y) must both be representative– these are different issues …

NOT a data analysis issue (sorry!)

Representative sampling: critical success factor

TOS: a missing link in much of current process analysis

Page 43: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Quick overview of 99 %-ile of conventional ”process sampling designs”

All these designs are incorrect – sampling process is non-representative !!!

- Physical sampling, or sensor probe localisation

Page 44: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

There is no way out of the need for understanding theprinciples and practise involved for producing representative

reference sampling

The situation can not be remedied by neither statistics, chemometric data analysis, nor by any other type of

a posteori "corrections"

TOS requirements:

Introduction to the Theory of Sampling (TOS): A practical framework of 7 sampling unit operations (SUO),

with which to approach all types of sampling in the field, in the production plant, in industry or in the laboratory

Page 45: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

– Mixing / blending– Particle Size Reduction– Composite Sampling– Representative Mass Reduction

• The ultimate summary of TOS• 3 principles and 4 practical procedures

– Heterogeneity Characterization– Variography (1-D ditto)– Lot Dimensionality Reduction

Seven Sampling Unit Operations

Normally used once in planning / optimization of a sampling process

Used as active steps in the sampling process (often used several times)

Page 46: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

SEVEN SAMPLING UNIT OPERATIONS – a toolbox for practical representative sampling

Kim H. Esbensen & Lars Petersen

Aalborg University Esbjerg, Denmark, www.acabs.dk

ACABS: Theory of Sampling (TOS): course documentation (2006)

www.acabs.dk

Page 47: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- ONLY TOS-correct & practical pipeline sampling configuration …

- a necessary condition for:

- a representative sample …

A quasi-acceptable ”solution” … based solely on existing technology

UPWARD flow only !!!

Page 48: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- composite sampling of (very) heterogeneous pipeline flux

- sampling 8 segments of pipeline flow (10L) + frac. shovel.

… followed by compositing (8L) + fractional shoveling

REPRESENTATIVE PRIMARY SAMPLING (problem-dependent)

primary process sampling: a master example

- not exactly realised by grab-sampling !!!

Page 49: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- sneak preview of coming attractions … (ACABS)

- conventionalprocess sampling

-TOS-incorrect:

- non-representative

- recurrent loop sampling- co-located with PAT modalities

Page 50: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- state-of-the-art NIR monitoring !

- Let’s play along – to learn a new chemometric issue

By-pass: - ”practical solution”

Page 51: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- typical result: significant TSE (not necessary)

- bad sampling – not an ”instrument problem”

- bad sampling – not a ”measurement problem”

- typical result: uncomfortable ”measurement errors”

Page 52: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

TSE = PSE + SSE + TSE + TAE + IPE … …

- bad X-sampling

Page 53: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- VERY LARGE Y-sampling errors …

- or bad Y-sampling

- reference sampling

Page 54: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- but luckily, bad sampling is not always the case …..

- not always – how much are YOU willing to gamble ???

Page 55: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

”SAMPLING – is not gambling!”

”TOS-sampling is not relevant for my:

- lot (material)

- process

- samples … … ”

???

- attributed to Pierre Gy

Still – after all this TOS talk ….

Page 56: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- Useless process sampling: grab sampling …

Often met with (unfortunately):

I don’t need/want/understand all this TOS [crap]:

It is a reasonable assumption that the flow is homogeneous ….

A minute analytical quantity is enough for the analyzer …..

Taking many sensor recording (e.g. 20 /sec.) will ensure representativity….

Page 57: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

How NOT to install a probe

N.B. Generic illustration !!

Similarity with any existingtechnologies is purelyaccidental & NOT intended

Page 58: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Peekaboo, through a window

Page 59: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

A memorable review ….(leading chemometrics journal …)

- by a certain irate reviewer, ”who shall still remain undisclosed” – after all...

”This aproach does not correspond to what we* mean by sampling …..”

Let’s hope he can define ”his” sampling ...

* chemometricians …..

- in as broad and comprehensive

fashion as Theory of Sampling (TOS)

Page 60: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

- THEORY of SAMPLING (TOS)

Page 61: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

how?• how would YOU do this?• HOW could you do this?

• sampling is necessary -• not just materials handling

• TOS: Theory of Sampling

Pierre Gy: founder of TOS

Cannes, June 8.th, 2005

First World Conference on Sampling and Blending, Aug. 2003, Esbjerg

Pierre Maurice Gy

b. Paris, July 25, 1924

Chem. Eng. Paris Sch. Phys. & Chem. (46)

Ph.D. physics. Univ. Nancy (1960)

Ph.D. Math. (stat). Univ. Nancy (1975)

Gold medal (Soc. l’industri Minerale) (63,76)

Lavoisier Medal (Fr. soc. Chemistry) (1995)

… 9 books, 175 papers, 200 lectures …

Page 62: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

REPRESENTATIVE SAMPLING FOR RELIABLE DATA ANALYSIS: Theory of Sampling (TOS)

Lars Petersen, Pentti Minkkinen*, Kim H. Esbensen

Aalborg University Esbjerg, Denmark, www.acabs.dk*) Lappeenranta University of Technology, Finland, www.lut.fi

Chemometrics and Intelligent Laboratory Systems, vol. 77 (2005) 261-277

www.acabs.dk

Page 63: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

REPRESENTATIVE PROCESS SAMPLING for reliable data analysis

Lars Petersen & Kim H. Esbensen

Aalborg University Esbjerg, Denmark, www.acabs.dk

Journal of Chemometrics (2006), in print

www.acabs.dk

Page 64: Theory of Sampling (TOS) – the missing link in chemical ...usermeeting.camo.com/Publications for the user meeting web site/PAT... · the missing link in chemical analysis, process

Representative Process sampling in practice – a tutorial:variographic analysis and estimation of Total Sampling Errors (TSE)

*Kim H. Esbensen, Hans Henrik Friis-Petersen, Lars Petersen, Jens Bo Holm-Nielsen & Peter P. Mortensen

ACABS, Aalborg University Esbjerg, Denmark

www.acabs.dk