dealing with the certainty of uncertainty: some …...dealing with the certainty of uncertainty:...

30
Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society

Upload: others

Post on 07-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Dealing with the Certainty of Uncertainty:

Some Reflections Andrew Buchan The Safety and Reliability Society

Page 2: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest
Page 3: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Let’s be honest

Page 4: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Where is the Uncertainty?

Page 5: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Belief and Uncertainty

Page 6: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Is Uncertainty a bad thing ?

• Uncertainty can amplify Risk

• Precautionary Principle approach

• Influences Risk Appetite

Page 7: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Probability

Consequence The chosen boundary of the plant safety case envelope

The “real” boundary of the plant safety envelope

Getting more specific

Page 8: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Probability

Consequence The chosen boundary of the plant safety case envelope

The “real” boundary of the plant safety envelope

A More Difficult Place

Page 9: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Some Areas for Consideration • Context

• Consequence • Certainty • Age • Types • Data • Models • Approaches • Some events

Page 10: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Uncertainty of Context

Page 11: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

PCM ?

Page 12: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Uncertainty of Consequence

Page 13: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Uncertainty is Certain • The Heisenberg

uncertainty principle is the statement of the inherent measurement uncertainty in quantum mechanics. It states that the more precisely a particle's position is known, the less precisely its momentum is known, and vice versa.

Page 14: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Does it improve with age? • John Finley, English

historian and mathematician tells us: "Maturity of mind is the capacity to endure uncertainty”

• Confidence: The feeling you have just before you fully understand the situation

• Dunning Kruger Effect

Page 15: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Types of Uncertainty

• Some Long Words

• Aleatory

• Epistemic

• Ontological

Page 16: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Uncertainty of Data • I know what you’re

thinking: 'Did he fire six shots or only five?' Well, to tell you the truth, in all this excitement, I’ve kinda lost track myself…….. you’ve got to ask yourself one question: 'Do I feel lucky?'

Well, do you, punk?

Page 17: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Uncertainty of the Model

• The Dunning–Kruger effect is a cognitive bias wherein relatively unskilled individuals suffer from illusory superiority, mistakenly assessing their ability to be much higher than is accurate. This bias is attributed to a metacognitive inability of the unskilled to accurately evaluate their own ability level

Page 18: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Mumbai High North

• Cook cut fingers • Transferred to Rig • Vessel hit Rig Riser • Fire escalated • Helicopter Inoperable

• Composite effects ?

Page 19: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

A useful approach ?

• Uncertainty in various parts of the overall model

• Use signs of uncertainty to our favour

• Active Risk Management

• Positive Safety Culture

Page 20: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Ontological Uncertainty • Well who would have

thought that would would happen ?

• Large events often have multiple sub causes

• How does uncertainty affects this

• Can we spot this ?

Page 21: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Owned by a Russian Company based in Switzerland and Registered in Cyprus. chartered by the Islamic Republic of Iran Shipping Lines IRISL

Carrying explosive from Iran to Lataka Syria for probable eventual use by Hamas in Gaza . Stopped and Searched by US forces in Red sea later detained in Limassol

MT Monchegorsk

Page 22: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest
Page 23: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest
Page 24: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest
Page 25: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest
Page 26: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest
Page 27: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

The consequences • 13 deaths • 62 injured • Island lost 60% electrical generating capacity

due to loss of Vasilikos Power Station which in early July had an output of 650 Mw

• Debris and blast damage out to 5 km • 2 Ministers immediately resigned, ongoing

demonstrations • Rioting in Nicosia for a week afterwards • € 1 Bn + damage later revised down to 400m

Page 28: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Conclusions • UN Resolution 1747 generated a set of circumstances for which a

small country was unprepared. • Cypriot Government primarily viewed this as a Political problem • Political considerations took precedence over offers of assistance • An authoritarian President remained ignorant of the problem, a fear

and a blame culture seeded lack of communication and indecision • The chosen location and storage arrangement guaranteed an

explosion with maximum consequences • There was no hazard assessment, basis for storage, Governance

or Regulation • The disaster evolved – opportunities to remove, intercept then

mitigate were missed • Information not passed to power station or fire service • There was no ER plan but the time of the explosion minimised the

number of casualties

Page 29: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

• Faith, Hope and Clarity

Page 30: Dealing with the Certainty of Uncertainty: Some …...Dealing with the Certainty of Uncertainty: Some Reflections Andrew Buchan The Safety and Reliability Society Let’s be honest

Upcoming SaRS events Safety and Reliability London Dinner 2015 When: Thursday, 24th September 2015 Where: Royal Over-Seas League, Over-Seas House, Park Place, St James’s Street, London SW1A 1LR Who: The speaker for this dinner is Rear Admiral (retd) Paul Thomas CB, FREng, FCGI, FIMechE, HonFNucI, HonFSaRS SaRS2015: Leadership and Management in Safety Culture When: Thursday 8th October 2015 Where: Bristol Marriott Hotel City Centre, 2 Lower Castle Street, Bristol BS1 3AD Who: The Keynote Speaker is Air Marshal Sir Barry Thornton KCB