give me 1m · how to measure anything in cybersecurity risk douglas w. hubbard & richard...

41

Upload: others

Post on 14-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 2: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 3: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Give me$1M

Page 4: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 5: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Give me$1M

Page 6: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

-$10M

-$3M

Page 7: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Quantifying RiskQCon SF 2019

Markus De Shon ([email protected])

Page 8: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

How to Measure anything in Cybersecurity Risk

Douglas W. Hubbard & Richard Siersen

Page 9: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Measuring and Managing Information Risk

Jack Freund & Jack Jones

fairinstitute.org

Page 10: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Frequency⨉

Magnitude ($)(of Loss)

Page 11: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

What is a loss?

Page 12: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

First steps of a risk analysis● Assets● Architecture● Control architecture● Loss scenarios

Page 13: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 14: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Meet Sam the Sponge

Page 15: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

His best friend Peter

Page 16: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

His boss Mr. Prawn

Page 17: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

The Prawn Patty

Page 18: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

The secret recipe

Page 19: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Controls Architecture● Only one copy● Not memorized● Kept in safe● Trusted handlers

Page 20: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

● Confidentiality○ Competitor○ Public

● Integrity○ crUD

● Availability○ Unavailable

Recipe loss scenarios

Page 21: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 22: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Threat

Page 23: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Hazard

Page 24: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Tardigrade

Page 25: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 26: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Estimate frequencySecurity Engineers

Range

0 ——— ∞

Page 27: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Calibration 0.1 0.01 0.001

Page 28: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Tardigrade steals recipe

0.01

Page 29: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

steals recipe

0.1

Page 30: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Estimate magnitude

● Asset owner● Decompose● Low → High (90% CI)● US$

Page 31: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Model magnitude with lognormal

Low loss

90% CI

High loss

Page 32: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 33: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Why Money?● Composable (A+B)● Comparable (A>B) ● Interpretable by business

What about:● Priceless? → Implicit valuation● Intangible? → Inverse of ROI on

existing investments

Page 34: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

● Recipe unavailable → sales stop (primary)○ 1 day @ $10K → $10K○ 100 days → $1M

● Knockoffs at Tardigrade’s. Lose customers (primary)○ 10 @ $100 → $1K○ 1,000 → $100K

● Total:○ Low: $11,000○ High: $1,100,000

Magnitude: Tardigrade

Expected Loss:$2,930

Page 35: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Magnitude: Patty PirateRecipe unavailable → lost sales (Primary loss)

○ 10 days @ $10K → $100K○ 100 days → $1M

No Prawn Patties anywhere → immediate collapse, fires. dystopia. (Secondary, external)

○ 10 days @ $1M → $10M○ 100 days → $100M

Totals:

○ Low: $10,100,000○ High: $101,000,000

Expected Loss:$4,080,000

Page 36: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org
Page 37: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Engineering a Safer World

Nancy G. Leveson

Page 38: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Controller and process

Page 39: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

(Incomplete) Control architecture

Internal Application

SystemAdmin App

User

System Admin

Corporation

Government Customers

Directives &Culture

PurchaseDecisions

Laws &Regulations

Critical Data

Page 40: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

Markus De [email protected]

● Identify Assets● Study Architecture● Define Control architecture● Identify loss scenarios● Estimate frequency● Estimate low/high magnitude● Calculate expected loss

Page 41: Give me 1M · How to Measure anything in Cybersecurity Risk Douglas W. Hubbard & Richard Siersen. Measuring and Managing Information Risk Jack Freund & Jack Jones fairinstitute.org

import mathimport numpy as npfrom scipy.stats import lognorm, norm

def get_magnitude(lo, hi): # Calculate the mean mu in log space mu = (math.log(lo) + math.log(hi)) / 2. factor = -0.5 / norm.ppf(0.05) sigma = factor * (math.log(hi) - math.log(lo)) distribution = lognorm(sigma, scale=math.exp(mu)) return distribution

0.01 * get_magnitude(11000, 1100000).mean()