probability - uta priss

39
An example Probability and intuition Mathematical probability Testing Probability SET07106 Mathematics for Software Engineering School of Computing Edinburgh Napier University Module Leader: Uta Priss 2010 Copyright Edinburgh Napier University Probability Slide 1/25

Upload: others

Post on 03-Feb-2022

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Probability

SET07106 Mathematics for Software Engineering

School of ComputingEdinburgh Napier UniversityModule Leader: Uta Priss

2010

Copyright Edinburgh Napier University Probability Slide 1/25

Page 2: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

An example

Probability and intuition

Mathematical probability

Testing

Copyright Edinburgh Napier University Probability Slide 2/25

Page 3: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Optical illusion

Copyright Edinburgh Napier University Probability Slide 3/25

Page 4: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Optical illusion: evidence

Copyright Edinburgh Napier University Probability Slide 4/25

Page 5: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

The Monty Hall’s game show problem

A prize is hidden behind one of 4 doors. A contestant chooses onedoor (which is NOT opened). The game show host then opens twodoors which don’t contain the prize. Two doors remain closed.The contestant can now choose whether the originally selecteddoor shall be opened or the other closed door.

What should the contestant do?

Copyright Edinburgh Napier University Probability Slide 5/25

Page 6: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Contestant selects a door (which stays closed)

this door

The treasure is behind one of the doors

I choose

Copyright Edinburgh Napier University Probability Slide 6/25

Page 7: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Two empty doors opened by the host

We’ll openthese two

Copyright Edinburgh Napier University Probability Slide 7/25

Page 8: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Contestant makes final choice

???choice?

Your final

Stick with the original choice or select the other closed door?

Copyright Edinburgh Napier University Probability Slide 8/25

Page 9: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Intuition about probability

If a prize is behind one of two doors. The probability for each doorto contain the prize is 50%.

If a prize is behind one of four doors. The probability for each doorto contain the prize is 25%.

Copyright Edinburgh Napier University Probability Slide 9/25

Page 10: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Monty Hall’s game show: solution

The door which the contestant chose originally contains the prizewith a probability of 25%.

Opening two more doors does not change the probability of theoriginal door. It stays 25%.

That means the only other remaining door contains the prize witha probability of 75%.

The contestant should always choose not to have the original dooropened, but instead the other door in order to have a winningchance of 75%.

Copyright Edinburgh Napier University Probability Slide 10/25

Page 11: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Innumeracy

“All of the students in this country are below average.”

(Innumeracy is the mathematical equivalent to illiteracy. JohnAllen Paulos (1988))

Copyright Edinburgh Napier University Probability Slide 11/25

Page 12: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Innumeracy

“All of the students in this country are below average.”

(Innumeracy is the mathematical equivalent to illiteracy. JohnAllen Paulos (1988))

Copyright Edinburgh Napier University Probability Slide 11/25

Page 13: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Intuitions about probability

I Practice improves performance.Example: shooting an arrow at a target many times willimprove during the learning phase.

I Central tendency: if an activity is repeated many times, theresult should approach an average.Examples: the sequel of a best-selling movie, will be moreaverage; children of unusually tall/short parents tend to be ofmore average height.

Copyright Edinburgh Napier University Probability Slide 12/25

Page 14: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Intuitions about probability (continued)

I Co-occurrence and correlation: if two events co-occur, there islikely to be a connection (assumed causality).Example: if someone feels ill after drinking too much, it islikely to be caused by the alcohol.

I Using a random experiment for decision making.Examples: “head or tails”; “drawing the short straw”

I An explanation is more likely if it fits a mental model.Example: a person who has a university degree is more likelyto have a well-paid job than a person without a degree.

Copyright Edinburgh Napier University Probability Slide 13/25

Page 15: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Intuitions about probability can be wrong!

I The Monty Hall problem conflicts with intuitions aboutrandom experiments.

I Does it become more likely to win in the lottery if one playsfor many years?

(This is not an example of “practice improvesperformance”!)

I A man is worried about the probability that there could be abomb on board of his plane. Just to be sure he carries onebomb himself because the probability of two bombs is tiny.

I Correlation: countries with higher meat consumption havehigher cancer rates. Does eating meat cause cancer? Or doricher countries have a higher life expectancy?(There can be a hidden cause, or co-occurring events mighthave no relationship at all.)

Copyright Edinburgh Napier University Probability Slide 14/25

Page 16: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Intuitions about probability can be wrong!

I The Monty Hall problem conflicts with intuitions aboutrandom experiments.

I Does it become more likely to win in the lottery if one playsfor many years? (This is not an example of “practice improvesperformance”!)

I A man is worried about the probability that there could be abomb on board of his plane. Just to be sure he carries onebomb himself because the probability of two bombs is tiny.

I Correlation: countries with higher meat consumption havehigher cancer rates. Does eating meat cause cancer? Or doricher countries have a higher life expectancy?(There can be a hidden cause, or co-occurring events mighthave no relationship at all.)

Copyright Edinburgh Napier University Probability Slide 14/25

Page 17: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Intuitions about probability can be wrong!

I The Monty Hall problem conflicts with intuitions aboutrandom experiments.

I Does it become more likely to win in the lottery if one playsfor many years? (This is not an example of “practice improvesperformance”!)

I A man is worried about the probability that there could be abomb on board of his plane. Just to be sure he carries onebomb himself because the probability of two bombs is tiny.

I Correlation: countries with higher meat consumption havehigher cancer rates. Does eating meat cause cancer?

Or doricher countries have a higher life expectancy?(There can be a hidden cause, or co-occurring events mighthave no relationship at all.)

Copyright Edinburgh Napier University Probability Slide 14/25

Page 18: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Intuitions about probability can be wrong!

I The Monty Hall problem conflicts with intuitions aboutrandom experiments.

I Does it become more likely to win in the lottery if one playsfor many years? (This is not an example of “practice improvesperformance”!)

I A man is worried about the probability that there could be abomb on board of his plane. Just to be sure he carries onebomb himself because the probability of two bombs is tiny.

I Correlation: countries with higher meat consumption havehigher cancer rates. Does eating meat cause cancer? Or doricher countries have a higher life expectancy?(There can be a hidden cause, or co-occurring events mighthave no relationship at all.)

Copyright Edinburgh Napier University Probability Slide 14/25

Page 19: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Pigeon hole principle

If 366 people are in the same room, at least two will have the samebirthday. Why?

Copyright Edinburgh Napier University Probability Slide 15/25

Page 20: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Example: what is the probability that 2 people havedifferent birthdays?

How many possibilities are there for 2 people to have differentbirthdays:

365× 364.

How many possibilities are there for 2 people to have anybirthdays: 365× 365.

Copyright Edinburgh Napier University Probability Slide 16/25

Page 21: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Example: what is the probability that 2 people havedifferent birthdays?

How many possibilities are there for 2 people to have differentbirthdays: 365× 364.

How many possibilities are there for 2 people to have anybirthdays:

365× 365.

Copyright Edinburgh Napier University Probability Slide 16/25

Page 22: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Example: what is the probability that 2 people havedifferent birthdays?

How many possibilities are there for 2 people to have differentbirthdays: 365× 364.

How many possibilities are there for 2 people to have anybirthdays: 365× 365.

Copyright Edinburgh Napier University Probability Slide 16/25

Page 23: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Probability that 2 people have different birthdays:

Calculating the probability of an event: all relevant eventsall possible events

Probability that 2 people have different birthdays: 365×364365×365

Probability that 2 people have the same birthday:

1− all relevant eventsall possible events = 1− 365×364

365×365 = 365365 −

364365 = 1

365

Copyright Edinburgh Napier University Probability Slide 17/25

Page 24: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

How many people are needed so that there is a 50%probability that two people have the same birthday?

Three people: 1− all relevant eventsall possible events = 1− 365×364×363

365×365×365 = 0.008

Keep trying with 4, 5, 6, until value > 0.50.

23 people are needed.

(This is a lot less than the 366 people that are needed to have 2people with the same birthday with 100% certainty.)

Copyright Edinburgh Napier University Probability Slide 18/25

Page 25: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

How many people are needed so that there is a 50%probability that two people have the same birthday?

Three people: 1− all relevant eventsall possible events = 1− 365×364×363

365×365×365 = 0.008

Keep trying with 4, 5, 6, until value > 0.50.

23 people are needed.

(This is a lot less than the 366 people that are needed to have 2people with the same birthday with 100% certainty.)

Copyright Edinburgh Napier University Probability Slide 18/25

Page 26: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

How many people are needed so that there is a 50%probability that two people have the same birthday?

Three people: 1− all relevant eventsall possible events = 1− 365×364×363

365×365×365 = 0.008

Keep trying with 4, 5, 6, until value > 0.50.

23 people are needed.

(This is a lot less than the 366 people that are needed to have 2people with the same birthday with 100% certainty.)

Copyright Edinburgh Napier University Probability Slide 18/25

Page 27: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Rules about probability

I Probability is a value between 0 and 1 (or 0% and 100%).

I An impossible event has probability 0.

I A certain event has probability 1.

I Complement: P(not A) = 1− P(A)

I Two events: P(A ∪ B) = P(A) + P(B)− P(A ∩ B)

I Two independent events: P(A ∩ B) = P(A)× P(B)

Copyright Edinburgh Napier University Probability Slide 19/25

Page 28: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Probability of two events

If a person has a university degree, which of the following is moreprobable:

I 1) The person has children.

I 2) The person has children and a well-paid job.

1) is a single statement: P(A).2) is a conjunction of two statements: P(A ∩ B) = P(A)× P(B)

P(A) ≥ P(A)× P(B)

Copyright Edinburgh Napier University Probability Slide 20/25

Page 29: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Probability of two events

If a person has a university degree, which of the following is moreprobable:

I 1) The person has children.

I 2) The person has children and a well-paid job.

1) is a single statement: P(A).2) is a conjunction of two statements: P(A ∩ B) = P(A)× P(B)

P(A) ≥ P(A)× P(B)

Copyright Edinburgh Napier University Probability Slide 20/25

Page 30: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Probability of two events

If a person has a university degree, which of the following is moreprobable:

I 1) The person has children.

I 2) The person has children and a well-paid job.

1) is a single statement: P(A).2) is a conjunction of two statements: P(A ∩ B) = P(A)× P(B)

P(A) ≥ P(A)× P(B)

Copyright Edinburgh Napier University Probability Slide 20/25

Page 31: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Throwing dice

Probability of throwing at least one 1 with two dice:

Throwing one 1 with one dice:

16 .

Throwing two 1s with two dice: 136 .

Throwing at least one 1 with two dice:P(A ∪ B) = P(A) + P(B)− P(A ∩ B) = 1

6 + 16 −

136 = 11

36

11 possibilities:(1,1),(2,1),(1,2),(3,1),(1,3),(4,1),(1,4),(5,1),(1,5),(6,1),(1,6)

What is the probability of getting at least 1 “head” with 2 coins?

Copyright Edinburgh Napier University Probability Slide 21/25

Page 32: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Throwing dice

Probability of throwing at least one 1 with two dice:

Throwing one 1 with one dice: 16 .

Throwing two 1s with two dice:

136 .

Throwing at least one 1 with two dice:P(A ∪ B) = P(A) + P(B)− P(A ∩ B) = 1

6 + 16 −

136 = 11

36

11 possibilities:(1,1),(2,1),(1,2),(3,1),(1,3),(4,1),(1,4),(5,1),(1,5),(6,1),(1,6)

What is the probability of getting at least 1 “head” with 2 coins?

Copyright Edinburgh Napier University Probability Slide 21/25

Page 33: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Throwing dice

Probability of throwing at least one 1 with two dice:

Throwing one 1 with one dice: 16 .

Throwing two 1s with two dice: 136 .

Throwing at least one 1 with two dice:

P(A ∪ B) = P(A) + P(B)− P(A ∩ B) = 16 + 1

6 −136 = 11

36

11 possibilities:(1,1),(2,1),(1,2),(3,1),(1,3),(4,1),(1,4),(5,1),(1,5),(6,1),(1,6)

What is the probability of getting at least 1 “head” with 2 coins?

Copyright Edinburgh Napier University Probability Slide 21/25

Page 34: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Throwing dice

Probability of throwing at least one 1 with two dice:

Throwing one 1 with one dice: 16 .

Throwing two 1s with two dice: 136 .

Throwing at least one 1 with two dice:P(A ∪ B) = P(A) + P(B)− P(A ∩ B) = 1

6 + 16 −

136 = 11

36

11 possibilities:(1,1),(2,1),(1,2),(3,1),(1,3),(4,1),(1,4),(5,1),(1,5),(6,1),(1,6)

What is the probability of getting at least 1 “head” with 2 coins?

Copyright Edinburgh Napier University Probability Slide 21/25

Page 35: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Winning the lottery

Which combination of numbers is more probable:1, 2, 3, 4, 5, 6 or 13, 25, 27, 35, 41, 45?

All possibilities to draw 6 out of 49: 49!6!×(49−6)! =

1×2×3×...×49(1×2×...×6)×(1×2×...43) = 44×45×46×...×49

1×2×...×6 = 13, 983, 816

Probability of getting all 6 right: 113,983,816

Copyright Edinburgh Napier University Probability Slide 22/25

Page 36: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Winning the lottery

Which combination of numbers is more probable:1, 2, 3, 4, 5, 6 or 13, 25, 27, 35, 41, 45?

All possibilities to draw 6 out of 49: 49!6!×(49−6)! =

1×2×3×...×49(1×2×...×6)×(1×2×...43) = 44×45×46×...×49

1×2×...×6 = 13, 983, 816

Probability of getting all 6 right: 113,983,816

Copyright Edinburgh Napier University Probability Slide 22/25

Page 37: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Inferential statistics

Using probability theory to

I estimate a value (for example a mean)

I test a hypothesis

I make a prediction

Copyright Edinburgh Napier University Probability Slide 23/25

Page 38: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Testing

A test for cancer correctly diagnoses cancer in 98% of the tests. In2% of the tests, the result is false positive, i.e. the test showscancer even though the patient is healthy.

Assumptions:10,000 people are tested with this cancer test and the cancer isfairly rare (only 0.5 % of people have this cancer).

If a patient is told that the test is positive, should the patientworry?

Copyright Edinburgh Napier University Probability Slide 24/25

Page 39: Probability - Uta Priss

An example Probability and intuition Mathematical probability Testing

Testing (continued)

Test is 98% correct:98/100 × 0.5/100 × 10,000 = 49

Test has 2% false positives:2/100 × (1 - 0.5/100) × 10,000 = 199

⇒ Test has 248 positive results.49/248 ≈ 20% probability to have cancer if test positive.

Copyright Edinburgh Napier University Probability Slide 25/25