i - probabilityfrst231-forestry.sites.olt.ubc.ca/files/2012/07/probability-part1.pdf · section 2 -...
TRANSCRIPT
Section 2 - Probability (1)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
What is Probability?– the chance of an event occuring
eg
�classical probability
�empirical probability
�subjective probability
Section 2 - Probability (2)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Terminology
– random (probability) experiments• a process that leads to well defined
results called outcomes…
– outcomes• the result of a single trial of an
experiment
• aka: elements, sample points
eg
experiment:
outcome:
Section 2 - Probability (3)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Terminology– sample space
• the set of all possible outcomes in a random experiment
• a listing of all sample points
eg - flip a coin twice
– event• a subset of the sample space with
some special characteristics
eg - get a head first
- get at least one tail
Section 2 - Probability (4)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Terminology– Venn diagram
• a graphical representation of probability problems
A B
S
A = (HH, HT)
B = (HT, TH, TT)
Section 2 - Probability (5)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
1. classical probability– uses sample spaces to determine
the numerical probability that an event will happen
– a sample space has ‘n’ equally likely outcomes; an event contains ‘f’ of those
ie
eg
( )nf
EP =
Section 2 - Probability (6)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
2. empirical probability– uses observations (frequency
distributions) to determine numerical probabilities
eg
• flip a coin 500 times...
P(head) =
• frequency distributions...
P(belonging to a class) =
Section 2 - Probability (7)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
3. subjective probability– educated guess, opinions, inexact
information
– based on a person’s knowledge, experience, or evaluation of a situation
eg
Section 2 - Probability (8)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
3. subjective probability
– odds
• if E is an event...
- the odds in favour of E are:
- the odds against E are:
( ))(
)(
EPEP
Eodds =
( ))()(
EPEP
Eodds =
Section 2 - Probability (9)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Laws of Probability
�all outcomes in a sample space are equally likely to occur (ie, each has the same probability)
where:
( ) α=EP
10 ≤≤= αα
Section 2 - Probability (10)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Laws of Probability�an event’s complement is when
that event does not occur
E_E
S
( ) ( ) ( ) 1==+ SPEPEP
( ) ( )EPEP =−∴ 1
eg B = (HT, TH, TT)
Section 2 - Probability (11)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Compound Events
– experiment: roll a dieS = (1, 2, 3, 4, 5, 6)
– 3 events: roll an even number
A = (2, 4, 6)
roll less than 3
B = (1, 2)
roll a 1
C = (1)
S
B A
C
Section 2 - Probability (12)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Compound Events
S
B A
intersection of events:
•probability of events occurring simultaneously, (overlapping elements)
( ) ( )BPAPBAP ×=∩ )(eg
“multiplication rule for independent events”
Section 2 - Probability (13)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Compound Events
S
A
C
mutually exclusive or disjoint events:
•occurrence of one event precludes the other, no intersection (no common elements)
Section 2 - Probability (14)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Compound Events
S
A
C
union of events:
•probability of one event or another (others) occurring
eg
“addition rule for mutually exclusive events”
( ) ( ) ( )CPAPCAP +=∪
Section 2 - Probability (15)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Compound Events
S
B A
union of events that are not mutually exclusive:
eg A = (2, 4, 6) P(A) = 1/2
B = (1, 2) P(B) = 1/3
Section 2 - Probability (16)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Compound Events
S
B A
union of events that are not mutually exclusive:
eg
“addition rule for events that are not mutually exclusive”
( ) ( ) ( ) ( )BAPBPAPBAP ∩−+=∪
( ) ( ) ( ) ( )BPAPBPAP −+=
Section 2 - Probability (17)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability - Compound Events
Review:
P (Queen of Hearts) =
P (Queen of Hearts or Queen of Spades) =
P (a Queen or a Heart) =
Section 2 - Probability (18)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Laws of Probability (review)
�general formula
�complement law
( )nf
EP =
10 ≤≤= αα
= α
where
( ) ( ) ( ) 1==+ SPEPEP
( ) ( )EPEP =−∴ 1
Section 2 - Probability (19)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Laws of Probability (review)
�addition law(for mutually exclusive events)
�generalized addition law(events need not be mutually exclusive)
( ) ( ) ( )BPAPBAP +=∪
( ) ( ) ( ) ( )BAPBPAPBAP ∩−+=∪
( ) ( ) ( ) ( )BPAPBPAP −+=
Section 2 - Probability (20)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Laws of Probability
�multiplication law(for independent events)
( ) ( )BPAPBAP ×=∩ )(
independent events - the probability of one event occurring does not effect the probability of the other occurring.
dependent events - the outcome of the second event is affected in such a way that the probability is changed.
Section 2 - Probability (21)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Laws of Probability
�generalized multiplication law(events need not be independent)
( ) ( )ABPAPBAP ×=∩ )(
conditional probability
the probability that event B occurs after (given that) event A has already occurred.
if events A and B are independent, then...
P(B|A) = P(B)
Section 2 - Probability (22)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability
Review: - drawing from a deck of cardswithout replacement
P (Q, K) =
P (Q, Q) =
P (Q, Q, Q) =
P (J, Q, K) =
P (Heart, Diamond) =
P (Heart, Heart, Heart) =
Section 2 - Probability (23)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability
log sort problem:
A mill purchases logs from 2 suppliers:
companies loggers80% of logs 20% of logs1% defective 2% defective
If all of the logs are randomly put in a log sort, what is the probability that a randomly selected log will be defective?
Section 2 - Probability (24)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability
log sort problem (cont.):
Section 2 - Probability (25)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability
log sort problem (cont.):
Section 2 - Probability (26)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Probability
log sort problem (cont.):
Section 2 - Probability (27)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
eg flip a coin twice S = (HH, HT, TH, TT)
2 events: at least one Head: A = (HH, HT, TH)first toss a Head: B = (HH, HT)
What is P(B|A)?
( ) ( )ABPAPBAP ×=∩ )(
( ) ( )( )AP
BAPABP
∩=
Section 2 - Probability (28)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
log sort problem:
1,000 logs:
company logger TOTALdefective 8 4 12not defective 792 196 988TOTAL 800 200 1000
What is the probability of selecting a defective log given that it came from a logger?
Section 2 - Probability (29)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
log sort problem (cont.):
Section 2 - Probability (30)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability– has order, depending on the
question being asked...
�natural order- ordered in terms of events
�Bayesian probability- reverse order- based on some information, what is the
probability of an event which occurred in the past?
eg P (D|C)
ie P (B|A) - B occurs after A
eg P (C|D)
Section 2 - Probability (31)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
�Bayesian probability (cont.)- solve using conditional probability
Section 2 - Probability (32)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
species blow-down problem:
species: blow-down rate:
D-fir 0.0001cedar 0.05hemlock 0.01
Given a tree that has blown down, what is the probability that it is a cedar?
Section 2 - Probability (33)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
species blow-down problem (cont.):
Section 2 - Probability (34)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
species blow-down problem (cont.):
Section 2 - Probability (35)FRST 231 / WOOD 242Introduction to Biometrics & Business Statistics
I - Probability
Conditional Probability
�Bayesian probability (cont.)
Bayes’ Theorem: for 2 events, A and B, where B follows A:
( ) ( )( )∑
=
∩
∩=
n
jj
jj
BAP
BAPBAP
1
( ) ( )( ) ( )∑
=
=n
jjj
jj
ABPAP
ABPAP
1