chebychev , hoffding , chernoff
DESCRIPTION
Chebychev , Hoffding , Chernoff. Histo 1. X = 2*Bin(300,1/2) – 300 E[X] = 0. Histo 2. Y = 2*Bin(30,1/2) – 30 E[Y] = 0. Histo 3. Z = 4*Bin(10,1/4) – 10 E[Z] = 0. Histo 4. W = 0 E[W] = 0. A natural question:. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/1.jpg)
![Page 2: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/2.jpg)
0.
0.1
-50 -40 -30 -20 -10 0 10 20 30 40 50
X = 2*Bin(300,1/2) – 300E[X] = 0
![Page 3: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/3.jpg)
0.
0.1
-50 -40 -30 -20 -10 0 10 20 30 40 50
Y = 2*Bin(30,1/2) – 30E[Y] = 0
![Page 4: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/4.jpg)
0.
0.1
-50 -40 -30 -20 -10 -38 10 20 30 38 48
Z = 4*Bin(10,1/4) – 10E[Z] = 0
![Page 5: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/5.jpg)
0.
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1.
-50 -40 -30 -20 -10 0 10 20 30 40 50
W = 0E[W] = 0
![Page 6: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/6.jpg)
• Is there a good parameter that allow to distinguish between these distributions?
• Is there a way to measure the spread?
![Page 7: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/7.jpg)
• The variance of X, denoted by Var(X) is the mean squared deviation of X from its expected value = E(X):
Var(X) = E[(X-)2]. The standard deviation of X, denoted
by SD(X) is the square root of the variance of X.
SD(X) = Var(X).
![Page 8: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/8.jpg)
2 2Var(X) = E(X ) E(X) .Proof:
E[ (X-)2] = E[X2 – 2 X + 2]
E[ (X-)2] = E[X2] – 2 E[X] + 2
E[ (X-)2] = E[X2] – 22+ 2
E[ (X-)2] = E[X2] – E[X]2
Claim: Var(X) = E[(X-)2].
![Page 9: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/9.jpg)
1. Claim: Var(X) >= 0.
Pf: Var(X) = (x-)2 P(X=x) >= 0
2. Claim: Var(X) = 0 iff P[X=] = 1.
![Page 10: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/10.jpg)
![Page 11: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/11.jpg)
![Page 12: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/12.jpg)
Theorem: X is random variable on sample space S, and P(X=r) it’sprobability distribution. Then for any positive real number r:
(proof in book)
2
( )(| ( ) | )
V XP X E X r
r
In words: the probability of finding a value of X farther away from the meanthan r is smaller than the variance divided by r^2.
r
![Page 13: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/13.jpg)
What is the probability that with 100 Bernoulli trials we find more than89 or less than 11 successes when the prob. of success is ½.
X counts number of successes.EX=100 x ½ =50
V(X) = 100 x ½ x ½ = 25.
P(|X-50|>=40)<=25/40^2 = 1/64
![Page 14: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/14.jpg)
![Page 15: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/15.jpg)
“k standard deviations”
![Page 16: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/16.jpg)
![Page 17: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/17.jpg)
![Page 18: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/18.jpg)
![Page 19: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/19.jpg)
![Page 20: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/20.jpg)
Let be random variables that for
![Page 21: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/21.jpg)
![Page 22: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/22.jpg)
, ,
![Page 23: Chebychev , Hoffding , Chernoff](https://reader035.vdocuments.mx/reader035/viewer/2022062305/568151f3550346895dc02c3e/html5/thumbnails/23.jpg)
What is the probability of getting 25 or fewer heads in 100 coin tosses?