^7j 'btd8ucx^slp r]yq; u?b]james/lectures/prob.pdf · o (# ) (# # ) * ' b ·_

52

Upload: others

Post on 10-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

����������� ������ ����� ��������������! #"$ #%'&(")")*,+

-�.(/)0213/4045687:9�;=<?>A@#BC;D> EFG7:9�;=<?>A@#BH<JI#KL;�MN@#OQP RTSLUVOQ>W<VOQXYBH<VO#X#U?Z\[V<VB]SN<VI^KL;�> 6=_E^7a`bOcRT;�d?BC<VRTSeU?O 6gfh 7jikU?B]Z�>l<VOQXSmOQ;�no@p<VKmSeR]SL;�> FVEfG7:qrU?Zts^KL;DRT;DOQ;D>T>lU?Mvu)wx<VOQXYU?B]RTyQU8d?U?Op<VK2s^BCUVzA;DPDRTSeU?O FV{{^7:qrU?O|[8;DBTd8;DO#P�;xSmO}ur~ ����� FV�� 7:q�yp<VBH<VPDRC; BTSe>]RTSeP�MN@#OQPDR]SLU?O#> EG6�^7:��<V@#>T>]SL<VO�BH<VOQX^U?Z\[V<VB]SN<VI#Ke;�> E h�^7j�'BTd8UcX^SLP�R]yQ;�U?B]� E8f6g_G7��c@#Zt>WU?M(SmOQX#; s�; OQX#;DO|RlBH<VO#X#U?Z�[V<VB]SN<VI#Ke;�> E?��v�G;DBTPDSL>];�> h F`bOQX^; � fc6

�4�g�]�,���g� �,�]��� �,���������T�! g�] ¢¡£���}¤J����¥�¦§���¨¤! g�T�D�¨�}�©¡t�¨�g�«ª��©�¨�g�]¬­� ����®A�©¯��^����°V�D�±�©�±�,�!�³²v�g�µ´¶ �T�,�,�µ�N¦·� ¡±¸�� ¬�¥!���� g¹D� ¸º�D°�¦g���»¹D�����,�]¬­�©���!�½¼4�µ�¨�¾�¨�g�¿�D¤g�,�!�D�] Àº¯µ�T� �,�Á�,�]�! Â®Ã�D�¨�,�]®Ã�,�µ���!�Ä�,�źÆLÇ�ÆeÈJÉ�Ç�Ç?Ê�Ë ÌJËCÍ!ÎDÍ?ËDÏ Î Ð4Æ�Ñ ÎTÒ(ÆNÎ!ÑQÆÔÓgÕ Ö

Page 2: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

�����)1������|19�;�<?>]@^BC;�>]sp<?PD;�>������Ã<JKLd8; I#BH<?>�� ��� >A�G>ARC; Z�>Y<VO#X @^O#SLno@Q; OQ;�>]>�U?M�;©�GRT;DOQ>ASLU?O�� >]RC<VRC; Z�; O|RYU?Mq­<VBC<VRTy"!;�UcX#U?BT��# >W; �cRC; OQ>]SeU?OYRTyQ;DU?BC; Z}7"$VqrUVOQ>]R]BT@QP RTSLUVO�UVM&%4; I�;D>Td?@Q;�Zt;=<?>A@#BC;�UVO(')$+*rU?BT;DK��� <VKLd?;DI#BC<YUVM"',�-%4;DIº;�>]d?@Q;/.^�cRTSe;DKmR,zA;�>�Zt;=<?>A@#BC;D>�<VO#X�s#BTU?Ip<VI^SeKeSmR �}XGSL>]R]BTSmI#@#RTSeU?OÄMN@#OQP RTSLUVOQ>�7`bOQX^;Dsº;DOQX#; OQP�;�U?MW; [8;DO|RT>0�$SeOQX#; s�; OQX#; OQP�;YU?M)��� <VKLd?;DI#BC<?>�71*�U?BC; K2.^q­<VO|RT;DKeKmS$KL;DZ�Z�<?>�743�UVK5�ZtU8d8U?BTUg[�# >)6�; BCU7.cUVOQ;�KN<98�79�;�<?>]@^BH<VI#Ke;�MN@^OQPDR]SLU?OQ>���BC<VOQX#U?Z [?<JBTSN<JI#KL;D>0�$SeOQX#; s�; OQX#; OQP�;�U?M BC<VOQX#UVZ [V<VBTSL<VI#KL;D>�7ÁqrU?O:�>ARTBT@#PDRTSeU?O�U?M$RTyQ;�SmOcRT;�d?BC<VK;�º; �csº;�PDRC<VRTSeU?O47�qrU?O|[8;DBTd8;DO#P�;tSmO�Z�;�<?>]@^BC; <VOQXÄPDU?O|[8;DBTd8;DO#P�;�<JK5�ZtU8>]R ; [8; BT��8 yQ;DBT;?7=<p<VRCUV@#µ>�KL;DZ�Z�<:�vZtU?OQU?RTU?OQ;<VO#X X^U?ZtSmOp<VRT;�X«P�UVOc[?;DBTd8;DOQPD;>�r@^O#SeM�U?B]ZSmOcRT;�d?BC<VI#SmKeSeR �>�(XGS@?º;DBC; O|RTSN<JRTSLUVO³@#OQX^;DB�R]yQ;�SeO|RT;�d?BC<VKr>ASLd?O271A SL>]PD@Q>]>]SLUVOQU?M s#BTUGX^@#PDR�Zt;=<?>A@#BC;<VO#X�>ARH<VRT;DZt;DO|RlU?MB<#@#I^SeO#SC#µ>­R]yQ;�U?BT;DZ�7q�yQ; I|�GPCy#;D[�#µ>�SmOQ;�no@p<VKmSeR �>�2RH<VSmK';�>ARTSeZ�<VRT;�>�7ED?; OQ>T; O#µ>�SeOQ;Dno@p<VKeSmR �87tqrU?Z�s#KL; RC; OQ;�>]>�U?Mru w M�U?B6GFIH4JLK§7NMPOU?KeX#;DB0#µ>l<VO#X±9�SmORQ8US8W>TQcSC#µ>WSeO#;�no@p<VKmSeRTSe;�>D7uNU�<?>�<VMWSeKmI�; BTR�>Asp<?P�;V7XW BTRTy#U8d8U?Op<JK s#BCUJzA;�PDR]SLU?O��2BC;DKL<VRTSeU?OY8 SmRTy�;DKe;DZt;DO|RH<VB]�±PDU?OQX^SmRTSLUVOp<VKs#BTU?Ip<VI^SeKeSmR �87PZ�<VB]SN<VO#P�;�<VOQX�P�Ug[V<VBTSL<VOQPD;?7���<V@#>T>]SL<VOÄBH<VO#X#U?Zj[V<VB]SN<VI#Ke;�>��)R]yQ;�Z�@#KmRTSe[V<VB]SN<VRT;OQUVBTZ�<VK4X^Se>]RTB]SeI#@^RTSLUVO47[ yQ;$>ARTBCUVOQd KN<98�U?M|KN<VBTd8;vO|@#Z�Iº;DBT>0�!s#BCUcU?M|M�U?B2SmOQX#;Dsº;DO#X#;DO|R)BH<VO#X#U?Z [V<VB]SN<VI^KL;�>�8 SeR]y�IºU?@#O#X#;�XM�U?@^BTRTy�Z�UVZ�; OcRT>�7­9�;=<?>A@#BC;�s#BC;D>T; BT[|SeOQd�RTBC<VOQ>]M�UVBTZ�<VRTSeU?OQ>0��*�;DBTO#U?@#KeKmS4>]y^SeMNRC>D7W9}<J�cSmZ�<VK2;DB\�d8UcX^SeP­RTyQ;DU?BC; Z <VOQXX*�SmB]Q|yQU>? # >$<VKmZ�U8>AR';D[?;DB]�^8 y#;DBC;k;DBTd8UGXGSLP­RTy#;�U?BT;DZ_�8s#BCUcU?M3U?M3RTyQ;W>]R]BCU?O#dKL<S8�7[ yQ;"<QU?@#BTSe;DB)RTBC<VOQ>AM�U?BTZÂU?M#<,`#O#SmRC;$Z�;�<?>]@^BC;>�VPCyp<VBC<?PDRT;DBTSe>]R]SLP$MN@#OQPDR]SLU?O#>0�V@^O#SLno@Q; OQ;�>]>'<VOQX�SeO:�[?;DBC>ASLU?O27Ba³;�<bQ�P�UVOc[?;DBTd8;DOQPD;>�G>]RH<JRC;DZt;DO|R�U?M�%�!;D[|��#µ>�P�U?O|R]SeO|@#SeR ��RTyQ;DU?BC; Z M�U?B$PCyp<JBH<?P RC;DB]SL>ARTSLPMN@#O#PDRTSeU?OQ>D7 [ y#;�PD;DO|RTBC<VK)KeSmZtSmR�R]yQ;�U?BT;DZ�7

�+c�cedgf�ced7hjilkSm4nof�f�pqr 7s*�SmKeKmSeOQd8>AKL; � t-uwv>x/y�x0z�{|z�}j~+y>���P���]y7���^u/� 7oa SmKL;D�}6g�8�of��\� {ofG7µ_8_�yp<VBTX^Ip<?PwQ^�©7� 7�9�7�A @QX^KL; � ���]y>{�����y>{|~S��z@��y>����t-u/v>x/y�x0z�{|z�}j~J7�q�yp<Vs#Z�<VO}<VOQXVM <VKmK'6g�8� h

�\�'f8fG7µ_8_�yp<VBTX^Ip<?PwQ^� 7A�7Ra SmKeKeSL<VZt> t-uwv>x/y�x0z�{|z�}j~E�oz�}�����y>u�}jz��^��y>{@�/� 7�q­<VZ�I#B]SLX#d?;��lO#Sm[8;DBT>]SmR � r BC;�>]>�6=�8�^6

�]�r6gfG7»�8f�sQ<Vs�; BTIp<VPwQ#�©7

Page 3: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �687�� 1��(5g���41p5

687Ô687 %4;DR�� Iº;�<�>];DR�7�� � �Ty>{ �^�0x0u\y"!±Se>l<�>];DRkU?Mv>A@#IQ>];DRC> U?M � >C<JRTSL>AMN�|SeOQdR�GM�U?Bk<VKeK$#&%'!<VO#X}<VKmK4>T;Dno@Q;DOQPD;�>x�(#�)+*-,.%0/�� SeO.!e�

1 %2!43 #65�%�!73 84)9#�)+%2!4:[ yQ;�sp<VSmB��(�;3<!�� SL>�P�<VKeKe;�X½<>=��]y7���^u\y�x0{@���@?RyBA/� 7��Se[8; O �(�;3<!����);�<?PCyC#D%E!�SL>�P=<JKeKL;DX�<=��]y7���^u\y�x0{@���S��},7`bR�8 SmKeK)Iº;�P�U?O|[?;DO#Se;DO|R9�4;D>]sº;�PDSL<VKeKm�SeO�>];DR]RTSeO#d�@#s±RTy#;xIp<?>ASLPxR]yQ;�U?B]� ��RTU�yp<=[8;�OQ<VZ�;D>kM�U?B

>]U?Z�;�U?R]yQ;DBk>TU?B]RC>lU?M >];DRT> U?Mv>]@#IQ>];DRT>GF U?MH�X�QZ�U?BT;�d8;DOQ; BH<VK)R]yp<VOY���Ã<VKed8;DI#BC<?>�7 �^<=�RTyp<VRF Se>W<����]��~S��} �I=\SmM �^M�U?Bl<VKmKJ#K3MLN%OF(�

1 %PFQ3 #SROLN%PFQ:�^<=��R]yp<VR FÂSL>�<UT��\��~g��} �I= SeM �8M�UVBr<JKeK�#K3MLN%OF 8 SeRTyV#XWYL <JOQX�<JKeK#SmOQPDBT;=<?>ASeOQd�>T;Dn|@#;DOQPD;�>�Z#�)+*-,.%0/�� SeOQF(�

�[%PF\3 L^]�#&%OF\3 84)_#G)"%PFQ:�^<=�R]yp<VR�F Se>W<Vu�z��^��SeM �cM�U?Bl<VKeKJ#�3ML[%PF+�

1 %OF\3 L^]�#X%PFQ3 #`8OLa%PF\:�^<=�R]yp<VR�F Se>W<VO y>{ �^�0x0u\y�SmM �^M�U?Bl<VKmKJ#K3MLN%OF(�

1 %PF\3 #�5�%PFQ3 #S8PLN%OF\:ilU?RC;�RTyQ<VR6F SL>�<(��� <VKLd?;DI#BC<�SeM�<VOQX�U?O#Km�}SeM F Se>�I�UVRTy½<+��� >A�G>ARC; Z <VOQX�<\T��b>]�c>]RT;DZ�7 `bOR]yQ;�P�<?>T;��cb ',�)RTyQ;�>T; R UVMvSeO|RT;DBT[V<VKe>WU?MvR]yQ;�M�UVBTZ��Zd�3feMg)M�U?BGd JYe SL>l<���� >A�c>]RC; Zih?7 [ y#;>];DRkU?M�`^O#SeRT;�@#O#SLUVOQ>WU?MvXGSL>�zAUVSeO|R ;DKe;DZt;DO|RC>WU?M7h�SL>l<�BTSmOQd�I#@#RWOQUVR <JO}<JKLd8; I#BH<^7687»FG7 [ yQ; >T; R�UVM­<VKmK'>]@^IQ>T; RC>�jW�(���kSe>�U?I|[cSeU?@Q>AKe��<(��� <VKLd?;DI#BC<^7 [ yQ;�SeO|RT;DBC>];�P RTSLUVO½UVM­<VO|�PDU?KeKe;�PDR]SLU?OYUVMB��� <VKLd8; I#BH<V>­SL>l<VKL>]U�< ���Ã<VKed8;DI#BC<^7 [ y|@Q>lM�UVB <JOc�Y>];DRlU?Mv>]@#IQ>];DRT>kF+�#RTyQ;�SeO|RC; B\�>];�PDR]SLU?O½U?M­<VKeK R]yQ; ���Ã<JKLd8; I#BH<?>�PDU?O|RH<VSmO#SeO#d;F SL>�SeRT>T; KeMr<V��� <VKLd?;DI#BC<:�2P=<JKeKL;DX�RTyQ;X���Ã<JKLd8; I#BH<�^������u\y>} �]�+x0~VF <VO#X�X^;DOQU?RT;�X_�'�lF � 7'`bMm� SL>W<�RCU?sºU?KeU8d?SLP�<VK3>]sp<VP�;>� 8�;�P=<VO�X#U�RTy#Se>­RCU RTyQ;>];DR�U?M�U?sº;DOÄ>];DRC>onl7 [ yQ;���� <VKLd8; I#BH<E�'�(nr��>TUUVI#RH<VSmOQ;�X±Se> P�<VKeKe;�X}R]yQ;+p�v7uw��{N���Ã<JKLd8; I#BH<�U?M� <VOQXYSL> X^;DOQU?RT;�Xrq �s���©7 [ yQ;G*rU?BC; K����Ã<JKLd8; I#BH<�U?Me'·Se> X#;DOQUVRC;�X�>]SmZts#Km�tI|�Pq�7687µE^7 %4;DR�F Iº;�<�BTSeO#d�U?Mv>A@#IQ>];DRC>lU?Mm�t7H� �S��}ut��l��A�}jzCv7�}Se> <VO|��MN@#OQP RTSeU?OPv>*9Fxw y _�3�Kzg8 SmRTy0v � 1 �{b·_^7 %4;DR�v�Iº;�<�>];DR MN@^OQPDR]SLU?O47­�^<=�YRTyp<VRGv�SL>�z���A�uw�]y7��z��^��SmM �#M�U?Bk<VKeK�#K3ML|%}F8 SmRTyr#~W�LE�

v'�(#��"F�v �sL���:�^<=�R]yp<VRkv�SL>Gy����>z�}jzl�>��SeM �cM�U?Bl<VKeK2X^SL>�zAU?SeO|R >];DRC>G#�3fLa%rF+�

v'�Z#S8OL���b�v �(#��$�zv'�sL��I:�^<=��RTyp<VR6v³SL>+A/v7�l� }Cy�x0{|~Vy����>z�}jzl�>�xSmM �3M�U?B�<VKeK(>T;Dno@Q;DOQPD;�>�U?M�X^Se>�zAU?SmOcRk>T; RC> �Z#�)\*�,z%'/���SeOF 8 SmRTy�84)�#G)+%PF(�

v'��84)9#�)8�{bE� ) v'�(#G)8��:

Page 4: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

�^<=� RTyp<JRQv Se>.A/v7�^� };y�x0{|~ ���Rx/y����>z�}jzl�>��SeM �rM�U?B�<VKmKk>];�no@Q; OQP�;D>³�Z#�)Y*k,|%a/��YSmO F 8 SeR]y84)_#G)+%PF+�

v'��84)9#�)8�-F^� ) v �(#�)?��:W�O}<�BTSmOQdKF(�p<JOc�<?X#X^SmRTSe[?;�>T; RlMN@^OQPDR]SLU?OYSL>­SmOQPDBT;=<?>ASeOQd^7687 h 7 %4;DR��(�;3<!�� I�;x<tZ�;�<?>]@^BH<VI#Ke;x>Asp<?P�;V7o� PDU?@#O|RH<VI^Ke�}<?X#X^SmRTSe[?;�>];DR�MN@^OQPDR]SLU?O�vz*�!>wy _�3�Kzg­Se>�P=<JKeKL;DX <C=��]y7���luw�?7 [ yQ;RTB]Ses#Ke;±�(�;3<!43fv)��SL>xR]yQ;DOÁP=<VKmKL;DX <'=��]y7���luw���@?RyBA/� 7½`bMv'�(���Kba6tRTy#;DOCv¿Se>x<Q?�uwv>x/y�x0z�{|z�} ~r=��]y7���luw��<VOQX �(�;3<!43fv4��Se>x<Q?�uwv>x/y�x0z�{|z�} ~ �@?RyBA/� 7 [ y#;OQUVRH<VR]SLU?O���� 3�� 3T����Se> U?MNRC; O�@#>T;�X�RCU X#; OQU?RC;�<�s#BTU?Ip<VI#SmKeSmR �t>Asp<?PD;?7 `bM7v'�s�x� JLK �^RTy#;DOrvSe> <��N� z�} � Zt;=<V>]@#BT;?7W`bM RTy#;DBC;�; �cSL>AR >];DRT>o�k);%z!73 ,2%>/G3�8 SeR]y0v'�(�k)8�,J K M�U?Bk<VKmK�,�<VO#X84)-� )Kb��X�GR]yQ;DO\v�SL>r<�� ���N� z�} �'Zt;=<?>A@#BC;V7'`bM4�¾Se>­<�RTU?sºU?KLU8dVSLP=<JKQ>]sp<VP�;�<VO#X�SeM7!Pb�q �s�x���R]yQ;DOPv}Se>­<+p�v7uw��{2Zt;=<?>A@#BC;�UVOP��GSmM4Z�UVBC;�Ug[?;DB v'��Ä�"J K M�U?B­<VKeKºP�U?Z�sp<?P R­>];DRC>�I�cRTyQ; OvÄSL>W<X�)y��^v7�}Zt;=<?>A@#BC;V7687»fG7 �_hjq � dgm�kSm���m^iRq �edgm+k���m�f�d���� %); R���Iº;kPDU?@#O|RH<VI^KL;l>T;DR­<VOQX�KL;DRk!\bEj �s���©7 �&=Xy7�/�t��^��A�} zCv7� SL>t<VO|� MN@#OQP RTSLUVO�� *�� w y _�3�Kzg,7 `bMUv¢SL>t<�Zt;=<V>]@#BT;�U?O·�s�V3<!����rR]yQ;DO�­I|�PDU?@#O|RH<VI^KL;�<?X#X^SmRTSm[cSmR � �

v'�(#��HbX�� ���

v'�����! V��3 #&WY�V:�GU�RTyQ; BC; Se>r<xUVOQ;��¨RCUb�bU?OQ;lP�U?B]BC;�>As�UVOQX#;DO#P�;�Iº;DR 8�;�;DOYZt;=<?>A@#BC;D> <VOQX�Z�<V>T>�MN@^OQPDR]SLU?OQ>��^d?Sm[8; OI|�

�Ä�"�º��b�v'�#���! V�I3 v'�(#��Hb �� � �

�Ä�"�º��:[ y#SL>'>]U?BTR'UVMQZ�;�<?>]@#BT; >]sp<VP�;­s#BTU![|SeX#;�>'<%$ RCUg��#?[?;DBC>ASLU?O UVM3R]yQ;­d8; OQ;DBC<VK#R]yQ;�U?B]� � 8 yQ; BC; ;�<?PCy

U?M�RTyQ;�BT;�>]@^KeRC> 8�;�s^BCUg[8; M�U?B�d8; OQ;DBC<VK'Z�;�<?>]@^BC; >]sp<VP�;�>�BC;DX^@QP�;D>�RTU�>]U?Zt;�>]RTBC<VSLdVycR]M�U?B]8r<VBTXM�<?P R�<JI�U?@^RlR]yQ;�P�U?O|[8; BCd8; OQP�;xU?M'>T; BTSe;�>�7 [ y#SL>WSL>l<VKmK)U?OQ;�OQ;�;DX#>kRTUtX#Ut;DKe;DZt;DO|RH<VB]�X^Se>TPDBT;DRT;s#BTU?Ip<VI^SeKeSmR ��<VOQX�X^Se>TPDBT;DRT;��bR]SeZt;�9}<JB]Q8Ug[}PCyp<VSeO#>0�4>TU�R]yQ;�>];�RCU?s^SLP�>�<VBC;x@#>]@p<VKmKe��SeO|RTBTUGXG@QP�;DX8 SmRTyQU?@^R�XGSL>TP @Q>T>ASeOQd�Z�;�<?>]@^BC; RTyQ;DU?BT�?79�U?BT;�Ug[8; BxZt;=<?>A@#BC;D>x<V>T>TUcPDSL<VRC;DX�8 SmRTy�Z�<?>]>�MN@#OQP��R]SLU?OQ>W<JBC;�;�>]>T;DO|R]SN<VKmKe��RTyQ;�U?O#Km��;©�#<JZts#Ke;�> U?O#;�P�<VO�X#;�`#O#;�;©�cs#KeSePDSeR]Ke��*&8�;�RT@#B]O�OQUS8¢RCU�RTyQ;PDU?OQ>]R]BT@QP RTSeU?O}UVM(ZtU?BC;�d?;DOQ; BH<VK4Zt;=<?>A@#BC;D>�7687µ{^7'& f)(eq�kSd*�+�>kghjf)( i,(+-.�/��iRdgi,�>kSm�d7h"0�ilkghjf)( f213��m^iRq �edgm^q4� 9�U8>AR ���Ã<VKed8;DI#BC<?>�<VBT;t>]UKL<VBCd8;�RTyp<JR�U?OQ;tP=<VO^OQU?R�X^;�`#OQ;�Zt;=<V>]@#BT;�>�X^SmBC;DPDRTKm�87�`bOQ>]RT;=<?X U?O#;�>]sº;�P S@`Q;D>�RTyQ;�[V<VKe@Q;D>�RTUIº;�RH<bQ?;DO½U?O�>TU?Zt;�>]Z�<VKmKL;DB >T; R�UVMr>A@#IQ>T; RC>��e8 y#SePCy³d?;DOQ; BH<VRT;�>�RTyQ;����Ã<VKed8;DI#BC<^7 [ y#SL>�d?Sm[8;�>B]SL>T;�RTU�R 8rUs#BTU?I#Ke;DZt><*�`^BC>]R�RTU+Q|OQUS8 RTyQ<VR�RTy#;DBC;�Se>�<�Z�;�<?>]@^BC;�; �cRT;DOQX^SmOQdRTyQ;�dVSe[8; OÄ>T; RMN@#O#PDRTSeU?O�o>];�P�UVOQX�RTU�Q|OQUS8ÁR]yp<VR'RTy#;DBC;­Se>vOQU?RvZ�U?BT;rRTyQ<VO�U?OQ;?7 [ yQ; `#BC>AR's#BCUVI#KL; Z4�78 y#SLPCy SL>U?O#;�U?M�P�U?OQ>ARTB]@QPDR]SLU?O�GSL>rX^;=<VKmR-8 SeR]yIc�tRTyQ;�M�UVKeKLUS8 SmOQd�BT;�>A@#KeR�7 [ yQ;�s#BCUcU?M)SL>�d?Se[?;DOYRCUS8r<VBCX^>R]yQ;k; OQX�UVM�RTy^SL>�>T;�P RTSeU?O .xyQUS8�;D[8; B9�#UVOQP�;)8r;lyp<=[8;kP�U?OQ>ARTB]@QPDRT;�X�U?@^B�Zt;=<V>]@#BT;�>0�|RTy#;kX#; RH<VSmKL>U?M(RTyQ; SeBWPDU?OQ>]R]BT@QP RTSeU?OYs#BCUg[8;�RCU�Iº;�KN<VBTd8;DKm�tSmBTBC; KL; [?<JOcR�7

Page 5: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �� �em�f�dgm � �2���!��� �bq­<VBC<VRTy"!;DUGX^U?BT��# >k;©�GRT;DOQ>ASLU?O�RTy#;�U?BT;DZ�� ��� ��}4F x���y(u�z��^�_v�t����Rx��S��}�� v�t� y>���+{@��}Hvz*BF w y _�3�Kzg,x���y0A/v7�^� };y�x0{|~(y����>z�} zl�>�G�S��}�t��^��A�} zCv7����� ���Ov ��� } �����7� } v(y=��]y7���^uw��v7�Y} � �,�m�Ty>{ �^�0x0u]y �^������u]y>} �]�+x0~ F �[ yQ; Q8; �ÄRCUYRTyQ;�>T;DP�U?OQX½s#BCU?I^KL;DZ_�4RTyp<JR�UVMr@#O#Seno@Q;DOQ;D>T>��vSL>�s#BTU![|SeX#;�XÄI|��R]yQ; M�U?KeKeUg8 SmOQd

BT;�>]@^KeR=7 [ yQ;�s#BTUGUVM(Se>W< s#Se;�PD;�U?M <JIQ>]R]BH<?P RlO#U?OQ>T; OQ>T;b�ºdVSe[8; O±<JR RTyQ;�;DO#X�U?M�RTy^SL>W>T;DPDRTSeU?O47� m � ��i��)��� ��� � A �cO:QcSmO# >)��� >]�c>ARC;DZ Ke;DZ�Z�<8� ��� ��}_F x�� y �H�C��~g��} �I=����� ��� y>� ~{T��C��~S��} �I=A/v7� }Cy>z�� z��^�oF A/v7� };y>z��:��y>{s�Sv�} � �,� �Ty>{ �^�0x0u\yP�^������u\y>} �]�+x0~ F �� �em�f�dgm � �2���!��� �C�lO^SLno@Q;DO#;�>T>kU?M(; �cRC; OQ>]SeU?O3� ��� ��} F x���y)� �C��~g��} �I= v�t ���:x��S��}���v�t�� y>���{@��}�! x���} � �,�m�Ty>{ �^�0x0u]y �^������u]y>} �]�+x0~ F ����� ?-?�vS�S��}��:y>}

v ~ * !Pw y _�3�Kzg(3 v U * !rw y _�3�Kzgy>uw� =��]y7���^u/�/� �oz�} �Vv ~ �s����bYv U �s�x�-J K���� t�v ~ b�v U v7�VF�� } � ��� v ~ b�v U v7�}!��t-uwvSv�t���qrUVOQ>]SeX#;DB��[b.� #X%2!�*-v ~ �(#��{bYv U �(#�� |7N*���yc�|sºU?RTy#;�>]Se>0���[% � �^M�UVBk#�3MLa%2!8 SmRTyr#~W�LE�:8r;�yp<=[8;

v ~ �(#����zv ~ �sL^]�#���b�v ~ �sL��-JLK�3 v U �(#��4�zv U �(LE]�#���bYv U �sL�� J K>]UR�#SeM7#�3ML[%!� �#RTyQ; O±<JKL>TUVL^]�#&%"� �^SmMm#G)"%!�P3 ,>%}/,��8 SmRTyr#�)$#6# �#R]yQ;DO

v ~ �(#��Hb§KeSmZ) v ~ �(#G)o��b KmSeZ) v U �Z#�)8�Hb�v U �Z#��>]UQ#c%%��7 [ y|@Q>&� Se> <VT��b>]�c>]RT;DZ P�UVOcRC<VSeO^SeOQd RTyQ;����b>]�c>]RT;DZ F(�p>TU'� bc!±I|�_A �cO:QcSmO# >Ke;DZ�Z�<^7[ yQ;DU?BC; Z�> 687µ{^7Ô6 <VOQX«687µ{^7µE�s#BCUg[|SLX^;�d8;DOQ; BH<VKvRCUcU?KL>lM�U?B�RTy#;�P�U?OQ>ARTB]@QPDR]SLU?O½<VOQX�PCyQ<VBH<?P RC; BTS5�6�<VRTSeU?O�U?M(Zt;=<V>]@#BT;�>�7Na½;�OQUS8¾<Vs#s#Km��R]yQ;DZ�SmO�< >As�;DPDS5`QP�PDU?O|RC;©�GR�7� �em�f�dgm � �2���!�)( � �� ��uw����� z@��}�� y �l� z+*0� �rp�v7uw��{6=��]y7���^uw�\v v7� ' ����A/�L} �:y>},��t9v7u y>{�{du3Me6%Y' �oz�}��Vd+J e-�

v �T�(du3MefgL��b^e/.Cdu:[ yQ;�Zt;=<?>A@#BC;Uv�SL> P�<VKeKe;�X � �0x��/�]�>���U=��]y7���^uw��U?OV'l7t-uwvSv�t��l�102� z@��} ����A/�-� � qrU?O#>]SLX^;DB�RTyQ;�BTSeO#d\FaU?M `#O#SeRT;�@^O#SLU?O#>�U?M­X^SL>�zAU?SeO|R�SeO|RC; BT[V<VKe>�UVM­RTyQ;M�U?B]Z

#�b �Zd ~ 3Me ~ g 8"3434398��(d-)�3Mef)9g<VO#X�X#;�`#OQ;�M�U?Bk#X%PFv'�Z#���b

)�576 ~

�se 5 .Cd 5 �I:ilU?RC;�RTyp<VRtRTyQ;�s#BC;D>T;DO|RC<VRTSeU?O U?Mo# SL>�OQU?R�@^O#SLno@Q;b�W<?>±�Zd�3feMg48 �(e 398�g�b �Zd�3:8�g)8 yQ; OQ;D[?;DBd J e�J;8!7 ik; [8;DB]RTyQ; KL;D>T>0�WSeR Se>t;�<?>]� RCU½PCyQ;�PwQ RTyQ<VR v§SL> 8r; KeK2� X#;�`#OQ;�X¿<VOQX¿<?X#X^SmRTSe[?;?7a½; <VSeZ RTU�>]yQUS8ÂRTyp<JRov�SL>kP�U?@#O|RC<VI#Ke�}<?X#XGSeRTSm[8;�UVOrF(��8 y#SLPCy�R]yQ;DOÄs#BTU![?;�>�; �cSe>]RC; OQP�;�I|�q­<VBC<VRTy"!;�UcX#U?BT��# >k;©�cRC;DO#>]SLUVO�R]yQ;�U?BT;DZ�7

Page 6: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

*���<?X^X^SeR]Se[|SeR �>�pSmRl>]@���P�;D>�RCUt>]yQUS8�RTyQ<VR9�pSeMH#c%�F�<VOQX�SeM �Z#�) *�,'%>/���SL>k<VO±SmOQPDBT;=<?>ASeOQd>];�no@Q;DO#P�;xSmO F 8 SeR]yr#G) # #��^RTyQ; O}v �(#�)8�{w v �(#��©7��G;DR�L�)Ub�#S] #�)�RTy#;DO}L�)+%PF <VO#XL�)�� 1 7�*��±<VX#X^SeR]Se[|SeR ��<Vdo<VSeO��3SmR�>]@��tPD;�>�RCU>AyQUS8¾RTyp<VR v'�sL�)8��w _^7��|@#s#sºU8>T;b�2SeO±M�<?P R9�R]yp<VR�M�U?B >TU?Zt;���·_:��8r;�yQ<g[?;"v'�sLG)8��ÂF�� M�U?B�<VKeK4,(7 <QU?B�;�<?PCy.,�8�;�P=<VO1`^OQX� �)\%>F8 SmRTy�� �)"WYL�)�<VOQXPv'�(L�)�]� �)o�-F��?F�� ) 7 [ yQ;DO

v'�(L�)�]��� ~ R"34343 R� �)8�T�"FYv'�T�(L ~ ]� ~ �48!34343 8��(L�)6]� �)?�T�-F �) ����8F � ) b��B:

�cSmOQP�;Kv'�sLG)o���F��^� 8r;�Z�@Q>AR yp<=[8;Kv'�� ~ R 343439R� �)8����l�3>TU ~ R 34343�R� �)��b 1 �3<VOQX±>]U+)0b � ~ R 34343 R � �)!�b 1 7ikUS8 ��V).*�,Y% /r��SL>�<�>];�no@Q; OQP�;U?M�I�UV@#OQX#;DX³OQU?O:�b;DZ�s#R �P KLU8>];�X�>T;DRT>lSmO '��4>]U 1 �b~R4) +)"W^R4)-L�)l�:8 y#SePCy}Se>W< PDU?O|RTBC<?X^SLP RTSeU?O47�#"e� z+*0� �����/�/�-� ��%4;DRUv�Iº; <�Z�;�<?>]@^BC;�U?O>q 8 SeRTy.v �T�(du3MefgL�6bxe .Sd�M�U?B�<VKmKmd J&eg7P<(SÔ�0,<VO#X�PDU?OQ>]SeX#;DB

v�)^�(#��Hb�v'�T�Z,m3f,V� 6<g�RQ#��I:[ yQ; O2v�)�SL> <�s#BCUVIp<VI#SmKeSeR �YZt;=<?>A@#BC;xU?O>q >]UR�2I|� [ yQ;DU?BC; Z 687µ{^7µE:�Jv�)tSL>l@#O#SLno@Q; Ke�}X#;DRT;DB\�Z�SeOQ;DXIc�SmRC>­[V<VKm@Q;�> U?O�RTy#;���� >]�c>ARC;DZDh�d?;DOQ; BH<VR]SeOQdVq�7��cSeO#P�;

v'�(#��HbX� ) v�)G�(#���3SmR M�U?KeKeUg8W>�RTyp<VRGv�SL>W<JKL>TU�@#O^SLno@Q;DKm��X#; RC; BTZ�SeOQ;DX27t-uwvSv�tPv�t%$Ny>u\y>} ��&�Sv0�^v7u�~(' ����� } ���:��zCv7�4} � �/v7uw�I=��B<QU?B(<VO|�KLNWY�X�VX#;�`#OQ;�RTyQ; v7�l} ��u�=��]y7���^uw�

v*)=�(L��Hb§SeO^M � ) v'�Z#�)8�8 yQ; BC;lRTyQ; SeO:`#Z�@#Z Se> RH<bQ?;DO�U![?;DB­<VKeK^>T;�no@Q; OQP�;D>��(#G)"*-,.%0/�� SmO"F >A@QPCy�R]yp<VR L[W~84)9#�)<VO#X³SL>�RH<7Q8;DO«RTU�Iº;VK SeMrR]yQ;DBT;tSe>�O#U}>]@#PCy >T;�no@Q; OQP�;V7±ilU?RC; RTyp<JR�v ) SL>�SeOQP BC;�<?>]SmOQd±<VO#Xv ) � 1 �Hb¢_^7 %4;DR @#>k>T<g��RTyp<VRG#~W�� SL> v ) � =��]y7���lu\y�x0{@��SmM �^M�U?Bl<VKmK$LaWY�E�

v ) �sL��Hb�v ) �sL^RO#��$� v ) �sL^RO# 5 ��:a�BTSmRC;,+ M�U?BlRTyQ;�>];DR�UVM$<VKeK7v ) �¨Z�;�<?>]@^BH<VI#Ke;�>];DRT>�7�-4���/�:y>{�{�/� v7�L} �:y>}.+ z@��y�� �Ty>{ �^�0x0u\yA/v7� }Cy>z�� z��^�}F y>��� } �:y>}ov ) z@� yC=��]y7���^u/��v7�/+ �V��� } �����>z��^��v � [ y#SL>(8 SeKmKks^BCUg[8;ÄRTyQ;R]yQ;�U?BT;DZ�7��} �@? ���0-4�4�/� v7� }��:y>}ov ) z@��A/v7�^� };y�x0{|~I���:x/y����>z�} zl�>�-� �c@^s#s�U?>T;�RTyp<JROL W 84)�L�)G7 `bMv ) �(L�)8�,J K M�U?B <VKeK�,��3R]yQ;DO��ºd?Sm[8; O1�%�¢_l�3R]yQ;DBT;�;©�GSe>]R >T;�no@Q; OQP�;D> �(#G)�2�* � %�/���SeO\F(�8 SmRTy

L�)+W^832�#G)�2G3 v*)=�sLG)o�$�4�65?F ) �2v'�Z#�)�2r��:

[ yQ; OLaW^87) 832�#G)�2

>]Uv*)=�(L��-F^� ) �

2v'�(#G)�2r�-F^� ) v*)g�sL�)8�$�7�B:

Page 7: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �

Ml;DOQPD;>�QSeO�<VO|�YP=<V>T;>�v )g�sL��"F � ) v*)=�(L�)8�I:

��} �@? ���-� -Y���/� v7� }��:y>}Hv ) ��� } �����7�6v �x�cSmOQP�;UF SL>�<tBTSmOQd<VOQX�v�Se> PDU?@#O|RH<VI^Ke�}<?X#X^SmRTSe[?;>�v�Se>�P�U?@^OcRC<VI#Km�}>A@#Ip<?X#XGSeRTSm[8;V7 Ml;DOQPD;>�2M�U?Bo#a%2F <VOQX�<VO|�}>];�no@Q; OQP�;��(#G)r*u, %C/���SeOrF8 SmRTyr#~W~84)9#�)l�

v'�(#��-F^� ) v'�(#G)o��:W OÄRH<bQ|SmOQd�RTy#;�SeOR`#Zx@#ZaUg[?;DB�<VKmK >]@#PCy½>];�no@Q; OQP�;D>0��8�;�>T;D;�RTyp<VR v'�(#���FXv ) �Z#��©7PW OÄRTyQ;U?R]yQ;DBWyp<JOQX��#SeR Se> U?I|[|SLU?@Q> R]yp<VRkv ) �Z#��-F v'�Z#���M�U?Bk#X%PF�7��} �@? ��� ����-Y�)�/� v7� } �:y>} + A/v7� };y>z��:� F �N%); R�#X%PF <JOQXQLaWY�t7Ba½;lyQ<g[?;kRTU�>AyQUS8 RTyp<VR

v )=�sL��Hb�v*)=�sL^RO#��$� v*)��sL^RO#65A��:*��Y>A@#Ip<?X^X^SeR]Se[|SeR �tU?M v ) �^SeR Se> ;DOQUV@Qd?y�RCU >]yQUS8·R]yp<VR

v ) �sL��� v ) �sL^RO#��$� v ) �(L^RO# 5 ��:`bM�v ) �sL�� b K �3R]y#SL>lSL>WRTBTSm[|SN<VKC�Q>TU�Ke;DR @#>�<?>]>]@#Zt;xRTyQ<VR6v ) �sL���J K§7 [ y#;DO�2dVSe[8; O1� �¢_:�8�;�P�<VOV`#OQX�< >];�no@Q; OQP�;�Z#�)"*-,.%0/�� SeOQF >A@QPCy}R]yp<VR

LNW^84)_#G)�3 v*)��sL��$�4� ^� ) v'�(#G)o��:[ yQ; O

LER\#XW^84)Q�Z#�)6RQ#���3 L^R\# 5 W^84)Q�Z#�)6RQ# 5 �>]Uv*)g�(L RV#��u��v*)=�(LYRV#65 � F � ) v'�Z#�)�RV#���� � ) v �(#�)�RV#�5Ã��b � ) v'�Z#�)8�"F�v )=�sL��u� �B:�cSmOQP�; �,� _P8­<?>k<VB]I#SeR]BH<VB]� �l8�;�<VBC;�X#U?O#;?7��} �@? ��� � -4�"�/� v7��} �:y>} + z@�,y>�+y>{ �^�0x0u\y �'q�KL;=<JBTKe�K�x%1+ <VOQX # 5 %PF 8 yQ;DO#;D[8; B{#&%OF7�c@^s#s�U?>T;�RTyp<VRk# ~ 3f# U %1+ <VO#X}LaWY�t7 [ yQ; Ov*)=�sL��{bYv*)g�sL^RQ# ~ �$� v )=�sL^RO#�5 ~ �bYv*)g�sL^RQ# ~ RO# U �$�zv*)=�(L~RQ# ~ R\#65 U �$�zv*)=�(LER\#65 ~ �bYv*)g�sL^RQ# ~ RO# U �$�zv*)=�(L~R��(# ~ R\# U � 5$R\# ~ �$� v*)=�(L^R��(# ~ R\# U � 5JRO#�5 ~ �bYv ) �sL^R��(# ~ RO# U �T�$�zv ) �sL^R��Z# ~ R\# U � 5 ��:

Ml;DOQPD;K# ~ RO# U %0+ 7��} �@?�� � -4���/� v7� }��:y>}3+ z@��y �m�Ty>{ �^�0x0u]yEy>���E}��:y>}7v ) z@� y;=��]y7���^u/� v7� + �oa³;�<VKmBC;�<?X^�Q|OQUS8 R]yp<VR + SL>�<VO�<JKLd8; I#BH<:��>TUSeR�>A@���P�;D>�RCU>AyQUS8 RTyQ<VR9�2M�U?B�<JOc�±>T;�no@Q; OQP�;�U?M�X^SL>�zAU?SeO|R>];DRC>��(#G)+*-,.%0/���SmO + �^M�U?Bk#�bX84)9#�)�8�;�yp<=[8;

#~%�+^3 v*)=�Z#��HbX� ) v*)��(#�)8�I:

Page 8: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

�GUR�#RH<7Q8;�<VO|�OLaWY�E�#RTy#;DOv )=�sL���b�v )=�sL^RO# ~ �$� v*)��sLER\#65 ~ �b�v )=�sL^RO# ~ �$� v*)��sLER\# U �$�zv*)=�(LER\#65 ~ RO#65 U �

b 34343-b)�5)6 ~

v*)=�(LER\# 5 �$�zv*)=�(LER\#65 ~ R"34343 R\#65) �I:

ilU?RC;�R]yp<VR v ) �sLXRr# 5 ~ R 34343-Rr# 5) ��Xv ) �(L&Rr# 5 �WM�UVB�<VKeK7,v7GMl;DOQPD;>�4U?O�Ke;DRTR]SeOQd;,zw K<VO#X�@Q>ASeOQd PDU?@#O|RH<VI^KL;�>]@#IQ<?X#X^SmRTSe[|SmR � �:8�;�d?;DR

v*)=�sL��� �� ) 6 ~v*)��sL^RO#�)8�$� v )=�sL^RO#�5A� v*)=�sLER\#��$� v*)g�(L^R\#65A��:

[ yQ;�BT;D[?;DBC>];SeOQ;Dn|@Q<VKeSmR ��yQU?KLX^>�I|��>A@#Ip<?X#XGSeRTSm[|SeR � �(>TUY8�;�yp<=[8;;Dn|@Q<VKeSmR �87YMl;DOQPD;\# % +<VO#X��Q>T; RTRTSmOQd;L b�# �R8�;�d?;DR

v )=�(#��Hb �� ) 6 ~v*)=�(#G)o��:

t-uwvSv�tPv�t���~7���7z�� ' �-�H�C��~S��} �I= {@�I="=Xy �BA�; OQU?RT;�I|� � RTyQ;�SeO|RT;DBC>];�P RTSLUVO·U?M�<VKeKoT �b>]�c>]RT;DZt>PDU?O|RH<VSmO#SeOQd�F�7 [ y#;DO �\SL>­SmRC>];DKeMv<+T��b>]�c>]RT;DZ�7 a½;�>Ayp<VKmK4>]yQUS8�R]yp<VR��\SL>W<VKe>TUt< ���b>]�c>]RT;DZ<VO#X�yQ; OQP�;�<����Ã<JKLd8; I#BH<:�cRTy|@Q>Ws#BCUg[|SeO#d R]yQ;�KL; ZtZ�<^7$qrU?O#>]SLX^;DB

����b � La% � * L^RO#~%"��M�UVBl<VKeK�#&%OF� :[ yQ; O0F W � � Iº;�P�<V@Q>T;KF\SL> <���� >A�c>]RC; Z}7�%4; R @Q>�PCyQ;DPwQ±RTyQ<VR � � SL> < T � >]�c>ARC;DZr*lPDKL;�<VBTKm��[%!� � �#OQ;©�GR0�Q>]@#s^s�U8>];�L ~ 3ML U %!� � 8 SmRTy}L ~ WYL U �^RTyQ; O�M�UVBk#&%OF 8r;�yp<=[8;

�(L U ]�L ~ �4R\#^bÂ�sL U R\#��7]��(L ~ RO#���% �Iº;�P�<V@Q>T; �aSL>�<\T � >A�G>ARC; Z4��>TUPL U ]�L ~ % � � ��`#Op<VKmKe�>�2SeM L�)�% � � 3f, % /)��<VOQX�L�)#;L��R]yQ;DO�M�U?Bk#~%rF 8�;�yQ<g[?;

L�)6RO# #6L~RQ#>]U L^RO#X%!��<VO#X}La%!� � 7NMk; OQP�;��ab�� � 7ilUg8·P�U?OQ>ASLX#; B

��� ��b � La%!� *-LER\#X%!� M�U?Bl<JKeK$#X%!� :[ yQ; OrF W � � � Iº;�P�<V@Q>]; � b � � 7"a½;xP�<VO±PCy#;�PwQ�RTyp<VR�� � � Se> <+T � >A�G>ARC; Z4�ozÃ@Q>]R <?>)8r;�X^SLXM�U?B�� � 7NMk; OQP�;�� � � b � 8 y#SLPCy�>]yQUS8W>WRTyp<JR�� SL>l<P��� >A�G>ARC; Z <?> s#BCU?Z�SL>];�X27

Page 9: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �687 � 7 �(+-em�com (+-em (+� m)� � s#BTU?Ip<VI^SeKeSmR �Y>]sp<VP�;�� � 3�� 3]���Ws#BTUg[cSeX#;�>�<�ZtUcX#;DK(M�U?B�<VOÄ;©�cs�; BTS5�Zt;DO|R)8 yQU8>];�U?@^RCP�UVZ�;�Se> >]@#I^zA;DPDRlRCU�PCyp<VOQPD;>�3<?PDP�U?BTX^SeOQd�RTU R]yQ;�M�U?KeKeUS8 SeOQdxSmO|RC;DB]s#BC; RH<VR]SLU?OJ*� �§Se>WR]yQ;�>T; RkUVM(sºU8>T>ASeI#Ke;�U?@#RTP�U?Zt;�>� �¿SL>­R]yQ;�>T;DRkU?M(U?IQ>];DBT[V<VI^KL;�>T; RC>WU?M(U?@#RCPDU?Zt;�>0�QUVBP�I�>��� } �� �$�(#��WSe>­RTyQ;�s#BTU?Ip<VI#SmKeSmR ��U?M�RTy#;�; [8; OcR�#x7

� ;DKL<VRTSm[8;'RCUlZ�;�<?>]@#BT;�R]yQ;�UVBT� �Vs#BCU?IQ<VI#SeKmSeR �lRTyQ;DU?BT��Se>�; O#BTSePCyQ;�X�Ic��R]yQ;�>ASLd?O^S@`QP�<VOQP�;�<VR]RH<?PCyQ;DXRTU�RTyQ;xO#U?RTSeU?O�U?M'SmOQX#;Dsº;DO#X#;DOQPD;?7�%4;DR��YI�;�<�P�U?@^OcRC<VI#Ke;�>T; R=7��^<=��R]yp<VR�; [8; OcRT>U# 5 3��G%��u3<VBT; z����^�@?������^��� }�SeM �cM�U?Bl<VKmK�`#O#SmRC;�>]@^IQ>T; RC>��.W���

����R 5 �� # 5 ��b �5 ��

�'�(# 5 ��:�^<=� RTyQ<VRX���Ã<VKed8;DI^BH<?>KF 5 W � 3��V%����r<VBC; z����^�@?������^��� }�SmM # 5 3��Q%��u3$<VBC;YSeOQX^;Dsº;DOQX#; O|R8 yQ; OQ;D[?;DBG# 5 %PF 5 M�UVB <VKmK��]7NMk; BC; Se>­<�@Q>];DMN@#K�8­<=��RCU�;D>]RC<VI#KeSe>]y�R]yQ; SmOQX#;Dsº;DO#X#;DOQPD;�U?M2R 8�U��� <VKLd?;DI#BC<?>�7� �em�f�dgm � �2��� ���2��� ��}$F ~ y>���oF U x��)�H�C��~S��} �I= � A/v7� };y>z����]�Xz�� � y>��� ��� ?-?�vS�S�G}��:y>}

�$�(# ~ RO# U ��b �$�Z# ~ ��$�Z# U ��&� �����I�>��u # ~ %PF ~ y>���K# U %PF U ���� ���+� �lF ~ � y>����� �lF U ��y>uw�Gz����^�@?������^��� }1�t-uwvSv�t�� <�Sm� # ~ %OF ~ <VOQX�X#;�`#OQ;�M�U?Bk#X% �

v'�(#��Hb �$�Z# ~ R\#��I3 ���Z#���b§�$�Z# ~ �Ã�'�(#���:[ yQ; O'v <VOQX��Ä<VBC;�Zt;=<?>A@#BC;D>�8 y^SLPCy³<?d?BC;D; U?OÄRTyQ;����b>]�c>]RT;DZ F U ��8 SmRTy>v'���W� b��º� �W�ob�$�Z# ~ �"J K§7��GUR�#I|��@^O#SLno@Q; OQ;�>]> U?M(; �cRC; OQ>]SeU?O�#M�U?Bl<JKeK$# U %Y� �lF U ���

�$�(# ~ RO# U ��b�v'�(# U �Hb����Z# U �Hb§�'�(# ~ � �$�(# U ��:ilUg8 `^�O# U %Y�'�F U �­<VOQXYBC;Dsº;=<JRlR]yQ;�<VBCdV@#Z�; O|R 8 SeRTyv �N�Z#��Hb§�'�(# RO# U ��3 � ���(#���b �$�Z#��Ã�'�(# U �

RTUt>AyQUS8 RTyQ<VR9�#M�U?Bl<JKeKJ# ~ %Y� �lF ~ ����'�(# ~ RO# U �Hb �$�(# ~ � �$�(# U �I:

687µ�^7 �Pf�dgm���� & i,(�k9m����jh��jm � ��iRq4� ��Se[?;DOÄ;D[?;DO|RC>o#G) 3f,C%2/,��8r;�Z�<=�}<V>\Q�M�U?B R]yQ;xs#BTU?Ip<7�I#SmKeSmR �tR]yp<VRWSeOR`^O#SeRT;DKe��Z�<VO|��UcP�PD@^B=7��G;DR

KmSeZ >A@#s #G) bXR4)6832 � )k#�263 KmSeZ SmO#M #�)KbE87) R32!� )k# 2G:[ yQ; O

�$�Z#�) Sb7 U#7µ��b§�$��KeSeZ >]@#sk#G)o��3 �'�(#�)t;D[37��Hb§�$��KmSeZ SmO#MB#�)8�I:Ml;DBC;'$ Sb7 U#75#v>]RH<JOQX#>WM�U?B $µSmOR`#O#SmRC; Ke�tU?MNRC; O#p<VOQX $»; [375#'M�U?B $µ;D[?;DO|RT@p<JKeKe�?75#� m � ��i��)�#" ��� � <(SeBT>]R,*rU?BT;DK .^q­<VO|RC; KeKeSºKL; ZtZ�<o� � � t%$ ) �$�Z#�)c� J K �)}�� �����$�Z#�)1z+�jv ���Gb_ �

Page 10: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

���������������� ��

t-uwvSv�t����k>k,�w K 8r;�yp<=[8;�$�Z#�) Sb7 U#7µ�-F �$��832!� )-# 2­�-FN�

2 � ) �$�Z# 2 ��w _�:

a½;�OQU?RC;�R]yp<VRWRTy#Se>W<VBCdV@#Z�; O|R SL>­[V<VKeSeX+8 yQ;DR]yQ;DBkU?B OQUVR ��SL>W<�s#BTU?Ip<VI#SmKeSmR �tZt;=<?>A@#BC;V7� m � ��i��)�#" ��� �¨�G;�PDU?OQXY*�U?BC; K2.^q­<VO|RT;DKeKmS�Ke;DZ�Z�<o� � ���/���B=��Y}��:y>} #�)�3f,|%N/k3Xy>uw�4z����^�I�?������^��� } �I�>��� } �-� � t $ ) �'�(#�)|�Hb K �N}�� �����$�(#G)1z+�jv ����bÂ6 �t-uwvSv�t��oa½;�@Q>T;�R]yQ;�SeOQ;Dn|@Q<VKeSmR �±6 .'d+F��#���J7��G;DRGd-)Kb§�$�Z#�)c�©7 [ yQ;DO��pM�UVBl<VKeK�, 8�;�yp<=[8;

�'��R32 � )_# 52 �{b �2 � ) �]6 .Cd 2 �"F ;©�cs!� . �2 � ) d 2 ob¢_�:

Ml;DOQPD;��$�Z#�)�Sb7 U#7µ�Hb 6 .��$��84)oR32 � )k# 52 �{bÂ687FG7�� 1��(5g���J�����|1�:�)/���0��.v/)5 ��/�� �J��/��(. �����7��l�����c1p5

FG7Ô687 %4;DR��s�V3<!��r<VOQX½���+3��3��Iº;�Zt;=<V>]@#BC<VI#KL; >]sp<?PD;�>D7��·MN@#OQP RTSeU?O���* �cw�� SL>o=��]y7���^u��y�x0{@��SmM��(�Q~ �(#���%2!_8 y#;DOQ; [8;DB6#X%��47NMk; BC;��(�Q~ �Z#��rX#; OQU?RC;D> RTyQ; z����>��uw�S� zl=XyS�^��U?Mm#·I|��

� �Q~ �Z#���b.���0%0�x*��v�"�º��%0# :�k>]@Q<VKeKm��� b ' U?B�� b y .�K�3�Kzg �4SeO 8 y#SePCy³P�<?>T;��½Se>�<VK@8r<=�c>�RC<bQ8; O½RTU�Iº;�RTyQ;X*rU?BT;DK��� <VKLd?;DI#BC<^7'`bM � Se>W< RTU?s�UVKLU8d?SeP=<VKº>]sQ<?P�;�<VOQX.!Pb�q��(�����#RTyQ; O±<�Z�;�<?>]@^BH<VI#Ke;�MN@#OQP RTSLUVO�UVO� SL> P�<VKeKe;�XY<;p�v7uw��{�MN@^OQPDR]SLU?O47[ yQ;�SeO|[?;DBC>];�SmZ�<Vd8;ks#BT;�>];DBT[?;�>�>];DRlU?sº;DBC<VRTSeU?OQ><*

� �Q~ � 8 5 # 5 �Hb~8 5 � �Q~ �Z# 5 ��3 � �Q~ �(#�5A�Hb�� �Q~ �Z#�� 5M:Ml;DOQPD;>�(M�UVBx<JOc��MN@^OQPDR]SLU?O��`*$� w �X� ��� �Q~ �(#���*J# %�� �Se>�< ���Ã<VKed8;DI#BC<U?O'� <VO#X� # * �(�Q~ �Z#��K% ! �SL>�<(��� <VKLd8; I#BH<�UVO�� 7�`bOÄsp<VB]RTSePD@#KL<VB9��SmM!�>b � �lF ��<VOQX"�(�Q~ �Z#��K% !8 yQ; OQ;D[?;DBG#X%PF+�cR]yQ;DO � #~*��(�Q~©�(#���%2! �Se>­<G���Ã<VKed8;DI^BH<�P�U?O|RH<JSeO#SmOQdUF <VOQX�y#;DOQPD;#��^>]U�±SL>­Zt;=<?>A@#BH<JI#KL;V7`bO§RTyQ;�P�<?>T;"� b ',�xR]yQ; *rU?BT;DK ��� <VKLd?;DI#BC<³SL>d8; OQ;DBC<VRC;DX§I|� SmOcRT;DB][?<JKL>U?M�RTy#;ÄM�UVBTZ

� .�K�3%$ g(3%$�%=',�$>TU:�2RCUY>]yQUS8 RTyp<VR&� *�� w ' SL>kZ�;�<?>]@#BC<VI#Ke;>�2SeR�>]@���P�;D>�RTU>]yQUS8 RTyp<VR���}%��[*��v�"�º�-F'$2 K%'!�M�U?Bl<VKmK�$37`bM7� SL>r<VO|��RTU?s�UVKLU8d?SeP=<VK3>Asp<?P�;�<VO#X(��* �cw ' Se>­P�U?O|R]SeO|@QU?@Q>��#RTyQ; O��(�Q~ �*)���Se>­U?sº;DOYSeO

��<JOQX}yQ; OQP�;�Zt;=<?>A@#BH<JI#KL;b��8 yQ; OQ;D[?;DB+) SL>lU?s�; O�SeO_' � R]yQ;xUVs�; OÄ>T;DRT>�) d8;DOQ; BH<VRT;"q���>]Uy>� ~\A/v7� } z�� � v7����t��l��A�}jzCv7�Yz@� =��]y7���^u]y�x0{@� 7ilU?RC; RTyp<JR�}�� �Xz����>zsA]y>} v7u t��^��A�} zCv7� v�tEy>� ~P=��]y7���lu\y�x0{@���S��}�z@��y�=��]y7���^u\y�x0{@� t��^��A�} zCv7�Q7

�lKL>TU:�} � � A/v =�?�vS��z�}jzCv7��v�to=��]y7���^u\y�x0{@�Ht��^��A�} zCv7�:�Gz@�U=��]y7���^u\y�x0{@� 7��Se[?;DOY<VO|��M�<VZ�SeKe�xU?M4MN@#OQP RTSeU?OQ>,� 5 * �xw��+3��H% ���^8�;�P=<JO�Z�<7Q8; R]yQ;DZ\<VKeKpZt;=<?>A@#BH<JI#KL;

I|�RH<7QcSmOQd!Ob � ��� �Q~5 �Z#���*_#X%��$3���% �G��:

[ yQ; O2!�SL>­RTy#;G�m�Ty>{ �^�0x0u]y �^������u]y>} �]�+x0~t��� 5 * ��% �G�©7

Page 11: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� Ö]Ö

�Gdgf�cof�q9h�kgh f)( � ���)���2��� ��} � )P*�� w 'G3f,�%z/ � x�� =��]y7���lu\y�x0{@� t��l��A�}jzCv7�:�-� �� ���1�SvVy>uw�� ~ � � U 3 � ~ � U y>���V�]yBA/�4v�t } � ��t9v7{�{@v7�oz��^� �SmO#M) � )�3 >]@#s) � )�3 KmSeZ SmO#M) � )�3 KmSeZ >A@#s) � )�:� �em�f�dgm � � ���)��� �b9�U?O#U?RCU?O#;�P KN<?>]> RTyQ;DU?BC; Z� � � ��})�s�;3 !2� x��-yU=��]y7���lu\y�x0{@�N�@?RyBA/�-y>����{@��}F x��-y"�H�C��~S��} �I= �^������u\y>}jz��^� !�� � ��}�� x��-yo�>�MA�} v7uo�@?RyBA/�)v�t"x�v7�l���^�]�mt��^��A�} zCv7�:� �0* �cw '����A/�V} �:y>} ���SN�}6K%�� y>����6 � %��Ct9v7u�y>{�{ #X%PF����SeSN�_z t � )+%��Ct9v7u�y>{�{ , y>���+�=z@� x�v7�^���^�]�E�oz�} �t_�F � ) # � � }�� ���(�0%������ �����[A/v7� }Cy>z��:�P�I�>��u�~�x�v7�^���^�]�;!4� =��]y7���lu\y�x0{@�mt��l��A�}jzCv7���t-uwvSv�t���qrUVOQ>]SeX#;DB�� b � # %c!�* 6 � %� |7 [ yQ; O �:SL>�<0T � >A�c>]RC; Z PDU?O|RH<VSmO#SeOQdOF(�'>]U� b !(7t�cSmOQP�;� Se>�<Y[?;�P RCU?B�>]sp<VP�;>�)SeR�R]y|@Q>�PDU?O|RH<VSmOQ>�<VKeK&`#O#SeRT;�KeSeO#;=<VB�PDU?Z�I#SmOp<VR]SLU?OQ> U?MSmOQX^SLP�<VRCUVB MN@#OQP RTSLUVOQ>'U?M3Z�;�<?>]@#BC<VI#Ke; >T;DRT>�7NMl;DOQPD;>�oM�U?B �� _:� ! �bZt;=<?>A@#BH<VI^KL; <VO#X IºU?@#O#X#;�X��R]yQ;�MN@^OQPDR]SLU?OQ> � )zb F � ) y F ) ��gs3 ,[%c/)� Iº;DKLUVOQd�RTU�� <JOQX¿_ F � ) #����ry#;DOQPD;��c%��W7<(SmOp<VKmKe� �r<VO|�ÁIºU?@#O#X#;�XE! �bZt;=<V>]@#BC<VI#KL;MN@#O#PDRTSeU?O Se>�R]yQ;±X^S5?�; BC;DO#P�;±U?M R 8rU�OQUVO:�bOQ;Ddo<VR]Se[8;>A@QPCy}MN@#O#PDRTSeU?OQ>��#yQ;DOQPD;�SmO �l7FG7»FG7 ���i���m ��m�i q��edgm^q4� %4;DR��(�;3<!��W<VOQX«� �V3 �3� Iº;�Zt;=<?>A@#BH<JI#KL;�>]sp<?PD;�>�<JOQX}KL; R v�I�;x<Zt;=<?>A@#BC;�U?O>!�7 [ y#;DO�<JOc�Zt;=<V>]@#BC<VI#KL;�MN@^OQPDR]SLU?O �.*B�cw � SmOQX^@QPD;�>k<VO�zl=XyS�^�U=��]y7���luw��;b�v�� �*�Q~rUVO���Qd?Sm[8; O�I|�

���Z#���b�v ��� �Q~ �Z#��]�I:a½;�>]yp<VKmK)P�U?O#>]RTB]@QPDRl>]U?Z�;�OQ;�8 Zt;=<?>A@#BC;D>lMNBTU?Z %4; I�;D>Td?@Q;�Zt;=<?>A@#BC;�SeOR]y#SL> 8r<=�87� m � ��i � ��� ���2��� ��}��'*�' w ' x��+y4u�z2�7�^}Z� A/v7� }jz�� ��v7���Ez���A�u/�]y7��z��^�Ut��l��A�}jzCv7���"����} �.b���º� .�K¿��3��3� K¿�]�Gy>�����^� �N��� �.* �;w ' x0~

�v� �º�{b SeO#M � $Q* �4F��3� $^� :�� �����=z@�G{@� t�}(� A/v7� }jz�� ��v7����y>����z���A�uw�]y7��z��^� � y>���

�v�"�º�-F'$ z tGy>���Vv7� {|~ z t �YF��3� $^�I:t-uwvSv�t�� [ y#;�>];DR � $Q* �4F��3� $^� �SL> X^;�PDBT;=<?>ASeOQd�SmO �)7 `bR SL> P KLU8>];�XI|�U?@#Bl<?>]>]@#Z�s#R]SLU?OQ> UVO�p7NMk; OQP�; �}SL>­SmOQPDBT;=<?>ASeOQd�<VOQX �3���v� �º�T� ��)7��kKe>TU

�(���3� $^�T� b SeO#M � $ � *��3� $^� F��3� $ � �� F'$�:ilUg8 �v�"�º�_F $³SeZ�s#KmSL;�>��º���v�"�º�]�VF��º� $#���$>TU � F��º� $#�©7 �cSeZ�SeKL<VBTKm� � � F��º� $#��SeZ�s#KeSe;�>�v� �º�-F'$��G>TU�RTyQ;�R 8�U�P�U?OQXGSeRTSeU?OQ>r<VBC;�;Dn|@^Se[V<VKL; O|R=7'`bOYsp<VB]RTSLP @#KN<JB9�|SeR­M�U?KmKLUS8W>�R]yp<VR ���}% �Q*�v� �º�-F'$) �SL> P KLU8>];�X��Q>]U �±SL>­Ke;DMNRT� P�UVOcR]SeO|@QU?@#>�7� �em�f�dgm � � ��� ��� ��� ��}���*"' w ' x��Vu�z2�7�^}Z� A/v7� } z�� � v7���4y>��� z���A�u/�]y7��z��^� � �� ��� }�� ��uw���� z@��}�� y��l� z+*0� ���)y��^v7��=��]y7���^u/� T���v7�E' ����A/�V} �:y>},�ut9v7u�y>{�{ du3Me6%4' �oz�}��Vd+J`e-�

T��º�]�(du3MefgL�Hb��3�se � .��3�(dG�I:��v7uw�/v �>��u9� �"� v>x0};y>z��1z��Y}��^z@�G� y>~�y>{�{��)y��^v7��=��]y7���luw�/�Pv7��'��

Page 12: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

[ yQ;�Zt;=<?>A@#BC;UT���Se> P=<VKmKL;DXYR]yQ; � �0x��/�]�>���I� ��}jzC��{|}��9�/�o=��]y7���luw��<?>]>TUcPDSL<VRC;DXV8 SmRTy �p7t-uwvSv�t��l�102� z@��} ����A/�-� � �G;DR �Yb ���º� .�K¿��3��3� K¿�]� 7L%4;DR v X#; OQU?RC;Y%); I�;D>Td?@#;}Z�;�<?>]@^BC;}UVO�½<VOQX�Ke;DR �E* �Cw '\Iº;�RTyQ;tKL;DMNRT� PDU?O|RTSeO|@QUV@Q>�SmOQPDBT;=<?>ASeOQd}MN@^OQPDR]SLU?O PDU?OQ>]R]BT@QP RC;DX SmO«RTyQ;Ke;DZ�Z�<^7 [ yQ;DO'� Se> *rU?BT;DK Zt;=<?>A@#BH<VI^KL;Y<VOQX RTy#;YSmOQX^@QPD;�X Z�;�<?>]@^BC; � b v ���*�Q~xUVO '>T<VRTSe>\`Q;D>

�º�T�(du3MefgL� bYv'�����}*��v�"�º� �Sd<VOQX �v� �º� FYe V��b�v'�]���3�(dG��3��3�se ��gL� b �3�(eD��.��3�Zd^��:�#"e� z+*0� �����/�/�-� � [ yQ;�<VBCd?@^Z�; OcRW@Q>];�XYM�U?BW@#O#Sen|@#;DOQ;D>T>lU?MB%4; I�;D>Td?@Q;�Zt;=<?>A@#BC;�<Vs#s^KeSL;D>�7<(SmOp<VKmKe� �JSeM �xSL>$<VO|� � <?X#UVO�Zt;=<V>]@#BT; U?O '�� 8�;kP�<VO�X#;�`^OQ; �;*>'Ew '��QB]SLd?y|R\�bP�U?O|R]SeO|@QU?@Q>

<VO#X�SmOQPDBT;=<?>ASeOQdR�GIc��3� $#� b�� ���T�,_�3%$ gN��3 SmM $ _:�

. ���]� $�3H_9gL�I3jSmM $�J _^7[ yQ; O ���]�(du3MefgL� b �º�(e ��.��º�ZdG� 8 yQ;DO#;D[8; Bod�J`eg�Q>]U �Vb�T�� Ic�@^O#SLno@Q; OQ;�>]>�7FG7µE^7 �+i,(+-ef)� �Ri:dbh iRn �jm^q4� %); R��� 3�� 3T��� Iº;�<�s^BCU?Ip<JI#SeKmSeR �±>Asp<?PD;<VOQX�KL;DR��s�V3<!���Iº;t<Zt;=<?>A@#BH<JI#KL;�>]sQ<?P�;V7���Z�;�<?>]@#BC<VI#Ke;�MN@^OQPDR]SLU?O�� * ��w � Se> P=<VKmKL;DX�< u\y>���^v = �7y>u�zjy�x0{@��z����7'`bRryp<?>�RTyQ;lSeO|RC; BTs#BT;DRH<JRTSLUVO�U?M�<�n|@Q<VO|RTSeR �>�^U?Br>]RC<VRC;b�^X#; RC;DB]ZtSmOQ;�XtIc�tPCyp<VO#P�;?7oa yQ; BC; O#U>Asp<?P�;V�\Se> Z�; O|RTSLUVOQ;�X��ºSeR�Se>�<?>T>A@#Zt;�X�RTyp<JR�� RH<bQ?;�>�[V<VKe@Q;D>�SeO1'l7 [ y#; SmZ�<Vd8;�Zt;=<?>A@#BC;v� b � �� �Q~)SL>(P=<VKmKL;�X�RTyQ;�{2y>� UVB)�>z@��}ju�zjx0�^}jzCv7�tU?M���7B<QU?BvBT;=<VK2�b[V<VKm@Q;�X�BH<VOQX^U?Z¾[?<JBTSN<JI#KL;D>0�v�ÁSL>r@^O#SLno@Q; Ke�tX#;DRT;DBTZ�SeO#;�X�I|��SmRC>�[V<VKm@Q;�>rU?ORTyQ;���� >]�c>ARC;DZ\U?M)SeO|RC; BT[V<VKe>���. K�3 ��g(3 �0%_'��d?Sm[8; O�I|� � ��� �º�{b�v���]��. K�3 ��gL�Hb§�$� � F��º�I:[ yQ;�MN@#OQP RTSeU?O

� � SL> P�<VKeKe;�XRTy#;��>z@��}ju�zjx0�l}jzCv7��t��^��A�} zCv7��v�t��«7ilU?RC;�RTyQ<VR

�b� � SL>­SeO#PDBC;�<?>]SmOQd�<VOQXYBTSed?y|R\� PDU?O|RTSmOc@#U?@Q>0�l8 SeRTy

KeSmZ��� � �

��"�º��b§_�3 KeSmZ

��� ���"�º�Hb 6_:

%4;DR�@Q>�P�<VKeKk<VO|� MN@#OQPDR]SLU?O�

*)' w y _�3�6<gl>C<VR]SL>]MN�|SmOQd½R]yQ;�>];±P�U?O#X^SeR]SLU?OQ>t< �>z@��}ju�zjx0�l}jzCv7�t��^��A�} zCv7�Q7�G; R �Sb �¨_�3=6<gº<VOQX �zb�q �T�,_�3=6<gL� 7o%4; R��ÄX#; OQU?RT;kRTy#;lBT;�>]R]BTSePDRTSeU?O�UVM%4;DIº;�>]d?@Q; Zt;=<?>A@#BC;

RTU ��7 [ yQ;DO¾��� 3�� 3T���xSe>�<Äs#BCU?IQ<VI#SeKmSeR �³>]sp<?PD;?7 %4;DR�I�;}<VO|� X^SL>ARTB]SeI#@#R]SLU?O MN@#O#PDRTSeU?O47

A�;�`#OQ;�� * � w '�I|� � ���r� b§SmO#M ���0*�� F �� �º� :

[ yQ; O�8I|��%); ZtZ�<kFG7�Fc7m6 ���\Se>v<kBC<VOQX#UVZ�[?<JBTSN<JI#KL;�<VOQX�� ���r� F���SmMp<VOQX�U?O#Km��SeM� F �� �º� 7

�GU � ���"�º��b �$� � F��º��b �$�T�,_�3��"�º��gL�{b

�� �º�I:

[ y|@Q>l;D[?;DBT��X^SL>ARTBTSmI#@#R]SLU?O�MN@^OQPDR]SLU?OYSL>�RTyQ;�X^Se>]R]BTSeI^@#RTSeU?O�MN@#OQP RTSeU?O�U?M(<xBH<VOQX^U?Z\[V<VB]SN<VI#Ke;?7a½;�>C<=��R]yp<VR BH<JOQX#U?Z [?<JBTSN<JI#KL;D>��+)�3 ,>%}/G3)<JBC;�z����^�@?������^��� }'SeM)RTy#; ���Ã<VKed8;DI^BH<?>-� � �+)o�

<VBT; SeOQX#; s�; OQX#; OcR�7o<QU?B'BC;�<VK#[V<VKm@Q;�X�BH<JOQX#U?Z [?<JBTSN<JI#KL;D>0�?R]y#SL> Se> ;�no@#Sm[?<JKL;DO|R'RTU�R]yQ; P�UVOQX^SeR]SLU?O�'� � ~ F � ~ 3 : :<: 3��+) F���)8��b �$��� ~ F�� ~ ��: : :]�'� �+)XF���)|�

Page 13: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� Ö �M�U?Br<VKmK � ~ 3 : : : 3 ��)+%4'§<VO#X�<VKmKu,v7 �§>T;Dn|@#;DOQPD;�U?M2BC<VOQX#U?Z [V<VB]SN<VI^KL;�>W���+)"*-,� _o�'Se>$U?MNRC; OBT;�do<VBTX#;�X�<?>l<�?�u/v A/�/�/��;D[8UVKe[|SeOQd SeOR]SeZt;?7 [ y#;���� <VKLd?;DI#BC<�d8;DOQ; BH<VRT;�XYI|� � � 3 : : : 3��+)

�H)Ub � � � � 3 : : :I3��+)8�PDU?O|RH<VSmOQ> RTyQU8>];�;D[8; O|RC>lX#;Dsº;DOQXGSeOQd���Zt;=<?>A@#BH<JI#Ke�^��U?O � � 3 : :<:<3��+) <VO#XYBT;Ds#BT;�>];DO|RC>,8 yp<VR SL>Q|OQUS8 O�<JI�U?@^R RTyQ;�s#BTUGPD;�>T>WI|�RTSmZ�; ,(7FG7 h 7 �+i,-�m ��i,�/��m�d 1 �+(+�>kghjf)(eq4� a½;�P�U?O|R]SeO|@Q; 8 SmRTy±R]yQ;�sp<VB]RTSLP @#KN<JB PCyQUVSLP�;xU?M's#BCUVIp<VI#SmK5�SmR �Ä>]sp<?PD;±��� 3�� 3T��� Z�<?X#; SeO�RTyQ; s#BC;DP�;DX^SeOQd}>T;�P RTSeU?O47 r BCUg[|SLX#;DX½R]yp<VRG8r;�M�U?BTI#SeX�SmOR`#O#SmRC;>];�no@Q;DO#P�;�> U?M _l#µ>��Q;=<?PCy �`% � yp<?>l<�@#O#Sen|@#;�I^SeOp<VB]��;©�GsQ<VOQ>]SeU?O�Cb _�: � ~ � U ���4:<: :<:A�;�`#OQ;�BH<VOQX^U?Z\[V<VB]SN<VI#Ke;�> �+)"* � w �J_�3�64 �I|� �+)^���r�Hb �4)c7 [ yQ;DO� ~ bÂ6����� ~�� 3 � U b¾6 �������� � � 6 ����� ~�� 3 ����b 6 ���� ��� � �§6 ���� ��� � � 6 ���� ��� � � 6 ���� ~�� :[ yQ;D>T;�<VBT;�P=<VKmKL;DX³RTyQ;(�,y��^�I=XyBA/� ��ukt��^��A�} zCv7�:� 7 [ yQ;tBH<VOQX^U?Z [V<VB]SN<VI^KL;�> � ~ 3�� U 3 : :<:�<VBC;SmOQX#;Dsº;DO#X#;DO|R <VOQX}p���u���v7�l{�{|z/�^R]yp<VR Se>­RCU >C<=�

�$��� b¢_8�Hb§�$� � b 6!�Hb 6 58F�:[ yQ;�>]R]BCU?O#d�KL<S8¢U?M�KN<VBTd8; O|@#Z�Iº;DBT>x��s#BCUg[?;�X�SmO��g6g_o�­<Vs^s#KeSe;�>­yQ; BC;�RCU >]y#Ug8 RTyp<VR

��� � ~ � 34343 � �+), w 6

F�� bÂ6_:[ y#Se>�Se>$P=<VKmKL;�XX*rUVBC;DKC#µ>'OQUVBTZ�<VKQO|@#Z�Iº;DB�RTyQ;DU?BC; Z}*-y>{ =�vS��} �I�>��u�~k?�v7z�� }ez����¨_�3=6 g&z@�kOQU?B]Z�<VKC�}��:y>}"z@�9�B�:y7�! � *0�:y>{ '<?�uwvf?�v7u�} zCv7�:� v�tl_ ' ��y>���t6 ' �Gz��4z�} � x0z���y>u�~(���I?Ry>�:��zCv7�Q7a½;�OQUS8 >AyQUS8 y#Ug8ÂRCUPDU?OQ>ARTBT@#PDR�OQU?R�zÃ@Q>]R�U?O#;xI#@#R�<VO�SmOR`#O#SmRC;�>T;�no@Q; OQP�;�U?M$SeO#X#;Dsº;DO:�

X#; O|RlBC<VOQX#UVZ\[V<VBTSL<VI#Ke;�> � ~ 3�� U 3<: : :0�^U?O �`b �,_�3=6<g �Gyp<=[|SeO#d�dVSe[8; O�X^SL>ARTBTSmI#@#R]SLU?O�MN@^OQPDR]SLU?OQ>�~ 3�U 3<: : :�7kq�yQUcU8>];�<�I^SµzA;�P RTSeU?O � *�/ U�w / <VOQX�>T;DR#"%$ ) b � 2 � $ )'& ��8 yQ; BC; � 2 SL>WRTyQ;

��R]y � <?X#; Z�<?PCy#;DBWMN@#OQP RTSLUVO47��G;DR "�) b �� $ 6 ~ F � $ "($ )B:[ yQ; O)" ~ 3*" U 3 : :<:W<VBC;�SeO#X#;Dsº;DOQX^;DO|R�<JOQX��^M�U?Bl<JKeK$,��

�$��� F � $ J+"�) F¾� ��� 6!�TF � $ ��b F � $>]U��$�,"u)XF��º��b ��M�U?Bl<VKeK ��%«�,_�3=6<g,7$�G; R

�U)^� $^�Hb SmO#M ���0* $+F�)#� �º�

R]yQ;DO�GIc�+%4;DZ�Z�<�Fc7�FG7Ô6 � �U)�SL>-*�U?BC; K)<VOQX��o)#� $#� F �YSmM�<VOQXU?O#Km� SeM $+F�)#� �º� 7��GUR�cSeM8�;

>];DR �V)Ub �U)^�-"�)?���#R]yQ;DO � ~ 3�� U 3 : : :W<JBC;�SeO#X#;Dsº;DOQX^;DO|RkBC<VOQX#UVZ�[V<VBTSL<VI#KL;D>­U?O � <VO#X�$���+)EF��º��b§�'���o)p�-"�)?� F��º��b �$�-"�)�F �

)#� �º�T��b�)#� �º�I:

Page 14: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

FG7»fG7 �"i h�� m ��m (�kgq4� %4;DR�� �+)"*-,.%0/���I�;�< >T;Dno@Q;DOQPD;xU?M�BH<JOQX#U?Z�[V<VB]SN<VI^KL;�>D7oA�;�`^OQ;n4)�b �'� �+)�� ~ 3��+)�� U 3<: : :T�I3 n>b~R4)_n4)�:

[ yQ; O`n Se> <1���Ã<VKed8;DI^BH<:� P�<VKeKe;�X�R]yQ; };y>z�{�� �Ty>{ �^�0x0u\y½U?Mx� �+)z*�, %~/�� 7 `bR PDU?O|RH<VSmOQ>�RTyQ;; [8;DO|RT>�8 y#SePCy}X#; s�; OQX}UVO#Ke��U?O�R]yQ;�KeSmZtSmRTSeO#d�Iº;Dyp<=[|SLUV@#BWU?M�RTyQ;�>T;Dno@Q;DOQPD;?7� �em�f�dgm � � ��� ��� �C3�U?KeZtU8d8UVBCUg[�#µ>-6D;DBTUb� U?O#;�KL<98k� � ��� ?-?�vS�S�+}��:y>}�� �+)C*7,~%E/��Yz@� y4�S�I�*0� ����A/�Ev�t z����^�@?������^��� }"u\y>���^v =D�7y>u�zjy�x0{@�/�-�"�� ��� }�� ��}Cy>z�{�� �Ty>{ �^�0x0u\y"n v�t����+)O* ,z%'/��A/v7� }Cy>z��:� v7� {|~��I�>��� }���v�t�?�uwv>x/y�x0z�{|z�} ~�_Yv7u�6 �-��v7uw�/v �>��u:� y>� ~onG� =��]y7���lu\y�x0{@�"u]y>���^v =N�7y>u�zl�y�x0{@�Gz@��y>{ =�vS��}o���^u/��{|~\A/v7�:��}Cy>� } �t-uwvSv�t����c;DR ��) b � � � ~ 3 : : : 3��+)?� 7 [ yQ;DO �H)xSL> d?;DOQ; BH<VRT;�XYIc��RTyQ; ���b>]�c>]RT;DZ U?Mv;D[8; O|RC>

#�b � � ~ F�� ~ 3<: : :<3 �V)PF���) 8 yQ; BC;�<?>6n4)�SL>Wd8; OQ;DBC<VRC;DX�I|��R]yQ; ��� >A�G>ARC; Z U?Mv; [8; OcRT>

L&b.� �+)�� ~ F���)�� ~ 3 : : : 3��+)�� $ F���)�� $* 3 �O%0/k:a½;�yp<=[8;��$�(#ER}L�� b �$�Z#�� �$�sL���M�U?B�<VKmK'>]@QPCy�# <VOQX�L��2I|�±SmOQX#;Dsº;DO#X#;DOQPD;?7XMk; OQP�; �H)<VO#XVn4)W<VBT;­SeOQX#; s�; OQX#; OcR0�oIc� [ yQ;�U?BT;DZ\687 � 7m687(`bR'M�U?KeKeUS8W>vRTyp<JR ��)k<VO#XVn±<VBC;­SmOQX#;Dsº;DO#X#;DO|R=7ilUg8x84)4��)�SL>k< ��� >]�c>ARC;DZ 8 y#SePCy�d8; OQ;DBC<VRC;D>lR]yQ; ��� <VKLd?;DI#BC< �

�b �'� �+);*�,>%�/��©7��GUtI|�

[ yQ;DU?BC; Z�687 � 7m6�<?d8<VSeO� ��<VO#XPn <JBC;�SeOQX^;Dsº;DOQX#; O|R=7 *�@#RknCW �

�7��GUR�#SmM4#&%}n��

�$�Z#��{b§�$�(# RO#��Hb§�$�(#��Ã�$�Z#��>]U��$�Z#��k% �J_�3=64 |7<(SmOp<VKmKe� �#SmM " Se> <VO|�rnN�¨Z�;�<?>]@^BH<VI#Ke;kBC<VOQX#U?Z [V<VB]SN<VI#Ke;>�QRTy#;DO

�� � $#��b��$�-" F�$^�WRC<bQ8;D>

[V<VKm@Q;�> SeO �J_�3�64 ��^>]U��$�,"xb 8���bÂ6>�R8 yQ;DBT;�8 b SeO#M � $Q*�� � $^�HbÂ64 |7

FG7µ{^7'& f)( ��m�d ��m (+� m1h"(���m�i q ��dgmYi,(+- � f)( ��m^d ��m ( � m4i ����f�q�k m ��m�d�����em�dgm2�%4;DR±�s�V3<!43fv)�xI�;}<�Zt;=<?>A@#BC;�>]sQ<?P�;V7�� >T;DR # % ! SL>�>TU?Zt;DR]SeZt;�> X#;�`#OQ;�X I|�Á<�s^BCU?s:�; BTR ��>]yp<JBC;�X½Ic��SmRC>�;DKe;DZt;DO|RC>D7�`bM v'�Z# 5 �Ub\_l��R]yQ;DO�8r;t>C<=��RTyp<JR�s#BTU?sº;DBTR ��y#U?KLX#>�y>{ =�vS��}�I�>��u�~7�&� ��u/�t��U?B�y �j�-� � 7 [ yQ;x<JKeRC; BTOp<JRTSe[?;Xy>{ =�vS��}B���luw��{|~±��U?B�y �2�-� �xSL> U?MNRT;DO�@Q>T;DX�SmO�<�s^BCU?I:�<VI^SeKeSe>]R]SLP�P�UVOcRT; �cR=7 [ y|@Q>0��M�UVB�<�>];�no@Q; OQP�;�U?MvZ�;�<?>]@#BC<VI#Ke;�MN@#OQP RTSeU?OQ>���� ) * ,'%�/r����8�;�>C<=�� )>A/v7���>��u �^�/��} v � y �j�-� RCU Z�;�<VOYRTyp<VR

v'�����}*�� )^�"�º� �w �(�"�º� V��b§_�:`bM �QU?O�RTy#;�UVRTyQ; B yp<VOQX��R8�;�yp<=[8;�RTyp<VR

v'��� � )�. ����!� V�{w _�3 M�UVBl<VKeK � � _:�R]yQ;DOP8�;r>T<=�#� ) A/v7���>��u �^�/� } v,�Yz��V=��]y7���^uw��U?B9�JSeOx<ls#BTU?Ip<VI#SmKeSe>]RTSeP P�UVOcRT; �cR9�:z��o?�uwv>x/y�x0z�{|z�}j~V7� �em�f�dgm � � ���!���2��� ��}r��� )+*_,.%0/��+x�� y��S� *0������A/�Pv�tU=��]y7���^u\y�x0{@�Ht��^��A�} zCv7�:�-��,<o� ���/���B=��G}��:y>}mv'�(���"J K�� �lt!� ) w _1y �j�-��}�� ���(� )Kw __z���=��]y7���^uw�-���I3� � t � )�w _Vz���=��]y7���luw��}�� ���(� )���w _1y �j�-��t9v7u �Sv =������Rx��S� *0� ����A/���(,�$g���

Page 15: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �

t-uwvSv�t��l�,<o� �c@#s^s�U8>];�� ) w _t<^7 ;?7Ô7N<QU?BW;=<VPCy0� � _:�v'� � ) �F��?�� v�� R32!� ) � � 2 �F�� V�/#6v'� � ) ^F���; [º7�� Yv'��� )�w _8�{bYv'�s�x�I:

Ml;DOQPD;6v'� � ) ��/�?�{w _�<VO#X � ) w _�SeO�Z�;�<?>]@#BT;?7 ��I3���c@#s#sºU8>T; � )�w _�SmOtZt;=<V>]@#BT;>�oRTyQ; O8�;�P�<VOV`#OQX�< >A@#IQ>];�no@Q;DO#P�;�Z, $g�­>A@QPCy}R]yp<VR

� $ v'� � ) � ��¢6 5 �#�-J K�:�GU:�#Ic�R]yQ; `#BC>AR�*rU?BC; K2.^q­<JOcRT;DKmKeS3KL;DZ�Z�<:�

v � � )�� ��·6 5 ��S¨7µU#7µ��b¢_>]U � ) � w _t<^7 ;?7Ô7

EG7 � /4041�� �J�#0 �.v/E^7Ô687 �Vm�� (�h�kgh f)(�i,(+-In�i q0h��Xc�dgf�com�dgkShjm^q4� %4; R��(�;3<!43fv)�(Iº;l<�Zt;=<?>A@#BC;W>Asp<?P�;V7oa³;W>]yQ<VKeKX#;�`#OQ;b��8 y#;DBC;�sºU8>T>ASeI#Ke;>��M�UVB�<�Z�;�<?>]@^BH<VI#Ke;xMN@#OQP RTSeU?O"� *�� w y . K�3�Kzg ��RTyQ;(z�� } �C�>u\y>{$U?M���#RTU�I�;�X#; OQU?RC;DX

v'���2�Hb������T vrb�����v�"�º��v'�(T �º�I:<QU?B <±BH<VO#X#U?Z [V<VB]SN<VI^KL; � U?OÁ<}s#BTU?Ip<VI^SeKeSmR ��>]sp<?PD;�� � 3�� 3T�)���'RTyQ;�SmO|RC;�dVBH<VK�SL>�@Q>A@p<VKeKm�P�<VKeKe;�XSeOQ>ARC;�<?XRTyQ;+���I?��MA�}Cy>} zCv7��U?M � <VOQX 8 BTSmRTRC; O�­����� 7� ��zl=�?�{@��MN@#O#PDRTSeU?OYSL> U?O#;�UVM(R]yQ;�M�U?BTZ

�Ob2� $ 6 ~ d $?6 � �

8 yQ; BC;�_XF^d $ F K <VO#X}# $K%C!�M�U?Bk<VKeK ���3<VO#X_8 yQ; BC;%� %./W7G<pUVBk>ASeZ�s#KL;�MN@^OQPDR]SLU?OQ> ���8�;�X^;�`#OQ;

v'���2�Hb2� $ 6 ~ d $ v �(# $=�I3

8 yQ; BC;P8�;�<?X#UVs#R�RTy#;xP�UVOc[?;DO|RTSeU?OQ> K�:µ_Vb _�:|K bÂ_^7 �lKeRTy#U?@Qd?y±R]yQ;�BT;Ds#BT;�>];DO|RH<VR]SLU?OÄUVM �Se>WO#U?R @#O#Sen|@#;>�#SeR Se> >]R]BH<VSed?y|RTM�U?B\8­<VBTXRCU PCyQ;�PwQYR]yp<VRGv'������SL>-8�;DKeK)X^;�`#OQ;DX±<VO#X��^M�U?BW>ASeZ�s#KL;MN@#O#PDRTSeU?OQ> ��3 ��<VOQXYPDU?OQ>]RC<VO|RC> � 3�� _:�R8�;�yQ<g[?;�¨<8�Kv'�����+��� �G� b��7v ���2�J����v'���G�����Ip�#� F�� SeZ�s#KeSe;�> v'���2�"F v ���G����,P=�#�rb§_t<G7µ;V7jSeM(<VOQX�U?O#Km��SeM v'���2�Hb§_^7`bO�sp<VB]RTSLP @#KN<JB9�GM�UVBW>]SeZ�s#Ke; MN@#OQP RTSLUVOQ> ���:8�;�yp<=[?;

v'���2�Hb§>]@#s!� v'���G� *��t>ASeZ�s#KL;b����F � :a½;�X#;�`#O#;�R]yQ;�SeO|RC;Dd?BH<VKJv'���2�rUVM <�OQU?Ol�bOQ;Ddo<VRTSm[8;�Zt;=<?>A@#BH<VI^KL;�MN@#OQP RTSeU?O��±I|�

v'���2�Hb§>]@#s!� v'���G� *��t>ASeZ�s#KL;b����F � :

Page 16: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

a½;�yQ<g[?;�>];�;DO½RTyp<JR�R]y#SL>�Se>�PDU?OQ>ASL>]RT;DO|RG8 SeRTy½U?@#B�X#;�`#O#SmRTSLUVO�M�UVB�>ASeZ�s#KL;�MN@#OQPDR]SLU?O#>�7�ilU?RC;R]yp<VR9�oM�U?B�<JKeK#OQUVO:�bOQ;Ddo<VR]Se[8;­Zt;=<V>]@#BC<VI#KL; MN@#O#PDRTSeU?OQ> �u3���8 SmRTy �1F���� 8�;lyQ<g[?;�v ���2�"F v'���G� 7<QU?Bl<VO|��Zt;=<V>]@#BC<VI#KL;�MN@^OQPDR]SLU?O����R8�;�>T;DR

� � b����Y_�3 � � b��. �2����_�:[ yQ; O��Pb � � .(�(��<VOQX � 9b�� � � �(�27 `bMJv'� �� � J K �8R]yQ;DOE8r;l>C<=��RTyQ<VR �Se> z�� } �C�>u\y�x0{@�<VO#X�X#;�`#OQ;

v'���2�Hb�v ��� � ��.2v'��� � �I:ilU?RC;�RTyQ<VR v'����� lF�v'� �� ��M�U?B <VKeK4SmOcRT;�d?BC<VI#Ke;�MN@#OQPDR]SLU?O#> �(7WilU?RC;�<VKe>TU RTyp<VRWR]yQ;�SmOcRT;�d?BC<VKv'���2��BC; Z�<JSeOQ>G8r; KeKWX#;�`#OQ;�X���R]yQU?@Qd?y sºU8>T>ASeI#Km�³RC<bQ|SeOQd±R]yQ;�[V<VKe@Q;VK �$@^OQX#;DB R]yQ;+8r;�<bQ8; BPDU?OQX^SmRTSLUVO�R]yp<VRkv'���(�3�-JLK§7 <QU?Bk#X%2!e�:8�;G8 B]SeRT;

v � ���� � ��b � � ��T v8 yQ; BC;;v � X#;DO#U?RC;D>�R]yQ;�BT;�>ARTBTSePDR]SLU?O�U?M v RTUr#�7t`bR�Se>�;�<?>]��RTU�PCy#;�PwQÄRTyp<JR9��8 yQ;DOQ; [8; B�RTyQ;SmOcRT;�d?BC<VKL>W<JBC;�X#;�`#OQ;�X�� �

���T vrb �� �(6 � TBvm:

Mk;DBT;�SL>­RTy#;�Q?;D�YBC;D>]@#KmR M�U?B RTy#;�R]yQ;�UVBT�U?M�SeO|RT;�d?BC<VRTSeU?O47� �em�f�dgm � � ���)��� �b9�U?O#U?RCU?O#;�PDU?O|[8; BCd8; OQP�;=� � � ��}���� )C* ,X%E/�� x��Vy4�S� *0� ����A/�_v�t���v7������C��y>}jzl�>� =��]y7���lu\y�x0{@�mt��l��A�}jzCv7�:�-���� ���

� )$# � zl=�?�{|zC�/� v'��� )?� #6v ���2��:t-uwvSv�t�� $Ny7�S�k6_* � ) b 6 ��� 3 �PbÂ6 � 7[ yQ;�BC;D>]@#KmR SL>l<�>]SmZts#Ke;�P�UVOQ>T;Dn|@#;DOQPD;�U?M(P�U?@#O|RC<VI#KL;�<VX#X^SeR]Se[|SeR �?7$Ny7�S� F�* � )+��zl=�?�{@��� �PbÂ6 � 7<(SÔ� � �¿_ <VOQX�>T;DRG#G)Kb.��� ) � 6 . � |7 [ y#;DO0#G) #6#Â<VO#X

�A6 . �?�©6 ��� F � ) F�6 �>]U

�A6 . �?��v'�(#G)8�-F v'��� )8�"F v'�(#��I:*�@^R�v �(#�)8� #6v �(#���I|��q­<?>]; 6x<VO#X�� � _P8­<V> <VB]I#SeR]BH<VB]� �G>TU RTyQ;�BC;D>]@#KmRWM�U?KeKeUg8W>D7$Ny7�S�­E�* � ) ��zl=�?�{@�9� � ��zl=�?�{@� 7a½;�P=<VOV8 BTSmRC;��}SeOYRTyQ;�M�U?B]Z

�Ob2� $ 6 ~ d $?6 � �

8 SmRTyrd $ � _�M�UVBl<VKeK �<VO#X�R]yQ;�>T;DRT>�# $�X^SL>�zAU?SeO|R�7 [ yQ;DO�� ) # �}SeZ�s#KeSe;�>d �Q~$ 6 � � � ) #x6 � �

Page 17: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �

>]UR�#I|��q­<?>T;�Fl�v'��� )?��b~� $ v'�]6 � � � )8� #K� $ d $<v'�Z# $���b�v'�����I:

$Ny7�S� h * � ) ��zl=�?�{@�9� �1§_r=��]y7���^u\y�x0{@� 7%4;DR��±I�;�>]SmZts^KL;�8 SeR]y �IF �(7 [ yQ; O � )!#(� SmZts^KeSL;D>�� )����%# ��>]UR�(I|��q­<?>T;�E:�vd?Sm[8; O� �¿_:�#M�U?Bk,�>A@���PDSL; O|RTKe�KL<VBCd?;

v'��� )8� �v ��� )�� �G� v'���G� . �B:�cSmOQP�; �,� _ <VOQX �E8�;DBC;�<VB]I#SeR]BH<VB]� �GR]yQ;�BC;D>]@#KmRlM�UVKeKLUS8W>D7$Ny7�S� f�* � ) _r=��]y7���lu\y�x0{@�9� �1 _}=��]y7���^u\y�x0{@� 7�G; R

� ) b �bF � ) y F ) � ) gN���Q,R]yQ;DO�� )�Se> >]SmZts#Ke;�<VOQX � )�F � ) F ���^>TU

v'��� )?�-F v'��� )o�"F v'���2�I:*�@^R � ) # �±M�U?BTP�;�> � )$#&�e�#>TUVv'��� )?� #6v'���2���GIc��q­<V>T; h 7� �em�f�dgm � � ���)��� ��� v7uVy>{�{ ��v7��� ���C��y>} zl�>�O=��]y7���^u\y�x0{@�Ut��l��A�}jzCv7�:� ��3 � y>����y>{�{6A/v7�:��};y>� }���{3�� _ ��,<o�Qv'�����+��� �G� b��7v ���2�J����v'���G�9���I3��� F�� zl=�?�{|zC�/� v'�����"F�v ���G�9���Pg�(�rb§_1y �j�-� z t�y>��� v7� {|~Xz t v'���2�Hb _ �t-uwvSv�t�� A�;�`#OQ;�>]SmZts^KL; MN@#O#PDRTSeU?OQ>!� )�3�� )�I|�

� )Kb �¨F � ) y F ) ��gL���\,m3 � ) b �bF � ) y F ) �-gN���\,m:[ yQ; O(� ) # ��<JOQX�� )$# ���o>]U � � )m� � � )$# � �G� � �p7&Mk;DO#P�;>�cI|��ZtU?OQUVRCU?OQ;WPDU?O|[8;DBTd8;DO#P�;>�

v'��� )8��#�v'���2�I3 v'��� )?� #6v ���G�I3 v'� � � )G��� � )8� #�v'�����"��� �G�I:a½;�Q|OQUS8 RTyp<VR�v'����� )H� � � )8�Hb��4v'��� )8��� ��v'��� )?���^>]U 8�;�U?I#RC<VSeO±�¨<o�$U?O�KL; RTR]SeOQd ,0w K§7�k>�8r;xO#U?RC;DX½<JI�Ug[8;b�'��Ip�lSL>kU?I|[cSeU?@Q> MNBTU?Z RTyQ;xX#;�`#O^SeRTSeU?O�U?M'R]yQ;�SeO|RT;�d?BC<VKb7k`bM �.b _<G7µ;V75�R]yQ;DO � )Kb§_�<^7 ;?72�?M�U?B'<JKeK�,&�o>TUov ��� )?��b¢_�<JOQX"v'�����Hb¢_^7BW�O�R]yQ;­U?R]yQ;DBvyp<VOQX��8SmMuv'�����Hb¢_:�R]yQ;DO}v'��� )8��b§_ M�U?Bl<JKeKJ,��Q>TU � )Kb§_�<G7µ;V7�<JOQX �Ob _ <^7 ;?7Ô7� �em�f�dgm � � ���)��� ��� v7uGy>{�{�z�� } �C�>u\y�x0{@�Ht��^��A�}jzCv7�:� ��3�� y>���+y>{�{mA/v7�:��}Cy>� }�� � 3���%4' ��,<o�Qv'�����+��� �G� b��7v ���2�J����v'���G�9���I3��� F�� zl=�?�{|zC�/� v'�����"F�v ���G�9���Pg�(�rb§_1y �j�-� ���PH� ���� v'���2�Hb§_ �t-uwvSv�t��oa½;�OQU?RT;�RTyp<VRGv'� . ���Hb .�v ���2�©7N<pUVB � _:�R8r;�yp<=[?;

v'� � �2� b�v'����� � ��.Cv'� � � � �Hb��7v ��� � ��.��7v'��� � �Hb��4v'�����I:`bM �Qb �+� ��RTyQ; O�� � � � � � � � b�� � � � � � � � �#>]U

v'��� � �$�zv'��� � �$� v ��� � ��b�v ��� � �$� v ��� � �$�zv'��� � �

Page 18: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� �������������� ��

<VO#X�>TUov'� �p�Hb�v'���2� �"v'���G� 7 [ yp<VR(s#BCUg[?;�>W�¨<8� 7v`bM � F���R]yQ;DO+v'���G� .�v'���2�Hb�v ��� .+�2�� _:�I|���¨<8� 7N<(SmOp<VKeKm� �|SeM��Pb¢_�<^7µ;V75�#R]yQ;DO � � b _ <^7 ;?72�Q>TUVv'��� � ��b¢_�<VOQXY>TUVv'���2�Hb¢_^7ilU?RC;­R]yp<VR'SeO [ y#;�U?BT;DZ E^7Ô687µE#�,P=��8r; KeU8>T;rR]yQ;­BC; [8; BC>T;WSeZ�s#KmSLP=<JRTSLUVO47 [ yQ; M�U?KeKeUS8 SeOQdlBC;�>A@#KeR

Se>l>]U?Zt;DRTSmZ�;D>r@Q>];DMN@#Ks*�Gdgf�cof�q9h�kgh f)( � ���)�)( ��� ��}�F x��Gy�� �C��~g��} �I=iA/v7� }Cy>z�� z��^� � y>���G�^������u]y>}jz��^�+!����� ��� ��t9v7uy>� ~Xz�� } �C�>u\y�x0{@�Ht��^��A�}jzCv7�(� �

v'����6 � �Hb _Kt9v7uGy>{�{�#X%PF zl=�?�{|zC�/� �Ob _Yy �j�-��:Ml;DBC;�<VBT;�>TU?Zt;�ZtSmOQU?B­[V<VB]SN<VO|RT> U?O�R]yQ;�Z�UVOQU?RCUVOQ;�P�U?O|[?;DBCd?;DOQPD;�RTy#;�U?BT;DZ�7

�Gdgf�cof�q9h�kgh f)( � ���)��� ��� ��}���� )C* ,~%E/�� x�� yY�S� *0������A/� v�t =��]y7���lu\y�x0{@�Gt��l��A�}jzCv7�:�9���oz�}��� ) _1y �j�-�,���� ���

� ) # � y �j�-� b�� v'��� )o�/#6v'�����I:[ y|@Q>xR]yQ; s�U?SmO|R 8 SL>T; y|�|s�U?R]yQ;�>];�>�U?MrOQU?O:�¨OQ;�do<JRTSe[|SmR �Ä<VOQX�Z�U?O#U?RCU?O#;tPDU?O|[8;DBTd8;DO#P�;P=<JO

Iº;�BC;DKL<J�G;�XYRCU�yQU?KeX�<VKeZtU8>]R­;D[8; BT��8 yQ; BC;?7�Gdgf�cof�q9h�kgh f)( � ���)��� ��� ��}­��� )V* ,�%�/��+x�� yE�S� *0�^��A/��v�t���v7��� ���C��y>} zl�>�o=��]y7���lu\y�x0{@�Ht��^��AI�}jzCv7�:�-���� ���

�� ) 6 ~v ��� )8��bYv � �� ) 6 ~ � )��`:

[ y#Se>�BC;DM�UVBTZ�@#KL<VRTSeU?O U?MlZ�UVOQU?RCUVOQ;P�U?O|[?;DBCd?;DOQPD;}Z�<7Q8;�> SeR P KL;�<VB�RTyp<JR�SmR�SL>�RTy#;�PDU?@#O:�RT;DBTsQ<VBTR�M�UVBxRTy#;�SeO|RC;Dd?BH<VR]SLU?O³U?M MN@#OQP RTSeU?OQ>�U?M R]yQ;�PDU?@#O|RH<VI^KL;<?X^X^SeR]Se[|SeR �Äs#BTU?s�; BTR �½U?MWRTyQ;Zt;=<?>A@#BC;�U?O�>T; RC>D7E^7»FG7 �(�k9m���dgi �jq(i,( - �jh���h kgq/� `bO�RTyQ;�ZtU?OQU?RTU?OQ;�PDU?O|[8; BCd8; OQP�;�RTyQ;DU?BC; Z4�4RTy#; y|�|sºU?RTyQ;D>]Se>R]yp<VR�R]yQ;±d?Sm[8; O >T;Dn|@#;DOQPD;�UVM�MN@#OQPDR]SLU?O#>tSL>�SeOQP BC;�<?>]SmOQd½Se>�;�>]>T; OcR]SN<VK¨7 `bO R]y#SL>t>T;�P RTSeU?O 8�;U?I^RH<VSmO>TU?Zt; BT;�>]@^KeRC>rU?ORTyQ;kSeO|RC;Dd?BH<VKe>rU?M4KmSeZ�SeRT>�UVM�MN@^OQPDR]SLU?OQ> 8 SeR]yQU?@#R >A@QPCy�<xy|�csºU?R]yQ;�>ASL>�7� m � ��i%�!��� ��� � <3<JRCU?@# > KL; ZtZ�<o� ��� ��}���� )X*o,D% /��=x�� y �S� *0� ����A/� v�tY��v7��� ���C��y>}jzl�>�=��]y7���^u\y�x0{@�Ht��l��A�}jzCv7�:�-���� ���

v'��KmSeZ SmO#M � )8�"F KeSmZ SeO#M_v'��� )o��:t-uwvSv�t�� <QU?B �� ,��R8r;�yp<=[8;

SeO#M2!� ) � 2 F � $>]U

v'�GSmO#M2!� ) � 2 �-F SmO#M$ � ) v ��� $��-F KeSmZ SeO#M v ��� )?��:*�@^R9�p<?>k,0w K �

SmO#M2 � ) � 2 #�>A@#s) � SeO#M2 � ) � 2 � b KeSmZ SeO#M � )

Page 19: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �

>]UR�#I|�Z�U?O#U?RCU?O#;�P�U?O|[8; BCd8; OQP�;b�v'�GSmO#M2 � ) � 2­� #6v'��KmSeZ SmO#M�� )8�I:

� �em�f�dgm � � ��� ��� �CA�U?Z�SeOp<JRC;�XPDU?O|[8; BCd8; OQP�;=� ��� ��}k��� )0*�,`% /��_x��Ey �S� *0� ����A/��v�t�z�� } �I��>u\y�x0{@� t��^��A�}jzCv7�:� �oz�}�� � )Kw �P?�v7z�� } �oz@�S��y7��,0w K�� ��� ?-?�vS�S� }��:y>}���t9v7u��Sv =�� z�� } �C�>u\y�x0{@�t��^��A�} zCv7� �

� ) �F���3 t9v7u�y>{�{ ,m:�� �����=z@�Gz�� } �C�>u\y�x0{@��y>���Kv ��� )8�{w v ���2�Gy7�k,0w K��

t-uwvSv�t�� [ y#; KeSeZ�SeR���SL>2Zt;=<V>]@#BC<VI#KL; <VOQX ���F����g>]U�v'� �� � F v'���^�"JLK �!>TU ��SL>2SmOcRT;�d?BC<VI#Ke;?7a½; yp<=[8;�_ F������ )�w ��� ��>TU�P�; BTRC<VSeO#Km��KeSmZ SeO#MC������� )o��b �����(7N*���<p<VRCU?@�#µ>�KL;DZ�Z�<:�

v'���^��� v'���2�Hb�v'��KeSeZ¿SeO#MC���6� � )8�T�-F KmSeZ SmO#M-v'��� � � )|�Hb�v'���G�J�«KeSeZ¿SeO#M-v ��� )8�I3v ���G� .'v'���2�Hb�v'��KeSmZ SeO#MC����. � )8�T�"F KmSeZ SmO#M v'����. � )8�Hb�v'���G� .�KeSmZ >]@#s�v'��� )o��:

�cSmOQP�;Uv'���G�"J K �:8�;�P�<VO�X#;�X^@#P�;�RTyp<VRv'�����"F KeSeZ¿SeO#M v'��� )?�-F KeSmZ >]@#s�v'��� )8�-F v'���2�I:

[ y#Se> s#BCUg[8;D>lR]yp<VRGv'��� )8�{w v'���2�­<?>k,0w K§7� �em�f�dgm � � ��� ��� �CA S@?º;DBT;DO|RTSL<VRTSeU?O�@#O#X#;DBlRTyQ;�SmOcRT;�d?BC<VK4>ASLd?O3� � � ��}�) W ' x�� vf?���� y>������ ?-?�vS�S�G} �:y>}��0* )��0�cw ' �0y>}jz@� �-�/� ���SN����w �v���3 �º��z@��z�� } �C�>u]y�x0{@� t9v7u y>{�{�:���SeSN�����w �v���3 �º� z@� �>z ���uw��� } zjy�x0{@� t9v7uGy>{�{ � ���SmSeS��ot9v7u��Sv =���z�� } �C�>u\y�x0{@�Ht��^��A�}jzCv7� � � t9v7u y>{�{ �0%�� y>���+y>{�{��%") �

����

� �� ����3 �º� ���

�F��3�"�º�I:

�� ��� ���w � � � 5 � �]�D���3 �º��z@�Gz�� } �C�>u\y�x0{@�Ht9v7u�y>{�{��:� }�� ��t��^��A�} zCv7��* )^w '����^� �N���]�+x0~�

��]��b � ���v����3 �º� v'�ZT �º�I3z@� �>z ���uw��� }jzjy�x0{@��y>���

TT�����]�Hb � � � �

� ����3 �º� v'�ZT �º��:

t-uwvSv�t�� [ <bQ?;�<JOc�Y>];�no@Q; OQP�; � ) w _ <VOQX�>T; R� )^�"�º��b �v��J� ��)�3 �º��. �v���3 �º�

� ) . � �� ����3 �º��:

Page 20: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

��

�������������� ��

[ yQ; O � )^�"�º��w _�M�U?B�<VKmK �2%C��<VO#X���I|��R]yQ;xZt;=<VO�[V<VKm@Q;�R]yQ;�UVBC;DZ_� � ) �FÂF �M�U?B�<VKeK7,v7`bO�sQ<VBTR]SLPD@^KN<VB0� � �w � � � 5 � �]� ���3 �º��SL>�Z�;�<?>]@^BH<VI#Ke;�M�U?B�<JKeK ��<VO#X½yQ; OQP�;�SeO|RC;Dd?BH<VI^KL;>��>]SmOQP�;�� � � 5 � �]�D����3 �º� lF��3�"�º��M�U?Bl<JKeK �)7 [ yQ; O�QIc��X#U?Z�SeOp<VRT;�XPDU?O|[8;DBTd8;DO#P�;>��

��J� ��)8��.����]�

� ) . � � � �� ����3 �º��v'�(T �º��b � � � )^�"�º��v'�(T �º�{w _�:

E^7µE^7 �(�k9m���dgi:kgh f)( i,(+- -�h � m�dgm (�kghjilkghjf)( � `bO�RTy#Se>�>T;DPDR]SLU?O 8r; >AyQUS8 RTyQ<VRG%4;DIº;�>TdV@Q;�SeO:�RT;�d?BC<VRTSeU?OÁ<?PDRT>�<?>�<VO SeO|[?;DBC>];�RTU½XGS@?º;DBC; O|RTSN<JRTSLUVO47 <QU?BX%4;DIº;�>]d?@Q;�Zt;=<V>]@#BT;Pv U?O=',��8�;8 B]SeRC;

v'����6 � � � � �Hb�� � � � � �(�"�º� T �\b���

��v�"�º��T ��:

� �em�f�dgm � � ���!��� �C<#@#OQXQ<JZ�; OcRC<VK4RTy#;�U?BT;DZ U?M(P=<JKLPD@^Ke@Q>C� ���SN� � ��} �0*�y du3MefgJw ' x�� y\A/v7� } z�� � v7����t��^��A�}jzCv7� y>��� �S��}�

� ���]�{b ���� �(�"�º� T ��:�� ���

�� z@� �>z ���uw��� } zjy�x0{@��v7�2y du3Mefg�� �oz�} �

��� b�� �

��SeSN� � ��}�*�y du3MefgJw ' x�� �>z ���uw��� } zjy�x0{@���oz�} ��A/v7� }jz�� ��v7��� �^��u�zl�7y>} zl�>�!� ���� ���

� ���v�"�º��T �Ob

��se � .

��(dG�I:

t-uwvSv�t�� <�Sm� �+%[y du3Me � 7}��Se[8; O � � _:�vRTy#;DBC;t; �cSL>ARC>���� _}>]@#PCy«RTyp<VR �v� �º�/. �v���]� BF �8 yQ; OQ;D[?;DB � . ��lF��|7��GUR�^M�UVBl_XJ �_F��^�

����

�� ��J� �p��.

�� ��]�

�. �v��]� ���

�b 6�

������� ��

���v� �º�2. �v��]�]� T � ����

F 6�� � ��

�v�"�º��. �(��]� T �4F ��� � ��

T �\b��B:Ml;DOQPD;

�� SL>­XGS@?º;DBC; O|RTSN<JI#KL;�UVO�R]yQ;�BTSed?y|Rl<VR � 8 SeRTyYX^;DBTSm[V<VRTSm[8;��v���]� 7��cSmZtSmKN<VB]Ke� �8M�UVBl<VKeK ��%�Zd�3feMg �

�� SL>vX^S@?º;DBT;DO|RTSL<VI#KL;�U?O�R]yQ;rKL; MNR'<VR ��8 SeRTy�X#;DB]Se[V<VRTSm[8; �v��]�©7B<(SmOp<VKeKm� �G�

�.�� � � ��]��b§_

M�U?Bl<JKeK ��%«�(du3Me �­>TUR�#I|��R]yQ;�Z�;�<VOY[V<VKe@Q;�R]yQ;�UVBC;DZ_���(eD��.

��(dG�Hb

�� �(e ��.

�� �(dG��b � �

��v� �º� T ��:

Page 21: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �Ö

E^7 h 7 ��dgf!-+� �>k ��m�i q ��dgmIi,(+-�� ��n�h�(eh��2q+k���m�f�dgm � � %4; R��(� ~ 3 ! ~ 3fv ~ ��<JOQX¿�(� U 3<! U 3fv U �Iº; �N� z�} ��Z�;�<?>]@^BC;�>]sp<VP�;�>D7 [ y#;DOF b.� # ~ �}# U *-# ~ %2! ~ 3f# U %'! U Se>­<G��� >]�c>ARC;DZ U?M4>A@#IQ>];DRC> UVM��&b�� ~ �;� U 7oA�;�`#OQ;lRTyQ; ?�u/v0�>��A�}� �Ty>{ �^�0x0u\y !Ob&! ~�� ! U b�'�F��©7

� m � ��i%�!�)( ���2��� ��} ��* � w ' x��o!4� =��]y7���^u]y�x0{@�-� �� ��� � t9v7uGy>{�{ � ~ %�� ~ �N} � � t��l��A�}jzCv7�� U �w �v� � ~ 3 � U ��* � U w ' z@�U! U � =��]y7���^u\y�x0{@�-�t-uwvSv�t�� A�; OQU?RT;lI|� � R]yQ; >];DR UVM2I�UV@#OQX#;DX0!��¨Z�;�<?>]@^BH<VI#Ke; MN@#OQPDR]SLU?O#>�M�U?B 8 y#SLPCy�RTyQ;�PDU?OQP Ke@:�>ASLU?OÄyQU?KeX#>�7 [ yQ;DO�� SL>�<�[8;DPDRTU?B�>]sp<?PD;>�)P�UVOcRC<VSeO^SeOQd�R]yQ;�SeOQXGSLP=<JRCU?BkMN@#OQPDR]SLU?O 6 � U?M�;D[?;DBT�>];DRo#[%>F�7 9�U?BC;DUg[8;DB0�2SeM � )\% � M�U?B�<VKeK4,³<VOQX}SmM ��SL>WIºU?@#OQX#;DXY8 SeR]yÄ_(F � ) ##���pRTyQ; O<VKe>TU���%��W7$�GUR�8I|��RTyQ;­ZtU?OQU?RTU?OQ; P KN<?>]>vRTyQ;DU?BC; Z4���½P�U?O|RC<VSeOQ>$<JKeK^IºU?@#O#X#;�X\! �bZt;=<?>A@#BH<JI#KL;MN@#O#PDRTSeU?OQ>D7 [ y#;�BT;�>ARkSe> ;=<?>A�87� m � ��i%�!�)( ��� ��� v7uGy>{�{�x�v7�^���^�]�V!4� =��]y7���^u]y�x0{@� t��l��A�}jzCv7�:� � � }�� ��t��l��A�}jzCv7�

� ~ �w � ~ �"� ~ �Hb � � � �v� � ~ 3 � U ��v U �(T � U ��*-� ~ w '

z@� x�v7�^���^�]�+y>���V! ~ � =��]y7���^u\y�x0{@�-�t-uwvSv�t����ls#s#Km�³RTy#;�ZtU?OQU?RTU?OQ;P KN<?>]> R]yQ;�UVBC;DZ_��<?>�SeO RTyQ;s#BT;�PD;�X^SmOQd�Ke;DZ�Z�<G7«ikU?RT;RTyp<VR`#O^SeRC; OQ;�>]>kUVMmv ~ <VOQXPv U SL> ;D>T>];DO|RTSL<VK)RCU�RTyQ;�<VBTd?@#Zt;DO|R=7� �em�f�dgm � � �)(+��� � r BCUcX^@QP RlZt;=<V>]@#BT;g� � �� ��uw�P��� z@��}���yE�^� z+*0� �U=��]y7���luw��v0bYv ~�� v U v7�! ����A/�V} �:y>}

v'�Z# ~ �0# U ��bYv ~ �(# ~ � v U �(# U �t9v7u�y>{�{�# ~ %2! ~ y>���K# U %�! U �t-uwvSv�t�� �WO#SLno@Q; OQ;�>]>ryQU?KeX#>$I�;DP=<V@Q>];kF SL>�<G��� >]�c>ARC;DZ d8; OQ;DBC<VRTSmOQd;!�7o<QU?B�;©�GSe>]RT;DOQPD;>�GI|��RTyQ;Ke;DZ�Z�<?>��l8�;�P�<VO�X#;�`#O#;

v'�(#��Hb��� � � �� � 6 � �"� ~ 3 � U � v U �(T � U � � v ~ �(T � ~ �<VO#X�@Q>];�ZtU?OQUVRCU?OQ; P�U?O|[8; BCd8; OQP�;�RCU >T;D;�R]yp<VRkv�SL> PDU?@#O|RH<VI^Ke�Y<?X^X^SeR]Se[8;V7�Gdgf�cof�q9h�kgh f)( � �)(+�)( ��� ��}��!ObX! U�� ! ~ y>��� �vrb�v U�� v ~ � � v7u�y�t��l��A�}jzCv7� �=v7�V� ~ �+� U ��ou�z�} � ��2t9v7u�}�� � t��^��A�} zCv7� v7��� U �C� ~ �>zl�>��� x0~ ��v�"� U 3 � ~ �"b �v� � ~ 3 � U �-� �� ��� �� z@� �!��=��]y7���^u\y�x0{@� z tGy>��� v7� {|~�z t �=z@�o!4� =��]y7���^u]y�x0{@� y>��� ��t9v7u �z=��]y7���lu\y�x0{@��y>���E��v7��� ���C��y>} zl�>�9��v'���2�Hb�v'���2�-�� �em�f�dgm � � �)(+��� �C<#@#I#SmO#S;# >­RTyQ;DU?BC; Z� ��,<o� � ��} � x��U!4� =��]y7���^u\y�x0{@�Gy>���E��v7��� ���C��y>}jzl�>�-���� ���

v'���2�Hb��� � � �� � �v�"� ~ 3 � U � v U �ZT � U � � v ~ �ZT � ~ �I:

Page 22: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

�\� �������������� ��

��I3� � ��} � x��Gvm� z�� } �C�>u\y�x0{@�-� �� �����S�� � U �w �(�"� ~ 3 � U � z@�Gv U � z�� } �C�>u\y�x0{@�Ht9v7ukv ~ �Ty>{ =�vS��} y>{�{ � ~ ���SmS��� ~ �w � � � �(�"� ~ 3 � U ��v U �ZT � U �Gz@�Gv ~ � z�� } �C�>u\y�x0{@�y>����} � ��t9v7u�=��^{2yGt9v7ukv'������z����,<o� � v7{2�7�-�

ilU?RC;�RTyp<VR�RTy#;�z�} ��u\y>} �]��z�� } �C�>u\y>{#SeO��¨<o�2SL>e8r; KeKcX#;�`^OQ;�X��8M�UVB'<VKmKoI�U?@^OQX#;�X�UVB(OQUVO:�bOQ;Ddo<VR]Se[8;Zt;=<?>A@#BH<JI#KL;�MN@#OQP RTSeU?OQ> ���QIc�V%4; ZtZ�<?>lE^7 h 7m6�<VOQX}E^7 h 7�Fc7­ikUVRC;�<VKL>]U R]yp<VR0�pSmO}PDU?Z�I#SmOp<VR]SLU?O8 Smy r BCU?sºU8>ASeRTSeU?O�E^7 h 7 h �^<Q@^I#SeO#SC#µ> R]yQ;�UVBC;DZ <JKeKLUS8W>'@Q>$RCU�SeO|RC; BCPCyp<JOQd8;WRTyQ;lU?BCX^;DB�U?M�SmO|RC;�dVBH<7�R]SLU?OYSeOYZ�@^KeRTSms#KL;lSeO|RC;Dd?BH<JKL>0� 8 yQ; OQ;D[?;DBlRTyQ;�SeO|RT;�d?BC<VOQXSL>­OQUVO:�bOQ;Ddo<VR]Se[8;�U?Bkv��bSeO|RT;�d?BC<VI#KL;V7t-uwvSv�t�� A�; OQU?RT; I|� �·R]yQ;t>];DR�U?M <JKeK IºU?@#OQX^;�X ! �¨Z�;�<?>]@#BC<VI#Ke;�MN@#OQPDR]SLU?O#>#��M�U?B�8 y#SLPCy½RTyQ;M�U?B]Z�@#KL<�y#U?KLX#>D7 [ yQ; O�� P�U?O|RC<VSeOQ> RTy#;�SmOQX^SLP�<VRCUVB�MN@^OQPDR]SLU?OÁU?M�; [8; BT��!��¨Z�;�<?>]@^BH<VI#Ke;>T; R>]UR�3I|�YRTy#;�ZtU?OQU?RTU?OQ;�PDKL<?>T>WRTyQ;DU?BC; Z4� � P�UVOcRC<VSeO#> <VKmK4I�UV@#OQX#;DX2! �bZt;=<?>A@#BH<VI^KL;�MN@#OQP RTSLUVOQ>�7Ml;DOQPD;>�QM�U?Bl<VKmK ! �bZt;=<?>A@#BH<VI^KL; MN@#O#PDRTSeU?OQ> ���:8�;�yp<=[8;

v'��� )8��b � � � � �� � � )^�"� ~ 3 � U � v U �ZT � U � � v ~ �(T � ~ �8 yQ; BC; � )Kb � .�,2��� � �\,(7<QU?B �±OQU?O:�¨OQ;�d8<VRTSm[8;>�R8�;�P=<VO�sp<?>]>lRTU�R]yQ;�KeSeZ�SeR­<?>k,.w K I|�ZtU?OQU?RTU?OQ;�PDU?O|[8;DBTd8;DO#P�;

RTUt;©�GRT;DOQX�RTyQ;�M�U?B]Z�@#KL<�RCU �(7 [ yp<VRWs#BTUg[8;�>��¨<8� 7`bM �±Se> v��bSmO|RC;�dVBH<VI#Ke;>�cRTyQ; O�#I|���¨<o�

� � � � � � � �v� � ~ 3 � U �� v U �ZT � U � � v ~ �ZT � ~ ��b�v'� �� �"J K�:Ml;DOQPD; 8�; U?I#RC<VSeO ��S��k<JOQX ��SeSN� 7 [ yQ; O�4Ic�±X#U?Z�SeOp<VRT;�X±PDU?O|[8; BCd8; OQP�;b��8�;�P�<VOÄsp<?>]>�RCURTyQ;KmSeZ�SeRr<?>k,�w K SmORTyQ;�M�U?B]Z�@#KL<xM�U?Bkv'��� )o��RTU U?I#RH<JSeOYRTyQ;�X#;D>]SmBC;�XYM�U?B]Z�@#KN<xM�UVBkv'���2�©7[ yQ;�; �cSe>]RC; OQP�;tU?Mrs^BCUcX^@QPDR�Zt;=<?>A@#BC;t<VOQX�<#@#I#SmO#S;# >�RTyQ;DU?BC; Z�; �cRC; OQX³;�<?>]SmKe�±RTU_���;`#O#SmRC;

Zt;=<?>A@#BC;t>]sp<VP�;�>D7 [ yQ;�U?sº;DBC<VRTSeU?O�U?M­RC<bQ|SeOQdYRTyQ; s#BTUGX^@#PDR�U?M­R 8�U�Zt;=<?>A@#BC;�>]sp<VP�;�>�SL>�<?>T�>]UGP SN<VR]Se[8;b�'Ic��<Y��� >A�G>ARC; Z @#O#Sen|@#;DOQ;D>T>t<VBCd?@^Z�; OcR�7��cU 8�;YP=<VO��$I|��SmOQX^@QP RTSeU?O� RH<7Q8;RTyQ;s#BTUGXG@QPDR�UVM$<E`#O#SmRC;�Oc@^Z�I�; B9��8 SeRTy#U?@#R�>As�;DPDSmMN�cSmOQdtR]yQ;�U?BTX#;DB�7 [ yQ;�Z�;�<?>]@#BT;xU?I^RH<VSmOQ;�X}I|�RC<bQ|SeOQdRTy#;",��bM�UVKLX±s#BTUGX^@#PDR�U?M"%4;DIº;�>TdV@Q;�Z�;�<?>]@#BT;�U?O ' SL>�P�<VKeKe;�X � �0x��/�]�>� �"=��]y7���^u/�Ev7�' ) 7 [ yQ;�PDU?BTBT;�>]sºU?OQXGSeOQd SeO|RC;Dd?BH<JK2SL>-8 B]SeRTRT;DO

����

�v� �º� T ��:

�Gdgf�cof�q9h�kgh f)( � �)(+��� ��� ��}��s�;3 !73 v)� x��Vy_� ���N� z�} �\=��]y7���^uw�+�@?RyBA/�Vy>��� {@��} � x��Vy ��v7������C��y>}jzl�>� =��]y7���lu\y�x0{@�mt��l��A�}jzCv7��v7�\� ���� ���

v'�����Hb�� �� v'���1��3� T���:

Page 23: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � �E^7»fG7 �"dgi,(�q 1;f�d/��i:kgh f (eq�f21�h"(�kSm���dgi � q/��Gdgf�cof�q9h�kgh f)( � ��� ���2��� ��}'�s�V3<!43fv)�,y>�������+3��$3 �#��x���=��]y7���^uw�,�@?RyBA/�/�-����� ?-?�vS�S�,} �:y>} �Vbv ���(�Q~�t9v7uE�Sv =�� =��]y7���lu\y�x0{@��t��l��A�}jzCv7� �~*H� w ��� �� ���������G�"b v ��� �&�2�9��t9v7u+y>{�{��v7��� ���C��y>}jzl�>�U=��]y7���^u]y�x0{@� t��l��A�}jzCv7�:� ��v7������k>k<�>As�;DPDSN<JK)P=<?>];G8�;�d8;DRWRTy#;�M�UVBTZ�@#KL<

����3� ���]�Gb � � �3� �º� v� �(T �º�M�U?B <VO|��BH<JOQX#U?Z [V<VBTSL<VI#KL; �jSmOP� <VOQXY<VO|��OQU?O:�¨OQ;�d8<VRTSm[8; Zt;=<?>A@#BH<JI#KL; MN@^OQPDR]SLU?O � U?OP��7�Gdgf�cof�q9h�kgh f)( � ��� ��� ��� ��}��(�;3<!43fv)� x��4y2=��]y7���^uw�+�@?RyBA/�4y>����{@��} � x��4y���v7��� ���C��y>}jzl�>�=��]y7���^u\y�x0{@�6t��^��A�} zCv7�=�oz�}��0v'���2�EJ K�� � � �N��� ���Z#��"bDv'���(6 � ��3f# %&! � �� �����Lz@�(y=��]y7���^uw��v7�\� y>��� �º���G��b�v'��� �G�Ht9v7uGy>{�{��v7��� ���C��y>}jzl�>�o=��]y7���^u\y�x0{@�Ht��l��A�}jzCv7�:� ��v7�\� �� BH<VO#X#U?Z·[V<VB]SN<VI#Ke; � SmO�' ) SL>)>T<VSLX�RCUWyp<=[8;�<P�^���:��z�}j~7t��^��A�} zCv7� ��SmM �gM�U?B(<VKeK-#X%�q � ' ) ���

�$� � %0#���b ���v�"�º��T ��:

*�� r BTU?s�U?>]SeR]SLU?OE^7�fc7�Fl�#M�UVBl<�BC<VOQX#UVZ�[V<VBTSL<VI#KL; � SmO(' ) 8 SmRTy�X#; OQ>]SmR � � ���r���3�����T� b � �

�3�"�º� � � �"�º��T ��:�Gdgf�cof�q9h�kgh f)( � ��� ��� ��� ��}��N*"y du3MefgVw ' x���A/v7� }jz�� � v7����{|~ �>z ���uw��� }jzjy�x0{@�Yy>������}ju�zsA�} {|~z���A�uw�]y7��z��^� ���� ��� ��t9v7uGy>{�{��v7��� ���C��y>}jzl�>�o=��]y7���^u\y�x0{@�Ht��^��A�} zCv7�:� ��v7��y��(�ZdG�I3����se ��g��

���� � &

�� � & �3� $^� T $Kb � �

��3���(� �º�T��� �N� �º� T ��:

`bR SL> <�>ASeZ�s#KL;�Z�<VR]RC;DB�RTU½;©�cRC;DO#X¿;=<VPCy¿U?MlRTy#;�<JI�Ug[8;Ys#BTU?s�U?>]SeR]SLU?O#>xRCU�<VKmK­SeO|RC;Dd?BH<JI#KL;MN@#O#PDRTSeU?OQ> �p7

h 7� .m� � 5 ��/e� �/)1�&�$�e� N0��1p5h 7Ô687xu w � (�f�d*�Iq/� %); R�(�;3<!43fv)� Iº;�<�Zt;=<V>]@#BT;�>]sQ<?P�;V7Y<QU?Bt6YF H J K �e8r;�X#;DOQUVRC;tI|�u4wob¢u)w|�(�;3<!43fv4��RTyQ;�>];DRlU?M�Z�;�<?>]@#BC<VI#Ke;�MN@#OQPDR]SLU?O#> �48 SmRTy `#O#SmRC;�u4w-� ��v7uI=P*

� � � w b � � � �� w T v � ~� Lw J K�:a½;�X#;DO#U?RC;�I|��u � b u � �s�V3<!43fv)�WR]yQ;�>T; R�U?M$Z�;�<?>]@#BC<VI#Ke;xMN@#OQP RTSLUVOQ>&��8 SeR]y1`#O#SeRT;�u � ���v7u�="*

� � ��b SeO#M � �r*� ���F �}<^7 ;?7 :

ilU?RC; R]yp<VR � � � w F � � ��M�U?B <JKeK(6GFIH_J K§7N<QU?Bk6GFIH4F K ��8r;�>T<=�tR]yp<VR � )0A/v7���>��u �^�/�

} v#�=z��Yu4w�SmM � � )�. � � w w _^7

Page 24: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

h 7»FG7'& ��m�n ��q ��m � �2q�h"(em�� ��i �jh k � � %); R �ÁIº;<}OQU?O:�¨OQ;�d8<VRTSm[8;�Zt;=<?>A@#BH<JI#KL;�MN@^OQPDR]SLU?O <VO#XKe;DR �0 _^7Ba½;�@Q>T;�RTyQ;�OQUVRH<VR]SLU?O ���1�� xM�U?B R]yQ;�>T;DR����}%��[* �v�"�º���� |7$ikU?RT;�RTyp<VR

�46���� ���� F �>]UtU?O�SeO|RT;�d?BC<VRTSmOQdP8r;�U?I^RH<VSmO/$�� �0x0~S�/� �I� ' � z���� *0�:y>{|z�}j~

�uv ���1��º�-F v'���2�I:

ilUg8³KL;DR � Iº;�<VO|��Z�;�<?>]@^BH<VI#Ke;'MN@#OQPDR]SLU?O27ea½;�P�<VO�X^;�X^@QPD;�SmOQ;�no@p<VKmSeR]SL;�>ºM�U?B � I|��PCyQUGU?>]SeO#d>]U?Z�;YOQU?Ol�bOQ;Ddo<VRTSm[8;YZ�;�<?>]@^BH<VI#Ke;MN@#OQPDR]SLU?O � <VOQX <Js#s#Ke�|SmOQd�q�y#;DI|�c>]yQ; [�# >�SeO#;�no@p<VKmSeR ��RTU�Pb � � �p7N<pUVBW; �^<VZ�s#KL;b�^SeM � %±u)wx<VOQX ��� _:�GRTyQ; O

v'� � �º�Hb�v � � w �� w �-F�� �Jw v'� � w �-JLK�:�GU 8�;�U?I^RH<VSmORTyQ; }Cy>z�{&�/��} zl=Xy>} �

v'� � ��3�{b��� � �Jw ��3 <?> �Ow K§7

h 7µE^7 � m (�q�m ( �2q4h"(em�� ��i �jh k � � � MN@#OQP RTSLUVO 8V*�'Nw ' SL>;A/v7���>����SmM ��M�U?B�<VKmK ��3%$.% ' <VO#X��% y _�3=6<g �

8V��� �+�¢�A6 . �]� $^� F � 8V� �º�$�¢�]6 . �]� 8V� $#��:� m � ��i (+��� ���2��� ��} 8"* 'xw ' x��;A/v7���>���4y>��� {@��} � %I'�� �� ����}�� ��uw����� z@��}Hdu3Me %I'����A/��8V� �º�� d �"� e�t9v7u�y>{�{ � � �oz�} �4� *0�Ry>{|z�}j~(y>} �Ob � �t-uwvSv�t�� *��P�U?O|[?; �cSeR �>�pM�UVB �YJ�� J $�8�;�yQ<g[?;

8V�"����. 8V� �º�� . � F

8J� $^� . 8J�����$�. � :

�GU:�R`^�cSeOQd'�1�#RTy#;DBC;�; �cSe>]RC>kdQ%_'�>]@QPCy�RTyp<JR9�#M�U?Bl<VKmK �4J��j<VO#X�<JKeK $ � �8J������. 8J�"�º�

� . � F d+F 8J� $^� . 8J�����$ . � :[ yQ; O"8J�"�º�� d3�"� . ���$� 8J�������#M�UVBl<VKeK �0%Y'l7� �em�f�dgm � ( ���!��� �;D?;DO#>T;DO�#µ>lSeOQ;Dn|@Q<VKeSmR �#� � � ��} � x�� y>��z�� } �C�>u\y�x0{@��u\y>���^v = �7y>u�zjy�x0{@� y>���{@��} 8 * '^w ' x�� A/v7���>��� ���� ��� ��18J� ���]�Ez@���"��{�{e�^� �N���]��y>����� 8V�����T�� 8V� �� ���]�I:t-uwvSv�t����c;DR � b �� �Ä� <VOQXPCyQUcU8>]; du3Me6%4' <?>rSmO�RTy#; KL; ZtZ�<^7 [ y#;DO 8J� ��� d �x��eg7$`bOsp<JBTRTSePD@#KL<VB r�18J� �Ä� � �-F d �� � �H� e lJLK �#>TU r�18J� ���]� SL>-8�;DKeK)X^;�`#OQ;DX27r9�U?BC;DUg[8;DBr�18J� �Ä�T�� d ­������� e bYd �[� e�b�8V�"���Hb�8J� �� �Ä�T�I:

Page 25: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� ���a½;�X#;DX^@QP�;�MNBCU?Z D?; OQ>T; O#µ>�SmOQ;�no@p<JKeSeR � }�� ��=�v7��v7} v7� zsA�z�}j~Vv�t u4w-� ��v7uI= ���oz�}��Yuw�/�@?��MA�} } v(y?�uwv>x/y�x0z�{|z�}j~ =��]y7���^u/� 7"%4;DR�6PF=HYJ��EJ K§7W�c;DR�8V� �º��b � � Lw �QRTyQ; O"8�SL>WPDU?O|[8; �º7k�GUR�QM�U?B<VO|� � %�u4w|���)���

� � � w b � � w � ~� Lw b � 8V� � w �T� ~� � F¾� $8J� � w �]� ~� � b � � � � ~� � b � � ��:

`bO�sp<VB]RTSLP @#KN<JB9�#u w ������� u��=����� 7h 7 h 7���f ��-�m�d �5qXh"(em�� ��i �jh k �=i,(+-¢� h"(ep�f �Eq0p�h��2qXh�(�m�� �ei � h�k � � %4;DRx�s�V3<!43fv)��Iº;x<�Zt;=<7�>A@#BC;�>]sp<VP�;?7 <QU?BBH$3� %Sy�6�3�KzgC�^8r;�>C<=�R]yp<VRoH�<VOQX���<VBT;\A/v7� ���>��y>} ��z����>zsA/�/��SeM

6H� 6�bÂ6_:

� �em�f�dgm � ( �)(+��� �CMPOUVKLX#; B9# >WSmOQ;�no@p<JKeSeR �^� � � ��}:H$3�� %��]6_3�K¿��x��KA/v7� ���>��y>} ��z����>zsA/�/�-� �� ��� �t9v7u�y>{�{$=��]y7���^u]y�x0{@�mt��l��A�}jzCv7�:� � y>����� �N�"���:y��>�

v'� � � � F � � � w � � � � :t-uwvSv�t�� [ y#;�P=<?>];�>�8 yQ;DBT; � � � w b _YUVB � � � w b K <VBC;�R]BTSe[|SL<VKv>]U(8r; P=<JO½;©�GPDKe@#X#;�RTyQ; Z}7[ yQ; O�|Ic�xZ�@#KeR]Ses#Km�|SeOQd ��I|� <JO�<Vs^s#BCU?s^BTSN<JRC;­PDU?OQ>]RC<VO|R9��8�; <VBT;­BC;DX^@QP�;DXtRTU�R]yQ; P=<V>T;)8 yQ;DBT;� � � w b 687��cU 8�;�P=<VO�X#;�`^OQ;x<�s#BTU?Ip<VI^SeKeSmR �tZt;=<V>]@#BT;��«U?O.!}I|�

�'�(#��{b �� �� w T v :

<QU?B Zt;=<?>A@#BH<JI#KL;�MN@#O#PDRTSeU?OQ> � _:�R8�;�yQ<g[?;������Gb�v'��� �� w ��3 �������F ���� � � ~� � :ilU?RC;�RTyQ<VR��^� H . 6!�Hb=H47 [ yQ; O48�;�yQ<g[?;

v'� � � �7b�v � � � w �Q~ �� w � b � �

�� w �Q~ �F � � �

�� � � w �Q~ & � ~� � b�v � � � � ~� � b � � � w � � � � :

� �em�f�dgm � ( �)(+��� �b9�SmORQ8US8W>\Q|SC#µ>WSeOQ;Dno@p<VKeSmR �^� � � v7u&Hr% y�6�3�K¿��y>���+=��]y7���lu\y�x0{@�mt��l��A�}jzCv7�:�� y>��� � �o�"� �:y��>�

� �"� � � w F � � � w � � � � w :t-uwvSv�t�� [ y#;�P=<?>];�H0b 6xSe> ;=<V>]�87 [ y#;�P=<?>];�>�8 yQ; BC; � � � w b K UVB � � � w b K <VBC;�RTB]Se[|SN<VKC�>]U�8r;�P=<VO�<?>T>A@#Z�;�RTyp<JRkIºU?RTy�OQU?B]Z�>k<VBC;�`#O#SmRC;V7 [ y#;DO�º>]SeO#P�; �+� � w F�F w � �� w � � w ���8�;�yQ<g[?;

v'� �"� � w �"F§F w � v'� �� w �$� v � � w � �J K�:[ yQ;�P=<V>T; 8 yQ;DBT; � �+� � � w b _�Se>­RTBTSm[|SN<VKC�G>]U�Ke;DR @Q>l<?>]>]@#Zt; � �V� � � w � _^7 W IQ>T; BT[8;�RTyp<JR

� �V� � w �Q~ ��bYv'� �V� � � w �Q~ & � � ~� � b�v'� �"� � w � ~ �Q~� Lw :

Page 26: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

�GU:�#Ic�VM OU?KLX^;DB9# >­SeO#;�no@p<VKmSeR � �v � �"� � w �-F v'� �� � � � w �Q~ �$� v � � � � � w �Q~ �

F¾� � � � w � � � � w � � �+� � w �Q~ � � :[ yQ;�BC;D>]@#KmR M�U?KeKeUS8W> U?O�X^Se[|SLXGSeOQd�IºU?RTy�>ASLX#;D>WI|� � �"� � w �Q~ �

�7

9�SmORQ8US8W>TQcSC#µ>lSeOQ;Dno@p<VKeSmR ��>AyQUS8W>lR]yp<VRku4w0�bOQUVBTZt> <VBC;�PDU?O|RTSeO|@QUV@Q><*'SeM � )Kw �}SeO�u4w��^RTy#;DO� � � w . � � )�. � � w F � � ) � w F � � � w � � � )�. � � w

>]U � � ) � w w � � � w 7fG7 -�.������|1Q041p/)1p5J5�.�� u4w ��/�� .m�c0�). � .(/$�����u�º.�� 1��º0��.v/

fG7Ô687���w iRq�iY�Pi,(�i,�/� q0cei,� m2� %); R��§Iº;W<k[8;DPDRTU?B$>]sp<VP�;?7H�ÁZ�<Vs��w � � *��cw y _�3�K¿�Se>k<(��v7u�=\SmM��S�� � � �� � F � � � � � � M�UVB <JKeK � 3�;%��X���SmS�� � �� � b � � � M�U?Bl<VKeK�Q%�� <VOQX �C%4',���SeSmS�� � � b _�SmZts#KmSL;D>�+b§_^7a½;�OQU?RC;�R]yp<VR9�#M�UVBl<VO|��OQU?B]Z4�^SmM � )�.� � w _�RTy#;DO � ) � w � � 7��>]�|Z�Z�; RTB]SLP±I#SmKeSeO#;=<VBtZ�<Vs � � 3�^� �w � � 3����*�� ��� w 'jSe>�<VO z�� ����uV?�uwv0�>�uA�}

SmM���u3����:_l� 8 SeR]y¿;Dno@p<VKeSmR �«U?O#Km��SeM�Sb _^7 <QU?Bt<VO|�«SeO#OQ; Bts^BCUcX^@QPDR0��� : 3 :�����R]yQ;YZ�<Vs �w ��u3���$SL>W<�OQUVBTZ_�^I|�RTyQ;�q­<V@QPCy|� .^�GPCy�8r<VBw6�SeOQ;Dn|@Q<VKeSmR �879�SmORQ8US8W>TQcSC#µ>�SmOQ;�no@p<JKeSeR ��>AyQUS8W>�RTyp<VRx;=<?PCyÁu4w>]sQ<?P�;�Se>�<�[?;�PDRTU?B >]sQ<?P�;<JOQX�RTyp<JR�RTyQ;

u4w0�bO#U?BTZt>k>T<VRTSe>]MN�YPDU?OQX^SmRTSLUVO³��S�� <VIºUg[8;?7kqrU?O#X^SeR]SLU?O³��SmS��­<VKe>TU yQU?KLX^>�7lqrU?OQXGSeRTSeU?O½��SmSeS���M�<JSeKL>��Iº;�P�<V@Q>T; � � � w b _YX#Uc;�>�OQU?R�SeZ�s#Km��R]yp<VR �zb _:�)U?O#Km�±RTyQ<VR �Cb _�<^7µ;V7m7EMkUS8�;D[?;DB9�(SeR�SL>sºU8>T>ASeI#Ke; RCU�Z�<7Q8; RTyQ;ku4w0�bOQUVBTZt> SeO|RCU�RTB]@Q;WOQU?BTZt> I|� no@QU?RTSe;DO|RTSmOQd�U?@#R$I|��RTyQ;W>A@#IQ>]sQ<?P�;kU?MZt;=<?>A@#BH<JI#KL;�MN@#OQPDR]SLU?O#>k[V<VO#Se>]y#SmOQd�<^7 ;?7Ô7 [ y#Se>�no@QU?R]SL;DO|R�8 SeKeK)Iº;�X#; OQU?RC;DX�� w 7 ikU?RT;�RTyQ<VR9�M�U?B �2%�uNU9��8r;xyQ<g[?; � � � UU b!����3 �"����8 y#;DBC;#� : 3<:$�rSL>kR]yQ;x>A�|ZtZt;DR]BTSLP�I#SmKeSeO#;=<VBWM�U?B]Z U?OÄuNUd?Sm[8; O�I|�

����3 �%� b � ��� � T v :[ y|@Q>&� U Se>l<VO}SmO#OQ;DBls#BTUGX^@#PDRk>]sp<?PD;?7 [ yQ;�OQU?R]SLU?O�U?M'PDU?O|[8;DBTd8;DO#P�;xSmO�u w X#;�`#OQ;DX±SeO � h 7Ô6Se>WR]yQ;�@Q>]@Q<VK4OQU?R]SLU?OYU?M(P�UVOc[?;DBTd8;DOQPD;xSeO�<�OQU?B]Z�;DXY>]sp<?PD;?7�\O#U?BTZt;�X�[?;�PDRTU?B >]sQ<?P�;'� Se>rA/v =�?�{@��} ��SmMW;D[?;DBT� q­<V@QPCy|�«>T;Dno@Q;DOQPD;�SmO(�aP�UVOc[?;DBTd8;�>��

R]yp<VRxSe>�RTU±>C<=�>�'d?Se[?;DO <VO|��>T;Dno@Q;DOQPD;��� )2*4,^%�/���SeO�� >]@#PCy«RTyp<VR � )$.)�2 � w _±<?>,73 �iw K �?RTyQ; BC; ;©�GSe>]RT>* %�� >A@QPCy RTyp<VR � ) .� � w _�<?> ,0w K§77� P�U?Z�s#Ke;DRC;�OQU?B]Z�;DX[?;�PDRTU?B�>Asp<?P�;tSL>�P=<VKmKL;�X½<0p�y>��yBA/�1�@?RyBA/�87O�\PDU?Z�s#KL; RC; SeO#OQ; B�s^BCUcX^@QPDRx>]sp<VP�;�Se>�P�<VKeKe;�X½<+ z�{2x���u�})�@?RyBA/�?7��c@#PCy�>]sQ<?P�;D>�yQ<g[?;�Z�<VO|�}@#>T;DMN@^K's#BCU?sº;DB]RTSe;�>0��8 y^SLPCyÄZ�<7Q8;�>�R]yQ;�M�U?KeKeUg8 SmOQdBT;�>]@^KeRWSeZ�s�UVBTRH<JOcR�7� �em�f�dgm � � ���)��� �bqrU?Z�s#KL; RC; OQ;�>]>kU?Mvu4wJ� ��� ��}oH^% y»6_3�Kzg � � ��}���� ) *�,X%X/���x��VyY�S�I�*0� ����A/�Gz��u w ���uA/�V}��:y>}

� � )�. � 2 � w w _ y7�G,73 �iw KY:

Page 27: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � �

�� ���Y}�� ��uw����� z@��} � �0%�u4w�����A/�V} �:y>}� � )�. � � w w _ y7�k,0w K�:

t-uwvSv�t�� [ y#;xP=<V>T;�H}b K SL>WKL;DMNR�<?>�<JO�; �G;DBTPDSe>T;?7,a³;�<?>T>A@#Z�;�MNBCU?Z OQUS8¾U?O}RTyp<VR H J K§7q�yQUcU8>];x<�>]@^IQ>T;Dn|@#;DOQPD;�(,�$g�r>]@#PCy}RTyQ<VR

� b �� $ 6 ~ � � ) ��� � . � ) � � w J K�:*���9YSeORQ?Ug8W>TQ|S;# >lSmOQ;�no@p<VKmSeR �>�GM�U?Bl<VO|� %0/)�

��� $ 6 ~ � ) ��� � . � ) � � w F � :

*��ZtU?OQUVRCU?OQ; P�U?O|[8; BCd8; OQP�;�RTy#Se>­I�U?@^OQX�y#U?KLX#>W<JKL>TU�M�UVB b K �#>]U�� $ 6 ~ � )���� � . � )�� �J K <^7 ;?7 :

Ml;DOQPD;>�QI|�YP�U?Z�s#KL; RC; OQ;�>]>lUVM�',� � ) � P�U?O|[8; BCd8;D> <G7µ;V7m7oa½;�X^;�`#OQ;�v�"�º��b�� KeSmZ � ) � �"�º� SeM)R]yQ;�KeSeZ�SeR�; �cSe>]RC>��

_ U?R]yQ;DB\8 SL>T;V7��Se[?;DO � � _:�l8r;�P=<VOV`#OQX��:>TU RTyp<JRk, ��jSmZts#KmSL;D>

v � � )�. � 2 w �-F���3 M�U?Bl<JKeK!� ,m3SmO�sQ<VBTR]SLPD@^KN<VB�v'� � )�. � ) � w!�-F��xM�U?BW<JKeK2>A@���PDSe;DO|RTKm��KN<VBTd8; �º7NMl;DOQPD;>�#I|� <p<VRTU?@# >­KL;DZ�Z�<:�M�U?Bk,����

v'� � )�. �� w ��b�v'��KeSeZ¿SeO#M$ � )�. � )�� w �"F KeSmZ SeO^M$ v'� � )�. � )�� w �"F �B:Ml;DOQPD;#��%�u4wx<JOQX��Q>]SmOQP�; �,� _P8­<?>k<VB]I#SeR]BH<VB]� � � � )�. � � w w _G7& f�dgf���� iRd�� � ���2��� � -4� �:y��>��,<o� �$w(z@� y"p�y>��yBA/���@?RyBA/�9��t9v7u�y>{�{26GFIHVF K ���I3� �,UPz@� y + z�{2x���u�}N�@?RyBA/�-�fG7»FG7���U i qPi � h � nom�dSk�q0cei,� m2� a³;�>Ayp<VKmK4<Vs#s^Ke�t>TU?Zt;�d8; OQ;DBC<VK�MlSmKeIº;DB]Rr>Asp<?P�;�<VBTd?@#Zt;DO|RC>RTU�u U 7 <(SmBC>]R0�:8�;�O#U?RC;�t-~b}��:yS�^v7u\y7� '^u��l{@�

� �"� � � UU b � � � UU �¿F����u3������ � � � UU<VO#X�R]yQ;6?Ry>u]y>{�{@��{@v]�>u\y�= {2y>�� �+� � � UU � � �'. � � UU b·FG� � � � UU � � � � UU �I:`bM����u3����kb _l��RTyQ; O18r;�>T<=�}RTyQ<VR���<VOQX ��<VBT;_v7u�} � v]�^v7��y>{ 7G<QU?B�<VO|�}>A@#IQ>T; R��DWÂu U ��8�;

X#;�`#OQ;��}b.���0%�u U * ����3�%� b _�M�U?Bl<JKeK";%�� :

Page 28: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

� >A@#IQ>];DR�� W uNU�SL>+A�{@vS�S�]��SeM �pM�U?B�; [8; BT��>];�no@Q;DO#P�;���� )O*�,z%C/���SeO��X��8 SmRTy� )Qw �½SeOu U �R8�;�yQ<g[?;#�Pb �<^7µ;V75�#M�UVBW>TU?Zt;� %���7� �em�f�dgm � � ��� ��� �;W BTR]yQU8d8U?OQ<VK2s#BTUVzA;�P RTSLUVO3� � � ��} � x��Py}A�{@vS�S�]�E���:x��@?RyBA/��v�tku U � �� ����]yBA/� ��%§uNU��:y7�+y �^�MA/v =�?�vS��z�}jzCv7� � b "� � ���oz�} � C% � y>��� � % � �_�Iv7uw�/v �>��u:�� � .� � U F � � .�� � U t9v7u y>{�{�� %�� � �oz�}��Y� *0�:y>{|z�} ~ v7� {|~ z t �"b �y �j�-�,�[ yQ;�MN@#OQP RTSeU?O'tSL> P�<VKeKe;�X��wyV�>��u/��zCv7� v�t2�rR]yQ;+v7u�}�� v]�^v7��y>{B?�uwv �9�MA�}jzCv7��v�t!�Lv7� ��7t-uwvSv�t���q�y#UGU8>];�< >];�no@Q; OQP�; � )+%�� >A@QPCy}R]yp<VR

� � . � ) � U w T3����3 ���Hb§SeO^M � � � .�� � U *�� %��' :*��R]yQ;�sp<VBC<VKeKe;DKLU?d?BH<VZ KL<98��

� F^��� . ��� )G� ��2r� 58F8� � UU � � � )�.���2 � UU b·F^� � � .�� ) � UU � � � .���2 � UU ��:*�@^R � F^��� .���� )u� � 2­� 58F8� � UU h T3����3 ���\U0�V>TU�8�;rZ�@Q>ARvyp<=[?; � � ) .�� 2 � U w _ <?>7,m3 �Dw K§7*���P�UVZts#Ke;DRT;DOQ;D>T>0� � � )�. � � U w _:�ºM�UVB >]U?Z�;��}%�u U 7 *��}P KLU8>A@#BC;b� �\b �<G7µ;V75�3M�U?B�>]U?Z�;Q%���7 Mk; OQP�;

� � . � U b§KeSmZ) � � .�� ) � U bYTº����3 ���I:ilUg8��QM�U?Bl<JOc� �r%�� <VOQX ��%4',��8�;�yQ<g[?;

T3���u3 �x� U F � � . � o� � �p� � UU b�T3����3 ��� U . F � ��� . u3 � �J� � U � � � UU :�GU 8�;�Z�@#>]R yp<=[8; ��� . u3 � � b _^7NMl;DOQPD; � b�� . Q%�� �p<?> BC;Dn|@^SeBC;DX27fG7µE^7�� i:dbh i,(+� m�� � f �RiRd7h i,( � m�i ( - � f)( -eh kShjf)(�i ��m��com �>kSi:kgh f)( � `bO�R]y#SL>v>T;�P RTSeU?OP8�;­KLUcU>Q<VR�>TU?Zt;�u U OQU?R]SLU?O#>�BC; KL; [?<JOcR�RCU±s#BTU?Ip<VI^SeKeSmR �87_<QU?B��}3*" %·u U �������N8 SeR]y�Zt;=<VOQ> � �Nbr� �Ä�I3 � � b ��-"���R8r;�X#;�`#OQ;V�7y>u�zjy>��A/�>�7A/v �7y>u�zjy>��A/��<VO#XCA/v7u�uw��{2y>}jzCv7�±Ic�

[V<VB=� ���Hb y�� � . � �W� U g(3PDUg[)� �}3*"��Hb y�� � . � �W� �-" . ������g(3PDU?BTB=� �}3*"��Hb¢PDUg[4� �}3*"�� 5 [V<VBg�����G[V<VB��-"���:

ilU?RC;�RTyQ<VR�[V<VBg�����6b _�SeM�<VOQXÄU?O#Km�}SmM � b � �Â<^7 >�7Ô7�ikU?RT; <VKL>]U�RTyp<JR9�4SeM � <VOQX " <VBC;SmOQX#;Dsº;DO#X#;DO|R9��RTyQ; O¿PDUg[4� �}3*"��Vbj_^7 [ yQ;YPDU?O|[8;DBT>T;�SL>�d8; OQ;DBC<VKeKm�³M�<VKe>T;V7I<QU?B�<±BH<VO#X#U?Z[V<VB]SN<VI#Ke; � b � � ~ 3 :<: : 3 �V)8��SeO ' ) �R8�;�X#;�`^OQ;�SmRC>�A/v �7y>u�zjy>��A/�U=Xy>}ju�z)�

[V<VB�� �Ä�{bÂ�,PDU![2� � 5 3 ��D�T� )5 � 6 ~ :�Gdgf�cof�q9h�kgh f)( � ���!���2� 0��>��u�~OA/v �7y>u�zjy>��A/�U=Xy>}ju�z)��z@�G��v7��� ���C��y>} zl�>���^� �N� z�} �-��c@^s#s�U?>T;�OQUS8 8r;�<VBT;�d?Sm[8;DO�<�P�U?@#O|RC<VI#KL;kM�<VZtSmKe� U?M)XGSL>�zAUVSeO|R­; [8;DO|RT>�� � 5 * ��% �G���^8 yQU8>];@#O^SLU?O½SL> ��7Y�G; R �'b �'��� 5 * �K% �^�©7(%4;DR � Iº;t<VO³SmOcRT;�d?BC<VI#Ke;�BH<VOQX^U?Z:[V<VBTSL<VI#KL;V7 [ y#;

A/v7���>z�}jzCv7��y>{����I?��MA�}Cy>} zCv7�±UVM � d?Se[?;DO��Se> d?Se[?;DO�I|�"&b �5r� � � 5 � 6� � 3

Page 29: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � �8 yQ; BC;V8r;�>T; R ���� � 5 � b �� ��6� �]� 5J�$� � 5 � 8 yQ; O¿�$� � 5 � � _�<VOQX X#;�`#OQ; ���� � 5 �xSeO>]U?Z�;�<JBTI#SmRTBH<JBT�X8­<=�+8 yQ; O��'��� 5 �{b§_^7 �G; R��Xb u U � �$3T��� <VO#XYO#U?RC;�R]yp<VR "[%��t7 [ yQ; O� SL>W<�>]@^IQ>]sp<VP�;�U?M'uNU=��� 3T�����#<VOQX � Se> P�U?Z�s#Ke;DRC;�<VOQXYRTyQ; BC;DM�UVBC;�PDKeU8>T;DX27�Gdgf�cof�q9h�kgh f)( � ���!��� � � t � % u U �)} � ��� " z@�Xy\�>��uw��zCv7� v�t } � �Ev7u�}�� v]�^v7��y>{�?�uwv �9�MA�} zCv7� v�t� v7�'���

{^7 -�.v/��(1u� � 1p/��21 �/ u ~ �����{^7Ô687 �Pf �+(+-em - � f)( ��m�d ��m (+� m2� a³;kI�;Dd?SeO+8 SmRTyY<xIQ<?>]SeP>�GI^@#R­;�<?>]�tRCUx@Q>];>�#PDU?OQX^SmRTSeU?O�M�U?BPDU?O|[8;DBTd8;DO#P�;xSmO�u­~D����� 7� �em�f�dgm � � ���)��� �C*rU?@^OQX#;�X�P�U?O|[?;DBCd?;DOQPD;g� ��� ��}r���+)"*-,.%0/���x��Gy��S� *0������A/��v�t u\y>���^v =�7y>u�zjy�x0{@�/�9���oz�}�� �+)>w � z��0?�u/v>x/y�x0z�{|z�}j~ y>��� �+) oF t9v7u(y>{�{4, � t9v7uE�Sv =��OA/v7�:��};y>� } J K�� �� ��� �+) w � z���u­~-�t-uwvSv�t�� *�� [ yQ;DU?BC; Z FG7»{G7m6 � � Se>�RTyQ;�<VKmZ�U?>]R�>A@#BC;�KmSeZ�SeRkU?M�<Y>A@#IQ>];�no@Q;DO#P�;>�v>TU � �F <^7 >�7Ô7 <QU?B�� � _l�^RTyQ; BC;�; �cSL>ARC> �:>]@QPCy�RTyp<JRk, ��:SeZ�s#KmSL;�>

�$� �V)�. � � � 58F8�"F�� 5^� h x��:[ yQ; O �+)2. � �b �� �+)2.�� »6�� �

� � ��� ��� U � � r� �+)2. � �6�� �� � ��� ��� U �"F§F# t� �65 h x�<� � 58FUb��B:

{^7»FG7 � (eh 1;f�d/� h"(�kSm���dgiRn&h��jh k � �� m � ��i%�!��� ���2��� ��} � x���y>�1z�� } �C�>u\y�x0{@��u\y>���^v = �7y>u�zjy�x0{@��y>��� �S��}

����� �?�Hb¢>A@#s!� �� � �6 � ��*_#X% � 3T�'�(#��"F�� :�� ��� ����� �?� ��_1y7� �,� _ �t-uwvSv�t����|@#s#sºU8>T; OQU?R�7 [ y#;DO�)M�U?B�>TU?Zt; �1� _:�)RTyQ; BC; ; �cSe>]R #�)�% ����8 SeR]y½�'�(#�)o� F F � )<VO#X r� � �6 � � ����xM�U?Bk<VKmKJ,v7 *���RTyQ;�`#BC>AR�*rU?BC; K2.^q­<JOcRT;DKmKeS�Ke;DZ�Z�<l�c�$�Z#�)�Sb7 U#7µ�Hb _^7 *�@#RR]yQ;DO�QI|�X#UVZtSmOp<VRC;DXYP�U?O|[8; BCd8; OQP�;b�

� F �� � �6��� � � � �{w r� � �6 � ������� ��� �C��b _

8 y#SePCy}Se>W< PDU?O|RTBC<?X^SLP RTSeU?O47%4;DR��¢Iº;x<�M�<VZ�SeKe�tU?M(BH<VOQX^U?Z [V<VBTSL<VI#KL;D>�7"<pUVB�6�F=H4F K � 8�;x>T<g�R]yp<VR��¢SL>�x�v7�^���^�]�

z��Yu4w�SmM>A@#s� �� � � � w J K�:

%4;DRW@Q>WX#;�`#OQ;� � � �V��b§>A@#s!� �� � �6 � ��* � %�� 3f#X% � 3T�$�Z#��"F�� :

Page 30: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

W I|[|SLU?@Q>AKe�>� �§SL>�I�U?@^OQX#;�XYSeO�ur~�SeM�<VO#X�UVO#Ke�tSeM � � �A6!�"J K§7Ba½;�>C<=��RTyQ<VR � Se>��l� z t9v7u�=�{|~z�� } �C�>u\y�x0{@��U?B " ��SmM � SL> I�UV@#OQX#;DX�SmO}u ~ <VOQX

� � � �?� � _�3 <?> ����_�:ilU?RC;�RTyQ<VR9�#I|� M OU?KLX#; B9# > SeOQ;Dn|@Q<VKeSmR � �GM�UVBWP�U?O?zÃ@#do<VRC;�SmOQX^SLPD;�>BH$3� %«�]6�3�K¿���r� � �6 � �"F � � � w ���$�(#��T� ~� � :Ml;DOQPD;>�WSeM �\SL>�I�U?@^OQX#;�X SmO u4w��­M�U?B�>]U?Zt;EH[% �A6_3�K¿���­R]yQ;DO �\Se>+�k`H7 [ yQ;±>];�no@Q;DO#P�;�+)rb|,(6 � � ~� )'&­SL>�I�U?@^OQX#;�X�SeO³ur~�M�U?B�%4;DIº;�>]d?@Q;tZt;=<V>]@#BT;tU?O �¨_�3�6<gC�)I#@#R�OQU?R�@#O^SeM�U?B]ZtKm�SmOcRT;�d?BC<VI#Ke;?7%4;DZ�Z�<{^7�Fc7m6�>AyQUS8W>�R]yp<VR�<VO|��>ASeOQdVKL;xSmOcRT;�d?BC<VI#Ke;�BH<JOQX#U?Z [?<JBTSN<JI#KL;�SL>�@#O#SmM�U?BTZ�Ke�YSmOcRT;��

d?BC<VI#Ke;?7 [ y#Se>x;©�GRT;DOQX^>�;�<?>]SmKe��RTU�<VO|��`#O^SeRC;tP�U?KmKL;DPDRTSeU?O½U?M SeO|RC;Dd?BH<JI#KL;�BH<VOQX^U?Z�[?<JBTSN<JI#KL;D>�79�UVBC;�Ug[?;DB9�pM�U?Bl<VO|��SmO|RC;�dVBH<VI#Ke; BH<JOQX#U?Z�[V<VB]SN<VI^KL; "X�#RTyQ;�>T; R

�`b � � *�� <�BC<VOQX#UVZ�[V<VBTSL<VI#KL;b� � �F " Se>W@^O#SeM�U?B]ZtKm� SeO|RC;Dd?BH<VI^KL;>�GI�;DP=<V@Q>];�� � »6 � �-F ��,"±6 � �I3 M�U?Bl<VKeK�#�:[ yQ;lM�U?KeKeUS8 SeOQd�BT;�>]@^KeRrs^BCUg[|SLX#;D>r<VO�<VKeRT;DB]Op<VRTSm[8;lPCyp<VBC<?PDRT;DBTS@6=<VR]SLU?OtU?Mº@#O#SeM�UVBTZ SeO|RT;�d?BC<VI#SeK2�

SmR �87�Gdgf�cof�q9h�kgh f)( � ��� ��� ��� ��} � x��Vy"t�y�=�z�{|~�v�t+u\y>���^v = �7y>u�zjy�x0{@�/�-� �� ��� � z@�4" �+z t(y>���v7� {|~Xz t

>]@^s!� �� � �6 � ��� � � ��* � %�� Kw _�3 y7� w KY:Ml;DBC;�Se>­RTyQ;�X#;�`#O#SeR]Se[?;�BT;�>A@#KeRlU?O�ur~ � PDU?O|[8;DBTd8;DO#P�;xUVM(BC<VOQX#U?Z\[?<JBTSN<JI#KL;D>�7

� �em�f�dgm � � ��� ��� ��� ��} �+)�3f,|%[/��4y>����� x��_u\y>���^v = �7y>u�zjy�x0{@�/�-� �� �Ut9v7{�{@v7�oz��^� y>uw�� *0�^zl�7y>{@��� } ��,<o� �+)+%�ur~�t9v7uGy>{�{�, � � %Äur~�y>��� �+) w � z��Yu­~ ���I3� � �+)+*-,>%}/� z@��" � y>�����V) w � z��V?�uwv>x/y�x0z�{|z�}j~ �t-uwvSv�t����|@#s#sºU8>T;��¨<8��yQU?KLX^>�7 *���q�yQ; I|�G>AyQ;D[�# > SeO#;�no@p<VKmSeR � �GM�U?B�� � _l�

�'� �+) . � ��!�8�"F�� �Q~ �� �+) . � �{w _>]U �+)�w � SmOs#BCUVIp<VI#SmKeSeR �?7'9�UVBC;�Ug[?;DB9�pd?Sm[8; O � � _:�^R]yQ;DBT;�; �cSL>ARC> �:>]@QPCy�RTyp<JR ­� �+) .� �-J!� 58F 8 yQ;DO#;D[8; B ,���½7 [ yQ; O48�;�P=<VOV`#OQX � � _ >TU�RTyQ<VRW�$�(#��)F ��SmZts#KmSL;D>r� � �6 � �"F�� 58F�3 �� �V) �6 � �-F��B3 ,}b¾6_3 : :<:<3 �>:[ yQ; O�QM�U?Bk,����<VOQXY�$�(#��,F������ �+) »6 � � F �� �+) . � �$� �� � »6 � �-F��B:Ml;DOQPD; � �+)+*-,�%�/ �Se>)�k`H7Ra½;�yQ<g[?;�>AyQUS8 O}R]yp<VR��¨<8��SeZ�s#KeSe;�>���I3� 7

Page 31: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � Ö

�c@^s#s�U?>T;>�GU?O�RTyQ;lU?RTy#;DB�yp<VOQX��|RTyQ<VRk��I3� yQU?KeX#>�7 [ y#;DO�R]yQ;DBT;lSe>�<�>]@#I#>T;�no@Q; OQP�; �Z, $=�'>A@QPCyR]yp<VR��+) � w � <^7 >�7Ô7��GUR�2I|� <p<VRTU?@# >�KL;DZ�Z�<:� �� � �EF KmSeZ SmO#M�$ �� �+) � �GJ K§7�ilUg8��d?Sm[8; O��,� _:�^R]yQ;DBT;�;©�GSe>]RT> J K >]@QPCy�RTyp<VR0�^M�U?Bl<VKmK$,&��� �+) �6�� �

�� � � �-J/� 5?E�3 �� � »6�� ��� � � �-J!� 5?E�:

qrU?O#>]SLX^;DB RTyQ;@#O^SeM�U?B]ZtKm�½IºU?@#OQX^;�X >T;�no@Q; OQP�; � �) b � . Ä� � �V) � <VOQX >T; R � � b� . Ä� � � � �7 [ yQ; O � �) w � � SmO�s^BCU?Ip<JI#SeKmSeR � �^>TUR�QI|�YI�U?@^OQX#;�X�P�U?O|[?;DBCd?;DOQPD;>��R]yQ;DBT;;©�GSe>]RT> �:>]@#PCy}RTyQ<VR9�^M�UVBl<VKeK$,��� � � �) . � � ^J �65VE�:*�@^RlR]yQ;DO��#M�U?Bl<VKeKJ, �� � �+) . � �F r� �+) »6 � �

�� � � ��� � �) . � � � �� � �6 � ��� � � �"J!��:

�cSmOQP�; �,� _P8­<?>k<VB]I#SeR]BH<VB]� �l8�;�yp<=[8;�>]yQUS8 O}R]yp<VR���I3�rSeZ�s#KeSe;�>��,<o� 7� 7 - ���4�J��º041u���5!0 � �l�)/e�º0��.v/)5

� 7Ô687 �Vm�� (�h�kgh f)(�q4� <pUVB�<E`^O#SeRT; *rUVBC;DK(Z�;�<?>]@^BC;�v½U?OY' ) ��8r;xX#;�`#O#;xRTyQ; � v7�^u�zC��u�}ju\y>�:�I�t9v7u�=

�v'� � �Hb � ��

� 5 ��� ��� v �(T �º�I3 � %_' ) :Ml;DBC;b� � : 3 :��WX#;DO#U?RC;D> RTyQ;�@Q>]@p<JK(SmO#OQ;DBks#BCUcX^@QP R�U?OY' ) 7�<QU?B <tBH<VO#X#U?Z [V<VBTSL<VI#KL;�� SmO4' ) �8�;�X^;�`#OQ;�RTy#;\A/�:y>u\yBA�} ��u�z@��} zsAHt��^��A�}jzCv7�

����� � �Hb ­� � 5 ��� � � ��3 � %4' ) :[ y|@Q> � � b �v ���R8 yQ; BC;Uv� Se>­RTyQ;�KN<98¢U?M �«7��BH<JOQX#U?Z [?<JBTSN<JI#KL; � SeO(' ) SL>���}Cy>����y>u\���)y>���/��zjy>�±SeM

�$��� %�#��Hb ��

6�bF7�)� ) U � �

� � �� U T ��3 #&%0q+:

%4;DRr@Q>rPDU?Zts^@#RC;lRTyQ;�PCyQ<VBH<?P RC; BTSL>ARTSePkMN@#OQP RTSeU?O�U?M�<�>]RH<JOQXQ<VBTXY��<J@Q>T>ASN<VO�BC<VOQX#UVZ [V<VB]SN<VI^KL;� SeO 'l7 a³;�yp<=[8;� � � � �Hb � � � 5 � � 6

� F7� � � �� U T �Ob � � �

� U �

8 yQ; BC;�"b���� 6

� F7� � �� � � 5 � & � U T ��:

[ yQ;±SmO|RC;�dVBH<VK � P=<VO Iº;}; [?<JKe@p<VRT;�X¿I|�¿P�U?OQ>ASLX#; BTSmOQd½R]yQ;}SeO|RT;�d?BC<VK UVM�RTyQ;�<JOp<VKe�|R]SLPYMN@#OQP��R]SLU?O � ��

� U <VBTU?@#OQX R]yQ;±BC;DPDRH<JOQd?@#KL<VB�PDU?O|RCU?@#B(8 SmRTy PDU?BTOQ; BC>� 3� .�� � 3 . .�� � 3-. *

I|� q­<V@#PCyc��# >�R]yQ;�UVBC;DZ_�'RTyQ;SmOcRT;�d?BC<VKrBTU?@#OQX«R]yQ;P�U?O|RTU?@#B�[V<VO#Se>]yQ;D>0��<?>�X#UR�'SeO«R]yQ;�KeSmZtSmR~w K �#R]yQ;�P�U?O|RTB]SeI#@^RTSLUVOQ>­MNBCU?Z RTyQ;�[?;DBTR]SLP�<VK)>]SeX#;�>WU?M�RTyQ;�BT;�PDRC<VOQd?Ke;?7Ba½;�X#;�X^@#P�;�RTyp<VR

�"b � � 6� F7� � � �

� U T �Ob¾6_:

Page 32: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

�]� �������������� ��

Ml;DOQPD;����� � ��b � � �� U 7

� 7»FG7 � (eh � �em (�m^q9q4i,(+- h�( ��m�d7q9h f ( � W @#B�<VSmZaSeOÄR]y#SL>�>T;DPDR]SLU?O�SL>�RTU�>AyQUS8 RTyp<JRx<+`#O^SeRC;*rUVBC;DK4Zt;=<V>]@#BT;�Se> X#;DRT;DB]ZtSmOQ;�X@#O#Seno@Q;DKm��I|��SeRT>)<pUV@#BTSe;DB RTBC<VOQ>AM�U?BTZ�<VOQXYRCU U?I#RC<VSeO�l8 yQ;DBT;sºU8>T>ASeI#Ke;�<VOIz����>��uw��zCv7�}M�U?B]Z�@#KL<�I|�(8 y#SePCy}RTUtPDU?Zts^@#RC;�RTyQ;�Zt;=<?>A@#BC;�MNBCU?Z\SeRC> R]BH<VOQ>AM�U?BTZ�7[ U�R]y#SL> ; OQX�� 8�;�X^;�`#OQ;b�QM�U?B ��� _ <VO#X ��3%$ %4' ) �^R]yQ;P� �]y>} ����u�����{

H)����3 ��3%$^�Hb 6�bF7� �]� ) U � �

� � � � �� U � :

a½;�OQU?RC;�MNBTU?Z�RTy#;�s^BC;�PD;�X^SmOQd >T;DPDRTSeU?O�RTyQ;�SLX^;DO|RTSmR �� ���

� U b ��� � 5 � � 6

� F7� � � �� U T � :

*���>T; RTR]SeOQd��&b �"� . $^� 5 � �k<VOQX}Z�<bQ|SeOQd�<�>]SmZts^KL;�PCyp<VOQd8;xU?M'[V<VBTSL<VI#KL;b� 8r;�X#;DX^@QPD;>��M�U?B,rb 6 �

H)���3 ��3%$#�Hb 6F7� ��� � 5 � � � � � � � U � � 5 � � T � :

Ml;DOQPD;G8�;�UVI#RH<VSmO�^M�U?Bk,�¾6 �H)����3 ��3%$^�Hb 6

�bFg��� ) � � � � 5 � � ��� � � � � � � � U � � 5 � � � � T � :� �em�f�dgm � � ��� ���2��� ��} � x�� y u]y>���^v =D�7y>u�zjy�x0{@� z��V' ) �"�� �P{2y>� v� v�t � z@���^� z+*0����{|~�^��} ��u�=�z����]�_x0~(z�}�� A/�:y>u\yBA�} ��u�z@��}jzsA t��l��A�}jzCv7� �������Iv7uw�/v �>��u:� z t � � z@� z�� } �C�>u\y�x0{@�9� }�� ������:y7� y+�^���:��z�}j~kt��l��A�}jzCv7�(� � �"�º�:�&�>zl�>��� x0~

� ���"�º��b 6�¨F7��� ) � � � � � � � � � � 5 ��� ��� T � :

t-uwvSv�t�� %4; R " Iº;�<x>]RC<VOQXQ<JBCX���<V@Q>T>ASN<VOBC<VOQX#UVZ [V<VB]SN<VI^KL;WSeO+' ) �GSeOQX#; s�; OQX#; OcRWUVM � �#<VO#XKe;DR��³Iº;�<�I�U?@^OQX#;�X *rUVBC;DKvMN@#OQPDR]SLU?OÄUVO1' ) 7 [ y#;DO�4M�U?B � �¾_l��I|�Ä<�PCyp<VOQd?;�UVM�[V<VB]SN<VI^KL;$ � b $�. � 5 � � <JOQX <#@#I#SmO#S;# >­RTyQ;DU?BC; Z4�

����v� � � � ��"��]�{b � ��

� ��

�v� �"� � �*$^�D�bFg��� � ) U � � � � �� U T $�v�k�ZT �º�

b � ��

����

H)����3 ��3%$^� �v� $#��T�$Bv�­�(T �º�b � �

� � ��

6�¨F7��� ) ��� � � 5 ��� ��� � � � � � � � U � � 5 ��� � � T � v � �ZT �º� � �v� $#��T�$

b � ��

� 6�bF7�)� ) � � � � � � � � � � � � � � � U � � 5 ��� � � T � � �(� $^� T $�:

Page 33: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � �*�� RTy#Se>�M�U?BTZx@#KN<:� ����X#; RC;DB]ZtSmOQ;�> ����v� �.� � ��"��T�©7�<QU?B�<JOc�kI�UV@#OQX#;DX�PDU?O|RTSeO|@QUV@Q>2MN@#OQP RTSLUVO���R8�;�yp<=[8; r���v��� � � ��"��]�{w ����v� ���]�<?> � ��_:�#>]U ��� X#; RC;DB]ZtSmOQ;�> r���(� ���]� 7)Mk; OQP�; � � X^;DRC; BTZ�SeOQ;D> v��7`bM � � Se>­SeO|RC;Dd?BH<VI^KL;�<VOQXYSeM��}SL> PDU?O|RTSmOc@#U?@Q>)8 SeRTy�PDU?ZtsQ<?PDRW>A@#s#sºU?BTR0�#RTyQ; O

����� � �� �v� $^� �%�u ~ �(T � � T�$^�I:�GU:�#Ic�YX^U?ZtSmOp<VRT;�XP�UVOc[?;DBTd8;DOQPD;>�º<?> � � _:�

� ��

� 6�¨F7��� ) � � � � � � � � � � � � � � � U � � 5 � � � � T � � �v� $#��T�$w ���

� 6�bF7��� ) ��� � � ��� � � � � 5 � � � � T � � �v� $#��T $�:

Ml;DOQPD; � yp<?> RTy#;�P KN<VSmZ�;DX�X#; OQ>]SmR �MN@#OQPDR]SLU?O27� 7µE^7'& ��iRdgi,�>kSm�d7hjq�kgh"� 1 � (+�>kgh f (eq�i,(+- h�(+-em�com (+-em (+� m)�� �em�f�dgm � � ���!���2��� ��} � b � � ~ 3 : : : 3��+)?��x���y u\y>���^v = �7y>u�zjy�x0{@� z�� ' ) � �� ��� }�� �t9v7{�{@v7�oz��^�+y>uw��� *0�^zl�7y>{@��� } ��,<o� � ~ 3 : : : 3��+)Yy>uw�Gz����^�@?������^��� },���I3�Qv� b�v� � � 34343 � v�

��

� A�� r��� $ � $8� ��$��T��b�� $ ���� $#� ��$g�]�9��t9v7u�y>{�{�x�v7�^���^�]� p�v7uw��{_t��^��A�} zCv7�:� � ~ 3 : : :I3 � ) ���Xp� � ��� � �Hb�� $ ��� � � � $��9��t9v7u�y>{�{ � bÂ� � ~ 3 :<: :<3 � )?��%4' ) �t-uwvSv�t��$`bMr�¨<8��yQU?KLX^>0�#RTy#;DO

v ���Z# ~ � 34343�0#G)o��b � $ v� � �(# $g�M�U?B <VKeK:*rU?BT;DK^>T;DRT> # ~ 3<: : :<3 #�)^�8>TU ��I3��yQUVKLX#>��?>]SmOQP�;�RTy#Se>(M�U?B]Z�@#KN<lPCyp<VBC<?PDRT;DBTS@6�;D> RTyQ;rs^BCUcX^@QPDRZt;=<?>A@#BC;V7`bM­��I3��yQUVKLX#>��#RTyQ; O�#M�U?B � ~ 3 : : : 3 � )�IºU?@#O#X#;�X4*rU?BC; K;�r� � $ � $8� ��$=�T�Hb����

� $ � $8�"�($=� v� �(T �º��b � $ ��� � $?�"�($g��v� � �(T �($=�Hb � $ ���� $Q� ��$��T��3>]U½��Pg�ly#U?KLX#>D7��cRH<JRC;DZt;DO|R ��Xp�lSe>�<�>]sº;�P SN<VKvP=<?>];�U?Ml�,P=� 7��c@#s^s�U8>];>��`#OQ<VKeKm� �ºR]yp<VR��,Xp�ly#U?KLX#><VO#X�RH<bQ?;tSeO#X#;Dsº;DOQX^;DO|R�BH<VO#X#U?Z�[V<VBTSL<VI#KL;D>��� ~ 3<: : :<3��V)V8 SeR]y'v�� � b v� � M�U?B�<VKeK �º7Va³;Q|OQUS8·R]yp<VR��¨<o��SmZts^KeSL;D>���Xp���#>]U

��� � � �{b � $ � ��� � � $=��b � $ � � � � � $���b � � � � �>]U;v�� bYv� I|�@#O#Sen|@#;DOQ;D>T>lU?MvPCyQ<VBH<?P RC; BTSL>ARTSeP�MN@^OQPDR]SLU?OQ>D7NMk; OQP�;t�¨<o��y#U?KLX#>D7

Page 34: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

�^7�� ����5!5 l��/S�J��/��(. �����4��l� ���|135�^7Ô687�� i,�eq9q9h i,( dgi,(+-�f � �RiRd7h iRn �jm^q h"( ' � �¢BH<JOQX#U?Z [V<VBTSL<VI#Ke; � SeO�'§SL> �)y>���/��zjy>��SeM �M�U?BW>]U?Zt; v.%4'Â<JOQXY>TU?Zt;��UG%��¨_�3�K¿�����yp<?>WX#; OQ>]SmR �MN@#OQPDR]SLU?O

� ���"�º��b 6� F7�� U � �

� � ��� & � U�� � :a½;�<VKL>]U <?X^Z�SeR <V> ��<V@Q>]>]SL<VO�<VO|��BH<JOQX#U?Z [?<JBTSN<JI#KL; � 8 SmRTy�� b�vÄ<^7 >�72�#RTy#Se> X#;�d?;DOQ; BH<VRT;P�<?>T;�P�U?B]BC;D>]sºU?OQX^SmOQd�RCU RH<bQ|SeO#d�� U b§_^7Ba³; 8 B]SeRC;��� �³�Zv 3w� U �©7�Gdgf�cof�q9h�kgh f)( " ���)���2� ��� ?-?�vS�S� �� �½�(v 3]� U � y>��� d�3fe6%Y'�� �� ����,<o� r� ���kb�v ���I3��[V<VBg������b � U ���Pg�\d � � e�� �³�ZdBv;� e 3 dlUw��U©�9���Xp� � ��� � �Hb � 5 � � � �

��� U �

�^7»FG7�� i,�eq9q9h i,( d7i ( -�f)� �:iRd7hjiRn � mlq,h"( ' ) � �ÁBC<VOQX#UVZ�[?<JBTSN<JI#KL; ��SmO�' ) Se> �)y>���/��zjy>� SmM� � 3�� �vSe>r��<V@Q>]>]SL<VO�oM�U?B�<VKeK � %4' ) 7 �lO�;©�#<JZts#Ke;WU?M2>A@QPCyY<�BC<VOQX#UVZ [V<VBTSL<VI#KL;­Se>'s#BCUg[|SLX#;DXI|� � b\��� ~ 3 : : : 3��+)o����8 yQ; BC; � ~ 3 : : : 3��+)�<JBC;xSmOQX#;Dsº;DO#X#;DO|R��³�,_�3=6!� BH<VO#X#U?Z [?<JBTSN<JI#KL;D>�7[ Ut>];�;�RTy#Se>0�:8�;�OQU?RC;�R]yp<VR +� 5 ��� � � b � $ � 5 � � � � b � � � � �

� U

>]U � � 3�� �$SL> �³�,_�3 � UH��M�U?Bl<VKmK � %_' ) 7� �em�f�dgm � " ��� ���2��� ��} � x���y �)y>���/��zjy>�4u]y>���^v = �7y>u�zjy�x0{@� z��+' ) ���� ����,<o�Q# � � e�z@� �)y>���/��zjy>� �ut9v7u�y>{�{ , �0,S=Xy>}ju�zsA/�/�k# y>���(y>{�{�e�%4' ) ���I3� � % u U y>���Iz�} �Y�>z@��}ju�zjx0�l}jzCv7�Lz@�1�^��} ��u�=�z����]� x0~�z�}��0=��]y>�Cv y>����z�}��.A/v �7y>u�zjy>��A/�

=Xy>} u�z)��� ���Pg� � ��� � �Hb � 5 ��� � � � ��� � � U ���Xp�Yz t�� z@�Gz����>��u�} zjx0{@�9�N}�� ��� � �:y7� y��^���:��z�} ~kt��l��A�}jzCv7��v7��' ) �&�>zl�>���1x0~

� ��� �º�{b 6 X#;DRg�bF7��� � ; �cs!� .� � .Cv 3�� �Q~ �"��.Cv)� � 5?F 3

��;g�1z t � bÂ�-"�3����:�N�oz�} � " z��+' 2 y>����� z��+' w � }�� ���P�Ug[4�,"{3�����b¢_ zl=�?�{|zC�/� "{3�� z����^�@?������^��� }l:

t-uwvSv�t�� <QU?B � %4' ) �:8�;�yp<=[8;� � 3f# �|� e ��b �(#�� � 3�� ��� � � 3Me �

>]U � � 3f# �|� e ��SL>l��<V@Q>T>ASN<VO��^I|� r BTU?sºU8>]SmRTSLUVO��^7m6?7m687 [ y^SL>­s#BTU![?;�>x�¨<o�©7�$<?PCyYPDU?ZtsºU?OQ; O|R ��$lSe>­��<V@Q>]>]SL<VO�c>TU � %�uNU�7 �G;DR vrb ­�����k<JOQX��Sb [?<JBg� �Ä� 7o<QU?B

� %_' ) 8�;�yp<=[8; ���� � 3*"#�]��b � � 3fv���<JOQX[V<VB=��� � 3�� �]� b§PDUg[)��� � 3�� ��3 � � 3�� �A�7b � � 3�� � �M:

Page 35: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � ��cSmOQP�; � � 3 � �QSL>���<V@Q>]>]SL<VO�=I|� r BCU?sºU8>ASeRTSeU?O��^7Ô687Ô6 �98�;$Zx@Q>]R4yp<=[?;�� � 3 � � � �³��� � 3fv���3 � � 3]� � �]�<VO#X

� � � � �Hb #� 5 � � � � b � 5 ��� � � � ��� � � U :[ y#Se> SL>��,P=� <VOQX½��I3��M�U?KmKLUS8W>­I|��@#O#Seno@Q;DOQ;D>T>kU?MvPCyQ<VBH<?P RC; BTSL>ARTSeP�MN@#OQPDR]SLU?O#>�7%4;DR " ~ 3 : : : 3*"�)�I�; SeO#X#;Dsº;DOQX^;DO|R �½�¨_�3=6g��BC<VOQX#UVZ:[?<JBTSN<JI#KL;D>�7 [ yQ;DO " b �-" ~ 3 : : : 3*"�)8�yp<V>lX^;DOQ>ASeR �

� � � $^�Hb 6 �¨F7��� ) ; �cs!� . $ U 5?F :

�G; R �� b � ~� U ">�rv&�8RTyQ; O �� SL>���<V@Q>T>ASN<VO�� 8 SeRTy �� ��Á�Hb�v�<JOQX�[V<VB=� �����b ���c>]U �� � �«7`bM��¾SL>�SeO|[8; BTRTSmI#KL;b��R]yQ;DO �� <VO#X½yQ; OQP�; � yp<V>�RTy#;tX#; OQ>]SmR ��PDKN<JSeZt;�X�SeO¿�,Xp����I|�½<�KmSeOQ;�<VBPCyp<JOQd8;�U?M([V<VB]SN<VI^KL;�>�SeO ' ) 7<(SmOp<VKmKe� �|SeM � b �,"{3�� � 8 SeRTy�P�Ug[2�-"�3����Hb _:�GRTyQ; O�#M�U?B Q%4' 2 <VO#X �~%4'�w �

�T��u3 ���I3���� u3 �����7b ��u3�� � ��J� � �K3�� � � ��38 yQ; BC; � � b [V<VBg�,"���<VOQX � � b [?<JBg��� � 7 [ yQ;�zAU?SeO|R�PCyp<VBC<?PDRT;DB]SL>]R]SLP�MN@#OQP RTSeU?O � � � RTyQ; O>As#KeSmRC>W<?>l<�s#BCUcX^@QP R

� � � � u3 ��� b � 5 ��� ��� � � ��� � � � U � 5 � � ��� � � � � � � � U>]U " <VOQX ��<VBC;�SmOQX#;Dsº;DO#X#;DO|RWI|� [ yQ;�U?BT;DZ � 7µE^7Ô687

�^7� � � .��� �«0�)1p.m���^7Ô687 � m�i q��edgm �wcedgm^q0m�d �h�( � kSdgi,(�q 1;f�d/��i:kgh f (eq4� %4; R}�(�;3<!43fv4��Iº;�<Y���;`#O#SmRC;�Zt;=<?>A@#BC;>Asp<?P�;V7 �ÂZt;=<V>]@#BC<VI#KL;�MN@#O#PDRTSeU?O �;*B�aw � SL>WP�<VKeKe;�X�<r=��]y7���^uw�I� ?�u/�/�S��u��Sz��^�E}ju\y>�:� t9v7u�=Xy��}jzCv7�±SeM

v'��� �Q~ �(#��T��b�v �(#���3 M�U?Bl<VKeKJ#&%�!�:� >];DR"# %c! Se>+z����7y>u�zjy>� }�SmM����Q~ �Z#��"bi#�7.�\Z�;�<?>]@^BH<VI#Ke;�MN@#OQP RTSeU?O �ÁSL>Ez����7y>u�zjy>� }�SmM��b �����G7 [ yQ;xP KN<?>]> U?M'<VKeK4SmOc[V<VB]SN<VO|Rl>T; RC> M�UVBTZt>k<E���Ã<VKed8;DI^BH<:�R8 y#SePCyY8�;�X#;DO#U?RC;�Ic�.!��=7[ yQ; O"�ÄSe>WSmO|[?<JBTSN<JOcRWSmM'<VOQX�U?O#Km�SeM ��SL>U!��T�bZt;=<V>]@#BC<VI#KL;V7-a³;�>C<=�YRTyQ<VR�� SL>P��u �^v0�>zsA�SeM !��PDU?O|RH<VSmOQ>WU?O#Ke��>T; RC>lU?M(Zt;=<V>]@#BT;G6D;DBTU�<VO#X�R]yQ;DSmBWP�U?Z�s#KL; Z�; O|RC>�7Ml;DBC;�<VBT;�R 8rU�>]SmZts#Ke;�; �^<VZ�s#Ke;�>WU?M�Z�;�<?>]@#BT;�s#BC;D>T;DB][|SeOQd RTBC<VOQ>]M�UVBTZ�<VRTSeU?OQ>�7��S��"Ru\y>�:��{2y>}jzCv7� =Xy�? v7� }�� � } v7u���� 7 [ <bQ?;r� b �,_�3=6<g ) 8 SmRTy=%4;DIº;�>]d?@Q;Zt;=<?>A@#BC;Y<VO#X

<?X#X^SmRTSeU?OZ�UcX^@#KeU6�SeO�;=<?PCy�P�UcU?BTX^SeOp<JRC;?7N<QU?Bkd %�� >T; R� � �"� ~ 3 :<: :<3 ��)8�Hb � � ~ �zd ~ 3 : : : 3 ��)G� d-)o�I:

��SmS�� p�y ����uw� ' =Xy�?º7 [ <bQ8;K�Xb �¨_�3=6<g�8 SmRTy_%4;DIº;�>TdV@Q;�Zt;=<V>]@#BT;?7��G;DR�^�"�º��b¢F*� .�y F*��g(:

�Gdgf�cof�q9h�kgh f)(�� ���)���2� � t � z@�Yz�� } �C�>u\y�x0{@� y>����� z@�0=��]y7���luw�I� ?�uw�/�S��u��Sz��^� �X} � ��� �����Lz@�z�� } �C�>u\y�x0{@� y>��� � ����T vrb � �������mT v :

Page 36: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

�Gdgf�cof�q9h�kgh f)(�� ���)��� � � t�=z@�_��u �^v0�>zsA y>��� � z@� z����7y>u�zjy>� },��}�� ��� ��b 8�y �j�-� ��t9v7uX�Sv =��A/v7�:��}Cy>� }�8 ��^7»FG7 �Pm^d*(�f)� ��� h�q �eh"1 kgq4� %4;DR � Iº;�<Ws#BCUVIp<VI#SmKeSeR �kZ�;�<?>]@^BC;�U?O�'l7­`bO � FG7 h �g8r;�P�U?OQ>ARTB]@QPDRT;�X<�s#BCUVIp<VI#SmKeSeR ��>]sQ<?P�;�� � 3�� 3]���vU?O 8 y#SLPCytRTyQ; BC;W; �cSe>]RC>�<�>T;�no@Q; OQP�;kU?M�SmOQX#; s�; OQX#;DO|R�BH<VO#X#U?Z[V<VB]SN<VI#Ke;�>��-"�);*�,'%>/����(<VKeK4yQ<g[|SmOQd�X^Se>]R]BTSeI^@#RTSeU?O ��7 qrUVOQ>]SeX#;DBlOQUS8�RTyQ;�SeOR`^O#SeRT;�s^BCUcX^@QPDR>Asp<?P�;

�&bL' � b.���\b �"��)+*-,.%0/�� * ��)+%4'�M�U?Bl<JKeKJ, <VO#X�R]yQ;����Ã<VKed8;DI^BH< !±UVO0� d8; OQ;DBC<VRC;DX�I|��R]yQ;�P�UcU?BCX^SmOp<VRT;�Z�<Vs#> �V)^�"�º��b ��)

!ObL�'� �+)+*-,.%0/��I:ilU?RC;�RTyQ<VRU!}SL>W<JKL>TU�d?;DOQ; BH<VRT;�X�I|��R]yQ; ��� >A�c>]RC; Z

Fcb.� �) ���#G)+*_#�)+%0q M�U?Bl<VKmKJ,&��#G)KbL'�M�U?BW>A@���PDSe;DO|RTKm��KN<VBTd8;o, :

A�;�`#OQ; " * �|w � I|� "t���r� b:�-"�)#���r�+*4,^%Y/�� 7 [ yQ;DO " SL>�Z�;�<?>]@#BC<VI#Ke;�<VO#X³RTyQ;SmZ�<?d?; Z�;�<?>]@^BC;Uv0b � � " �Q~r>C<VR]SL>T`Q;�>��pM�UVBk#�b � ) � � #G)"%PF+�

v'�(#��Hb �) � ���(#G)|��:

*�� @^O#SLno@Q; OQ;�>]>�U?M�; �cRT;DOQ>ASLU?O�ov�Se>�RTyQ;�@#O#Seno@Q;�Zt;=<V>]@#BT;�UVO&!¢yp<=[|SeOQd RTy#Se>�s#BCUVs�; BTR �87ilU?RC;�R]yp<VR9�º@#OQX#; B�RTyQ;�s#BTU?Ip<VI^SeKeSmR �Z�;�<?>]@^BC;"vB�3RTyQ;�PDUGU?BTX^SeOQ<VRC;�Z�<Vs#>�� �+)P*u, %z/���<VBC;R]yQ;DZt>T; Ke[8;D> <�>];�no@Q; OQP�;�U?M�SeOQX#; s�; OQX#; OcR�BH<VO#X#U?Z [V<VBTSL<VI#Ke;�>o8 SeR]y�KN<98 ��7 [ y#;ks#BTU?Ip<VI#SmKeSmR �>Asp<?P�;��(�;3<!43fv)�WSL>�P�<VKeKe;�X±RTy#;}A]y>��v7� zsA]y>{m=�v0�^��{'M�U?B�>A@QPCy�>];�no@Q;DO#P�;�>D7 A�;�`^OQ;�RTyQ;��/�^z t�}=Xy�? �+* �cw � Ic�

�^� � ~ 3 � U 3 : :<:H�Hb � � U 3 �(� 3 : :<:H�I:� �em�f�dgm � � ��� ���2� �� ���/�^z t�}{=Xy�? z@� y>����u �^v0�>zsAU=��]y7���^uw�I� ?�u/�/�S��u��Sz��^� } u\y>�:� t9v7u�=Xy>} zCv7���t-uwvSv�t�� [ y#;�X^;DRH<JSeKL>�UVMr>AyQUS8 SeOQdYRTyp<JR �Se>�Z�;�<?>]@^BH<VI#Ke; <VOQXÄZ�;�<?>]@^BC;��¨s#BC;D>T; BT[|SeOQd�<VBT; Ke;DMNR<?>W<JOY; �G;DBTPDSL>];?7 [ U�>T;�;�R]yp<VR ��Se>­;DBTd8UcX^SLPb�^8�;�BC;DP=<VKmK�RTy#;�X#;�`#O^SeRTSeU?OU?M4R]yQ;�RH<JSeK����Ã<VKed8;DI^BH<?>

n4)�b �'� � 2 *4� Y,V�§6!��3 n>bXR4)�n4)�:<QU?Bk#�b�� ) ��� #�)+%PF 8r;�yp<=[8;

� � ) �(#��Hb.� �+)�� $o%0# $�M�U?Bl<VKeK �) �%}n7)_:�cSmOQP�; n7)�Se>k< ��� <VKLd8; I#BH<l�^SeRWM�U?KmKLUS8W>­RTyp<JR � � ) �Z#�� %.n7)�M�U?Bk<VKeKJ#c%'!e�p>TUO! ��W�nl7oMl;DOQPD;��SL> ; BCd8UcX^SeP�Ic�(3�UVKeZtU8d8U?BTU![�# >-6�; BCUb�bU?OQ;�KN<98�7

Page 37: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � ��^7µE^7 ��hjdgp!��f � �5q(i,(+- ��f)(·�4m � ��i,( ( �2qVm�d ��f!-eh��Yk���m�f�dgm �Iq4��[ y^BCU?@QdVyQU?@#R�R]y#SL>�>];�P��R]SLU?O� �s�V3<!43fv)��8 SeKmK X#; OQU?RC;}< ���;`#O#SmRC;Zt;=<?>A@#BC;�>]sp<VP�;>�rU?O 8 y#SePCy¿Se>�dVSe[8; O <�Z�;�<?>]@^BC;��s#BT;�>];DBT[|SmOQd�RTBH<JOQ>]M�U?B]Z�<JRTSLUVO �c74a³;E`^� <VO³SeO|RC;Dd?BH<VI^KL; MN@#OQPDR]SLU?O ���'>T; R � � b _±<JOQX��vM�U?B,�¾6 � � )Kb � )^���2�Hb �V� � ���k� 34343 � � ��� ) �Q~ :� m � ��i �!��� ��� �¨9}<J�cSeZ�<VK4; BCd8UcX^SLPkKL;DZ�Z�<o� �&� ��} � ) b§>]@#s ) � ) ���� ���

�� ��� � � � ��T v� _�:

t-uwvSv�t����c;DR � )) b§Z�<J� � ��2 � ) � 2 <VOQXP#�)Kb � � )) � _ |7 [ y#;DO�QM�U?B�� b 6_3 : :<: 3f,��� 2 b��+� � 2 �Q~ ����F �+� � )) ���B:

W Or#�)�8�;�yQ<g[?; � )) b Z�<!� ~ ��2 � ) � 2��#>TU� )) F �+� � )) ����:W Or# 5) 8�;�yQ<g[?; � )) b _�F � )) ����:�GU:�#SeO|RC;Dd?BH<VR]SeOQd <JOQX}<VX#X^SeO#dR�l8�;�UVI#RH<VSmO

� � � )) TBv F ����

��T vV� � � � )) ���9T v :*�@^R � )) Se>­SeO|RC;Dd?BH<JI#KL;b�^>TU �� � )) ���9T vrb �� � )) T v J K8 y#SePCy}M�U?BTP�;D> �

� ���T v� _�:

�k>�,}w K � #�) # � � ) � _ x>]UR�^I|�YX#U?Z�SeOp<JRC;�XPDU?O|[8; BCd8; OQP�;b��� � � � � � ��T v� _�:

� �em�f�dgm � � ���!��� �C*�SmB]Q|yQU>? # >l<VKeZtU8>AR ;D[?;DBT��8 yQ; BC;�;DBCd?UGX^SeP�RTyQ;DU?BC; Z� � �� ��uw�-��� z@��} � y>��z�����7y>u�zjy>� }ut��l��A�}jzCv7� �� � �oz�}��Vv'� �� �"F v'� �� �:�B���uA/�(} �:y>} � ) 5 ,�w �� y �j�-��y7�G,0w K��t-uwvSv�t�� [ y#;kMN@#OQP RTSeU?OQ>$KeSeZ¿SeO#M()#� � ) 59,2��<JOQXtKmSeZ >A@#s ) � � )659,2��<VBT;lSmO|[?<JBTSN<JOcR�7 [ yQ; BC; M�U?BC;b�cM�U?Bd+J`eg�Q>]U�Se>­RTyQ;�M�U?KmKLUS8 SeO#d�>T; R

� b � �(du3Me �Hb.�gKmSeZ SmO#M) � � ) 5 ,4�"J`d+JSe�J¿KmSeZ >A@#s) � � ) 5 ,4� :-4���/�:y>{�{�/� v7�L} �:y>}mv'� � ��bÂ_ ��<�SeBC>AR9�QI|��SmO|[?<JBTSN<JOQP�;b��8�;�P�<VO±BC;D>]R]BTSLP R�; [8;DB]�|RTy#SmOQd�RCU �

<VO#X½RTy#;DBC; I|��BT;�X^@#P�;tRTU�R]yQ;�P=<?>]; � b|��7�ikUVRC; RTyp<VR�; SeRTy#;DBKe � _YU?B dIJ _^7Xa³;�P=<JOSmOcRT;DBTPCyp<VOQd8;�RTy#;�R 8�U�P=<?>];�>WIc��BC;Ds^KN<?P SeOQd �}I|�". ��7 %4; Rl@#>k<V>T>]@^Z�;�RTy#;DO�RTyp<VR�e �¿_^7

Page 38: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

%4;DR L % !18 SmRTy}v'�sL��,J K �pRTy#;DO �;b � . eg6��³SL>WSeO|RT;�d?BC<VI#KL;�<VO#X��3M�UVB ;�<?PCy ��% � �QM�U?B>]U?Z�;U,�� � )^���G� �"�º� � )#���2�D� �º��.',Je��¿_�:Ml;DOQPD; � ) ���G� � _ ; [8; BT��8 yQ;DBT;�<VOQX��#Ic��RTyQ;�Z�<J�cSeZ�<VK2; BCd8UcX^SLPkKL;DZ�Z�<:�

_ F ����� .zeg6���� T vrb �

���T v'.zeMv'�(L��I:

�cSmOQP�;Uv�SL> ���;`#O#SmRC;b�:8r;�P=<JO�Ke;DRGL # � RCU U?I^RH<VSmOeMv'� � �"F �

���T v :

`bO�sQ<VBTR]SLPD@^KN<VB0��8�;�>];�;�RTyp<VR v'� � �PJ K§7\� >]SmZtSmKN<VB�<JBCd?@#Zt;DO|Rx<Vs#s#KmSL;DX�RTU . �Á<VO#X .Gd��R]y#SL> RTSmZ�;�8 SeRTyrL b � �Q>AyQUS8W>lR]yp<VR

��.GdG� v'� � �"F ����. �2� T v :

Ml;DOQPD;eMv'� � �"F �

���TBv F d v'� � �I:

�cSmOQP�;Ud+J`e�<VOQXRTy#;�SmO|RC;�dVBH<VK2Se>-`#O#SmRC;>�#R]y#SL>­M�UVBCP�;D>kv'� � �Hb¢_^7 �c;DR� b �gKmSeZ SmO#M) � � ) 59,2�-JÁKeSmZ >]@^s) � � ) 59,2�

R]yQ;DO � SL>lSeO|[V<VBTSL<VO|R=76�lKL>]UR� � b[8 � � ��� ��� � � �Zd�3feD���2>TU v'� � �kb _^7 W�O�R]yQ;�PDU?Zts^KL;DZt;DO|RU?M � � � ) 5 ,�PDU?O|[8; BCd8;D>kSeOCy .�K�3�KzgC�#>]UX8�;�P=<VO�X#;�`#OQ;�<VOYSeO|[V<VBTSL<VO|R­MN@#OQP RTSLUVO ��}I|�

��Ob�� KmSeZ )^� � )659,4� UVO � 5_ UVO � :

<(SmOp<VKmKe� ��8�;�yp<=[8;\v'� � � � ) � b v'� �� ���v>TU�v � � ) �EF ,�v � � ��M�UVB�<VKmK ,(7 Mk; OQP�;b�$I|�<p<VRTU?@# >WKe;DZ�Z�<l�

v'� �� �{bYv'��KmSeZ SmO#M) � ) 59,� �-F KeSmZ SeO^M) v'� � )65 , �"F v � � �I:

� �em�f�dgm � � ���!��� ��[8UVO±il;D@#Z�<VO#O# >ku)w�;DBTd8UcX^SLP�R]yQ;�U?BT;DZ�� � ���/����=�� }��:y>}Bv'�s�x�"J K�� � ��}Hr% y»6_3�K¿�-� �� ��� ��t9v7u ��%±u w � � )659,0w ��=z��Yu w �t-uwvSv�t��oa½;�yp<=[8;

� � ��� ) � w b � � � �� w ��� ) T v � ~� Lw b � � � w :�GU:�#Ic��9YSeORQ?Ug8W>TQ|S;# >lSmOQ;�no@p<VKmSeR �>�

� � )^���2� 59, � w F � � � w :

Page 39: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � ���Se[?;DO4� � _:�'PCyQUcU8>]; J K >TU�RTyQ<VR � �. � � w J � 5?E:�&8 y#;DBC; �2b � . Ä� �"� � �7*�� *�SeB]Q|yQUb? #µ>�R]yQ;�U?BT;DZ_� � )#���^� 59, w ��±<G7µ;V7m7 a³;�yp<=[?; � )#���^� 59, �F M�UVBx<JKeK , >TU:�)I|�IºU?@#OQX^;�X}PDU?O|[8; BCd8; OQP�;b�3R]yQ;DBT;�;©�cSL>]RT> �:>A@QPCy}R]yp<VR9�GM�U?Bk,�����

� � )#���G� 59, . �� � w J/� 5?E�:*��V<p<VRTU?@# >­KL; ZtZ�<:�

� �� . �� � ww b����KeSeZ¿SeO#M) � )#���'. �^� 59, w T vF KmSeZ SmO#M) � � � )G��� .��G� 5 , w T v F � � .�� � ww :

Ml;DOQPD;>�QM�U?Bk,����� � )#���2� 5 ,'. �� � w F � � )#���'.��G� 59, � w � � � )#���^� 59,'. �� � w � � ���. �� � w

J/� 5?Ek�7� 5?Ek� � 5?EUb���:

6g_^7 ��� ��5�.����/���1 �p1p/��(1p/40 �J��/e��.�� ���7��l�����c1p56g_G7m687 ��k9d7f)( � � i � f21%�ji:d ��m ( � �1nom�d7q 1;f�d � (�h�kSm 1;f)�edSk�� ��f ��m (�k � [ yQ;�BT;�>]@^KeR 8�;U?I^RH<VSmO±SeO±R]y#SL> >T;�P RTSeU?O18 SeKmK(Iº;xKN<JBCd8; Ke�Y>]@^s�; BC>T;DX#;�XÄSeO}RTyQ;�OQ;©�cR=7 a³;�SeOQP Ke@QX#;�SeR Iº;�P�<V@Q>];SmRC> s#BCUcU?M(SL> Z�@QPCy�Z�U?BT;�;DKL; Z�; O|RH<VB]�RTyp<VO�RTyQ<VRkO#;�;�X^;�X}M�U?BWR]yQ;�X^;�`#O#SmRTSm[8;�[8; BC>]SeU?O±UVM RTyQ;>ARTBCUVOQd�KL<98 8 y#SePCy�M�UVKeKLUS8W>D7� �em�f�dgm � ���!�+�2���2��� ��} � �+);*�,2%>/�� x���yE�S� *0� ����A/� v�t�z����^�@?������^��� } u\y>���^v = �7y>u�zjy�x0{@�/�����A/�V} �:y>},�ut9v7u��Sv =�� A/v7�:��}Cy>� } �kv y>������� �+)p��b�vm3 r� ���) �-F�� t9v7u�y>{�{ ,7:����} � )Kb � ~ � 34343 � �+) ���� ���

� )659,}w v y �2�-� � y7�G,0w K�:t-uwvSv�t���qrUVOQ>]SeX#;DB "�) b �+)�.Cv 7 [ y#;DO��,"��) �-F�6g{#��� �zv� �<VO#X�SeR�>]@���PD;�>­RCUx>]yQUS8 RTyp<JR��-" ~ ��34343f� "�)8� 59,}w _x<^7 >�7Ô7��GU 8�;�<VBT;kBC;DX^@QPD;�X�RCU�RTyQ;kP=<?>];8 yQ; BC; v0b§_^7ilU?RC;WRTyp<JR��+)�3�� U) 3�� �) <VBT; <VKmKQSeO|RC;Dd?BH<JI#KL;W>]SmOQP�; � �) Se>�7$�|SeOQPD;6vrb¢_:�|I|� SeOQX#; s�; OQX#; OQP�;b�r��� 5 � �

� ��b r� � 5 � � � U$ ��b ���� 5 � � ��$ ��m��b¢_M�U?BWXGSL>]R]SeOQP R SeOQXGSLP�;D> � 3 �_3 ��3 � 7NMk;DO#P�;�� � �) �Hb ��U�

~ � 5 � )���$ � { �

~ � 5 � � � )� U5 � U� �I:

Page 40: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

��

�������������� ��

ilUg8 M�U?B �NJ � �#I|��SeOQX^;Dsº;DOQX#; OQP�;�<VOQXYRTy#;xq­<J@QPCy|��.G�GPCy�8­<VB]6�SeOQ;Dno@p<VKeSmR ��� � U5 � U� ��b �� � U5 � r� � U� �"F r� � �5 � ~� U �� � �� � ~� U F���:�GU 8�;�d8; R RTyQ;�IºU?@#OQX �� � �) �-F , � �ÁE�,v�(, . 6!� � F§E�, U ��:[ y|@Q> � ) � � )659,4� ��F E � � ) 6 59, U J K8 y#SePCy}SmZts#KmSL;D>

� ) � � )659,2� � J K <G7µ>D7<VO#X�yQ; OQP�; � )659,0w v�<^7 >�7Ô76g_G7�FG7 ��k9d7f)( � � i � f21 � iRd ��m ( �+�1nom�dbq/�� �em�f�dgm � ���!�,� ���2��� ��} � x�� yo?�uwv>x/y�x0z�{|z�}j~;=��]y7���^uw�Pv7�+' ���oz�} �

� � � �Ä�ZT �º�"J K�3 � ���2�Ä�ZT �º�{b ��:� ��} �(�;3<!43fv)��x���} � �VA]y>��v7� zsA]y>{J=�v0�^��{-t9v7uPyE�S� *0� ����A/� v�t�z����^�@?������^��� } u\y>���^v = �7y>u�zjy�x0{@�/��oz�}��V{2y>� � � �� ���

v'�#���}*p� � ~ � 34343 � ��)8� 5 ,�w �Iy7�G,0w K V�Hb 6_:t-uwvSv�t�� *�� [ yQ;�UVBC;DZ �G7�FG7Ô6 �2R]yQ; >]y#SmMNR�Z�<Vs �U?O���SL>�Zt;=<?>A@#BC;��bs#BT;�>];DBT[|SmOQd}<JOQX½; BCd8UcX^SeP?7[ yQ;kP�UcU?BCXGSeOp<VRT; MN@#OQPDR]SLU?O �Ob � ~ Se>$SmO|RC;�dVBH<VI#Ke;W<VOQX � )#���2�Hb��G��� � �7�%34343 ��� � � ) �Q~Hb� ~ � 34343f� �+)^7$�GU��� ~ � 34343M� �+)o� 59,0w ���<^7µ;V7$<VOQX�SmOu ~ �|M�U?Br>]U?Zt;kSeO|[V<VB]SN<VO|R$MN@#OQP RTSLUVO����|I|�E*�SeB\Qcy#U>? # >�R]yQ;�U?BT;DZ�7��cSeO#P�; ��Se>�; BCd8UcX^SLPb� ��rb 8k<^7 ;?72�|M�U?Br>]U?Zt;kPDU?OQ>]RC<VO|R 8W<VOQX�RTyQ; O8kb�v � �����b KeSeZ")mv'� � )659,2�Hb��º7� �em�f�dgm � ���!�,� ��� �¨�cRTBTU?OQd KN<98¢U?M(KL<VBCd?; O|@#Z�Iº;DBC>C� � � ��}W�-"�)\*�,z%'/��_x���y(�S� *0� ����A/� v�tz����^�@?������^��� },��zj�^��� } zsA]y>{�{|~��>z@��}ju�zjx0�^} �]� �Pz�� } �C�>u\y�x0{@� u\y>���^v = �7y>u�zjy�x0{@�/�(�oz�}�� =��]y>��� � ����}� )Kb " ~ � 34343 � "�) ���� ���

� ) 59,0w � y �2�-� � y7�G,0w KY:t-uwvSv�t��$`bO�R]yQ; OQU?RC<VRTSeU?O�U?M [ yQ;�UVBC;DZ 6g_^7»FG7m6>�!RC<bQ8; �¾RCU­Iº;'RTyQ; KL<S8�U?McRTy#; BH<VOQX^U?Z [V<VB]SN<VI#Ke;�>"�)^7 [ y#;DOPv0b ��� " �Q~/�:8 yQ;DBT; "[* �Yw � SL>­dVSe[8; OI|� "����r�Hb �-"�)G���r��*-,.%0/�� 7,Ml;DOQPD;

�$� � ) 59,0w ��<?>k,0w K¿�Hb�v'�����r*p�"� ~ � 34343 � ��)o� 59,}w ��<?>k,}w K V�HbÂ6_:

Page 41: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� �Ö

6g_G7»E^7'& m (�kSdgi � �jh"�Ih k=k���m�f�dgm � � a½; 8 SeKeK @Q>T;�RTyQ;ÄM�U?KeKeUS8 SeOQd«>As�;DPDSN<JK�P�<?>T;½U?M�%�!; [c��# >PDU?O|RTSeO|@#SmR �³R]yQ;�U?BT;DZ M�U?B�PCyp<JBH<?P RC;DB]SL>ARTSLPtMN@#OQPDR]SLU?O#>�7 � ��} �V)�3f,X%^/��+y>��� � x���u\y>���^v =�7y>u�zjy�x0{@�/�-� ��� ?-?�vS�S� }��:y>} ���

�� � �kw � � � � �{t9v7uPy>{�{ � y>���(} �:y>} � � z@�VA/v7� } z�� � v7���-� �� ���� �

��"�º� w

� ��� �º��t9v7u�y>{�{ ��%4'��� �em�f�dgm � ���!� � ��� �¨qr;DO|RTBC<VK)KeSmZtSmR�R]yQ;�U?BT;DZ�� ��� ��} ���V)Q* ,z%2/�� x�� y��S� *0������A/�Xv�t�z����^�I�?������^��� },��zj�^��� } zsA]y>{�{|~4�>z@��} u�zjx0�^} �]� ��u\y>���^v = �7y>u�zjy�x0{@�/� �oz�}���=��]y>��_ y>���r�7y>u�zjy>��A/��6 � ����}� )Kb � ~ � 34343 � �+) ���� ��� ��t9v7u�y>{�{ d+J e-�"y7�k,0w K �

�$� � ) 5 � ,.% y du3MefgL��w � ��

6� Fg� � �

� � U T $�:t-uwvSv�t����c;DR �(� � �ob ���� 5 � � � �©7�cSmOQP�; r� �1U~ � J K �8r;tP=<VO½X^S@?º;DBT;DO|RTSL<VRC; �� � 5 � � � ��R 8 SLP�;@#O#X#;DBlRTyQ;�;©�Gsº;�P RH<VR]SLU?O��#RCU >]yQUS8·R]yp<VR

���¨_o�Hb¾6_3 � �L�¨_o��b¢_�3 � � �N�,_o��b .�6_:Ml;DOQPD;>�QI|� [ <=�|KLU?B0#µ> R]yQ;�U?BT;DZ_�Q<?> � w _:�

��� � � b 6 . � U 58Fk� � � � U �I:�GU:�#M�U?B RTyQ;�PCyp<JBH<?P RC;DB]SL>ARTSLP�MN@^OQPDR]SLU?O �u)�UVM � )65 � ,��

�u)^� � �Hb r� � 5 � � � � � ����� �� � & �� ) ��b.� ���� 5 � � �� )�& � � � ) b �A6 . � U 58F9,V� � � � U 5 ,4�T� ) :[ yQ;�P�UVZts#Ke; ��KLU8do<JBTSeR]y#Z >C<VR]SL>T`Q;�>��º<V>�� w _:�

KeU8dQ�A6����o��b��� � � �� �>]UR�#M�U?BW;=<VPCy � %_'���<?> ,0w K �

KLU8d ��)#� � �HbY,�KLU8d#�]6 . � U 58F9,+� � � � U 59,4�]��b . � U 5?F � � �]6!��:Ml;DOQPD; �u)G� � �{w � � �

� U M�UVB <VKmK � 7B*�@#R � � �

� U SL>)RTyQ;�PCyp<VBC<?PDRT;DBTSe>]R]SLP�MN@^OQPDR]SLU?OxU?M#RTy#; �³�,_�3=6!�

X^Se>]R]BTSeI^@#RTSeU?O�^>]U�%�!; [c��# >kPDU?O|RTSmOc@^SeR ��R]yQ;�U?BT;DZ�O#Ug8·P�U?Z�s#KL; RC;D>­RTyQ;�s#BTUGU?MÃ7Ml;DBC; Se>'<VOt<VKeRT;DB]Op<VRTSm[8;r<VBCd?@^Z�; OcR0� 8 y#SLPCytX#Uc;�> OQUVR BC; Ke��UVO�%�!; [c��# >$P�U?O|RTSmO|@#SeR ��RTyQ;DU?BC; Z}7

[ <bQ8;�<xBC<VOQX#UVZ [V<VB]SN<VI^KL; " � �½�¨_�3�6!���cSeOQX#; s�; OQX#; OcRWUVM4RTyQ;�>];�no@Q; OQP�;t� �+)"*-,.%0/�� 7,<(SÔ�d J&ex<VOQX ���Â_<VOQXÄP�U?O#>]SLX^;DB�RTyQ;�MN@^OQPDR]SLU?O"��8 y#SePCy�SmO|RC;DB]s�UVKN<VRT;�> KmSeOQ;�<VBTKm��R]yQ;�sºU?SeO|RC>� .�K�3H_8�I3g�Zd . � 3C_o�I3g�Zdu3=6!�I3=�se 3=6!��3g�se4� � 3C_o�I3g� K�3H_o�©7'ikU?RT;�RTyp<JR �v� � � $^� . �(�"�º� ^F $ 5 �M�U?Bl<JKeK ��3%$37��GUR�^d?Se[?;DO � � _:�GM�U?B ��b � �358F8� � � �#5?Eo�\U <JOQX}<JOc��BH<VOQX^U?Z�[V<VBTSL<VI#Ke; � �

����v��� � � ��"x�T��. ����(� ���]� �F �� � � " � 5 �ob �65VE�:`bO�sp<VB]RTSLP @#KN<JB9�ºR]y#SL>�SmOQ;�no@p<JKeSeR ��yQU?KeX#> M�U?B�� <JO�SmOQX#; s�; OQX#;DO|R�P�U?s|��UVM "X��8 yQ;DO�8r;�yp<=[?;� � � ��" � � 6 � ��"E�Q>]U

����v� � 6{� ��"��]��. ����v�,"�T���F�� 5?E�:� ;�P�<VKeK2MNBTU?Z�R]yQ;�s#BCUcU?M(U?M(R]yQ;G<QU?@#BTSe;DB­SmO|[8;DBT>]SeU?O�M�UVBTZ�@#KL<�RTyQ<VR

����v�]� � )�5 � ,2�4� � ��"x�T��b � � � 6F7� � � �u)^� � � � � � � � U � � 5 � � T � � �v� $#��T $�:

Page 42: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

ilUg8 � � ��� U �v� $#� %½u ~ �ZT � � T $#� <VOQX �u) SL> IºU?@#OQX^;�X���8 SeRTy �u)G� � ��w � � �

� U M�U?B <VKeK � <?>

,0w K �^>TUR�#I|�X#UVZtSmOp<VRC;DXYP�U?O|[8; BCd8; OQP�;b�3M�UVBk,�>A@���PDSe;DO|RTKm��KN<VBTd8;>� ����(�T� � )�5 � ,4�$� � ��"��T��. ����v� � 6�� ��"��]� �F�� 5?E

<VO#X�R]yQ;DO ����(� � )�5 � ,)�]��. r���v�,"��]� ^F��B:

Ml;DOQPD; ����(� � ) 5 � ,4�]� w ����v�,"�T��<?>U,Sw K§7 [ yQ;t>T<VZt;t<JBCd?@#Zt;DO|R�<Vs#s^KeSL;D>�RCUYRTyQ;MN@#O#PDRTSeU?O�����X#;�`#O#;�X�KeS5Q8; ���(I^@#R 8 SmRTy'du3Me�BT;Ds#KL<?P�;DX³I|��d"� � 3Me�. �YBT;�>]sº;�P RTSm[8;DKm�87�ikUS8�EFÂ6�� � � � F ���#>]U ����º� � ) 5 � ,4�]�-F �$� � ) 5 � ,.% y du3MefgN� F ����v� � ) 5 � ,4�]�I:W O�RTyQ;�U?R]yQ;DBWyp<VO#X��p<?> �,��_l�

r���3�-"��T� # � ��

6� F7� � �

� � U T $�3 r���(�-"��]� � � ��

6� Fg� � �

� � U T�$>]UX8�;�Zx@Q>]RWyp<=[8;b�3<?> ,0w K �

�$� � ) 5 � ,.% y du3MefgL��w � ��

6� Fg� � �

� � U T $�:��� 1u��� �5!1p5

�cR]@QX#; OcRT>�>]yQU?@^KLX�<VR]RC; Zts#R��v�^; BCP SL>T;D>�687Ô6�.^FG7 � M�U?BkRTyQ; SeB�`#BC>AR�>]@#sº;DB][|SL>]SeU?O�3RTyQ; O�E^7m6�.GE^7Ô6gE:�h 7Ô6�. � 7»{ <VOQX��^7Ô6�.36g_G7�F�M�U?B KL<VRC; BW>]@#sº;DB][|SL>]SeU?OQ>D7�2��� �|yQUS8 RTyQ<VRl< ��� >]�c>ARC;DZ 8 y^SLPCy�SL>W<VKe>TU <+T��b>]�c>]RT;DZ�Se>l< ���Ã<VKed8;DI#BC<^7�2��� �|yQUS8 RTyQ<VR RTyQ;�M�U?KmKLUS8 SeO#d�>T; RC>lU?Mv>A@#IQ>];DRC>kU?Me'¾<VKeK2d8;DOQ; BH<VRT;�RTyQ;�>C<JZ�; ��� <VKLd?;DI#BC<�*

�¨<o� �c�(du3Me ��*-d+J`e� �� ��Ip� �c�Zdu3Mefg$*-d+J e �� �,P=� �c��. K�3Mefg�* e6%4'� |7�2��� �|yQUS8 RTyp<VR�<�PDU?@#O|RH<VI^Ke�½<?X#X^SmRTSm[8;�>T;DR�MN@#OQP RTSLUVO�U?O <YBTSmOQd�Se>�IºU?RTy½SeOQP BC;�<?>]SmOQd±<VO#XPDU?@#O|RH<VI^Ke�>A@#Ip<?X#XGSeRTSm[8;V7�2�)( %4;DRQv¢Iº;�< `#O^SeRC;��b[V<VKm@Q;�X¿<?X#X^SmRTSe[?;}>];DR�MN@#O#PDRTSeU?O UVO <½BTSmOQd.F�7��|yQUS8 R]yp<VR v¢SL>PDU?@#O|RH<VI^Ke�Y<?X^X^SeR]Se[8;�SmM <JOQXYU?O#Ke�tSeM

#�) � #G)�� ~ %PFQ3f,.%0/k3 � ) #�)Kb 1 � v'�Z#�)?� w _�:�2��� %4;DR��(�;3<!43fv)�QI�;$<­Zt;=<?>A@#BC;'>Asp<?PD;?7'�|yQUS8³RTyQ<VR9�gM�U?B)<JOc��>T;�no@Q; OQP�;�U?MG>T; RC>��(#G)"*-,.%0/��SmO>!e�

v'��KmSeZ SmO#M #�)8�"F KeSmZ SeO#M_v'�(#G)o��:�cy#Ug8 RTyp<VR0�^SeM7v�SL>-`#O^SeRC;b�^RTy#;DO�<JKL>TU

v'��KmSeZ >A@#s�#G)o�� KmSeZ >A@#s v'�Z#�)?�<VO#X�d?Sm[8;�<VO�; �^<VZ�s#Ke;�RCU >]yQUS8·R]y#SL>­SmOQ;�no@p<JKeSeR �tZ�<=�tM�<VSeK2SmM4vÄSe>­OQU?R)`#O#SmRC;V7

Page 43: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � ��2��� %4;DR���� 3�� 3T����Iº;�< s#BTU?Ip<VI^SeKeSmR ��>Asp<?PD;x<VO#X}#�)�3f,.%�/)��<�>];�no@Q;DO#P�;�U?Mv;D[?;DO|RC>D7W�cyQUS8R]yp<VRG#�)�3f,�%�/)�)<VBC;�SmOQX#;Dsº;DO#X#;DO|RlSeM(<VOQX�U?O#Km��SeM)R]yQ;����Ã<VKed8;DI^BH<?>­R]yQ;D�d?;DOQ; BH<VRT;

�'�Z#�)8��b � 1 3f#G)�3f# 5) 3�� <VBT;�SeOQX#; s�; OQX#; OcR�7�2��� �|yQUS8 R]yp<VR9�$M�U?B�; [8; BT�=*rU?BT;DK >];DR;L W '\U?M�`^O#SeRT;(%4;DIº;�>TdV@Q;�Zt;=<V>]@#BT;Y<VOQX ;D[?;DBT�� �¿_:�^R]yQ;DBT;�;©�cSL>]RT>l<�`^O#SeRT;�@#O#SLUVO�UVMvX^Se>�zAU?SmO|R­SeO|RC; BT[V<VKe>�#�b �(d ~ 3Me ~ gB8"34343 8��(d-)�3Mef)9g4>A@QPCyR]yp<VRWRTyQ;G%4;DIº;�>]d?@Q;�Z�;�<?>]@^BC;�U?M7#��PL �@b �(# 5 RPL��48��(#SRPL 5 �T�rSL>­Ke;�>]>WR]yp<VO��c7�2�#" %4; R��s�;3 !73 v)��Iº;�<�Zt;=<?>A@#BC;�>Asp<?P�;V7­q­<JKeK)<�>]@^IQ>T; R � WY� � �l{�{cSeM

� WYL M�U?BW>]U?Zt;ULN%2!_8 SeR]y}v'�(L��Hb _B:r BCUg[?;�R]yp<VRWRTyQ;�>];DRlU?M(>]@#IQ>];DRT>

! � b.� #S8 � *-#X%2!43 �aO|@#KmK� Se>�<���� <VKLd8; I#BH<t<VOQX±>AyQUS8 R]yp<VR6v�yp<?>�<E8�;DKmK5�bX#;�`#O#;�XÄ<VOQX}P�U?@#O|RC<VI#Ke�}<?X#XGSeRTSm[8;�; �cRC; OQ>]SeU?ORTUP! ��dVSe[8; O�I|�

v'�(#S8 �±��b�v'�Z#���:a½;�P=<VKmK ! ��RTyQ;QA/v =�?�{@��}jzCv7��v�t !=�oz�}�� uw�/�@?��MA�} } v v �� ��� r BCUg[?; r BCU?sºU8>]SmRTSeU?O Fc7m687Ô6±<JOQX X#;DX^@QP�;�RTyp<VR0�­M�U?B�<VO|�Á>];�no@Q; OQP�; ��� )Y*k,N%[/��YU?MZt;=<?>A@#BH<JI#KL;�MN@#O#PDRTSeU?OQ>WU?O½�s�V3<!����

���0%0�a*�� )#� �º�­P�U?O|[8; BCd8;D> <V>G,0w K �%'!�:� ��� %); R � <VOQX "aIº;�R 8rUÄBH<VO#X#U?Z [V<VB]SN<VI^KL;�>�U?O¢� � 3�� 3]����<VO#X >A@#s#sºU8>T;R]yp<VR�M�U?B <JKeK��3%$ %4'

�$� � F���3 " F'$^�Hb �'� � F��º� �$�-" F'$#��:�cy#Ug8 RTyp<VR � <VOQX " <VBT;�SmOQX#; s�; OQX#;DO|R�7� ��� %4; R � ~ 3 � U 3 : : :­Iº;�BH<VOQX^U?Z�[V<VBTSL<VI#Ke;�>"8 SmRTy

�V)Ub � ,�U . 6 8 SmRTy�s#BCUVIp<VI#SmKeSeR ��6 5 ,�U.�6 8 SmRTy�s#BCUVIp<VI#SmKeSeR ��6 . 6 59, U 7

�cy#Ug8 RTyp<VR � � ~ � 34343 � �+)

, � b§_I#@^R,8 SmRTyYs#BTU?Ip<VI#SmKeSmR ��U?O#;>�p<?>k,0w K �� ~ � 34343 � �+)

, .Jw .�6�:

Page 44: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

� �)( <QU?B �� 6�X#;�`^OQ;�R]yQ;�6�; RH<�MN@#OQPDR]SLU?OYI|�� � !�Hb �� ) 6 ~

, ��� :%4;DR � <VOQX " I�;�SmOQX#;Dsº;DO#X#;DO|RlBH<VOQX^U?Z\[V<VB]SN<VI#Ke;�>-8 SmRTy

�'� � b�,4��b �$�,"xbY,4��b�, ��� 5 � ��!��:�cy#Ug8 RTyp<VR R]yQ;�;D[?;DO|RC>

�/H�X^Se[|SeX#;�> � 3HYs#BTSmZ�;<VBT;�SeOQX#; s�; OQX#; OcR <VOQXYX#;DX^@QPD;�� @#KL; B9# > M�U?BTZ�@^KN<

6� � !� b �

w�26 . 6

H � � :r BCUg[?;x<VKe>TU�RTyQ<VR

�$��� Se>l>]no@p<VBC;��bMNBT;�;g��b 6 5 � �bF !�<VO#X

���Ãy$: P�: M :e���03*"x�{b�,�� b�, �lU�� 5 � �bF !�I:� ��� %4;DR � ~ 3 � U 3 : : : Iº;xSmOQX#;Dsº;DO#X#;DO|R�BH<JOQX#U?Z [V<VBTSL<VI#KL;D>,8 SmRTyÄX^Se>]R]BTSeI^@#RTSeU?O}@#O^SeM�U?B]Z UVOy _�3=6<g,7N%4;DRG#�)�Iº;�RTy#;�; [8; OcRkRTyp<JRl< BT;�P�UVBCX�UGPDPD@#BT>k<JR RTSeZt; ,��#RTyp<VRWSe>0��V) � �%2 M�U?Bl<VKeK � J`,7:<(SmOQXRTyQ;�s#BTU?Ip<VI^SeKeSmR ��UVMm#G)�<VOQX�>]yQUS8 R]yp<VRG# ~ 3f# U 3 :<: :W<VBC;�SmOQX#;Dsº;DO#X#;DO|R=7 A�;�XG@QP�;�RTyQ<VR9�8 SmRTy�s#BCU?IQ<VI#SeKmSeR ��U?OQ;b�#SeOR`^O#SeRT;DKe��Z�<VO|��BC;DP�U?BTX#>WUGPDPD@#B�7� ��� %4; R � ~ 3 � U 3 : : :­Iº;�SeOQX#; s�; OQX#; OcR �³�,_�3=6!��BC<VOQX#UVZ�[V<VBTSL<VI#KL;D>�7 r BTU![?;�R]yp<VR

KeSmZ >]@^s) � �+) 5 F KeU8dH,�� bÂ6 <^7 >�7

� ��� %4;DR �)}X^;DOQU?RT;�RTy#;Q,ºR]y <Vs#s#BTU=�GSmZ�<JRTSLUVO½RTU}RTyQ;q­<VO|RCU?Bx>T;DR V*�RTy|@Q> � b y _�3=6 gC� ~ b y _�3 ~� g�8 y U� 3=6 gC�3 U b y _�3 ~� g�8 y U� 3 ~� g�8 y U� 3� g�8 y��� 3=6 gC��;DRTP?7�<VOQX �)1� <?>U, w K§7A�; OQU?RC; I|�

�)YRTy#;tX^Se>]R]BTSeI^@#RTSeU?O�MN@#OQP RTSLUVO³U?M­<�BC<VOQX#U?Za[?<JBTSN<JI#KL;�@#O^SeM�U?B]ZtKm�}X^Se>]R]BTSeI^@#RC;DX

U?O0 �)G7��cyQUS8��S��

�� �º��b§KeSmZ ) � � �

)^�"�º�­; �cSe>]RC> M�U?Bl<JKeK �}% y _�3=6<g ���SmS��

�SL> PDU?O|RTSeO|@QUV@Q>0�

��¨_o�Hb¢_�<JOQX

��]6g�HbÂ6 �

��SeSmS���SL> X^S5?�; BC; OcR]SN<VI^KL;�<^7 ;?7R8 SmRTy

�� b§_^7

� ��� ��>ASeZ�s#KL;kMN@#OQPDR]SLU?O��±yp<?>­R 8�UtBT;Ds#BT;�>T; O|RH<VR]SLU?OQ> *�Ob2� $ 6 ~ d $?6 � �kb

)�� 6 ~

e*$?6�� � :

Page 45: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � �<QU?B � % �J_�3=64 2 X#;�`#O#;6# ��b�# � �~ R 34343 RU# � �2 8 yQ;DBT;�# �$ b�# 5$ �B#�~$ b�# $J7o<QU?B � % �J_�3=64 )X#;�`#OQ;KL��W>]SmZtSmKN<VB]Ke�87 [ yQ; O±>];DR

�� �{b ��� ��2� $ 6 ~ � $Id $ SmM4# �mRPL����b 1K UVRTyQ; B]8 SL>];?7

�cy#Ug8 RTyp<VR M�UVBl<VO|�Z�;�<?>]@#BT;ov2� $ 6 ~ d $ v'�(# $g�Hb �

� � �� � v'�(# �mRPL��C�<VO#X�X#;DX^@QPD;�R]yp<VR

2� $ 6 ~ d $<v'�Z# $���b

)�� 6 ~

e �Iv'�(L � �I:

� ��� �|yQUS8�RTyp<VR�<VO|�}PDU?O|RTSmOc@#U?@Q>kMN@^OQPDR]SLU?O�2*l'cw ' Se>�%4;DIº;�>]d?@Q;xSmO|RC;�dVBH<VI#Ke;�Ug[?;DB�<VO|�`#O^SeRC;�SmOcRT;DB][?<JKb7� ��� r BTU![?; r BTU?s�U?>]SeR]SLU?O#> E^7Ô687 h �QE^7Ô687�f�<VO#X}E^7Ô687µ{^7� �)( %4; R � Iº;�< O#U?O:�bO#;�do<VR]Se[?;�SeO|RC;Dd8;DBT�b[V<VKe@#;�XBH<VO#X#U?Z\[V<VB]SN<VI^KL;?7'�cyQUS8·RTyQ<VR

r� ��Gb �� ) 6 ~�$� � ,2�I:

A�;DX^@QP�;�RTyp<JR9�rSmM r� �Ä��b K <JOQX � ~ 3�� U 3 :<: :�SL>�<½>];�no@Q;DO#P�;±U?M SeOQX#; s�; OQX#; OcRtBH<VO#X#U?Z[V<VB]SN<VI#Ke;�>-8 SmRTyYRTyQ;�>T<VZ�;�XGSL>]R]BTSmI#@#RTSeU?O�<?> � �^R]yQ;DOKmSeZ >A@#s2���+) 59,2� �6 <^7 >�7

<VO#X�SmOQX#;�;DXKmSeZ >A@#s2���+) 59,2��b K <^7 >�7

ilUg8 >]@#s#sºU8>];lR]yp<VR " ~ 3*" U 3 : : : Se>�<JOc� >];�no@Q; OQP�;�UVMºSmOQX#;Dsº;DO#X#;DO|R�SLX#; OcR]SLP�<VKeKm�xX^Se>]R]BTSeI^@#RC;DXBC<VOQX#U?Z\[?<JBTSN<JI#KL;D>"8 SeR]y " ~ 9b K§7��|yQUS8 RTyQ<VR

KmSeZ >A@#s2� "�) 59,2�Hb K <^7 >�7<VO#X�SmOQX#;�;DX

KeSeZ >]@#s�� " ~ � 34343 � "�) 59,4�Hb K <^7µ>D7� ��� <QU?B �z%��¨_�3�K¿��<VOQX H}% y»6_3�K¿��<VOQXYM�U?B

���#�"�º��b 6 5*� � 3 �0� _�3

Page 46: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

>AyQUS8�P=<VBT;DMN@#KmKe�tRTyp<VR� �;%�u w �]�¨_�3=6 gs3fT �º� � ��HVJ·6_3� �;%±u w �My�6�3�K¿�I3fT �º� � ��H �·6_:

� ��� �|yQUS8 RTyQ<VR RTyQ;�MN@#O#PDRTSeU?O�v�"�º��b >]SeO��

�Se>WO#U?R,%4;DIº;�>TdV@Q;�SmO|RC;�dVBH<VI#Ke;�Ug[8; BVy»6_3�K¿��I#@^RlR]yp<VR R]yQ;�M�U?KeKeUg8 SmOQdxKmSeZ�SeR�X#UG;D>W; �cSL>AR *

KmSeZ� � � � �

~>ASeO �� T ��:

� ��� �|yQUS8��S���* � �� >ASeO)� � � � 5^�A6 � , � U ��T �rw _ <V> ,0w K �

��SeSN�I* � ~� �(,�PDU8> �º� 5G�]6 � , U � � � � T �rw _ <?> ,0w K§7� �#" %); R � <VOQX��I�;�X^S5?�; BC; OcR]SN<VI^KL;xMN@#O#PDRTSeU?OQ>�U?O y du3Mefgo8 SeRTy�PDU?O|RTSeO|@QUV@Q>�X#;DB]Se[V<VRTSm[8;D> � �<VO#X � 7��cy#Ug8¢RTyp<JR M�U?Bkd+J e

� ��� � �º� � � �º� T �Ob.� � �(eD� 3�se � . � �(dG� 3�Zd^�� . � �

�� � �"�º� º� �º� T ��:

� � � r BTU![?; r BTU?s�U?>]SeR]SLU?O#> E^7 h 7 h �QE^7 h 7»{l�QE^7»fG7m6>�QE^7»fG7�F�<VO#X}E^7»fG7µE^7� ����� [ yQ;�ZtU?Z�; O|Rd8;DO#;DBH<JRTSeO#d MN@^OQPDR]SLU?O � U?M�<�BC;�<VK5�¨[?<JKe@Q;DX BH<VOQX^U?Z [V<VB]SN<VI#Ke;�� SL>X#;�`#OQ;DX�I|�

�����p��b ­� ��� � ��3 �r%Y'k:�cy#Ug8 RTyp<JR�RTyQ; >T; R%�}b ���C* �(���p��J K �SL>�<VOÄSeO|RT;DBT[V<VK'<VOQX1`#OQX�; �^<VZ�s#KL;D>�8 yQ;DBT; ��SL>',� �J_ t<VOQX ��. K�3=6!�©7K�k>T>A@#Z�;�M�UVB�>]SmZts#KmSLP SeR �RTyQ<VR�� _^7��|yQUS8 R]yp<VR�SeM!��P�U?O|RC<VSeOQ>�<OQ; SLd?y|IºU?@#B]yQUGUcXYU?Mv_�R]yQ;DO���yp<?> `#O#SmRC;�ZtU?Z�; O|RC> U?Mv<VKeK2U?BCX#; BC>Wd?Sm[8;DO�I|�

�� � ) �Hb � TT� � ) ����� 6 � �(���p�I:

<(SmOQX�<tO#;�P�;D>T>T<VBT�±<VOQX�>]@��tP SL; OcR�P�U?OQXGSeRTSeU?O±UVO±RTyQ;x>T;�no@Q; OQP�; U?M'ZtU?Zt;DO|RC> �Q);b ���� ) �M�U?B �tRCU P�U?O|RC<VSeO�<�OQ;DSed?y|I�U?@^BTyQUcUGXUVM _^7� ��� � %4;DR�� ~ 3 : :<:<3��+)�I�;�BC<VOQX#U?Z [V<VBTSL<VI#Ke;�>�8 SmRTyÄX#; OQ>]SmR �}MN@#O#PDRTSeU?OQ>&� ~ 3 : :<:<3 � )�BC;D>]sº;�P��R]Se[8; Ke�?7³�|@#s#sºU8>T;�R]yp<VR�R]yQ;+' ) �b[V<VKm@Q;�X½BH<VOQX^U?Z [V<VB]SN<VI^KL; � b � � ~ 3 : :<:<3��+)?��<VKL>]U}yp<?>�<X#; OQ>]SmR �MN@#OQP RTSLUVO ��7��cyQUS8·RTyQ<VR � ~ 3 : : : 3��+) <VBT;�SmOQX#; s�; OQX#;DO|RlSeM(<VOQX�U?O#Km��SmM

�v�"� ~ 3<: : :<3 ��)o��b � ~ �"� ~ ��:<: : � )#� ��)|� <G7µ;V7

Page 47: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � �� ��� � %4;DRk��� )"*-,.%0/��­Iº;W<�>T;Dno@Q;DOQPD; U?M3SeO|RT;�d?BC<VI#KL;�MN@#OQP RTSLUVOQ>$<VOQX >]@^s#s�U?>T;WRTyp<VR � ) w �<^7 ;?7 M�UVB$>TU?Zt; SeO|RC;Dd?BH<VI^KL;­MN@#OQP RTSeU?O ��7'�cyQUS8 R]yp<VR0�|SmM � � ) � ~ w � � � ~ �oRTyQ; O � � ) .(� � ~ w _^7� ��� � %4;DR+v <JOQX ��Iº;�s#BTU?Ip<VI#SmKeSmR ��Zt;=<V>]@#BT;�> U?O¢�s�V3<!��x<VOQX >]@^s#s�U?>T;RTyp<JR9�'M�U?B�>]U?Z�;Zt;=<?>A@#BH<JI#KL;�MN@#O#PDRTSeU?O��.* � w y _�3�6gC�

�º�(#���b ���6TBvm3 #X%2!4:

%4;DR�� �+)�*$,Y%`/���I�;t<Y>T;�no@Q; OQP�;�U?MrSmOQX#;Dsº;DO#X#;DO|RxBC<VOQX#UVZj[V<VBTSL<VI#KL;D>�SeO2� 8 SeRTy�KN<98cv<VO#X�Ke;DR��*)4)+*-,.%0/�� I�;�<�>T;Dno@Q;DOQPD;xU?M�SeO#X#;Dsº;DOQX^;DO|R�)+y _�3=6<g4BC<VOQX#UVZ�[V<VBTSL<VI#KL;D>�7$�c;DR

� b§Z�SeO)� ,.%0/~* �)4) F �v� �+)?� 3 " b � � :�cy#Ug8 RTyp<VR " yp<V>WKL<98 �º7( ��� %4; R � Iº;�< BC<VOQX#UVZ\[V<VBTSL<VI#Ke;�<VOQXYKL; R�6GFIH_J �PJ K§7��cyQUS8 R]yp<VR

�� � w �Hb�� �� H � w �Q~ �$� � ��º��T��<VO#X�X#;DX^@QPD; � %�u � ����� � �$� � ��º�Hb t� � � � � � � %�u w ������:( ��� ��Se[?;�<�>]SeZ�s#Ke; s#BCUcU?M(U?M �GPCy�8­<VB]6>#pSeOQ;Dno@p<VKeSmR �tM�UVB Z�;�<?>]@#BC<VI#Ke;�MN@#OQPDR]SLU?O#> ��<VO#X �u*

� � � � ~ F � � � U � � � U :( ��� �|yQUS8 RTyQ<VR M�U?B SeO#X#;Dsº;DOQX^;DO|RkBC<VOQX#UVZ�[V<VBTSL<VI#KL;D> � <VOQX "

� ��" � ~ b � � � ~ � " � ~<VO#X�R]yp<VR SeM�IºU?RTy�� <VOQX " <VBC;�SeO|RT;�d?BC<VI#KL;kRTyQ; O�����"��b ������ �-"��I:( �)( � ��} �@? t��^��A�}jzCv7� �0* '^w '¢Se>r<VO|�X`#O#SmRC;kKmSeOQ;�<VB�P�U?Z�I^SeOp<VR]SLU?OtU?M4SmOQX^SLP�<VRCUVB�MN@^OQPDR]SLU?OQ>U?M `^O#SeRT;�SeO|RT;DBT[V<VKe>�7 �cyQUS8 RTyQ<VR�R]yQ;±>T; R�U?M�>ARC; s#MN@#OQP RTSLUVOQ>Qh�Se>tX^;DOQ>];±SeO u4w|� '­�YM�U?B�<JKeKH�% y�6�3�K¿�I*�RTyp<VRxSL>0�'M�U?B�<VKeK �X%·u w � 'r�Y<JOQX <VKeK �4� _}R]yQ;DBT;; �cSL>ARC>�S%~h�>A@QPCy RTyp<VR� � .�� � w J/�c7( ��� %); Rt� �+)}*�,`% /���I�;�<VOÄSLX^;DO|RTSeP=<VKmKe��X^SL>ARTB]SeI#@#RT;�X�>];�no@Q;DO#P�;tSmO½u U �����©7��|yQUS8 RTyQ<VR9�M�U?B�� � _:���S���*7,3�$� � ~ �� � � ,4� w _ <?> ,0w K ���SeSN�I*�, � ~U Z�<J� $ � ) ��$ -w _ SmOYs#BCU?IQ<VI#SeKmSeR �?7

Page 48: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� � �������������� ��

� ��� %4; RW�s�V3<!43fv)�2I�; <lZ�;�<?>]@#BT;­>]sQ<?P�;W<VO#X�KL;DR*� ~ F � U F~: :<:vI�;­<VO�SeO#PDBC;�<?>]SmOQd�>];�no@Q;DO#P�;U?M�PDKLU?>T;�X >]@^IQ>]sp<VP�;�>�U?M�u U b u U �s�V3<!43fv)��M�U?B �c% u U ��X#;DO#U?RC;�Ic� � )ÄRTyQ;�U?BTR]yQU8d8UVOp<VKs#BTUVzA;�P RTSeU?O}UVM �±U?O ��)c7��cyQUS8¢RTyp<VR � )�P�U?O|[?;DBCd?;�>kSmO�u U=7� ��� r BTU![?; r BTU?s�U?>]SeR]SLU?O#>WfG7µE^7m6�<VO#X±fG7µE^7»FG7� ��� r BTU![?; r BTU?s�U?>]SeR]SLU?O{^7�Fc7�FG7� ��� <�SeOQX³<�@#O#SmM�U?BTZ�Ke�}SeO|RC;Dd?BH<VI^KL; >T;Dn|@#;DOQPD;�UVM­BH<VO#X#U?Z�[V<VBTSL<VI#KL;D>�� �+)2*4,^%Y/���>A@QPCyR]yp<VR �V)Kw _�<^7 >�7 <VOQX �H>]@#s ) �+) � b K�:� ��� %4; R�� �+)+*-,.%0/���Iº;�<VOYSLX#; O|RTSLP�<VKeKm��XGSL>]R]BTSmI#@#RC;DXY>T;�no@Q; OQP�;�SeO�uNUg�����©7­�|yQUS8 RTyQ<VR � Z�<!�$ � ) � $ � 5 � ,0w _ <?> ,�w K�:� ��� �cyQUS8�RTyp<JR4RTyQ;N<QU?@#B]SL; B2RTBC<VOQ>]M�UVBTZ·UVM^<-`#O^SeRC;B*rU?BC; K8Zt;=<?>A@#BC;'SL>2< IºU?@#O#X#;�X�P�UVOcR]SeO|@QU?@#>MN@#O#PDRTSeU?O47� ��� %); RPvÂIº;³<=*rU?BT;DK�Zt;=<?>A@#BC;�U?O '�U?M `#O^SeRC;ÄRCUVRH<VK�Z�<?>T>D7 �c@^s#s�U?>T;ÄRTyQ;�<QU?@#BTSe;DBR]BH<VOQ>AM�U?BTZ �v�SL>�%); I�;D>Td?@#;�SeO|RC;Dd?BH<VI^KL;?7��|yQUS8ÂR]yp<VRov�yQ<?>�<�P�UVOcR]SeO|@QU?@#>�X#;DO#>]SeR ��MN@#OQP RTSLUVO�Y8 SeR]y�BT;�>As�;DPDRlRCUX%4;DIº;�>TdV@Q;�Zt;=<V>]@#BT;�*

v'�(#��{b ���v� �º� T ��:

� ��� �cyQUS8ÂRTyp<JR�RTyQ; BC;�X^U�OQU?R�;©�GSe>]R�SmOQX#;Dsº;DO#X#;DO|R�SLX^;DO|RTSeP=<VKmKe�YX^Se>]RTB]SeI#@^RC;�X�BH<VOQX^U?Za[V<VB]S5�<VI^KL;�> �}3*" >]@QPCy�RTyp<VR � . " � )+y .�6_3=6 gs:� �)( [ y#;xq­<J@QPCy|��XGSL>]R]BTSmI#@#RTSeU?O�yp<V>lX^;DOQ>ASeR �MN@#OQP RTSeU?O

�v�"�º�Hb 6�$�]6 � � U � 3 �0%4'G:

�cy#Ug8 RTyp<VR R]yQ;�P�U?B]BC;D>]sºU?OQX^SmOQdtPCyQ<VBH<?P RC; BTSL>ARTSeP�MN@#OQPDR]SLU?OYSe> d?Se[?;DO�Ic�� � � �Hb � � � � � :

�cy#Ug8 <VKe>TU�R]yp<VR0�GSeM� ~ 3<: : :<3 �V)x<VBT;kSeO#X#;Dsº;DOQX^;DO|Rkq­<V@QPCy|��BC<VOQX#UVZ [V<VB]SN<VI#Ke;�>��cR]yQ;DO���� ~ �34343 � �V)8� 5 ,�Se>k<JKL>TU�q­<V@QPCy|�?7 qrUVZtZt;DO|RlU?O}R]y#SL> SmO�R]yQ;�KmSLd?y|RWU?MvRTyQ;�>]R]BCU?OQd�KN<98·UVMvKN<JBCd8;O|@#Z�Iº;DBT> <JOQX�PD;DO|RTBC<VK4KeSmZtSmR�R]yQ;�UVBC;DZ�7� ��� <QU?B­<G`#O#SeRT;�*�U?BC; KºZt;=<?>A@#BC;�v±U?OtRTyQ; KmSeOQ;W>AyQUS8§R]yp<VR0�cSmM � � $ TBv �"�º�-J K �|RTyQ; ORTyQ;<QU?@#B]SL; B RTBH<JOQ>]M�U?B]Z �v�U?M7vÄyQ<?>l< �|RTy�P�U?O|RTSmO|@QU?@Q>WX#; BTSe[V<VR]Se[?;>�:8 y#SePCy�<VRl_�Se> d?Se[?;DO�Ic�

�v � $*& �¨_o�Hb� $ � � $ T v'� �º�I:� ��� ��S��­�|yQUS8 RTyQ<VRWM�U?Bl<VO|��BC;�<VK4O|@#Z�Iº;DBT>Gdu3MekU?OQ;�yp<?> � �� � 5 � � T �rw _�<V> ��_w K§7

Page 49: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� ��������R ��b ������� �������������� � ���SeS��$�c@^s#s�U?>T;kR]yp<VR v�Se>r<�`#O#SeRT;�*rUVBC;DKpZt;=<?>A@#BC;kU?O�'L8 y#SePCy�yp<?>r<�X#; OQ>]SmR � �(8 SeR]y�BC;D>]sº;�P RRTU�%4;DIº;�>]d?@Q;�Z�;�<?>]@^BC;?7��|yQUS8·RTyp<JR SeRC>)<QU?@^BTSL; B RTBC<VOQ>]M�UVBTZ

�v'���]��b � �� �

� 5 � � �v� �º� T �RT;DOQX#>WRCU�_�<?> ��-w K§7 [ y#SL> Se>­RTyQ;���zC�I=Xy>� ��� � �0x��/�]�>� � � �I="=Xy?7��SeSeSN�­�c@#s^s�U8>];�R]yp<VRWRTy#;�X#; OQ>]SmR � �ÄUVMmvÄyp<?>k<VO�SeO|RC;Dd?BH<VI^KL;�<VOQX�P�UVOcR]SeO|@QU?@#>kX#; BTSm[?<JRTSe[?;�� � 7�cy#Ug8 RTyp<VR

�v'���]�{b � ��� �Q~ �I3 Sb7 ;?72� � �v'��]�{w _�<V> ��_w K§7�v�cRC; OQX�RTU�y#Sed?yQ; BWX#;DB]Se[V<VRTSm[8;D>�7" ��� r BTU![?; r BTU?s�U?>]SeR]SLU?O�^7m6?7m687" ��� �|@#s#sºU8>T;�RTyQ<VR � ~ 3 : : : 3��+) <VBC;rzAUVSeO|RTKm�Y��<V@Q>T>ASN<VOYBC<VOQX#U?Z [V<VBTSL<VI#KL;D>-8 SeR]y���� 5 �{bYv 5 3 PDU![���� 5 3�� �D�Hb � 5 �<VO#X RTyp<VRtRTyQ;�Z�<JRTBTSÔ� � b ��� 5 ����SL>tSmO|[8;DB]RTSmI#KL;V7·�G; R " b � � ~U � � .�v)� 7·�cyQUS8 RTyp<VR" ~ 3 : :<:<3*"�) <VBT;�SmOQX#; s�; OQX#;DO|R �³�,_�3=6!�rBC<VOQX#U?Z [V<VBTSL<VI#KL;D>�7�cy#Ug8 RTyp<VR)8�;xP�<VO_8 B]SeRT;�� U SeOYRTyQ;�M�U?B]Z � U b�d � ~ � � 8 yQ; BC; �·SL> SmOQX#;Dsº;DO#X#;DO|RkU?M� ~ <VOQX�X#;DRT;DBTZ�SeO#;�RTyQ;�X^Se>]RTB]SeI#@^RTSLUVOYU?M ��7

" ��� %4; R � ~ 3<: : :I3��+)�I�;�SmOQX#;Dsº;DO#X#;DO|R �³�¨_�3=6!��BH<JOQX#U?Z�[V<VB]SN<VI^KL;�>D7$�cyQUS8·R]yp<VR� �C3 )�2 6 ~

� � 2 . ��� U � <VO#X � �V)65 � ,m3 ) �Q~�2 6 ~

� U2 �yp<=[?;�R]yQ;�>C<VZt;�X^SL>ARTBTSmI#@#R]SLU?O�^8 yQ;DBT; � bÂ� � ~ � 34343 � �V)8� 5 ,v7� ��� %4;DR��(�;3<!43fv4�$Iº;�<xZ�;�<?>]@#BT;�>]sQ<?P�;�<VOQX �P* �cw � <xZ�;�<?>]@#BT;��¨s#BC;D>T;DB][|SeOQd�RTBC<VOQ>AM�U?B\�Z�<VRTSeU?O47$�|yQUS8 RTyQ<VR

!�* b � #X%2!}* � �Q~ �(#���b�#

Se>W< ���Ã<VKed8;DI#BC<:�G<VOQXYRTyp<VR <�Zt;=<V>]@#BC<VI#KL;�MN@^OQPDR]SLU?O �}SL>�!��bZt;=<?>A@#BH<JI#KL; SmM(<VOQXYU?O#Km��SeM4SmR­SL>

z����7y>u�zjy>� }��#RTyp<JR SL>!� � � b���7� ��� r BTU![?; r BTU?s�U?>]SeR]SLU?O#> �^7Ô687m6�<VO#X}�^7Ô687»FG7� ��� <QU?B � b[y _�3�6!�I3fdV%.� <VOQXPv'�ZT �º�Hb�T ���^>]yQUS8·R]yp<VR

�4� �º� b �+�zd ��ZtUGX�6g�Se>�Zt;=<V>]@#BT;��bs^BC;�>];DB][cSmOQd#7(A�; RC; BTZ�SeOQ;�M�U?B 8 y#SePCy³[V<VKm@Q;�>�U?M�d�RTyQ; RTBC<VOQ>]M�UVBTZ�<VRTSeU?O �½Se>�;DB\�d8UcX^SeP?7%4;DR �}Iº;�<JO�SmO|RC;�dVBH<VI#Ke;�MN@#OQP RTSLUVO�UVOzy _�3=6g� 7NA�;DRT;DB]ZtSmOQ;�M�U?BW;=<VPCy�[V<VKm@Q;�U?M7d�RTyQ;�KmSeZ�SeR

�Ob KeSmZ) � � 6, ���+� � � ��� 34343 � � � � ) �Q~ ��:

Page 50: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

��

�������������� ��

� �)( �|yQUS8 RTyQ<VR�4�"�º��b·F�� ��ZtUcX�6!�

Se>'<VOQU?R]yQ;DBvZ�;�<?>]@#BT;��¨s#BC;D>T;DB][|SeOQd�R]BH<VOQ>AM�U?BTZ�<VR]SLU?OxU?M�%4;DIº;�>TdV@Q; Z�;�<?>]@#BT;­U?O0y _�3=6!���8<VO#X�RTyp<VR�YSL>W; BCd8UcX^SLPV7o<(SmOQX �±M�UVBW;=<?PCy�SeO|RC;Dd?BH<VI^KL; MN@#O#PDRTSeU?O��(7� ��� q­<VKeK^<k>];�no@Q; OQP�;WU?M#BC<VOQX#UVZ [V<VB]SN<VI#Ke;�>�� �+)+*-,�%�/���UVO <ks#BTU?Ip<VI#SmKeSmR ��>]sp<VP�;���� 3�� 3T�����}Cy>} zCv7��y>u�~�SeM#M�UVBv;�<?PCy+,m3 �\%0/ RTyQ;�BH<VOQX^U?Z¾[8;�P RCU?BT>W� � ~ 3 : :<: 3��+)8�(<VO#X� ��$ � ~ 3<: : :<3 � $ ��)8�yp<=[?;�R]yQ;�>C<VZt;�X^SL>ARTBTSmI#@#R]SLU?O$*�M�U?Bk# ~ 3<: : :<3 #�)"%�q���$��� ~ %0# ~ 3 :<: :<3��+)"%}#�)8�{b �$� ��$ � ~ %0# ~ 3<: : :<3 � $ ��)"%0#�)8�I:�cy#Ug8ÁRTyp<JR9�oSeM(� �+)"*-,.%0/��rSL> <�>ARH<VR]SLU?OQ<VBT�x>T;�no@Q; OQP�; <VOQX � ~ %±u)w��8M�UVB$>TU?Zt;BH}% y�6_3�K¿���R]yQ;DO

6,

)�5)6 ~

� 5 w � <^7 >�7p<VOQXSmO}u w �M�U?BW>]U?Zt;�BC<VOQX#UVZ�[V<VBTSL<VI#KL; � %±u w <VOQX(`#OQX�ky �}g¨7���!��� %4;DR �±Iº;�< IºU?@#OQX^;�X�P�U?O|RTSmO|@QU?@Q> MN@#OQP RTSeU?O�U?O��,_�3�K¿���Gyp<=[|SeOQdE%)<Vs#KL<?P�;�R]BH<VOQ>AM�U?BTZ

���� �3��b � �� � � � � �v�"�º��T ��3 �}%«�,_�3�K¿��:%4;DR����V) *{,c%X/���I�;Y<Ä>T;Dn|@#;DOQPD;}U?MlSeOQX^;Dsº;DOQX#; O|Rt;©�cs�U?O#;DO|RTSL<VK BH<VO#X#U?Z [V<VB]SN<VI#Ke;�>��'U?Msp<JBH<VZt;DRT;DB �)7��cyQUS8 R]yp<VR ��«yp<?>�X#;DB]Se[V<VR]Se[8;D>xU?M <VKeK$U?BTX#;DBT>xU?O �¨_�3�K¿��<VO#X½RTyQ<VR9��M�U?B�<JKeK,.%0/)�4M�U?BW>TUVZ�; �� �$3f,4� �b§_ SmOQX#;Dsº;DO#X#;DO|RlU?M ���R8r;�yp<=[?;

�(T 59T��3� ) �Q~ ��v� �3�Hb �� �$3f,4� � �v� � )8� �8 yQ; BC; � )Kb � ~ � 34343 � �+)^7 A�;�XG@QP�;�RTyQ<VRWSeM �� � _�R]yQ;DO}<VKL>]U � � _G7���!��� <QU?B�;=<VPCy�, %C/)� RTyQ; BC;�Se>�<�@#O#Sen|@#;�s#BCU?IQ<VI#SeKmSeR �Zt;=<?>A@#BC;�v�)�U?O�R]yQ;�@#O#SmR�>As#yQ;DBT;� ) �Q~ b ��� % ' ) * � �b 6/ �>A@QPCy�RTyQ<VRUv�)^�(#��6bav�)^�*)�#���M�UVB�<VKeKN*�U?BC; K$>T;DRT>K# <JOQX³<JKeKU?B]RTyQU?d8U?Op<VK�, �V,�Z�<VR]BTSeP�;�> )�7N<(SÔ� �\%�/§<VO#X��cM�UVB ,� ���|KL; R�� )�X#; OQU?RT;kRTy#;ks#BTU?Ip<VI#SmKeSmR �Zt;=<?>A@#BC;�U?OV' $ 8 y#SLPCy�SL>­R]yQ;�KN<98 UVM � ,'�"�2~�3<: : :<3 � $ �r@#OQX#; BGv�)^7��|yQUS8��S���SeM �� �³�¨_�3�� )8�rRTyQ; O��5 � ��v�)l���SmS���SeM�� �+)>*4,�% /�� Se>�<�>T;Dn|@#;DOQPD;U?MrSmOQX#;Dsº;DO#X#;DO|R �½�¨_�3�6!��BC<VOQX#UVZ:[?<JBTSN<JI#KL;D>�<JOQX½SmM

�)Kb ��� U~ � 34343 � � U) � ~U RTy#;DO��) 5 � ,0w 6�<^7 >�72���SeSmS�� M�U?B <VKmK�IºU?@#O#X#;�X P�UVOcR]SeO|@QU?@#>�MN@#OQPDR]SLU?O#> �¿U?O ' $ ��� )^���2�Vw �(���2���&8 yQ;DBT;��ÁSe>xRTyQ;

>]RC<VOQXQ<VBTX±��<V@Q>]>]SL<VO�X^SL>ARTBTSmI#@#R]SLU?OYU?OV' $ 7

Page 51: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

� /���1 ����C´L�!�D�¨¬������ ´L�,¦g���,�]¬���� ´L� ¯µ¹D�]¥!�¨��� ��2�����]¯����¹D�]�g�T�,� ���T k¥�¦������������������ �"!¹D�]�g�T�,� ���T k¥�¦$#����°J���g !¤!®A�%�&����¨�©�»¯��'�%(

) ´N�,¦=�,���T¬����! � *� �%(�©¯»¹ �T¥!�,��� ��©¯�¬r�D�,��� ¶ �T��¦=¼)�g�T���+�,�-(�©¯�¬r�D�,�2�¨¤!�,�A¯»¦��.�-(�4� �!�D® �k�¨°!� ®A������/�2�]�¨�g�D¤g¯»¯»�|�,�g�µ¡£�%�,��/�2�»�10=�g��243 �|�©¯�¬r�D�,�o� ¶ �T��¦=¼)�g�T���#�T��¹D�= !�»®^�,�!�A�D�,�]¬�

�65�2�D�,�A¯73 �4�g���,¬­� ¯8�=¤!¬�¥J�T�4�,�!�A�D�,�]¬�.�"��2�D�,�A¯98!¸�� ���,�A¯»¯µ�8¯»�]¬­¬­� �-��:¥J��¤!�! g�T �®Ã�D� ¶ �]�,¹ �]�J®Ã�v�,�g�]�D�,�]¬����:¸�� �¨�©�¨��;�A�g g����¦<3 �3�%=g���]�J���»�D�k�,�g�]�D�,�]¬��>®Ã�T�D�¨�,� ¯o¯µ��¬r�µ�4�¨�g�A�����T¬��(��® �!� �¨� ®A���T�������,�»®�¡Ô¤!�!®A���»�D�.�&���¤J�g�*?=¤g�T�g�]�¨�-���+�¸��g�]¥�¦g�¨�g� ¶ 3 �2�»�g�"?=¤!�©¯»�µ�N¦+����(®Ã��¬r°!¯µ�]���]�!�]�¨�2�©¡���� �&��/®Ã���! g�»���»�D�!� ¯o�@=!°J�T®Ã�¨�©���»�D��]¯µ�T¬r�]���,�D��¦+����A®Ã���CB�¤g¹D� ��� ���! g��®Ã�]�-�&�+>®Ã��� ¶ �]�,¹ �T�!®Ã��J �D D�'�%(���E� � �&�������¬r�]� �¨¤!�,���.�-(����°!�,�D¥!�D¥g�µ¯»�»�N¦��.�%(®Ã���,�,�A¯��©�,�µ���.����A®Ã��¤!���,� ¥!¯µ¦l�D ! g�»��� ¶ �+���®Ã� ¶ � �,��� �!®A������A¬­� �,�,�9=.�&��A g�]�J���»�N¦��&��� g�D2?�T���T�D�,�»� ���»�D��¤!�! !�]�2�,�!�'�»�����]¹D�¨�©¯o�,�µ¹��.� �-: g�����¨����¥!¤g�,�µ���.� �"� g�D¬r���!�©�,�] �®Ã��� ¶ �]�,¹ �T�!®Ã�(�,�g�]�D�,�]¬�.�-:F(¦g��0����.3 � ´L�,¦g���,�]¬ ¯µ�T¬r¬­����>

� ¶ �T���%��:�@=!°J�T®Ã�¨�©���»�D� �.�">GV�©�,�D¤.3 �2¯»�]¬­¬­��� �"AGJ�D¤J���»�]�2�¨�,�D�!��¡£���,¬� ������ ¶ �]�¨�,�µ���.� �+�GV¤!¥g���g�73 �)�,�g�]�D�,�]¬��� �¡Ô¤!�!®Ã�,�µ����2�D�,�A¯7�.�-!® �!�D�,�D®Ã�,�]�,�»�,����®�� ���®A�D� ¶ �%=<����( g�T�!�,�µ�N¦+�&��� g���,�,�,�»¥!¤!���»�D�.� �C��������A¹��,�D¥g¯»���<�-/¬r�]�D�,¤J�,�D¥g¯µ�+�<�-!"��D g�]¬­�D® �g�]�-�<�-��,�»¬­°g¯»���'�">¡Ô¤!�! !�D¬��T���,�©¯c�,�g�]�D�,�]¬«� ¡^®A� ¯»®]¤g¯�¤!�%����!

H$I� ¯� g�T�%3 �2�»�!�-?=¤!�©¯»�»�N¦�����>�g�]� �J0 �]�¨�g�A¯7���+�H��»¯»¥V�]�,�)�,°J� ®Ã�+����/�»�! !�]°V�]�! g�T�!®Ã�+��:� ¡ � ´N�©¯»¹ �T¥!�,�D�%�K:� ¡#�¨� �! !�D¬ ¶ � �,�»�D¥g¯»�]�-�.�"��»�!�!�]�4°!�,�g !¤!®Ã�-�&��/�»�����]¹D�¨�©¯7�<�">¥!�D����® °!�,�D°V�]�,���»�]�-�.�C5�©�T�!���T�.3 �2�»�g�"?=¤!�©¯»�µ�N¦+����(L'� ¯�¬��D¹ ����� ¶ 3 �NMA�T��� ´e���g�v¯»�C¼O�.�-(¯»�C¼O�.�C�ª���=g��¬r� ¯o�]�,¹ �g g��®�¯»�]¬­¬­���&�65¬��T� �¨¤!�¨� ¥g¯»�v�,�A�-���¬��T� �¨¤!�,��� (� ´7PV�g�»���+��(�2�D�,�A¯7� ( g���¨®A�,�A���+� (��¬­�©¹ �+�.���QG�]¥V�]�,¹D¤g�+��>QG�]¥V�]�,¹D¤g�+�g�D�RTSU�����QG�]¥V�]�,¹D¤g�A´�+��,�µ�]¯µ�VB��]�-� �"�°!�,�g !¤!®A�%�&���"��D g�D� � (

�Ö

Page 52: ^7j 'BTd8UcX^SLP R]yQ; U?B]james/Lectures/prob.pdf · O (# ) (# # ) * ' b ·_

�\� �������������� ��

¬r�]� �¨¤!�,�ôN°!�,�]�,�]� ¶ ���g¹��,�¨� �!��¡£�D�¨¬­�©���»�D� �K�6>�T��¹D�g g�»®����+>ª�����0©�H¼)�10���3 �2�»�!�-?=¤!�©¯»�»�N¦�����>¬r�D�g�D���D�!� ®A¯»�D�,�2�¨�g�A�����T¬�.���¬r�D�g�D���D�!� ®A�D� ¶ �T��¹D�]�!®A���¨�g�A�����T¬��'�-/�g�D�¨¬�&��/�D�,�,�g�D¹ ���!�©¯7���+5°!� �¨�©¯»¯»�A¯»� ¹D�¨� ¬³¯��C¼O���+5°!�,�D¥!�D¥g�µ¯»�»�N¦l¬r�]� �¨¤!�,��� (À3¦=�,�J�©¹ ���,�D�%3=�¨¤g¯µ�+�&�+5�,�D�! g��¬ ¶ � �,�»�D¥g¯µ�+�.�"�

� �D¤!�¨����� �.����(�����g¹&������]�2¡Ô¤!�!®A���»�D�.������¨�����g¹­¯»�C¼��©¡^¯»�D��¹D�v�=¤!¬�¥J�T�,�-��(+!¡£���JPV�g�»��� ¡£��¤!�,�,� ¬���¬r�]���%���+:�,� �µ¯|�T���,�»¬­� �����,��(�,� �µ¯|� ¶ �T�D�-�.�%(¤!�g�µ¡£�D�¨¬ �������A¹��,�D¥g�»¯µ�»�N¦����+!¶ � �,�»�D�!®Ã�+����A¶ ���l%(�]¤!¬­� �J�.3 � �����T��¹D�= !�»®(�,�g�]�D�,�]¬����A