computational journalism at columbia, fall 2013, lecture 9: drawing conclusions from data

Upload: jonathan-stray

Post on 04-Jun-2018

215 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    1/71

    !"#$%&"' #)

    *#+,-./%#$/0 1#-"$/02'+

    *#0-+32/ 1#-"$/02'+ 456##0

    7&&8 9: ;"/

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    2/71

    F&5.-"& 9: ;"/

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    3/71

    ;/./ I#&'$M. ',&/8 )#" 2.'&0)

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    4/71

    G$.&","&%$= ;/./

    ;/./ N *#$.&O. PQ R&/$2$=

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    5/71

    G+,#"./$. $#.&

    S6&"& +/T 3& +#"& .6/$ #$& I&)&$'230&

    2$.&","&./%#$ #) / I/./ '&.U

    V-" =#/0 2$ .62' 50/'' 2' .# "-0& #-. !"#$%$"&!'($

    2$.&","&./%#$'U

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    6/71

    W#- '&& / '.#"T 2$ .6& I/./G' 2. "&/00T .6&"&X

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    7/71

    76T

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    8/71

    [#<

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    9/71

    G$.&$%#$/0 #" -$2$.&$%#$/0 ,"#30&+'

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    10/71

    76/.

    I#&'$M. /

    S

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    11/71

    >W*

    ,#,-0/%#$

    5#0#"&I 3T

    2$5#+&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    12/71

    G$.&"?2&< .6& ;/./

    76&"& I# .6&'& $-+3&"' 5#+& )"#+X 76# "&5#"I&I .6&+X [#

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    13/71

    _I?&$.-"&' 2$ !2&0I ;&J$2%#$'

    BCC` L0&5%#$A 2$ !0#"2I/A "&5#-$.&I 3T R/Y 7/2.& 2$ )*"#(!"+-*.* *'/0. 1*2$ *"# 3.4"!2!.56

    S6&"&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    14/71

    F&5.-"& 9: ;"/

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    15/71

    76/. './.' 8$#

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    16/71

    76256 #$& 2' "/$I#+X

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    17/71

    V$& './" ,&" 3#O e $#. "/$I#+

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    18/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    19/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    20/71

    76/.M' .6& ,"#3/3202.T #) "#002$= / @X

    fg@h P Di@

    _0'#: fgDh P Di@A fgBh P Di@A fgEh P Di@A fg`h P Di@A fgjh P Di@

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    21/71

    G' .62' I2& 0#/I&IX

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    22/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    23/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    24/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    25/71

    _"& .6&'& .

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    26/71

    S

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    27/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    28/71

    S

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    29/71

    G' '#+&.62$= 5/-'2$= 5/$5&"X

    */$5&" "/.& ,&" 5#-$.TU ;/"8&" P ="&/.&" 2$52I&$5& #) 5/$5&"U

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    30/71

    76256 #) .6&'& 2' "&/0 I/./X

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    31/71

    l0#3/0 .&+,&"/.-"& "&5#"I

    [#< 028&0T 2' 2. .6/. .6& .&+,&"/.-"& 7/"8.2$5"&/'& #?&" $&O. I&5/I&X

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    32/71

    !"#+ 94$ :!+"*( *"# .4$ ;/!&$A >/.& 420?&"

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    33/71

    G. 2' 5#$5&2?/30& .6/. .6& D` &0I&"0T ,,0&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    34/71

    _''-+2$= .6/. /3#-. `C ,&"5&$. #) &0I&"0T _+&"25/$'

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    35/71

    S6& ,"#3/3202%&' #) ,#002$=

    G) H#+$&T 2' .

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    36/71

    l2?&$:

    H P `9rA VP`ar

    RVLgHh P RVLgVh P sjUjr

    [#< 028&0T 2' 2. .6/. V3/+/ 2' /5.-/00T /6&/IX

    F&. ; P HdV P BrU S62' 2' /$ #3'&"?&I ?/0-&A /$I 2)

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    37/71

    4.IU I&? #) ; u RVLg;hiDU9@ /' RVL 2' \-#.&I /' 9jr 5#$JI&$5& 2$.&"?/0

    P sjUjrU

    wd'5#"& #) d; P dBrijUjr P dCUE@

    fgZtdCUEjh P CUE@A '# E@r 56/$5& / H#+$&T 2' $#. /6&/IA #" /3#-. D 2$ EU

    fgV3/+/ /6&/Ih fgH#+$&T /6&/Ih

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    38/71

    H/$I#+ [/,,&$'

    xv$028&0T .# 6/,,&$ 3T 56/$5&x 2' #$0T / =##I

    /"=-+&$. 2) T#-M?& &'%+/.&I .6& 56/$5&U

    _0'#: /B*>C20(*> 5#2$52I&$5& +/T 3& "/"&A 3-. &/@$5#2$52I&$5& '#+&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    39/71

    F&5.-"& 9: ;"/

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    40/71

    K&02&)

    x76/. T#- 3&02&?&x #" x

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    41/71

    K&02&):

    ,"#3/3202.T I2'."23-%#$ #?&" 6T,#.6&'&'

    LU=U G' .6& >Wf; ./"=&%$= +#'\-&' )#" '.#,d/$Id)"2'8X

    D

    C

    [C [D [B

    >&?&" H#-%$&0TV$5& #" .

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    42/71

    L?2I&$5&

    G$)#"+/%#$ .6/. z-'%J&' / 3&02&)U

    f"&'&$.&I

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    43/71

    4."&$=.6 #) L?2I&$5&

    G' 5#-=62$= '."#$= #"

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    44/71

    ;#$M. "&?&"'& ,"#3/3202%&'}

    G$ =&$&"/0 fg_|Kh ~ fgK|_h

    fg5#-=62$=|5#0Ih u CU9

    fg5#0I|5#-=62$=h u CUE

    K/T&'M .6"&+ =2?&' .6& "&0/%#$'62,

    fg_|Kh P fgK|_h fg_h i fgKh

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    45/71

    -/$%J&I '-,,#". )#" 6T,#.6&'&'

    [#< 028&0T 2' / 6T,#.6&'2' [A =2?&$ &?2I&$5& LX

    V"A

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    46/71

    K/T&' .6"&+:

    0&/"$2$= )"#+ &?2I&$5&

    f"g[|Lh P f"gL|[h f"g[h i f"gLh

    #"

    fg[|Lh P f"gL|[hif"gLh y f"g[h

    !"#$%"&''(

    [#< 028&0T 2' [

    =2?&$ &?2I&$5& LX

    *+"'+

    [#< 028&0T

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    47/71

    _025& 2' 5#-=62$=U ;#&' '6& 6/?& / 5#0IX

    [T,#.6&'2' [ P _025& 6/' / 5#0I

    L?2I&$5& L P

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    48/71

    _025& 2' 5#-=62$=U ;#&' '6& 6/?& / 5#0IX

    [T,#.6&'2' [ P _025& 6/' / 5#0I

    L?2I&$5& L P

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    49/71

    _025& 2' 5#-=62$=U ;#&' '6& 6/?& / 5#0IX

    fg[|Lh P fgL|[hfg[hifgLh

    P CU9 y CUCj i CUD

    P CU`j

    G) T#- 3&02&?& T#-" 2$2%/0 ,"#3/3202.T &'%+/.&'A T#-

    '6#-0I $#< 3&02&?& .6&"&M' / `jr 56/$5& '6& 6/' /

    5#0IU

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    50/71

    K2/'

    _ &5&.$@*C2.&$I&$5T .# ,"#I-5& /$ 2$5#""&5.

    /$'

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    51/71

    *#=$2%?& 32/'&'

    _?/20/3202.T 6&-"2'%5:

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    52/71

    *#$J"+/%#$ 32/'

    *#+&' 2$ +/$T )#"+'U

    UUU-$5#$'52#-'0T J0.&"2$= 2$)#"+/%#$ .6/. I#&'$M. J.

    &O,&5./%#$'U

    UUU$#. 0##82$= )#" 5#$."/"T 2$)#"+/%#$U

    UUU$#. 2+/=2$2$= .6& /0.&"$/%?&'U

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    53/71

    S6& .62$= /3#-. &?2I&$5&UUU

    _' .6& /+#-$. #) 2$)#"+/%#$ 2$5"&/'&'A 2. =&.'

    +#"& 028&0T .6/. '#+& 2$)#"+/%#$ '#+&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    54/71

    R&.6#I #) 5#+,&%$= 6T,#.6&'&'

    4./". gH&+&+3&"A 2) T#- 5/$M. 2+/=2$& 2.A T#- 5/$M. 5#$50-I& 2.}h

    l# 0##82$= )#" 2$)#"+/%#$ .6/. =2?&' T#- .6& 3&'./3202.T .# ("01+"2"345$3&.

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    55/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    56/71

    _ =##I +#I&0 6/' / .6"T #) .6&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    57/71

    F&5.-"& 9: ;"/

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    58/71

    76 . 2 x % xX

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    59/71

    76/. 2' x5/-'/%#$xX

    W

    {

    #3'&"?/30& .62$=

    .62$= 2$ .6&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    60/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    61/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    62/71

    l I J 6 2 2I X

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    63/71

    l-$' /$I J"&/"+ 6#+252I&'X

    W{

    2) T#- 6/?& / =-$A T#-M"& =#2$= .# -'& 2.

    W{

    2) 2.M' / I/$=&"#-' $&2=63#"6##IA T#-M00 3-T / =-$

    W{

    .6& 5#""&0/%#$ 2' I-& .# 56/$5&

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    64/71

    K&/-.T /$I "&',#$'&'

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    65/71

    K&/-.T /$I "&',#$'&'

    W{

    .&002$= /

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    66/71

    ,

    2$.&"?&$& 2$ / $&.

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    67/71

    ,,0& .# '6/"& 02$8'X

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    68/71

    _ I2m5-0. &O/+,0&

    >Wf; ,&")#"+' @CCACCC '."&&. '.#, /$I )"2'8'

    ,&" T&/"U

    76/. '#".' #) 5#$50-'2#$' 5#-0I

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    69/71

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    70/71

    4.#, /$I !"2'8 */-'/%#$

  • 8/14/2019 Computational Journalism at Columbia, Fall 2013, Lecture 9: Drawing Conclusions from Data

    71/71

    4.#, /$I !"2'8 */-'/%#$

    4-,,#'& T#- ./8& .6& /II"&'' #) &?&"T +#'\-&

    2$ >W*A /$I I2'5#?&" .6/. .6&"& /"& Djr +#"&

    '.#,d/$Id)"2'8'