connections between the lines: augmenting social …jbg/docs/kdd_pres.pdf · connections between...

Connections between the Lines:

Augmenting Social Networks with Text

Jonathan Chang, Jordan Boyd-Graber, David M. Blei

KDD 09

June 29th, 2009

Princeton UniversityIdentity Guidelines Signature or wordmark

WORDMARK

SIGNATURE

The signatureThe Princeton signature should be included on all offi cial Princeton publications.

It need not appear in a large or prominent position, but it should be included to signal a publication’s core relationship to Princeton.

The signature should be used in all situations that call for the Princeton “logo,” for instance on promotional materials for public events for which Princeton is the primary sponsor.

The wordmarkThe wordmark may be used alone in some situations. When the wordmark is used alone, the shield should also appear somewhere on the publication or item. It may be particularly useful to incorporate the wordmark separately from the shield in display settings or in less formal situations.

Digital art for the Princeton signature and wordmark is available to the Princeton community for use on publications relating to the University. Please visit our website (www.princeton.edu/identity) or contact Megan Peterson ([email protected] / 609-258-5730) or Laurel Masten Cantor ([email protected] / 609-258-5734) in the Offi ce of Communications for digital fi les.

6

Jonathan Chang, Jordan Boyd-Graber, David M. Blei Connections between the Lines

Motivation

Data that express relationships between ensembles of entities

(people, places, companies, genes, etc.) is pervasive.


Motivation

Annotating the edges of these networks with rich information is

often a desideratum.

Jonathan Chang

Jordan Boyd-GraberYou and Jordan both went to Princeton.


Motivation

Unfortunately, much of the rich information about links is encoded

implicitly as free text.

Example

In 1938, Wyman co-starred with Ronald Reagan. Reagan and actressJane Wyman were engaged at the Chicago Theater and married inGlendale, California. Following arguments about Reagan's politicalambitions, Wyman �led for divorce in 1948. Since Reagan is the onlyU.S. president to have been divorced, Wyman is the only ex-wife of anAmerican President.


Motivation

Using the text as input, our goal is to annotate a network with this

information.

Example

Ronald Reagan

Jane WymanYou and Jane used to be married.


Main idea

We de�ne a probabilistic model Networks Uncovered By

Bayesian Inference (Nubbi).

Using Nubbi, we can create a social network by discovering

relations over the ensemble of people.

Because Nubbi is a fully Bayesian approach, we can

incorporate information from other data-mining approaches as

priors (Agichtein and Gravano 2003; Diehl et al. 2007; Mei

et al. 2007; Sahay et al. 2008; Banko et al. 2007; Katrenko

and Adriaans 2007; Davidov et al. 2007).

Wikipedia

Joseph Stalin

Winston Churchill

Lyndon B. Johnson

Mao Zedong

Jimmy Carter

Margaret Thatcher

Ronald Reagan

Richard Nixon

Nikita KhrushchevJohn F. KennedyHubert

Humphrey

George H. W. Bush

Ross Perot

Leon Trotsky

Lev Kamenev

Zhou Enlai

Mikhail Gorbachev

labourgovernleaderbritishworld

sovietcommunist

centralunion

full

sovietrussiangovernunion

nuclear

republicanstate

federalistvotevice


A larger example...

lazio, rick arichter, mikewilder, l douglasforeman, georgemehta, zubinbhutto, benazirwright, jimolmert, ehudpinochet, augustohatch, orrin gberlin, irvingsouter, david htower, john ghusband, rick drisen, jamescharles, eleanorklebold, dylanrather, danmcmellon, edwardsaint laurent, yveshelms, jessespitzer, eliot lpanetta, leon ecolumbus, christopher

jesus christmcveigh, timothy jameso'neill, paulmartinez, pedrobarry, marion s jrels, erniechernomyrdin, viktor s

hynes, charles jewing, patrickmiers, harriet estein, andrew jaung san suu kyi, dawsilver, sheldonspecter, arlencoughlin, tomkennedy, john fitzgerald

rodman, dennischaney, donjames, caryn

lane, nathanhashimoto, ryutaro

lautenberg, frank r

giambi, jasonde klerk, f wmourning, alonzo

mapplethorpe, robert

glavine, tomwinfrey, oprahvan horn, keithjeter, derek

reagan, ronaldlimbaugh, rush

netanyahu, benjamin

law, bernard fsessions, william s

fujimori, alberto

ward, charliebarron, james

van gundy, jeff

musharraf, pervez

blair, jayson

valentine, bobby

rowland, john g

chass, murray

jacobs, marc

puccini, giacomo

gates, henry louis jr

staples, brent

baker, howard h jr

clark, wesley k

koch, edward i

canseco, jose

major, john

plame, valerie

o'neill, paul h

holyfield, evander

mills, ric

hard p

abdullahbush, la

ura

odeh, mohammed saddiq

kozlowski, l dennis

karadzic, radovan

salinas de gortari,

carlos

federer, roger

jospin, lio

nel

bennett, willia

m j

nader, ralph

jackson, m

ark

steinbrenner, g

eorge m 3d

steinberg, li

sa

velella

, guy j

moynihan, d

aniel patric

k

kahane, m

eir

khamenei, a

li

darman, ri

chard g

barber, tiki

friedman, th

omas l

bradley, bill

minaya, o

mar

goldin, harris

on j

hernandez,

orlando

brown, d

ave

reich, ro

bert b

smith

, willi

am k

scoppetta

, nich

olas

james

, sha

rpe

gore

, al

moi, da

niel a

rap

forbe

s, ste

ve

cher

toff, m

ichae

l

wolfow

itz, p

aul d

clark

, laur

el sa

lton

ashe

, arth

ur

vecs

ey, g

eorg

e

pirro

, jean

ine f

sulliv

an, a

ndre

w

man

tle, m

ickey

hank

s, to

m

robin

son,

jack

ie

bird,

larry

reno

, jane

t

edbe

rg, s

tefa

n

belki

n, lis

a

nuss

baum

, hed

da

blix,

han

s

hous

ton,

alla

n

carte

r, bi

ll

scow

crof

t, br

ent

gold

en, h

owar

d

quay

le, d

an

mor

gent

hau,

robe

rt m

taylo

r, la

wrenc

e

ovitz

, mich

ael

mur

doch

, rup

ert

dela

y, to

m

wagne

r, ric

hard

wells

tone

, pau

l

brod

y, ja

ne e

mce

nroe

, joh

n

kim

jong

il

river

a, m

aria

no

wel

ch, j

ohn

f jr

schu

ndle

r, br

et d

gree

n, m

ark

jiang

zem

in

kim

dae

jung

karz

ai, h

amid

roha

tyn,

felix

g

carlu

cci,

frank

c

kacz

ynsk

i, th

eodo

re j

biag

gi, m

ario

brun

i, fra

nk

bake

r, ja

mes

a 3

d

chav

ez, j

ulio

ces

ar

kant

or, m

icke

y

clem

ens,

roge

r

stei

nber

g, jo

el b

buffe

tt, w

arre

n e

paul

son,

hen

ry m

jr

gree

nhou

se, s

teve

n

klei

n, c

alvi

n

conn

er, d

enni

s

lette

rman

, dav

id

lam

ont,

ned

rice,

con

dole

ezza

sunu

nu, j

ohn

h

com

bs, s

ean

mill

er, a

rthu

r

brud

er, t

hom

as

mus

sina

, mik

e

freeh

, lou

is j

difra

nces

co, d

onal

d t

john

son,

lynd

on b

aine

s

pelo

si, n

ancy

mox

ley,

mar

tha

wei

cker

, low

ell p

jr

scot

t, by

ron

john

son,

mag

ic

geffe

n, d

avid

man

dela

, win

nie

falw

ell,

jerr

y

farr

akha

n, lo

uis

chre

tien,

jean

east

woo

d, c

lint

dean

, how

ard

florio

, jam

es j

mill

er, j

udith

war

d, b

enja

min

gret

zky,

way

ne

zedi

llo p

once

de

leon

, ern

esto

araf

at, y

asir

joyc

e, ja

mes

woo

dwar

d, b

ob

gree

n, r

icha

rd r

sum

mer

s, la

wre

nce

h

mus

cham

p, h

erbe

rt

izet

bego

vic,

alij

a

roth

, phi

lip

mar

tin, s

teve

abra

ms,

rob

ert

chira

c, ja

cque

s

sulli

van,

loui

s w

shev

ardn

adze

, edu

ard

a

star

r, ke

nnet

h w

rost

enko

wsk

i, da

n

thom

pson

, will

iam

c jr

was

sers

tein

, wen

dy

levi

n, c

arl

kris

tof,

nich

olas

d

rang

el, c

harle

s b

norie

ga, m

anue

l ant

onio

ali,

muh

amm

ad

mob

utu

sese

sek

o

gate

s, b

illja

mes

, leb

ron

pitin

o, r

ick

fehr

, don

ald

war

hol,

andy

robb

ins,

jero

me

dala

i lam

afe

inst

ein,

dia

nne

holtz

man

, eliz

abet

hke

nned

y, e

dwar

d m

pirr

o, je

anin

eva

nce,

cyr

us r

beck

er, b

oris

moo

re, m

icha

elgo

nzal

ez, e

lian

bare

nboi

m, d

anie

lhe

nder

son,

ric

key

john

, elto

ned

war

ds, j

ohn

win

erip

, mic

hael

padi

lla, j

ose

lew

is, a

ntho

nyab

ram

off,

jack

eisn

er, m

icha

el d

beck

ett,

sam

uel

fran

ks, b

obbo

nilla

, bob

bym

artin

ez, t

ino

sist

ani,

ali a

l−m

anni

ng, e

lish

alal

a, d

onna

efo

ley,

thom

as s

bide

n, jo

seph

r jr

eins

tein

, alb

ert

hart

, gar

yw

illia

ms,

ser

ena

harir

i, ra

fikfe

ld, e

liot

dole

, eliz

abet

h h

cosb

y, b

illfr

ist,

bill

alito

, sam

uel a

jrdi

ngel

l, jo

hn d

klei

n, jo

el i

purd

um, t

odd

san

ders

on, d

ave

mad

dox,

alto

n h

jrki

ng, w

ayne

mul

rone

y, b

rian

mbe

ki, t

habo

thur

mon

d, s

trom

mos

es, r

ober

tst

ern,

hen

ry j

shar

on, a

riel

mcg

reev

ey, j

ames

ero

bb, c

harle

s s

mal

vo, j

ohn

lee

noro

dom

sih

anou

kta

ubm

an, a

alfr

edre

dsto

ne, s

umne

r m

bern

stei

n, le

onar

dfie

lds,

c v

irgin

iabo

tste

in, l

eon

rove

, kar

lpe

rry,

will

iam

jm

arco

s, im

elda

shef

field

, gar

yhu

ssei

n i

ruth

, geo

rge

herm

an

cuom

o, m

ario

msc

hmitt

, eric

mor

ris, m

ark

mill

er, m

elvi

nth

omas

, isi

ahke

atin

g, c

harle

s h

jr

chal

abi,

ahm

ad

ceau

sesc

u, n

icol

ae

brok

aw, t

omsu

ozzi

, tho

mas

r

roh

tae

woo

o'ne

ill, e

ugen

e

petti

tte, a

ndy

polla

n, m

icha

el

rabi

n, y

itzha

k

leno

, jay

tagl

iabu

e, p

aul

rose

ntha

l, a

m

orte

ga s

aave

dra,

dan

iel

nort

h, o

liver

l

turn

er, t

edbl

umen

thal

, ral

ph

wal

ters

, bar

bara

hark

in, t

omhu

ssei

n, s

adda

m

mad

den,

john

glen

n, jo

hngo

lisan

o, b

thom

as

brya

nt, k

obe

brem

er, l

pau

l iii

mar

bury

, ste

phon

kelly

, ray

mon

d w

pick

ens,

t bo

one

jr

qadd

afi,

mua

mm

ar e

l−

dole

, bob

hing

is, m

artin

a

king

, rod

ney

glen

wils

on, a

ugus

t

bond

s, b

arry

mub

arak

, hos

ni

brad

sher

, kei

th

kean

, tho

mas

h

cole

man

, der

rick

brod

sky,

richa

rd l

sond

heim

, ste

phen

tom

mas

ini,

anth

ony

john

son,

ear

vin

gate

s, ro

bert

m

vince

nt, f

ay

philli

ps, s

teve

brow

n, je

rry

kabi

la, l

aure

nt

spre

well,

latre

ll

washi

ngto

n, d

esire

e

lewis,

lenn

ox

kush

ner,

tony

ma,

yo−y

o

whitm

an, c

hrist

ie

wiese

, tho

mas

leite

r, al

kasp

arov

, gar

ry

capr

iati, j

ennif

er

lee, s

pike

moli

nari,

guy

v

prim

akov

, yev

geny

m

shak

espe

are,

willi

am

duka

kis, m

ichae

l s

verd

i, gius

eppe

piazz

a, m

ike

yelts

in, b

oris

n

khat

ami, m

oham

mad

bush

, bar

bara

moham

ed, k

halfa

n kha

mis

dowd,

maure

en

lloyd

web

ber, a

ndre

w

norm

an, g

reg

meese

, edw

in 3d

patak

i, geo

rge e

gershwin, g

eorge

hitler, a

dolf

johnson, la

rry

volpe,

justin a

baker, r

ussell

domingo, placid

o

dinkins,

david n

baryshniko

v, mikh

ail

giamatti, a bartle

tt

leetch, b

rian

dole, robert j

weinberger, casp

ar w

kevo

rkian, ja

ck

paterno, joe

simon, n

eil

simpso

n, o j

gerstner, l

ouis v jr

masur, k

urt

ashcro

ft, john

soros,

george

dole, eliza

beth

jones, mario

n

schlesinger, arth

ur m jr

diana, prin

cess of wales

schroder, gerhard

walsh, lawrence e

lennon, john

gibson, mel

baker, al

gore, albert jr

brown, david m

spitzer, ellio

t l

miyazawa, kiichi

collins, glenn

mccartney, paul

torre, joe

ridge, tom

malone, john c

scalia, antonin

ackerman, felicia

lindros, eric

leonard, sugar ray

mutombo, dikembe

torricelli, r

obert g

aquino, corazon c

kim young sam

murphy, richard

fujimori, alberto k

martin, kenyon

hemingway, ernest

gotti, john

sciolino, elaine

belichick, bill

reagan, ronald wilson

weingarten, randi

milosevic, slobodan

hill, anita f

kerry, john

thomas, clarence

bettman, gary

stevens, scott

peres, shimon

picasso, pablo

bumiller, elisabeth

keller, bill

spielberg, steven

packwood, robert w

foster, vincent w jr

o'neal, shaquille

lipsyte, robert

weinstein, harvey

prodi, romano

papp, joseph

badillo, herman

canby, vincent

collins, kerry

pierce, samuel r jr

maliki, nuri kamal al−

graham, martha

van gogh, vincent

charles, prince of wales

li pengda silva, luiz inacio lula

bloomberg, michael r

savimbi, jonas

mickelson, phil

webber, chris

messinger, ruth w

dimaggio, joe

krugman, paul

riley, patmartin, billymcfarlane, robert c

ozawa, seijicamby, marcusnunn, samlewinsky, monica spowell, colin lstrahan, michaelwaldheim, kurtlevy, steveoates, joyce carolkemp, jack fsnow, john whun senbruno, joseph lcourier, jimellington, dukepoindexter, john mpopewhitman, christine toddwilson, petelevitt, arthur jrstern, davidmaslin, janetvolcker, paul a martin, curtis brown, edmund g jr pareles, jon graham, bob holland, bernard lopez, jennifer daly, john johnson, randy albee, edward brawley, tawana tsongas, paul e richardson, bill blair, tony waxman, henry a jones, paula corbin testaverde, vinny reagan, nancy levine, james fabricant, florence williams, ted hyde, henry j nichols, terry lynn

goss, porter j brooks, david sadr, moktada al−schilling, curt carter, jimmy koizumi, junichiro

perot, ross parcells, bill montana, joe gorbachev, mikhail skostunica, vojislavdeng xiaopingrowling, j k sabatini, gabriela

nicklaus, jacknixon, richard milhous

armey, dickmccain, john sroosevelt, theodore

ramon, ilanshamir, yitzhakbush, george whelmsley, harry b

al−'owhali, mohamed rashed daoud

cortines, ramon c

cheney, dickholik, bobby

messier, markwhitehead, mary beth

crew, rudyhosokawa, morihiro

altman, robert

mamet, davidcasey, william j

christo pear, roberthastert, j dennis

shultz, george p

woods, tiger

thompson, tommy g

bentsen, lloyd

cashman, brian

mccain, john

harris, katherine

safire, william

jeffords, james m

jobs, steven p

oakley, charles

ferraro, geraldine a

robertson, pat

johns, jasper

schiavo, terri

thornburgh, richard l

wilson, michael

singh, vijay

starks, john

ravitch, richard

rose, pete

wilson, joseph c iv

havel, vaclav

o'connor, john

carey, mariah

diallo, amadou

fox, vicente

glass, philip

malcolm x

marsalis, wynton

sand, leonard b

thatcher, margaret h

martins, peter

o'neill, william a

kennedy, john f jr

anderson, kenny

king, don

gandhi, rajiv

stalin, joseph

armani, giorgio

buckley, william f jr

spano, andrew j

williams, bernie

clinton, bill

simon, paul

karpov, anatoly

kidd, jason

bowman, patricia

stoppard, tom

rodriguez, alex

hartocollis, anemona

mcconnell, m

itch

armstrong, lance

rosenbaum, yankel

ahern, bertie

jennings, peter

pollock, jackson

regan, edward v

versace, gianni

lauder, ronald s

karan, donna

warner, john w

le pen, jean−marie

tudjman, franjo

fernandez, joseph a

schwarz, charles

shostakovich, dmitri

louima, abner

kalikow, peter s

chavez, hugo

cuomo, andrew m

ebbers, bernard j

rocker, john

norton, gale

herbert, bob

robertson, marion g

safir, howard

lieberman, joseph i

mailer, norm

an

ferguson, colin

kwan, m

ichelle

pavarotti, luciano

gates, william

h

mccall, h carl

lott, trent

forrester, douglas r

zemin, jiang

franco, john

mladic, ratko

gooden, dwight

wiesel, elie

steinbrenner, george

scorsese, martin

castro, fidel

bork, robert h

lauren, ralph

william

s, tennessee

gordon, jeff

eisenhower, dw

ight david

collor de mello, fernando

abdel rahman, om

ar

navratilova, martina

helmsley, leona

bush, jeb

brady, nicholas f

ford, gerald rudolph jr

shevardnadze, eduard

kerry, john f

strawberry, darryl

allen, woody

jagr, jaromir

rafsanjani, hashemi

hu jintao

salameh, m

ohamm

ed a

adams, john

madonna

farrow, m

ia

bolton, john r

wilson, valerie plam

e

griffith, michael

menendez, robert

mugabe, robert

wilpon, fred

weiner, tim

boxer, barbara

reid, harry

lagerfeld, karl

greenspan, alan

khodorkovsky, mikhail b

perelman, ronald o

fassel, jim

de niro, robert

putin, vladimir

harding, tonya

bush, george w.

sather, glen

bowe, riddick

mcnally, terrence

deaver, michael k

rehnquist, william

h

quindlen, anna

jackson, thomas penfield

botha, p w

perez de cuellar, javier

adams, gerry

handel, george frederick

pennington, chad

barak, ehud

zedillo, ernesto

tierney, johnkerrigan, nancy

brown, larry

matsui, hideki

jefferson, thomas

chun doo hwan

zuckerman, m

ortimer b

bakker, jimbalanchine, georgealexander, lam

arfreud, sigm

undchang, m

ichaelhevesi, alan gjohnson, philipcrew

, rudolph fagassi, andrepresley, elvisicahn, carl cbrow

n, ronald hw

ilson, robertchilds, chrislew

is, neil atharp, tw

ylaroosevelt, franklin delanow

eill, sanford ikerkorian, kirkm

uhamm

ad, john allennajibullahw

illiams, jayson

dodd, christopher jtaylor, charlescone, davidpol poto'connor, sandra daygoldm

an, ronald lyleerlanger, stevenking, stephenonassis, jacqueline kennedygoodnough, abbyharris, ericsolom

on, deborahsandom

ir, richardkaye, judith slay, kenneth lrandolph, w

illiecarter, vincestrauss, richardcham

orro, violeta barrios decorzine, jon sholbrooke, richard csinatra, frankbuchanan, patrick jgrasso, richard aahm

adinejad, mahm

oudw

ashington, georgebush, georgefox quesada, vicentegram

m, phil

spitzer, eliotfitzw

ater, marlin

sorenstam, annika

edwards, herm

anjackson, m

ichaelvan natta, don jrtrum

an, harry sabbas, m

ahmoud

cooper, michael

diller, barryboss, kennethseles, m

onicam

andela, nelson r

rumsfeld, donald h

weinstein, jack b

gingrich, newt

aspin, lesm

enem, carlos saul

kissinger, henry a

cage, johnbabbitt, bruce

schumer, charles e

assad, bashar al−

boutros−ghali, boutros

simm

s, phillipton, eric

newm

an, paul

mcgw

ire, mark

lee, wen ho

leahy, patrick j

grassley, charles e

libeskind, daniel

gephardt, richard a

brown, lee p

vacco, dennis c

rell, m jodi

tyson, mike

davis, grayo'donnell, rosie

roberts, john g jr

clinton, hillary rodham

goetz, bernhard hugo

stephanopoulos, george

aziz, tariqlew

insky, monica

iacocca, lee a

feiner, paul

smith, w

illiam kennedy

cunningham, m

erce

khomeini, ruhollah

skilling, jeffrey k

showalter, buck

samaranch, juan antonio

abraham, spencer

springsteen, bruce

davenport, lindsay

monroe, m

arilyn

rohde, david

gonzales, alberto r

romney, m

itt

lemieux, m

ario

trump, donald j

pearl, daniel

jackson, bo

kerik, bernard b

mason, c vernon

lewis, carl

gulotta, thomas s

maazel, lorin

lugar, richard g

lincoln, abraham

de la hoya, oscar

lewis, michael

jackson, jesse l

berlusconi, silvio

suhartowachtler, sol

aoun, michel

lendl, ivan

rushdie, salman

mandela, nelson

holden, stephen

chen shui−bian

albright, madeleine k

gotbaum, betsy

hanover, donna

tenet, george j

cardoso, fernando henrique

piniella, lou

sampras, pete

kimmelman, michael

walesa, lech

mozart, wolfgang amadeus

barkley, charles

levy, harold o

byrd, robert c

jones, roy jr

shays, christopher

cohen, william s

mueller, robert s iii

mitterrand, francois

ginsburg, ruth bader

elizabeth ii, queen of great britain

williams, venus

brodeur, martin

el−hage, wadih

aristide, jean−bertrand

feingold, russell d

hawkins, yusuf k

beethoven, ludwig van

carroll, sean

kerrey, bob

giuliani, rudolph w

cruise, tom

stewart, martha

john paul ii

berke, richard l

graf, steffi

mitchell, george j

chawla, kalpana

maxwell, robert

winfield, dave

o'rourke, andrew p

nelson, lemrick jr

rodgers, richard

kohl, helmut

koppel, ted

rubin, robert e

stern, howard

clinton, chelsea

wright, frank lloyd

d'amato, alfonse m

rich, frank

annan, kofi

jackson, phil

putin, vladimir v

irabu, hideki

weiner, anthony d

miller, gifford

sharpton, al

johnson, keyshawn

hubbell, webster l

egan, edward m

libby, i lewis jr

obama, barack

johnson, ben

roddick, andy

bin laden, osama

brozan, nadine

boesky, ivan f

connors, jimmy

schwarzenegger, arnold

white, mary jo

ryan, george

mattingly, don

weld, william f

sosa, sammy

silverstein, larry a

wells, david

mccool, william c

traub, james

bratton, william j

sweeney, john j

daschle, tom

milken, michael r

ryan, nolan

blumenthal, richard

moussaoui, zacarias

jordan, michael

vallone, peter f

dylan, bob

christopher, warren m

codey, richard j

pagones, steven a

dershowitz, alan m

hewitt, lleyton

selig, budassad, hafez al−

bach, johann sebastian

altman, lawrence k

gehry, frankzimmer, richard a

daley, richard m

broad, william jbrady, lois smithsimpson, nicole brown

zarqawi, abu musab al−

reeves, dantrump, donaldiverson, allenknoblauch, chuckking, martin luther jrkennedy, anthony mkasparov, garykoresh, davidbenedict xvimarcos, ferdinand eferrer, fernando


Topic Models

Nubbi leverages the machinery of topic modeling (Blei et al.

2003; Hofmann 1999; Steyvers and Gri�ths 2007), Bayesian

mixture models of discrete data.

Topic models have emerged as powerful tools for unsupervised

analysis of large document collections.

The multinomial parameters of the mixture components are

known as \topics."

Example (NYTimes using LDA)

law art politics sports

lawyer music republican game

justice �lm democrat coach

judge artist senate player

investigate art campaign play

prosecutor ballet mayor match


Model input

We take as input text whose references to entities have been

identi�ed, and convert this into a collection of documents.

1 When Jesus had spoken these words, he went forth with his disciples over the brook Cedron, where was a garden, into the which he entered, and his disciples.

2 And Judas also, which betrayed him, knew the place: for Jesus ofttimes resorted thither with his disciples.

3 Judas then, having received a band of men and officers from the chief priests and Pharisees, cometh thither with lanterns and torches and weapons.

4 Jesus therefore, knowing all things that should come upon him, went forth, and said unto them, Whom seek ye?

5 They answered him, Jesus of Nazareth. Jesus saith unto them, I am he. And Judas also, which betrayed him, stood with them.

6 As soon then as he had said unto them, I am he, they went backward, and fell to the ground.

7 Then asked he them again, Whom seek ye? And they said, Jesus of Nazareth.


Model input








received band officers chief priests Pharisees lanterns

torches weapons

spoken words disciples brook Cedron garden enter disciples knowing things

seek asked seek NazarethJesus

Judas


Model input








betrayed knew place disciples answered Nazareth saith betrayed

Jesusand

Judas


Intuition

Both individuals and pairs of people can be described by

topics.

Nubbi hypothesizes that each word in a pair context describes

either one of the entities or their relationship.

In 1938, Wyman co-starred with Ronald Reagan. Reagan and

actress Jane Wyman were engaged at the Chicago Theater and

married in Glendale, California. Following arguments about

Reagan's political ambitions, Wyman �led for divorce in 1948.

Since Reagan is the only U.S. president to have been divorced,

Wyman is the only ex-wife of an American President.


Intuition

Red words can be explained by a politics topic.

Blue words can be explained by an acting topic.

politics words can be attributed to Ronald Reagan.

acting words can be attributed to either

Ronald Reagan or Jane Wyman.

The remaining words characterize their relationship.

In 1938, Wyman co-starred with Ronald Reagan. Reagan and

actress Jane Wyman were engaged at the Chicago Theater and

married in Glendale, California. Following arguments about

Reagan's political ambitions, Wyman �led for divorce in 1948.

Since Reagan is the only U.S. president to have been divorced,

Wyman is the only ex-wife of an American President.


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''

N entity contexts M pair contexts Kψ relationship topicsKθ entity topics

These intuitions are encoded in this graphical model.


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''


We must then infer the posterior probability over the hidden

variables (e.g., the hidden topics and the assignments of

topics to people and relationships) given the data.


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''


The posterior lacks the structure for e�cient computation, so

exact posterior inference is intractable. We appeal instead to

mean-�eld variational inference (Jordan et al. 1999).


Bible Topics

Relationships are described by relationship topics

(c.f. Bhattacharya et al. 2008; Newman et al. 2006; Rosen-Zvi

et al. 2004; Culotta et al. 2005; Rabbat et al. 2006).

Topics cluster words which are used to describe similar

relationships and pairs who participate in similar relationships.

People in the Bible

Topic 1 Topic 2

Jacob-Laban Adonizedek-Piram

Top pairs Miriam-Moses Abraham-Birsha

Ishmael-Sarah Birsha-Lot

wife king

abraham cave

Top words daughter lord

child smote

call great


Describing relationships

Nubbi can predict words in each entity pair's text pro�le.

This describes the relationship between the entities.

●

●

●

●

6 8 10 12 14 16 18

−5.

9−

5.8

−5.

7−

5.6

−5.

5−

5.4

biological

Number of topics

Wor

d P

redi

ctio

n Lo

g Li

kelih

ood

●

●

●

●

6 8 10 12 14 16 18

−6.

5−

6.4

−6.

3−

6.2

−6.

1−

6.0

−5.

9

bible

Number of topics

●

●

●

●

6 8 10 12 14 16 18

−7.

5−

7.0

−6.

5

wikipedia

Number of topics

● Nubbi Author−Topic LDA Unigram Mutual


Predicting entities

Nubbi can also predict which entities are best described by a text

pro�le.

●

●

●

●

6 8 10 12 14 16 18

−6.

0−

5.5

−5.

0−

4.5

−4.

0

biological

Number of topics

Ent

ity P

redi

ctio

n Lo

g Li

kelih

ood

●

●●

●

6 8 10 12 14 16 18

−6.

5−

6.0

−5.

5

bible

Number of topics

●

●

●●

6 8 10 12 14 16 18

−7.

0−

6.5

−6.

0−

5.5

−5.

0−

4.5

−4.

0

wikipedia

Number of topics

● Nubbi Author−Topic LDA Unigram Mutual


NY Times social network



hynes, charles jewing, patrickmiers, harriet estein, andrew jaung san suu kyi, dawsilver, sheldonspecter, arlencoughlin, tomkennedy, john fitzgerald

rodman, dennischaney, donjames, caryn

lane, nathanhashimoto, ryutaro

lautenberg, frank r



glavine, tomwinfrey, oprahvan horn, keithjeter, derek

reagan, ronaldlimbaugh, rush

netanyahu, benjamin

law, bernard fsessions, william s

fujimori, alberto

ward, charliebarron, james

van gundy, jeff

musharraf, pervez

blair, jayson

valentine, bobby

rowland, john g

chass, murray

jacobs, marc

puccini, giacomo

gates, henry louis jr

staples, brent

baker, howard h jr

clark, wesley k

koch, edward i

canseco, jose

major, john

plame, valerie

o'neill, paul h

holyfield, evander

mills, ric

hard p

abdullahbush, la

ura


kozlowski, l dennis

karadzic, radovan

salinas de gortari,

carlos

federer, roger

jospin, lio

nel

bennett, willia

m j

nader, ralph

jackson, m

ark

steinbrenner, g

eorge m 3d

steinberg, li

sa

velella

, guy j

moynihan, d

aniel patric

k

kahane, m

eir

khamenei, a

li

darman, ri

chard g

barber, tiki

friedman, th

omas l

bradley, bill

minaya, o

mar

goldin, harris

on j

hernandez,

orlando

brown, d

ave

reich, ro

bert b

smith

, willi

am k

scoppetta

, nich

olas

james

, sha

rpe

gore

, al

moi, da

niel a

rap

forbe

s, ste

ve

cher

toff, m

ichae

l

wolfow

itz, p

aul d

clark

, laur

el sa

lton

ashe

, arth

ur

vecs

ey, g

eorg

e

pirro

, jean

ine f

sulliv

an, a

ndre

w

man

tle, m

ickey

hank

s, to

m

robin

son,

jack

ie

bird,

larry

reno

, jane

t

edbe

rg, s

tefa

n

belki

n, lis

a

nuss

baum

, hed

da

blix,

han

s

hous

ton,

alla

n

carte

r, bi

ll

scow

crof

t, br

ent

gold

en, h

owar

d

quay

le, d

an

mor

gent

hau,

robe

rt m

taylo

r, la

wrenc

e

ovitz

, mich

ael

mur

doch

, rup

ert

dela

y, to

m

wagne

r, ric

hard

wells

tone

, pau

l

brod

y, ja

ne e

mce

nroe

, joh

n

kim

jong

il

river

a, m

aria

no

wel

ch, j

ohn

f jr

schu

ndle

r, br

et d

gree

n, m

ark

jiang

zem

in

kim

dae

jung

karz

ai, h

amid

roha

tyn,

felix

g

carlu

cci,

frank

c

kacz

ynsk

i, th

eodo

re j

biag

gi, m

ario

brun

i, fra

nk

bake

r, ja

mes

a 3

d

chav

ez, j

ulio

ces

ar

kant

or, m

icke

y

clem

ens,

roge

r

stei

nber

g, jo

el b

buffe

tt, w

arre

n e

paul

son,

hen

ry m

jr

gree

nhou

se, s

teve

n

klei

n, c

alvi

n

conn

er, d

enni

s

lette

rman

, dav

id

lam

ont,

ned

rice,

con

dole

ezza

sunu

nu, j

ohn

h

com

bs, s

ean

mill

er, a

rthu

r

brud

er, t

hom

as

mus

sina

, mik

e

freeh

, lou

is j

difra

nces

co, d

onal

d t

john

son,

lynd

on b

aine

s

pelo

si, n

ancy

mox

ley,

mar

tha

wei

cker

, low

ell p

jr

scot

t, by

ron

john

son,

mag

ic

geffe

n, d

avid

man

dela

, win

nie

falw

ell,

jerr

y

farr

akha

n, lo

uis

chre

tien,

jean

east

woo

d, c

lint

dean

, how

ard

florio

, jam

es j

mill

er, j

udith

war

d, b

enja

min

gret

zky,

way

ne

zedi

llo p

once

de

leon

, ern

esto

araf

at, y

asir

joyc

e, ja

mes

woo

dwar

d, b

ob

gree

n, r

icha

rd r

sum

mer

s, la

wre

nce

h

mus

cham

p, h

erbe

rt

izet

bego

vic,

alij

a

roth

, phi

lip

mar

tin, s

teve

abra

ms,

rob

ert

chira

c, ja

cque

s

sulli

van,

loui

s w

shev

ardn

adze

, edu

ard

a

star

r, ke

nnet

h w

rost

enko

wsk

i, da

n

thom

pson

, will

iam

c jr

was

sers

tein

, wen

dy

levi

n, c

arl

kris

tof,

nich

olas

d

rang

el, c

harle

s b

norie

ga, m

anue

l ant

onio

ali,

muh

amm

ad

mob

utu

sese

sek

o

gate

s, b

illja

mes

, leb

ron

pitin

o, r

ick

fehr

, don

ald

war

hol,

andy

robb

ins,

jero

me

dala

i lam

afe

inst

ein,

dia

nne

holtz

man

, eliz

abet

hke

nned

y, e

dwar

d m

pirr

o, je

anin

eva

nce,

cyr

us r

beck

er, b

oris

moo

re, m

icha

elgo

nzal

ez, e

lian

bare

nboi

m, d

anie

lhe

nder

son,

ric

key

john

, elto

ned

war

ds, j

ohn

win

erip

, mic

hael

padi

lla, j

ose

lew

is, a

ntho

nyab

ram

off,

jack

eisn

er, m

icha

el d

beck

ett,

sam

uel

fran

ks, b

obbo

nilla

, bob

bym

artin

ez, t

ino

sist

ani,

ali a

l−m

anni

ng, e

lish

alal

a, d

onna

efo

ley,

thom

as s

bide

n, jo

seph

r jr

eins

tein

, alb

ert

hart

, gar

yw

illia

ms,

ser

ena

harir

i, ra

fikfe

ld, e

liot

dole

, eliz

abet

h h

cosb

y, b

illfr

ist,

bill

alito

, sam

uel a

jrdi

ngel

l, jo

hn d

klei

n, jo

el i

purd

um, t

odd

san

ders

on, d

ave

mad

dox,

alto

n h

jrki

ng, w

ayne

mul

rone

y, b

rian

mbe

ki, t

habo

thur

mon

d, s

trom

mos

es, r

ober

tst

ern,

hen

ry j

shar

on, a

riel

mcg

reev

ey, j

ames

ero

bb, c

harle

s s

mal

vo, j

ohn

lee

noro

dom

sih

anou

kta

ubm

an, a

alfr

edre

dsto

ne, s

umne

r m

bern

stei

n, le

onar

dfie

lds,

c v

irgin

iabo

tste

in, l

eon

rove

, kar

lpe

rry,

will

iam

jm

arco

s, im

elda

shef

field

, gar

yhu

ssei

n i

ruth

, geo

rge

herm

an

cuom

o, m

ario

msc

hmitt

, eric

mor

ris, m

ark

mill

er, m

elvi

nth

omas

, isi

ahke

atin

g, c

harle

s h

jr

chal

abi,

ahm

ad

ceau

sesc

u, n

icol

ae

brok

aw, t

omsu

ozzi

, tho

mas

r

roh

tae

woo

o'ne

ill, e

ugen

e

petti

tte, a

ndy

polla

n, m

icha

el

rabi

n, y

itzha

k

leno

, jay

tagl

iabu

e, p

aul

rose

ntha

l, a

m

orte

ga s

aave

dra,

dan

iel

nort

h, o

liver

l

turn

er, t

edbl

umen

thal

, ral

ph

wal

ters

, bar

bara

hark

in, t

omhu

ssei

n, s

adda

m

mad

den,

john

glen

n, jo

hngo

lisan

o, b

thom

as

brya

nt, k

obe

brem

er, l

pau

l iii

mar

bury

, ste

phon

kelly

, ray

mon

d w

pick

ens,

t bo

one

jr

qadd

afi,

mua

mm

ar e

l−

dole

, bob

hing

is, m

artin

a

king

, rod

ney

glen

wils

on, a

ugus

t

bond

s, b

arry

mub

arak

, hos

ni

brad

sher

, kei

th

kean

, tho

mas

h

cole

man

, der

rick

brod

sky,

richa

rd l

sond

heim

, ste

phen

tom

mas

ini,

anth

ony

john

son,

ear

vin

gate

s, ro

bert

m

vince

nt, f

ay

philli

ps, s

teve

brow

n, je

rry

kabi

la, l

aure

nt

spre

well,

latre

ll

washi

ngto

n, d

esire

e

lewis,

lenn

ox

kush

ner,

tony

ma,

yo−y

o

whitm

an, c

hrist

ie

wiese

, tho

mas

leite

r, al

kasp

arov

, gar

ry

capr

iati, j

ennif

er

lee, s

pike

moli

nari,

guy

v

prim

akov

, yev

geny

m

shak

espe

are,

willi

am

duka

kis, m

ichae

l s

verd

i, gius

eppe

piazz

a, m

ike

yelts

in, b

oris

n

khat

ami, m

oham

mad

bush

, bar

bara

moham

ed, k

halfa

n kha

mis

dowd,

maure

en

lloyd

web

ber, a

ndre

w

norm

an, g

reg

meese

, edw

in 3d

patak

i, geo

rge e

gershwin, g

eorge

hitler, a

dolf

johnson, la

rry

volpe,

justin a

baker, r

ussell

domingo, placid

o

dinkins,

david n

baryshniko

v, mikh

ail

giamatti, a bartle

tt

leetch, b

rian

dole, robert j

weinberger, casp

ar w

kevo

rkian, ja

ck

paterno, joe

simon, n

eil

simpso

n, o j

gerstner, l

ouis v jr

masur, k

urt

ashcro

ft, john

soros,

george

dole, eliza

beth

jones, mario

n

schlesinger, arth

ur m jr

diana, prin

cess of wales

schroder, gerhard

walsh, lawrence e

lennon, john

gibson, mel

baker, al

gore, albert jr

brown, david m

spitzer, ellio

t l

miyazawa, kiichi

collins, glenn

mccartney, paul

torre, joe

ridge, tom

malone, john c

scalia, antonin

ackerman, felicia

lindros, eric

leonard, sugar ray

mutombo, dikembe

torricelli, r

obert g

aquino, corazon c

kim young sam

murphy, richard

fujimori, alberto k

martin, kenyon

hemingway, ernest

gotti, john

sciolino, elaine

belichick, bill


weingarten, randi

milosevic, slobodan

hill, anita f

kerry, john

thomas, clarence

bettman, gary

stevens, scott

peres, shimon

picasso, pablo

bumiller, elisabeth

keller, bill

spielberg, steven

packwood, robert w


o'neal, shaquille

lipsyte, robert

weinstein, harvey

prodi, romano

papp, joseph

badillo, herman

canby, vincent

collins, kerry

pierce, samuel r jr

maliki, nuri kamal al−

graham, martha

van gogh, vincent


li pengda silva, luiz inacio lula


savimbi, jonas

mickelson, phil

webber, chris

messinger, ruth w

dimaggio, joe

krugman, paul

riley, patmartin, billymcfarlane, robert c

ozawa, seijicamby, marcusnunn, samlewinsky, monica spowell, colin lstrahan, michaelwaldheim, kurtlevy, steveoates, joyce carolkemp, jack fsnow, john whun senbruno, joseph lcourier, jimellington, dukepoindexter, john mpopewhitman, christine toddwilson, petelevitt, arthur jrstern, davidmaslin, janetvolcker, paul a martin, curtis brown, edmund g jr pareles, jon graham, bob holland, bernard lopez, jennifer daly, john johnson, randy albee, edward brawley, tawana tsongas, paul e richardson, bill blair, tony waxman, henry a jones, paula corbin testaverde, vinny reagan, nancy levine, james fabricant, florence williams, ted hyde, henry j nichols, terry lynn

goss, porter j brooks, david sadr, moktada al−schilling, curt carter, jimmy koizumi, junichiro

perot, ross parcells, bill montana, joe gorbachev, mikhail skostunica, vojislavdeng xiaopingrowling, j k sabatini, gabriela



ramon, ilanshamir, yitzhakbush, george whelmsley, harry b

al−'owhali, mohamed rashed daoud

cortines, ramon c


messier, markwhitehead, mary beth


altman, robert

mamet, davidcasey, william j

christo pear, roberthastert, j dennis

shultz, george p

woods, tiger

thompson, tommy g

bentsen, lloyd

cashman, brian

mccain, john

harris, katherine

safire, william

jeffords, james m

jobs, steven p

oakley, charles


robertson, pat

johns, jasper

schiavo, terri


wilson, michael

singh, vijay

starks, john

ravitch, richard

rose, pete

wilson, joseph c iv

havel, vaclav

o'connor, john

carey, mariah

diallo, amadou

fox, vicente

glass, philip

malcolm x

marsalis, wynton

sand, leonard b


martins, peter

o'neill, william a

kennedy, john f jr

anderson, kenny

king, don

gandhi, rajiv

stalin, joseph

armani, giorgio


spano, andrew j

williams, bernie

clinton, bill

simon, paul

karpov, anatoly

kidd, jason

bowman, patricia

stoppard, tom

rodriguez, alex


mcconnell, m

itch

armstrong, lance

rosenbaum, yankel

ahern, bertie

jennings, peter

pollock, jackson

regan, edward v

versace, gianni

lauder, ronald s

karan, donna

warner, john w

le pen, jean−marie

tudjman, franjo

fernandez, joseph a

schwarz, charles


louima, abner

kalikow, peter s

chavez, hugo

cuomo, andrew m

ebbers, bernard j

rocker, john

norton, gale

herbert, bob

robertson, marion g

safir, howard

lieberman, joseph i

mailer, norm

an

ferguson, colin

kwan, m

ichelle

pavarotti, luciano

gates, william

h

mccall, h carl

lott, trent


zemin, jiang

franco, john

mladic, ratko

gooden, dwight

wiesel, elie

steinbrenner, george

scorsese, martin

castro, fidel

bork, robert h

lauren, ralph

william

s, tennessee

gordon, jeff

eisenhower, dw

ight david

collor de mello, fernando

abdel rahman, om

ar

navratilova, martina

helmsley, leona

bush, jeb

brady, nicholas f

ford, gerald rudolph jr

shevardnadze, eduard

kerry, john f

strawberry, darryl

allen, woody

jagr, jaromir

rafsanjani, hashemi

hu jintao

salameh, m

ohamm

ed a

adams, john

madonna

farrow, m

ia

bolton, john r

wilson, valerie plam

e

griffith, michael

menendez, robert

mugabe, robert

wilpon, fred

weiner, tim

boxer, barbara

reid, harry

lagerfeld, karl

greenspan, alan

khodorkovsky, mikhail b

perelman, ronald o

fassel, jim

de niro, robert

putin, vladimir

harding, tonya

bush, george w.

sather, glen

bowe, riddick

mcnally, terrence

deaver, michael k

rehnquist, william

h

quindlen, anna

jackson, thomas penfield

botha, p w

perez de cuellar, javier

adams, gerry

handel, george frederick

pennington, chad

barak, ehud

zedillo, ernesto

tierney, johnkerrigan, nancy

brown, larry

matsui, hideki

jefferson, thomas

chun doo hwan

zuckerman, m

ortimer b

bakker, jimbalanchine, georgealexander, lam

arfreud, sigm

undchang, m

ichaelhevesi, alan gjohnson, philipcrew

, rudolph fagassi, andrepresley, elvisicahn, carl cbrow

n, ronald hw

ilson, robertchilds, chrislew

is, neil atharp, tw

ylaroosevelt, franklin delanow

eill, sanford ikerkorian, kirkm

uhamm

ad, john allennajibullahw

illiams, jayson

dodd, christopher jtaylor, charlescone, davidpol poto'connor, sandra daygoldm

an, ronald lyleerlanger, stevenking, stephenonassis, jacqueline kennedygoodnough, abbyharris, ericsolom

on, deborahsandom

ir, richardkaye, judith slay, kenneth lrandolph, w

illiecarter, vincestrauss, richardcham

orro, violeta barrios decorzine, jon sholbrooke, richard csinatra, frankbuchanan, patrick jgrasso, richard aahm

adinejad, mahm

oudw

ashington, georgebush, georgefox quesada, vicentegram

m, phil

spitzer, eliotfitzw

ater, marlin

sorenstam, annika

edwards, herm

anjackson, m

ichaelvan natta, don jrtrum

an, harry sabbas, m

ahmoud

cooper, michael

diller, barryboss, kennethseles, m

onicam

andela, nelson r

rumsfeld, donald h

weinstein, jack b

gingrich, newt

aspin, lesm

enem, carlos saul

kissinger, henry a

cage, johnbabbitt, bruce

schumer, charles e

assad, bashar al−

boutros−ghali, boutros

simm

s, phillipton, eric

newm

an, paul

mcgw

ire, mark

lee, wen ho

leahy, patrick j

grassley, charles e

libeskind, daniel

gephardt, richard a

brown, lee p

vacco, dennis c

rell, m jodi

tyson, mike

davis, grayo'donnell, rosie

roberts, john g jr

clinton, hillary rodham

goetz, bernhard hugo

stephanopoulos, george

aziz, tariqlew

insky, monica

iacocca, lee a

feiner, paul

smith, w

illiam kennedy

cunningham, m

erce

khomeini, ruhollah

skilling, jeffrey k

showalter, buck


abraham, spencer

springsteen, bruce

davenport, lindsay

monroe, m

arilyn

rohde, david

gonzales, alberto r

romney, m

itt

lemieux, m

ario

trump, donald j

pearl, daniel

jackson, bo

kerik, bernard b

mason, c vernon

lewis, carl

gulotta, thomas s

maazel, lorin

lugar, richard g

lincoln, abraham

de la hoya, oscar

lewis, michael

jackson, jesse l

berlusconi, silvio

suhartowachtler, sol

aoun, michel

lendl, ivan

rushdie, salman

mandela, nelson

holden, stephen

chen shui−bian


gotbaum, betsy

hanover, donna

tenet, george j


piniella, lou

sampras, pete

kimmelman, michael

walesa, lech

mozart, wolfgang amadeus

barkley, charles

levy, harold o

byrd, robert c

jones, roy jr

shays, christopher

cohen, william s





williams, venus

brodeur, martin

el−hage, wadih

aristide, jean−bertrand

feingold, russell d

hawkins, yusuf k


carroll, sean

kerrey, bob

giuliani, rudolph w

cruise, tom

stewart, martha

john paul ii

berke, richard l

graf, steffi

mitchell, george j

chawla, kalpana

maxwell, robert

winfield, dave

o'rourke, andrew p

nelson, lemrick jr

rodgers, richard

kohl, helmut

koppel, ted

rubin, robert e

stern, howard

clinton, chelsea

wright, frank lloyd

d'amato, alfonse m

rich, frank

annan, kofi

jackson, phil

putin, vladimir v

irabu, hideki

weiner, anthony d

miller, gifford

sharpton, al

johnson, keyshawn

hubbell, webster l

egan, edward m

libby, i lewis jr

obama, barack

johnson, ben

roddick, andy

bin laden, osama

brozan, nadine

boesky, ivan f

connors, jimmy


white, mary jo

ryan, george

mattingly, don

weld, william f

sosa, sammy


wells, david

mccool, william c

traub, james

bratton, william j

sweeney, john j

daschle, tom

milken, michael r

ryan, nolan

blumenthal, richard

moussaoui, zacarias

jordan, michael

vallone, peter f

dylan, bob


codey, richard j

pagones, steven a

dershowitz, alan m

hewitt, lleyton

selig, budassad, hafez al−


altman, lawrence k

gehry, frankzimmer, richard a

daley, richard m

broad, william jbrady, lois smithsimpson, nicole brown

zarqawi, abu musab al−

reeves, dantrump, donaldiverson, allenknoblauch, chuckking, martin luther jrkennedy, anthony mkasparov, garykoresh, davidbenedict xvimarcos, ferdinand eferrer, fernando


NY Times social network



hynes, charles jewing, patrickmiers, harriet estein, andrew j

aung san suu kyi, daw

silver, sheldonspecter, arlencoughlin, tomkennedy, john fitzgerald

rodman, dennischaney, donjames, carynlane, nathanhashimoto, ryutaro

lautenberg, frank r



glavine, tomwinfrey, o

prahvan horn, keith

jeter, derek

reagan, ronald

limbaugh, rush

netanyahu, benjamin

law, bernard f

sessions, willia

m s

fujimori, a

lberto

ward, charlie

barron, ja

mes

van gundy, jeff

musharraf, p

ervez

blair, jayson

valentine, bobby

rowland, john g

chass, murra

y

jacobs, marc

puccini, giacomo

gates, henry lo

uis jr

staples, brent

baker, howard h jr

clark, wesley k

koch, edward i

canseco, jose

major, john

plame, valerie

o'neill, paul h

holyfield, e

vander

mills, ri

chard p

abdullah

bush, laura


kozlowski, l

dennis

karadzic, ra

dovan

salinas de gorta

ri, carlo

s

federer, r

oger

jospin, li

onel

bennett, willi

am j

nader, ralph

jackso

n, mark

steinbre

nner, georg

e m 3

d

steinberg

, lisa

velella

, guy j

moyn

ihan, daniel p

atrick

kahane, m

eir

kham

enei, ali

darman, r

ichard

g

barber,

tiki

friedm

an, thom

as l

bradley,

bill

min

aya, o

mar

goldin

, harri

son j

hernandez,

orla

ndo

brown, d

ave

reich

, robert

b

smith

, willi

am k

scoppetta

, nichola

s

jam

es, s

harp

e

gore

, al

moi

, dan

iel a

rap

forb

es, s

teve

cher

toff,

micha

el

wol

fowitz

, pau

l d

clar

k, la

urel

sal

ton

ashe

, arth

ur

vecs

ey, g

eorg

e

pirro

, jea

nine

f

sulliv

an, a

ndre

w

man

tle, m

icke

y

hank

s, to

m

robi

nson

, jac

kie

bird

, lar

ry

reno

, jan

et

edbe

rg, s

tefa

n

belkin

, lisa

nuss

baum

, hed

da

blix, h

ans

hous

ton,

alla

n

carter

, bill

scow

crof

t, br

ent

gold

en, h

owar

d

quay

le, d

an

mor

gent

hau,

rob

ert m

tayl

or, l

awre

nce

ovitz

, mic

hael

mur

doch

, rup

ert

dela

y, to

m

wag

ner,

richa

rd

wel

lsto

ne, p

aul

brod

y, ja

ne e

mce

nroe

, joh

n

kim

jong

il

river

a, m

aria

no

wel

ch, j

ohn

f jr

schu

ndle

r, br

et d

gree

n, m

ark

jiang

zem

in

kim

dae

jung

karz

ai, h

amid

roha

tyn,

felix

g

carluc

ci, f

rank

c

kacz

ynsk

i, th

eodo

re j

bia

ggi,

mario

bru

ni,

frank

bake

r, ja

mes

a 3

d

chav

ez,

julio

cesa

r

kanto

r, m

icke

y

clem

ens,

roger

stein

berg

, jo

el b

buffe

tt, w

arr

en e

pauls

on, henry

m jr

gre

enhouse

, st

even

klein

, ca

lvin

conner, d

ennis

letterm

an, davi

d

lam

ont, n

ed

rice

, co

ndole

ezz

a

sununu, jo

hn h

com

bs,

sean

mill

er, a

rthur

bru

der, thom

as

muss

ina, m

ike

freeh, lo

uis

j

difr

ance

sco, donald

t

johnso

n, ly

ndon b

ain

es

pelo

si, nancy

moxl

ey,

mart

ha

weic

ker, lo

well

p jr

scott, byr

on

johnso

n, m

agic

geffen, davi

d

mandela

, w

innie

falw

ell,

jerr

y

farr

akh

an, lo

uis

chre

tien, je

an

east

wood, cl

int

dean, how

ard

florio, ja

mes j

mill

er, judith

ward

, benja

min

gre

tzky,

wayne

zedill

o p

once d

e leon, ern

esto

ara

fat, y

asir

joyce, ja

mes

woodw

ard

, bob

gre

en, richard

r

sum

mers

, la

wre

nce h

muscham

p, herb

ert

izetb

egovic

, alij

a

roth

, phili

p

mart

in, ste

ve

abra

ms, ro

bert

chirac, ja

cques

sulli

van, lo

uis

w

sheva

rdnadze, eduard

a

sta

rr, ke

nneth

w

roste

nko

wski, d

an

thom

pson, w

illia

m c

jr

wassers

tein

, w

endy

levin

, carl

kri

sto

f, n

ichola

s d

rangel, c

harl

es b

nori

ega, m

anuel anto

nio

ali,

muham

mad

mobutu

sese s

eko

gate

s, bill

jam

es, le

bro

n

pitin

o, ri

ck

fehr,

donald

warh

ol, a

ndy

robbin

s, je

rom

e

dala

i la

ma

fein

ste

in, dia

nne

holtzm

an, eliz

abeth

kennedy,

edw

ard

m

pirro

, je

anin

evance, cyru

s r

becker,

bori

sm

oore

, m

ichael

gonzale

z, elia

nbare

nboim

, danie

lhenders

on, ri

ckey

john, elton

edw

ard

s, jo

hn

win

eri

p, m

ichael

padill

a, jo

se

lew

is, anth

ony

abra

moff, ja

ck

eis

ner,

mic

hael d

beckett, sam

uel

franks, bob

bonill

a, bobby

mart

inez, tino

sis

tani, a

li al!

mannin

g, eli

shala

la, donna e

fole

y, thom

as s

bid

en, jo

seph r

jr

ein

ste

in, alb

ert

hart

, gary

will

iam

s, sere

na

hari

ri, ra

fik

feld

, elio

tdole

, eliz

abeth

hcosby,

bill

fris

t, b

illalit

o, sam

uel a jr

din

gell,

john d

kle

in, jo

el i

purd

um

, to

dd s

anders

on, dave

maddox, alton h

jr

kin

g, w

ayne

mulroney,

bri

an

mbeki, thabo

thurm

ond, str

om

moses, ro

bert

ste

rn, henry

jsharo

n, ariel

mcgre

eve

y, jam

es e

robb, charles s

malv

o, jo

hn lee

noro

dom

sih

anouk

taubm

an, a a

lfre

dre

dsto

ne, sum

ner

m

bern

ste

in, le

onard

field

s, c

virgin

iabots

tein

, le

on

rove

, karl

perr

y, w

illia

m j

marc

os,

im

eld

asheffie

ld, gary

hussein

iru

th, georg

e h

erm

an

cuom

o, m

ario m

schm

itt, eric

morr

is, m

ark

mill

er, m

elv

inth

om

as,

isia

hke

atin

g, ch

arles

h jr

chala

bi,

ahm

ad

ceause

scu, nic

ola

e

bro

kaw

, to

msu

ozz

i, th

om

as

r

roh tae w

oo

o'n

eill

, eugene

pettitt

e, andy

polla

n, m

ichael

rabin

, yi

tzhak

leno,

jay

taglia

bue, paul

rose

nth

al,

a m

ort

ega s

aave

dra

, danie

l

nort

h, oliv

er l

turn

er, ted

blu

menth

al,

ralp

h

walte

rs, barb

ara

hark

in, to

m

huss

ein

, sa

ddam

madden, jo

hn

gle

nn, jo

hn

golis

ano,

b thom

as

bry

ant, k

obe

bre

mer, l

paul i

ii

marb

ury

, st

ephon

kelly

, ra

ymond w

pic

kens,

t b

oone jr

qadd

afi,

mua

mm

ar e

l!

dole

, bob

hing

is, m

artin

a

king

, rod

ney

glen

wils

on, a

ugus

t

bond

s, b

arry

mub

arak

, hos

ni

brad

sher

, kei

th

kean

, tho

mas

h

cole

man

, der

rick

brod

sky, ric

hard

l

sond

heim

, ste

phen

tom

mas

ini,

anth

ony

john

son,

ear

vin

gate

s, rob

ert m

vinc

ent,

fay

phillip

s, s

teve

brow

n, je

rry

kabi

la, l

aure

nt

spre

wel

l, la

trel

l

was

hing

ton,

des

iree

lew

is, l

enno

x

kush

ner,

tony

ma,

yo!

yo

whi

tman

, chr

istie

wie

se, t

hom

as

leite

r, al

kasp

arov

, gar

ry

capr

iati,

jenn

ifer

lee,

spi

ke

mol

inar

i, gu

y v

prim

akov

, yev

geny

m

shak

espe

are,

willia

m

duka

kis, m

icha

el s

verd

i, gius

eppe

piaz

za, m

ike

yelts

in, b

oris n

khat

ami,

moh

amm

ad

bush

, bar

bara

moh

amed

, kha

lfan

kham

is

dowd,

mau

reen

lloyd

web

ber,

andr

ew

norm

an, g

reg

mee

se, e

dwin

3d

pata

ki, g

eorg

e e

gershw

in, g

eorge

hitler,

adolf

johnso

n, larry

volp

e, ju

stin

a

baker,

russ

ell

domin

go, p

lacid

o

dinkin

s, d

avid n

barysh

nikov,

mikh

ail

giam

atti, a

bartl

ett

leetc

h, bria

n

dole, robert

j

weinberger,

casp

ar w

kevo

rkian, ja

ck

patern

o, joe

simon, n

eil

simpso

n, o j

gerstn

er, louis

v jr

masur,

kurt

ashcro

ft, john

soro

s, georg

e

dole, eliz

abeth

jones, mario

n

schlesinger, arth

ur m jr

diana, prin

cess of wales

schroder, gerhard

walsh, lawrence e

lennon, john

gibson, mel

baker, a

l

gore, albert j

r

brown, david m

spitzer, e

lliot l

miyazawa, kiichi

collins, g

lenn

mccartney, p

aul

torre, jo

e

ridge, to

m

malone, john c

scalia, antonin

ackerman, fe

licia

lindros, eric

leonard, sugar ray

mutombo, dikembe

torricelli,

robert g

aquino, corazon c

kim young sam

murphy, richard

fujimori, a

lberto k

martin, kenyon

hemingway, ernest

gotti, john

sciolino, elaine

belichick, bill


weingarten, randi

milosevic, slobodan

hill, anita f

kerry, john

thomas, clarence

bettman, gary

stevens, scott

peres, shimon

picasso, pablo

bumiller, elisabeth

keller, bill

spielberg, steven

packwood, robert w


o'neal, shaquille

lipsyte, robert

weinstein, harvey

prodi, romano

papp, joseph

badillo, herman

canby, vincent

collins, kerry

pierce, samuel r jr

maliki, nuri kamal al!

graham, martha

van gogh, vincent


li peng

da silva, luiz inacio lula


savimbi, jonas

mickelson, phil

webber, chris

messinger, ruth w

dimaggio, joe

krugman, paul

riley, pat

martin, billy

mcfarlane, robert c

ozawa, seiji

camby, marcus

nunn, samlewinsky, monica s

powell, colin l

strahan, michael

waldheim, kurtlevy, steveoates, joyce carolkemp, jack fsnow, john whun senbruno, joseph lcourier, jimellington, dukepoindexter, john mpopewhitman, christine toddwilson, petelevitt, arthur jrstern, davidmaslin, janetvolcker, paul amartin, curtisbrown, edmund g jr pareles, jongraham, bob holland, bernard lopez, jennifer daly, john johnson, randy albee, edward brawley, tawana tsongas, paul e richardson, bill blair, tony waxman, henry a jones, paula corbin testaverde, vinny reagan, nancy levine, james fabricant, florence

williams, ted hyde, henry j nichols, terry lynngoss, porter j brooks, david sadr, moktada al!

schilling, curt carter, jimmy koizumi, junichiroperot, ross parcells, bill montana, joe

gorbachev, mikhail s

kostunica, vojislav

deng xiaopingrowling, j k sabatini, gabriela



ramon, ilanshamir, yitzhak

bush, george w

helmsley, harry b

al!'owhali, mohamed rashed daoud

cortines, ramon c


messier, mark

whitehead, mary beth


altman, robert

mamet, david

casey, william j

christo pear, robert

hastert, j dennis

shultz, george p

woods, tiger

thompson, tommy g

bentsen, lloyd

cashman, brian

mccain, john

harris, katherine

safire, william

jeffords, james m

jobs, steven p

oakley, charles


robertson, pat

johns, jasper

schiavo, terri


wilson, michael

singh, vijay

starks, john

ravitch, richard

rose, pete

wilson, joseph c iv

havel, vaclav

o'connor, john

carey, mariah

diallo, amadou

fox, vicente

glass, philip

malcolm

x

marsalis, wynton

sand, leonard b


martins, peter

o'neill, william a

kennedy, john f jr

anderson, kenny

king, don

gandhi, rajiv

stalin, joseph

armani, giorgio


spano, andrew j

william

s, bernie

clinton, bill

simon, paul

karpov, anatoly

kidd, jason

bowm

an, patricia

stoppard, tom

rodriguez, alex


mcconnell, m

itch

armstrong, lance

rosenbaum, yankel

ahern, bertie

jennings, peter

pollock, jackson

regan, edward v

versace, gianni

lauder, ronald s

karan, donna

warner, john w

le pen, jean!m

arie

tudjman, franjo

fernandez, joseph a

schwarz, charles


louima, abner

kalikow, peter s

chavez, hugo

cuomo, andrew

m

ebbers, bernard j

rocker, john

norton, gale

herbert, bob

robertson, marion g

safir, howard

lieberman, joseph i

mailer, norm

an

ferguson, colin

kwan, m

ichelle

pavarotti, luciano

gates, william

h

mccall, h carl

lott, trent


zemin, jiang

franco, jo

hn

mla

dic, ra

tko

gooden, d

wig

ht

wie

sel, e

lie

stein

bre

nner, g

eorg

e

scorse

se, martin

castro, fid

el

bork, ro

bert h

laure

n, ra

lph

willia

ms, te

nnesse

e

gord

on, je

ff

eise

nhow

er, d

wig

ht d

avid

collo

r de m

ello, fe

rnando

abdel ra

hm

an, o

mar

navra

tilova

, martin

a

helm

sley, le

ona

bush

, jeb

bra

dy, n

ichola

s f

ford

, gera

ld ru

dolp

h jr

sheva

rdnadze

, eduard

kerry, jo

hn f

straw

berry, d

arryl

alle

n, w

oody

jagr, ja

rom

ir

rafsa

nja

ni, h

ash

em

i

hu jin

tao

sala

meh, m

oham

med a

adam

s, john

madonna

farro

w, m

ia

bolto

n, jo

hn r

wilso

n, va

lerie

pla

me

griffith

, mich

ael

menendez, ro

bert

mugabe, ro

bert

wilp

on, fre

d

wein

er, tim

boxe

r, barb

ara

reid

, harry

lagerfe

ld, k

arl

gre

enspan, a

lan

khodorko

vsky, m

ikhail b

pere

lman, ro

nald

o

fassel, jim

de n

iro, ro

bert

putin

, vla

dim

ir

hard

ing, to

nya

bush, g

eorg

e w

.

sath

er, g

len

bow

e, rid

dic

k

mcnally, te

rrence

deave

r, mic

hael k

rehnquis

t, willia

m h

quin

dle

n, a

nna

jackson, th

om

as p

enfie

ld

both

a, p

w

pere

z d

e c

uella

r, javie

r

adam

s, g

erry

handel, g

eorg

e fre

deric

k

pennin

gto

n, c

had

bara

k, e

hud

zedillo

, ern

esto

tiern

ey, jo

hn

kerrig

an, n

ancy

bro

wn, la

rry

mats

ui, h

ideki

jeffe

rson, th

om

as

chun d

oo h

wan

zuckerm

an, m

ortim

er b

bakker, jim

bala

nchin

e, g

eorg

e

ale

xander, la

mar

freud, s

igm

und

chang, m

ichael

hevesi, a

lan g

johnson, p

hilip

cre

w, ru

dolp

h f

agassi, a

ndre

pre

sle

y, elv

isic

ahn, c

arl c

bro

wn, ro

nald

hw

ilson, ro

bert

child

s, c

hris

lew

is, n

eil a

tharp

, twyla

roosevelt, fra

nklin

dela

no

weill, s

anfo

rd i

kerk

oria

n, k

irkm

uham

mad, jo

hn a

llen

najib

ulla

hw

illiam

s, ja

yson

dodd, c

hris

topher j

taylo

r, charle

scone, d

avid

pol p

ot

o'c

onnor, s

andra

day

gold

man, ro

nald

lyle

erla

nger, s

teven

kin

g, s

tephen

onassis

, jacquelin

e k

ennedy

goodnough, a

bby

harris

, eric

solo

mon, d

ebora

hsandom

ir, richard

kaye, ju

dith

sla

y, kenneth

lra

ndolp

h, w

illiecarte

r, vin

ce

stra

uss, ric

hard

cham

orro

, vio

leta

barrio

s d

e

corz

ine, jo

n s

holb

rooke

, richard

csin

atra

, frank

buchanan, p

atric

k j

gra

sso, ric

hard

aahm

adin

eja

d, m

ahm

oud

washin

gto

n, g

eorg

ebush, g

eorg

efo

x q

uesada, v

icente

gra

mm

, phil

spitze

r, elio

tfitz

wate

r, marlin

sore

nsta

m, a

nnik

a

edw

ard

s, herm

an

jackson, m

ichael

van n

atta

, don jr

trum

an, h

arry

sabbas, m

ahm

oud

cooper, m

ichael

dille

r, barry

boss, ke

nneth

sele

s, monica

mandela

, nelso

n r

rum

sfeld

, donald

h

wein

stein

, jack b

gin

grich

, new

t

asp

in, le

sm

enem

, carlo

s saul

kissinger, h

enry a

cage, jo

hn

babbitt, b

ruce

schum

er, ch

arle

s e

assa

d, b

ash

ar a

l!

boutro

s!ghali, b

outro

s

simm

s, phil

lipto

n, e

ricnew

man, p

aul

mcg

wire

, mark

lee, w

en h

o

leahy, p

atrick j

gra

ssley, ch

arle

s e

libeskin

d, d

anie

l

gephard

t, richard

a

bro

wn, le

e p

vacco, d

ennis c

rell, m

jodi

tyson, m

ike

davis, g

ray

o'd

onnell, ro

sie

roberts, jo

hn g

jr

clinto

n, h

illary ro

dham

goetz, b

ern

hard

hugo

stephanopoulo

s, georg

e

aziz, ta

riq

lewin

sky, monica

iacocca, lee a

feiner, paul

smith, w

illiam kennedy

cunningham, m

erce

khomeini, ruhollah

skilling, jeffrey k

showalter, buck


abraham, spencer

springsteen, bruce

davenport, lindsay

monroe, m

arilyn

rohde, david

gonzales, alberto r

romney, m

itt

lemieux, m

ario

trump, donald j

pearl, daniel

jackson, bo

kerik, bernard b

mason, c vernon

lewis, carl

gulotta, thomas s

maazel, lorin

lugar, richard g

lincoln, abraham

de la hoya, oscar

lewis, m

ichael

jackson, jesse l

berlusconi, silvio

suharto

wachtler, sol

aoun, michel

lendl, ivan

rushdie, salman

mandela, nelson

holden, stephen

chen shui!bian


gotbaum, betsy

hanover, donna

tenet, george j


piniella, lou

sampras, pete

kimm

elman, m

ichael

walesa, lech

mozart, wolfgang am

adeus

barkley, charles

levy, harold o

byrd, robert c

jones, roy jr

shays, christopher

cohen, william s





williams, venus

brodeur, martin

el!hage, wadih

aristide, jean!bertrand

feingold, russell d

hawkins, yusuf k


carroll, sean

kerrey, bob

giuliani, rudolph w

cruise, tom

stewart, martha

john paul ii

berke, richard l

graf, steffi

mitchell, george j

chawla, kalpana

maxwell, robert

winfield, dave

o'rourke, andrew p

nelson, lemrick jr

rodgers, richard

kohl, helmut

koppel, ted

rubin, robert e

stern, howard

clinton, chelsea

wright, frank lloyd

d'amato, alfonse m

rich, frank

annan, kofi

jackson, phil

putin, vladimir v

irabu, hideki

weiner, anthony d

miller, gifford

sharpton, al

johnson, keyshawn

hubbell, webster l

egan, edward m

libby, i lewis jr

obama, barack

johnson, ben

roddick, andy

bin laden, osama

brozan, nadine

boesky, ivan f

connors, jimmy


white, mary jo

ryan, george

mattingly, don

weld, william f

sosa, sammy


wells, david

mccool, william c

traub, james

bratton, william j

sweeney, john j

daschle, tom

milken, michael r

ryan, nolan

blumenthal, richard

moussaoui, zacarias

jordan, michael

vallone, peter f

dylan, bob


codey, richard j

pagones, steven a

dershowitz, alan m

hewitt, lleyton

selig, bud

assad, hafez al!


altman, lawrence k

gehry, frank

zimmer, richard a

daley, richard m

broad, william j

brady, lois smith

simpson, nicole brown

zarqawi, abu musab al!

reeves, dantrump, donaldiverson, allenknoblauch, chuck

king, martin luther jr

kennedy, anthony mkasparov, garykoresh, davidbenedict xvimarcos, ferdinand eferrer, fernando

fightmatch

trial


Examining predictions on solicited descriptions

1 2 3 4 5 6 7 8

12

34

56

78

Lower is betterLog Rank (Author−Topic Model)

Log

Ran

k (N

ubbi

)

time

president

minister

countriesbush

prime

israeli

race

1992

presidential

opponents

presidentpresident

american

political

figures

candidates

presidential

ran

republican

republicans

politicians

president

americanpolitical

figures

york

republicans

politicians

president

court

bush

attorney

supreme

husband

married

partydemocratic

politicians

involved

prizeprize

figureolympic

york

politicians

york

state

political

figures

politicians

world leaders

countries

president

world

war

leaders

iraq

bush

troops

opponents

war

leaders

iraq

professional

president

general

attorney

president

vicedemocratic

senators

father son

brothers

brother

brothers

president

election

candidates

presidential

2004

opponents

president

democratic

running

ranpoliticians

husband

married

wife

victim

president

united

states

vice

father

mother

daughter

married

players

basketball

time

worldleaders

countries

wife husband

married

married

california

leaders

minister

prime

russian

russia

father son

time

president

leaders

groups

attack

september2001

terrorist

east

process

involved

middle

peace

headed

president

worldleaders

british

bushcandidates

presidential

1992

candidates

presidential

ran

president

state

secretary

ran

wifehusband

married

previously

president

party

republican

republicans

candidates

politicians

republic

wife

married

federal

building

involved

planned

fed

bombing

father

daughter

wifehusband

married

president

vice

runningcandidates

1996

manager

yankees

owner

york

senate

race

spot

opponents

father

president

candidates

presidential

2004

president

republican

2000

candidates

politiciansopponents

players

tennis

players

professional

tennistime

worldleaders

nations

countrieseast

issue

leaders

middle

israelipalestinian

politicians

show

night

latetalk

wifehusband

married

sexual

sex

players

opponents

tennistime

countryleaders

countries

president

chairman

fed

president

running

president

administration

vice

running

father

sonpersonprofessional

person

executives

convicted

york

currentsenators

husband

married

person

relationship

accused

sexual

sex

field

track stars

olympic

wifehusband

married

president

vicedemocratic

running

2000

candidates

presidential

politicians

players

baseball

users

israelieast middle

eastern

east

leadersnations

process

middle

peace

time

leaders

democratic

countries

president

republican

governor

bush

yorkyork

state

governor

politicians

police

case

victim

york

city house

white

worked

jersey

married

president

special

part

bill

investigation

clintonsubjectsex

headed

players

tennis

president

house

clinton

speaker

american

political

figures

case

accused

sexual

president

court

failed

supreme

reagan

time

countries

worldleaders

powers

worldleaders

person

president

general

attorney

president

stategeneral

attorney

washington

area

baseball

players

baseball

atlanta

president

republican

politicians

york

city

party

mayor

democratic

candidates

players

baseball

politicians

american

political

administration

figures

politicians

president

administration

defense

secretary

leaders

countries

republican

running

politicians

person

senators

president

state

leaders

palestinian

time

political

leaders

countries

court

candidates

supreme

americanpolitical

figures

party

democratic

electionpresidential

primary

president

ranpoliticians

leaders

countriesmiddle

eastern

politicians

yorkmayor

politicians

york

politicians

police

commissioner

jersey

baseball

owner

chief

staff

person

senators

part

east

process

middle

peacehusband

won

governor

ran

convicted

york

city

mayor

candidates

2001

state

politicians

president

state

secretary

york

city

politicians

executives disney

players

subject

iranpoliticians

president

vice

1988

candidates

president

political

south

africa

worldleaders

victim

leaders

countries

convicted

prime

israeli


Examining predictions on solicited descriptions

1 2 3 4 5 6 7

12

34

56

7

Lower is betterLog Rank (Author−Topic Model)

Log

Ran

k (N

ubbi

)

baseball

africa

baseball

south

presidential

israeli

owner

chairman

terrorist

palestinianisraeli

ministerminister

olympic

palestinian

primeprimeprime

fed

israeliisraeli

democratic

peacepeace

trackiran

peaceparty

candidates

democraticiraq

primaryrussian

russia

candidates

presidentialpresidentialpresidential

stars

candidates

supreme

presidential

senatedemocratic

presidential

politicianspoliticians2001

case

running

administrationcourt

time

worldworld

presidentstatestate

governor

figure

nations

president

tennis

wife

opponents

disney

baseball

nations

york

brothers

president

brothers

married

tennistennis

wife

fatherfather

husband

wifewife

sex

husband

wifehusbandhusbandwifewife

sonson

sexual

husbandhusband

sex

husbandhusband

relationship

brother

husband

sexualsexual


Conclusion

Networks of entities are a pervasive form of data.

There are deep meanings associated with the links in these

networks.

These meanings are often not encoded in the network itself,

but rather as free text elsewhere.

The Nubbi model allows us to take this text and infer

characterizations of the relationships between the ensemble of

entities.

This is an important step towards mining complete social

networks from free text.

Thanks!


Wikipedia Topics

Nubbi learns topics associated with individual entities.

This clusters entities according to the words used to describe

them.

People in Wikipedia

Topic 1 Topic 2

Frederick Sanger Kate Winslet

Top Entities Svante Arrhenius Ringo Starr

William Ramsay Al Pacino

work �lm

universe music

Top Terms year album

develop award

society song


Wikipedia Topics

Nubbi also learns topics associated with pairs of entities.

These topics cluster together pairs with similar relationships.

People in Wikipedia

Topic 1 Topic 2

Tyler-Roosevelt Perot-Bush

Top Pairs McKinley-Roosevelt J.Q. Adams-Monroe

Taft-Roosevelt J.Q. Adams-Clay

president republican

vice march

Top Terms roosevelt reagan

calvin vote

johnson state


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''


1 For each entity e,1 Draw entity topic proportions �e � Dir(��);2 For each word associated with this entity's context,

1 Draw topic assignment ze;n � Mult(�e);2 Draw word we;n � Mult(��

ze;n).


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''


1 For each pair of entities e; e 0,1 Draw relationship topic proportions e;e0 � Dir(� );2 Draw selector proportions �e;e0 � Dir(��);3 For each word associated with this entity pair's context,

1 Draw selector ce;e0;n � Mult(�e;e0);


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''


1 If ce;e0;n = 1,

1 Draw topic assignment ze;e0;n � Mult(�e);2 Draw word we;e0;n � Mult(��

ze;e

0;n

):


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''


1 If ce;e0;n = 2,

1 Draw topic assignment ze;e0;n � Mult(�e0);2 Draw word we;e0;n � Mult(��

ze;e

0;n

):


Graphical Model

MNe Ne,e'Kθ

βθ

ψe,e'

αθ

w

z

θe

αψ

c

πe,e'

ηθz

w

απ

Kψ

βψ

ηψ

Ne'

z

w

θe'

...Ne''

z

w

θe''


1 If ce;e0;n = 3,

1 Draw topic assignment ze;e0;n � Mult( e;e0);2 Draw word we;e0;n � Mult(�

ze;e

0;n

):


References

Eugene Agichtein and Luis Gravano. Querying text databases for

e�cient information extraction. Data Engineering, International

Conference on, 0:113, 2003. ISSN 1063-6382. doi: http://doi.ieeecomputersociety.org/10.1109/ICDE.2003.1260786.

Michele Banko, Michael J. Cafarella, Stephen Soderland, Matthew

Broadhead, and Oren Etzioni. Open information extraction from

the web. In IJCAI 2007, 2007. URL http:

//www.ijcai.org/papers07/Papers/IJCAI07-429.pdf.

Indrajit Bhattacharya, Shantanu Godbole, and Sachindra Joshi.

Structured entity identi�cation and document categorization:

Two tasks with one joint model. KDD 2008, 2008. URL http:

//portal.acm.org/ft gateway.cfm?id=1401899&type=

pdf&coll=ACM&dl=ACM&CFID=2420023&CFTOKEN=56734162.

D Blei, A Ng, and M Jordan. Latent Dirichlet allocation. Journal

of Machine Learning Research, 2003. URL

http://www.mitpressjournals.org/doi/abs/10.1162/

jmlr.2003.3.4-5.993.

A Culotta, R Bekkerman, and A McCallum. Extracting social

networks and contact information from email and the web.

AAAI 2005, 2005. URL

http://www.cs.umass.edu/�ronb/papers/dex.pdf.

Dmitry Davidov, Ari Rappoport, and Moshe Koppel. Fully

unsupervised discovery of concept-speci�c relationships by web

mining. In ACL, 2007.

Christopher Diehl, Galileo Mark Namata, and Lise Getoor.

Relationship identi�cation for social network discovery. In AAAI

2007, July 2007.

T Hofmann. Probabilistic latent semantic indexing. SIGIR, 1999.

URL http://portal.acm.org/citation.cfm?id=312649.

Michael I. Jordan, Zoubin Ghahramani, Tommi S. Jaakkola, and

Lawrence K. Saul. An introduction to variational methods for

graphical models. Oct 1999.

S Katrenko and P Adriaans. Learning relations from biomedical

corpora using dependency trees. Lecture Notes in Computer

Science, 2007. URL http:

//www.springerlink.com/index/n145566q7t1u4365.pdf.

Q Mei, D Xin, H Cheng, J Han, and C Zhai. Semantic annotation

of frequent patterns. KDD 2007, 1(3), 2007.

David Newman, Chaitanya Chemudugunta, and Padhraic Smyth.

Statistical entity-topic models. In KDD 2006, pages 680{686,

New York, NY, USA, 2006. ACM. ISBN 1-59593-339-5. doi:

http://doi.acm.org/10.1145/1150402.1150487.M Rabbat, M Figueiredo, and R Nowak. Inferring network

structure from co-occurrences. NIPS 2006, 2006. URL http://

books.nips.cc/papers/files/nips19/NIPS2006 0247.pdf.

Michal Rosen-Zvi, Thomas Gri�ths, Thomas Gri�ths, Mark

Steyvers, and Padhraic Smyth. The author-topic model for

authors and documents. In AUAI 2004, pages 487{494,

Arlington, Virginia, United States, 2004. AUAI Press. ISBN

0-9749039-0-6.

Saurav Sahay, Sougata Mukherjea, Eugene Agichtein, Ernest

Garcia, Shamkant Navathe, and Ashwin Ram. Discovering

semantic biomedical relations utilizing the web. KDD 2008, 2

(1), Mar 2008. URL http:

//portal.acm.org/citation.cfm?id=1342320.1342323.

M Steyvers and T Gri�ths. Probabilistic topic models. Handbook

of Latent Semantic Analysis, 2007.


http://www.ijcai.org/papers07/Papers/IJCAI07-429.pdf

http://www.ijcai.org/papers07/Papers/IJCAI07-429.pdf

http://portal.acm.org/ft_gateway.cfm?id=1401899&type=pdf&coll=ACM&dl=ACM&CFID=2420023&CFTOKEN=56734162



http://www.mitpressjournals.org/doi/abs/10.1162/jmlr.2003.3.4-5.993

http://www.mitpressjournals.org/doi/abs/10.1162/jmlr.2003.3.4-5.993

http://www.cs.umass.edu/~ronb/papers/dex.pdf

http://portal.acm.org/citation.cfm?id=312649

http://www.springerlink.com/index/n145566q7t1u4365.pdf

http://www.springerlink.com/index/n145566q7t1u4365.pdf

http://books.nips.cc/papers/files/nips19/NIPS2006_0247.pdf

http://books.nips.cc/papers/files/nips19/NIPS2006_0247.pdf

http://portal.acm.org/citation.cfm?id=1342320.1342323

http://portal.acm.org/citation.cfm?id=1342320.1342323

connections between the lines: augmenting social …jbg/docs/kdd_pres.pdf · connections between...

Documents