Scott Wen-tau Yih

Knowledge

Base𝜆𝑥. sister_of(justin_bieber, 𝑥)

Who is Justin Bieber’s sister?

𝜆𝑥. sibling_of(justin_bieber, x) ∧ gender(x, female)

semantic parsing

querymatching

Jazmyn Bieber

Knowledge

Base

Who is Justin Bieber’s sister?

𝜆𝑥. sibling_of(justin_bieber, x) ∧ gender(x, female)

semantic parsingquery

Jazmyn Bieber

“What was the date that Minnesota became a state?”

“When was the state Minnesota created?”

“Minnesota's date it entered the union?”

location.dated_location.date_founded

directly

grows staged

Basic idea

Addresses Key Challenges

52.5

• Introduction

• Background• Graph knowledge base

• Query graph

•

•

• Family Guy cvt2

Meg Griffin

Lacey Chabert

1/31/1999

cvt1

from

12/26/1999

cvt3

series

Mila Kunis

Family Guy cast

Meg Griffinargmin

xy

topic entity core inferential chain

constraints

• Introduction

• Background

• Staged Query Graph Generation (Our Approach)• Link topic entity

• Identify core inferential chain

• Augment constraints

Staged

Meg Family Guy

Family Guys1

Meg Griffins2

ϕ s0

(1) Link Topic Entity

Staged

Meg Family Guy

(2) Identify Core Inferential Chain

Family Guys1

Family Guy cast actor xys3

Family Guy writer start xys4

Family Guy genre xs5

Staged

Meg Family Guy

(3) Augment Constraints

Family Guy cast actor xy

Family Guy cast actor xy

Meg Griffin

Family Guy xy

Meg Griffinargmin

s3

s6

s7

Family Guys1

Meg Griffins2

ϕ s0

Family Guys1

Family Guy cast actor xys3

Family Guy writer start xys4

Family Guy genre xs5

Who first voiced Meg on Family Guy?

{cast−actor, writer−start, genre}

• Input is mapped to two 𝑘-dimensional vectors

𝑃 𝑅 𝑃 =exp cos(𝑦𝑅 , 𝑦𝑃)

𝑅′ exp cos(𝑦𝑅′ , 𝑦𝑃)

𝑦𝑃 ∈ R𝑘 𝑦𝑅 ∈ R

𝑘

who voiced meg on 𝑒 cast−actor

15K 15K 15K 15K 15K

1000 1000 1000

max max

...

...

... max

300

...

...

<s> w1 w2 wT </s>

... ...

300

• Who voiced Family Guy

cast FamilyGuy 𝑦 actor 𝑦 𝑥

• One or more constraint nodes can be added to 𝑦 or 𝑥• 𝑦 : Additional property of this event (e.g., character 𝑦 MegGriffin )

• 𝑥 : Additional property of the answer entity (e.g., gender)

Family Guy cast actor xy

Family Guy cast actor xy

Meg Griffin

Family Guy xy

Meg Griffinargmin

s3

s6

s7

Family Guy cast actor xys3

Who first voiced Meg on Family Guy?

Family Guy cast actor xys3

Family Guy writer start xys4

Who first voiced Meg on Family Guy?

Family Guy cast actor xys3

Family Guy xy

Meg Griffinargmins7

𝑞 =Who first voiced Meg on Family Guy?

Family Guy cast

Meg Griffinargmin

xy

𝑠 =

• Introduction

• Background

• Staged Query Graph Generation (Our Approach)

• Experiments• Data & evaluation metric

• Creating training data from Q/A pairs

• Results

• What character did Natalie Portman play in Star Wars? Padme Amidala

• What currency do you use in Costa Rica? Costa Rican colon

• What did Obama study in school? political science

• What do Michelle Obama do for a living? writer, lawyer

• What killed Sammy Davis Jr? throat cancer [Examples from Berant]

Relation Matching (Identifying Core Inferential Chain)

Pattern Inferential Chain

what was <e> known for people.person.profession

what kind of government does <e> have location.country.form_of_government

what year were the <e> established sports.sports_team.founded

what city was <e> born in people.person.place_of_birth

what did <e> die from people.deceased_person.cause_of_death

who married <e> people.person.spouse_s

people.marriage.spouse

Reward Function 𝛾

3335.7

37.539.2 39.9

41.344.3 45.3

52.5

0

10

20

30

40

50

60

Avg. F1 (Accuracy) on WebQuestions Test Set

Yao-14 Berant-13 Bao-14 Bordes-14b Berant-14 Yang-14 Yao-15 Wang-14 Yih-15

Method #Entities Covered Ques. Labeled Ent.

Freebase API 19,485 98.8% 81.2%

Yang & Chang, ACL-15 9,147 99.8% 87.8%

52.5% 48.4%

49.6 52.5

A random sample of 100 incorrectly answered questions

directly

http://aka.ms/sent2vec

http://aka.ms/codalab-webq

http://aka.ms/stagg