table-to-text generation by structure-aware seq2seq learning · neural text generation from...

|

Table-to-text Generation by Structure-aware Seq2seq Learning

1

Authors:Tianyu Liu,KexiangWang,LeiSha,BaobaoChangandZhifang SuiAffiliation:KeyLaboratoryofComputationalLinguistics(ICL),PekingUniversity,Beijing,ChinaSpeaker:Tianyu LiuE-mail:[email protected]

|

Knowledge Modeling

2

Machine ReadingUnstructured text Structured data

MachineWritingStructured data Unstructured text

| 3

Knowledge Modeling

Machine ReadingUnstructured text Structured data

MachineWritingStructured data Unstructured text

|

Data-to-text

4

WisemanS,Shieber SM,RushAM.Challengesindata-to-documentgeneration EMNLP 2017

|

Data-to-text

5

MeiH,BansalM,WalterMR.Whattotalkaboutandhow?selectivegenerationusinglstms withcoarse-to-finealignment NAACL2016.

|

Data-to-text

6

DušekO,Jurčíček F. Sequence-to-sequence generationforspoken dialogueviadeepsyntaxtreesandstrings. ACL 2016.

|

Data-to-text

7

GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australianactorandwriterbestknown forhisperformances in TheGunsofNavarone (1961)and TheGreatEscape (1963).

Our work !

|

How to represent a table ?

8

1. Key-value map(Name, George Mikell); (Nationality, Lithuanian Australian); (Years Active, 1957--present) ….

|


9

1. Key-value map

2. Triple(George Mikell, FullName, George Mikell);(George Mikell, Nationality, Lithuanian Australian);(George Mikell, Known for, The Guns of Navarone); (The Guns of Navarone, Directed by, J.Lee Thompson) ….

(Name, George Mikell); (Nationality, Lithuanian Australian); (Years Active, 1957--present) ….

|


10

1. Key-value map



3. Multi-element Tuple

|


11

1. Key-value map



3. Multi-element Tuple

|12

Table Encoder

ℎ#

George Mikell

(name,1,2)

(name,2,1)

ℎ$ ℎ%

Jurgis

(birthname,1,2)

……

……

The

ℎ$&

Great

ℎ$' ℎ%(

Escape

(known for,5,3)

(known for,6,2)

(known for,7,1)

Field-gating Tableencoder

𝑧# 𝑧$ 𝑧% 𝑧$& 𝑧$' 𝑧%(

𝑠%

George Mikell is

𝑠+ 𝑠,

an Australian<sos>

George Mikell is an Australian actor

𝑠-𝑠$𝑠#

Description Decoder

Word

Field & Pos

|13

(name, George Mikell)Word embedding + Structure embedding

Table Encoder

|14

(name, George Mikell)Word embedding + Field embedding

Table Encoder

|15

(name, George Mikell)Structure embedding (Field type embedding + Position embedding)

Table Encoder

|16

(name, George Mikell)

Lebret R,Grangier D,Auli M.Neuraltextgenerationfromstructureddatawithapplicationtothebiographydomain. EMNLP 2016

Table EncoderStructure embedding (Field type embedding + Position embedding)

|17

Field-gating Encoder

ℎ#

George Mikell

(name,1,2)

(name,2,1)

ℎ$ ℎ%

Jurgis

(birthname,1,2)

……

……

The

ℎ$&

Great

ℎ$' ℎ%(

Escape

(known for,5,3)

(known for,6,2)

(known for,7,1)


𝑧# 𝑧$ 𝑧% 𝑧$& 𝑧$' 𝑧%(

Vanilla LSTM

Undate cell state

|

Human-like Generation

18

GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australianactorandwriterbestknown forhisperformances in The Guns ofNavarone (1961)and The Great Escape(1963).

name GeorgeMikell

birthname Jurgis Mikelaitis

birthdate 4April1929 (age 88)

birthplace Bildeniai, Lithuania

nationality Lithuanian,Australian

occupation Actor,writer

years active 1957–present

known for The Guns of NavaroneThe Great Escape

|


19


name GeorgeMikell








|


20

GeorgeMikell (born Jurgis Mikelaitis;4April1929)isaLithuanian-Australian actorandwriterbestknown forhisperformances in The Guns ofNavarone (1961)and The Great Escape(1963).

name GeorgeMikell








|


21


name GeorgeMikell








|22

Word-level & Field-level Dual Attention

ℎ#

George Mikell

(name,1,2)

(name,2,1)

ℎ$ ℎ%

Jurgis

(birthname,1,2)

……

……

The

ℎ$&

Great

ℎ$' ℎ%(

Escape

(known for,5,3)

(known for,6,2)

(known for,7,1)

𝑠%

George Mikell is

𝑠+ 𝑠,

an Australian<sos>

George Mikell is an Australian actor

𝑠,

……⊙

⊙ ……

……

……

⨁Embeddingfor ‘Australian’

dual attentionvector

Word level attention

Field level attention

⊗Dual attention

Input for 𝑠,


𝑠-𝑠$𝑠#

𝑧# 𝑧$ 𝑧% 𝑧$& 𝑧$' 𝑧%(

Description Decoder

Word-level Attention:

Field-level Attention:

Dual Attention:

Context Vector:

|23

Case study

|

Dataset: WIKIBIO

24

WIKIBIO (Lebret,Grangier,andAuli (2016)) contains728,321 articlesfromEnglishWikipedia(Sep2015).Thedatasetusesthefirstsentenceofeacharticleasthedescriptionoftherelated infobox.

GeorgeMikell (born JurgisMikelaitis;4April1929)isaLithuanian-Australian actorandwriterbestknown forhisperformancesin The Guns ofNavarone (1961)and The Great Escape(1963).

name GeorgeMikell




nationality Lithuanian, Australian




Infobox Description

Lebret R,Grangier D,Auli M.Neuraltextgenerationfromstructureddatawithapplicationtothebiographydomain. EMNLP 2016

|

Experiments

25

Statistical Baselines:KN & Template KN:TheKneser-Ney(KN)model isawidelyusedlanguagemodel.TemplateKNisaKNmodelovertemplateswhichalsoservesasabaselinein[Lebret etal.,2016]

NLM& Table NLM:NLMisanaivestatisticallan-guage modelproposedbyLebret etal.2016.TableNLM includeslocalandglobalconditioning overthetables

Neural Network Baseline:Seq2seq: vanillaseq2seqneuralarchitectureisalsoprovidedasastrongbaselinewhichusestheconcatenationofwordembedding, fieldembedding andpositionembedding asthemodelinput.

|

Does the order matter?

26

name GeorgeMikell














name GeorgeMikell


Shuffle

|27

Thanks.

table-to-text generation by structure-aware seq2seq learning · neural text generation from...

Documents