Upload File

global and local models for multi-document summarization · pdf filesentences from a...

  • Home
  • Documents
  • Global and Local Models for Multi-Document Summarization · PDF filesentences from a generative ... English recall-French recall-Greek recall-Hebrew recall-Hindi SU 4 l ... and Local
18
Global and Local Models for Multi-document Summarization Pradipto Das and Rohini Srihari SUNY Buffalo TAC 2011, Gaithersburg, MD

Upload: lehanh

Post on 19-Mar-2018

222 views

Category:

Documents


2 download

Report

TRANSCRIPT

  • Global and Local Models for Multi-document Summarization

    Pradipto Das and Rohini Srihari

    SUNY Buffalo

    TAC 2011, Gaithersburg, MD

  • Global and Local Models

    Accidents and Natural Disasters

    Attacks (Criminal/Terroris

    t)

    Health and Safety

    Endangered Resources

    Investigations and Trials

    (Criminal/Legal/ Other)

    Global Model

    Local Models

    Multi-document summaries

  • An Example of a Global Model Topic Translation Topic Translation Topic Translation

    , , , ,

    , , ,

    Tsunami, earthquake,

    Chile, Pichilemu,

    gone, warning , news, city

    , , , , ,

    ,, , ,

    flight, Air, France,

    Brazil, A, 447,

    disappear, ocean France

    , , ,

    , , ,

    ,

    China, Olympic, Beijing, Gore,

    function, stadium, games

    Topic Translation Topic Translation Topic Translation

    , ,

    :xx->xx, ,

    , ,

    , :xx->xx

    Tsunami, earthquake,

    earthquake:xx->xx, city, local, UTC,

    Mayor, Tsunami:xx-

    >xx

    , , , ,

    , :xx-

    >xx, ,

    :xx->xx, :xx->xx, ,

    Brazil, A, disappeared, search, flight,

    aircraft:xx->xx, ocean, ship:xx->xx, air:xx->xx, air, space

    , :xx->xx, ,

    :xx->xx, :xx-

    >xx, , ,

    :xx->xx,

    China, Olympic,

    China:xx->xx, Olympic:xx-

    >xx, Gore:xx->xx, Gore,

    gold, Beijing:xx-

    >xx, National

    Top

    ics

    ove

    r w

    ord

    s To

    pic

    s o

    ver

    con

    tro

    lled

    vo

    cab

    ula

    ry

  • Bi-Perspective Document Structure

    Words in

    Para 1

    Manually edited Wiki

    category tags words that summarize/

    categorize the document

    Wikipedia

    Words in

    Para 2

  • It is believed US investigators have asked for, but have been so far refused access to, evidence accumulated by German prosecutors probing allegations that former GM director, Mr. Lopez, stole industrial secrets from the US group and took them with him when he joined VW last year. This investigation was launched by US President Bill Clinton and is in principle a far more simple or at least more single-minded pursuit than that of Ms. Holland. Dorothea Holland, until four months ago was the only prosecuting lawyer on the German case.

    Understanding the Two Perspectives

    News Article

    Imagine browsing over reports in a topic cluster

  • It is believed US investigators have asked for, but have been so far refused access to, evidence

    accumulated by German prosecutors probing allegations that former GM director, Mr. Lopez, stole industrial secrets from the US group and took them with him when he joined VW last year.

    This investigation was launched by US President Bill Clinton and is in principle a far more simple

    or at least more single-minded pursuit than that of Ms. Holland. Dorothea Holland, until four months ago was the only prosecuting lawyer on the German case.

    Understanding the Two Perspectives

    News Article

    The document level perspective

    What words can we remember after a first browse?

    German, US, investigations, GM, Dorothea Holland, Lopez,

    prosecute

  • Important Verbs and Dependents

    Named Entities

    Understanding the Two Perspectives

    What helped us generate the Document Level perspective?

    ORGANIZATION

    It is believed US investigators have asked for, but have been so far refused access to, evidence accumulated by German prosecutors probing allegations that former GM director, Mr. Lopez, stole industrial secrets from the US group and took them with him when he joined VW last year. This investigation was launched by US President Bill Clinton and is in principle a far more simple or at least more single-minded pursuit than that of Ms. Holland. Dorothea Holland, until four months ago was the only prosecuting lawyer on the German case.

    News Article

    LOCATION

    MISC

    PERSON

    WHAT HAPPENED?

    The word level perspective

    The document level perspective

    German, US, investigations, GM, Dorothea Holland, Lopez,

    prosecute

  • What if we turn the document off?

    Summarization power of the perspectives

    It is believed US investigators have asked for, but have been so far refused access to, evidence accumulated by German prosecutors probing allegations that former GM director, Mr. Lopez, stole industrial secrets from the US group and took them with him when he joined VW last year. This investigation was launched by US President Bill Clinton and is in principle a far more simple or at least more single-minded pursuit than that of Ms. Holland Dorothea Holland, until four months ago was the only prosecuting lawyer on the German case.

    German, US, investigations, GM, Dorothea Holland, Lopez,

    prosecute

  • End

    (2

    )

    Documents are at least tagged from two different perspectives either implicit or explicit and one perspective affects the other

    Simplest example of implicit WL tagging binned positions indicating sections

    Simplest example of implicit DL tagging tag cloud

    It is believed US investigators have asked for, but have been so far refused access to, evidence accumulated by German prosecutors probing allegations that former GM director, Mr. Lopez, stole industrial secrets from the US group and took them with him when he joined VW last year. This investigation was launched by US President Bill Clinton and is in principle a far more simple or at least more single-minded pursuit than that of Ms. Holland. Dorothea Holland, until four months ago was the only prosecuting lawyer on the German case. tagcrowd.com

    Be

    gin

    (0

    ) M

    idd

    le (

    1)

    Assumptions of the Global Models

  • Document Level Perspectives

    Guided Summarization Track

    Multilingual Track

    Centers of Attentions (with regard to grammatical or semantic roles)

    Menu_foods:ne->ne, pet:nn->nn, unit:nn->nn, Henderson:ne->ne, wheat:nn->nn, food:subj->nn etc.

    Top 20 (tf-idf)docset words + Top 5 most frequent non-stopwords in the documents

    Menu_Foods, pet, associate, plant, sell, source, FDA, Henderson, agency, shelf, test, unit, Canadian, dog, food etc.

    Centers of Attentions (without regard to grammatical or semantic roles)

    (North):xx->xx, (injured):xx->xx, (investigation):xx->xx, ( London):xx->xx, (police):xx->xx etc.

    Top 20 (tf-idf)docset words + Top 5 most frequent non-stopwords in the documents

    (investigation), (houses), (search), (police), (station), (Kings), (Cross), (attack)etc. Multilingual stopwords

    found by Google translate

  • Word Level Perspectives

    Guided Summarization Track

    Named Entity classes (Person, Organization, Location, Misc, Date/time/money/number/ordinal/percent)

    Subjective class e.g. Of the 10 cats and dogs whose deaths have been linked to pet food that was recalled over the weekend, seven died last month in a taste test conducted by

    Multilingual Track

    {0, 1, 2, 3, 4}: Words annotated by positional bins document segregated into 5 sections

    prep_of - X

    Nsubj -

  • Global(Background) Models

    METag2LDA: A topic generating all DL tags in a document doesnt necessarily mean that the same topic generates all words in the document

    CorrMETag2LDA: A topic generating *all* DL tags in a document does mean that the same topic generates all words in the document

    Topic concentration parameter

    Document specific topic proportions

    Document content words

    Document Level (DL) tags

    Word Level (WL) tags

    Indicator variables

    Topic Parameters

    Tag Parameters

    CorrME- Tag2LDA

    METag2LDA

    The idea was to assign weights

    to words in sentences from

    a generative standpoint

  • Global(Background) Models

    CorrMETag2LDA METag2LDA

    U.S. :xxxx U.S.:nnobj

    0/1/2 etc.. PER, ORG etc..

  • Local Models - Guided

    Guided Summarization Track Collection of a bag of all nouns (Bag-nn) which are not proper nouns

    from the Document Level perspective Collection of a bag of all verbs (Bag-vb) which are not stopwords

    from the Word Level perspective Collection of the dependency parsing (using open-source Stanford

    CoreNLP parser) outputs for each sentence in the docset

    , = , =1

    ()=1

    where sentencei is within a context that is fit to the model METag

    2LDA

    Finallyby greedily optimizing: = + , , , *1, +

    Overlapping sentence removal and heuristic sentence pruning afterwards

  • Local Model - Multilingual

    Multilingual Track

    Purely based on probabilities!

    Take a multilingual sentence context (s1) where the central sentence is at least 10 words long

    Obtain the log likelihoods of the contexts to the trained corrMETag2LDA model with 30 topics

    Order the sentences in descending order of likelihoods

    Post-processing only involves keeping sentences within a length threshold, checking for overlaps and removing sentences beginning with a quote

  • Multilingual Track: Automatic scoring

    0

    0.05

    0.1

    0.15

    0.2

    0.25

    0.3

    0.35

    0.4

    recall-Arabic recall-Czech recall-English recall-French recall-Greek recall-Hebrew recall-H


Patient recall

GUIDE TO RECALL - ACGOV.org | Alameda County … · 2013-03-18 · 2 A Public Guide to Recall For County, School District, Special District and Local Judicial Offices . Table of Contents

Precision recall

Fasiculo 2 h x h - bvs.panalimentos.orgbvs.panalimentos.org/local/File/MANUAL_HACCP_FASCICULO_BPA_B… · FICHA TÉCNICA EDITOR OPS - Organização Pan-americana da Saúde ... (Recall)

PROCEDURE FOR RECALLING STATE AND LOCAL ...elections.cdn.sos.ca.gov/recalls/recall-procedures-guide.pdf2017/08/24 · PROCEDURE FOR RECALLING STATE AND LOCAL OFFICIALS Prepared by

Brand Recall

Automotive: Product Recall - oliverwyman.com · AUTOMOTIVE PRODUCT RECALL 1 Ford Recall History Puts Toyota Recalls in Perspective, US recall news, February 2010 2 Toyota recalls

Safety Recall Communication Guide · Safety Recall Communication Guide 2016 . 2 ... Dealer Recall Communication Guide | 2016 TABLE OF CONTENTS TOC . 3 Recall/Action Population Safety

Focus recall. - Axis Communications 3. How does focus recall work? The focus recall feature is very easy to use. The user sets a focus recall area by clicking the focus recall button

Toyota recall

Sentences, Paragraphs, and · PDF fileSentences, Paragraphs, and Compositions . Skills Practice for Chapters . 10-13 • Stlldent Worksheets ... niques such as combining sentences

RECALL REVIEW & RE-RELEASE OF RECALL OFFENDERS … · RECALL REVIEW & RE-RELEASE OF RECALL OFFENDERS ... Audit/monitoring: ... Annex D Guidance on completing Recall & Review Reports

Smartphone recall

IMPORTANT SAFETY RECALL Safety Recall: 21V-179 21V-184 …

Safety Recall D55 Safety Recall D55 D55 ––– Right Steering

Recall procedures

Safety Recall Communication Guide 2016Safety Recall Communication Guide | 2016 TABLE OF CONTENTS TOC . 3 Recall/Action Population Safety Recall P78 - Passenger Airbag Inflator 2004

Acknowledgments - Columbia Universitysfchang/papers/talk-ICME09...0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2 Recall Precision Flower Local + Global Features Local Feature Only Avg

Children's Comprehension and Local-to-Global Recall of

Civics Local Governm…  · Web view2016-08-22 · Lesson Plan: Local Government Services. Lesson Basics. ... Recall oral vocabulary through word domains. L2.1b Respond appropriately

DEVELOPMENT OF A RECALL PLANFILE/chapter_10_recall.pdfDevelopment of a Recall Plan Chapter 10 DEVELOPMENT OF A RECALL PLAN 1.0 WHAT IS A RECALL? 1.1 When is a Recall Necessary? 1.2

Drug Recall

Local anesthetics. Objectives Recall how an action potential is generated and propagated Classify local anesthtics Describe the machanism of action, pharmacokinetics

F37 Recall

Recall 2008

Holt Handbook: Grammar, Usage, Mechanics, · PDF fileSentences : Fourth Course, / 0030661471, 9780030661471 ... // ... is featured in this new edition

FOOD RECALL PLAN Recall Team Personnel - HACCP Manager Software

Advertising recall

ALLIANZ GLOBAL CORPORATE & SPECIALTY PRODUCT RECALL · Drivers of the product recall risk landscape Eight emerging developments in product recall risk By the numbers - product recall

Anatomy Recall

SENTENCES: ELEMENTS, PATTERNS, TYPES - · PDF fileSENTENCES: ELEMENTS, PATTERNS, TYPES PRETEST ... • Identify four basic sentence patterns. • Convert fragments into complete sentences

Unemployment Insurance, Recall Expectations, and Unemployment …unionstats.gsu.edu/9220/Katz-Meyer(1990)_QJE_Insurance, Recall... · UNEMPLOYMENT INSURANCE, RECALL EXPECTATIONS,

Recall: Stride Scheduling Recall: Linux Completely Fair

The Recall ImPact - WordPress.com · The Recall ImPact Medical Device Manufacturing An involuntary recall which is mandated by a regulative agency involuntary recall A voluntary recall,

By: Anna Levina edited: Rhett Chien. Section 10.1 Maclaurin and Taylor polynomial Approximations Recall: Local Linear Approximation Local Quadratic (Cubic)