the time yards model: towards reshuffling puzzled fabulas in ...dcristea/talks/towards...

32
The Time Yards Model: Towards Reshuffling Puzzled Fabulas in Texts Dan Cristea “Alexandru Ioan Cuza” University of Iași, Faculty of Computer Science Romanian Academy Iași branch, InsKtute for Computer Science [email protected]

Upload: others

Post on 28-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TheTimeYardsModel:TowardsReshufflingPuzzledFabulas

inTextsDanCristea

“AlexandruIoanCuza”UniversityofIași,FacultyofComputerScienceRomanianAcademyIașibranch,InsKtuteforComputerScience

[email protected]

Page 2: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Fabula?...

•  Thebackboneofthestory.•  EverystoryisamenKonofafabula,i.e.,asequenceofchronologicallyorderedandlogicallyconnectedeventsinvolvingoneormoreactors.

J.Bruner,“Actualminds,possibleworlds”.Cambridge,MASS.,HarvardUniversityPress,1986.M.Bal,“Narratology:introducKontothetheoryofnarraKve”.Trans.ChrisKnevanBoheemen.2nded.Toronto:UofToronto,1997.

RAAI-2017,18thJune,Univ.Bucharest

Page 3: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Arefabulaspuzzled?Example1

•  Inthekitchen,wai-ngforthewatertoboil,MargaretwonderedhowwasitthatshejumpedsonaturallytoembraceAdam.Shecouldnotrealizewhathadmadeherfeelsohappytoseehimagain.

TashAw:Mapoftheinvisibleworld

RAAI-2017,18thJune,Univ.Bucharest

Page 4: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Example1:segmentaKon

•  [Inthekitchen,wai-ngforthewatertoboil,Margaretwonderedhowwasitthat]

•  [shejumpedsonaturallytoembraceAdam.]

•  [Shecouldnotrealisewhathadmadeher]

•  [feelsohappytoseehimagain.]

Margaret:inthekitchen,wonderingsmth

Margaret&Adam:somewhere,MargaretembracesAdam

Margaret:inthekitchen,notrealisingsmth

Margaret&Adam:somewhere,MargaretfeelshappyRAAI-2017,18thJune,Univ.Bucharest

Page 5: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Example1:ourpercepKonofKme

MargaretMargaret&Adam

RAAI-2017,18thJune,Univ.Bucharest

Page 6: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

PuzzledfabulaExample2

•  BetweenthetworoundsofpreparingtomatosauceandaquickchatonFacebook,IrememberedthatIputTeodorBaconschi'sbook“Facebook.Factorynarcissism”,publishedthisyearbyHumanitas,amongthebookslabelled"tonecessarilyread”.Icouldnotstopmyselffromreadingittothelastline.

RAAI-2017,18thJune,Univ.Bucharest

Page 7: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Example2:segmentaKon•  [BetweenthetworoundsofpreparingtomatosauceandaquickchatonFacebook,Irememberedthat]

•  [IputTeodorBaconschi'sbook“Facebook.Factorynarcissism”…amongthebookslabelled"tonecessarilyread”.]

•  [publishedthisyearbyHumanitas,]

•  [Icouldnotstopmyselffromreadingittothelastline.]

RAAI-2017,18thJune,Univ.Bucharest

myself:somewhere1,cooking&chaang,remembering

myself:somewhere2,cooking&chaKng

Humanitas:somewhere3,publishing

myself:somewhere2,reading

Page 8: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Example2:ourpercepKonofKme

Humanitas

myself

RAAI-2017,18thJune,Univ.Bucharest

Page 9: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Goals•  AcomputaKonalrepresentaKonofnarraKvephenomenaoccurringintexts,withaspecialemphasison:– KmedevelopmentofnarraKves,involvementofcharacters,

– changesofKmeseangs:flashbacks(remembers)andflashforwards(supposiKons,dreams,hopes),

–  transiKonsfromoneplot(theme)toanother,– perspecKvesofdifferentnarratorsonthesamestory

RAAI-2017,18thJune,Univ.Bucharest

Page 10: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Mainideasinthismodel•  Storydevelopments(fabulas,happenings,plots)gluetogethercharactersoverKme

•  Timeisnotlinearintexts:– significantKmepoints:commute,rupture,joinandsplit

•  VisualisaKon:threadsthatinterlaceandseparate– muchlikerailwaysdoincomplexrailyards:-meyards

•  ProposenotaKonsfortheserepresentaKons•  ExploitaKon?

RAAI-2017,18thJune,Univ.Bucharest

Page 11: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Roots…•  Temporalreasoning(andtemporallogic:Allen,etc.)•  Muchinterest:–  informaKonextracKon– quesKonanswering–  textualentailment– decipheringsemanKccontentoftexts

See:ACLworkshoponSpa-alandTemporalReasoning(2001),LRECworkshoponAnnota-onStandardsforTemporalInforma-oninNaturalLanguage(2002)

RAAI-2017,18thJune,Univ.Bucharest

Page 12: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Relatedwork–  AnnotaKonconvenKons/standardstocopewithKmeas

menKonedinlanguageandtext•  TimeML

•  TIMEX3–explicittemporalexpressions(Kmes,dates,duraKons,etc.)•  SIGNAL–funcKonwordsthatindicatehowtemporalobjectsaretoberelatedtoeachother

(e.gon,during,when,if,etc.)•  TLINK,SLINK,ALINK–temporalrelaKonshipholdingbetweenevents,aspectualevents,

eventsandKmeexpressionsoreventsandsignals•  EVENT–eventnotaKon

–  TARSQIToolkitcapabletorecognise:•  temporalexpressions(TimeEx)•  events•  relaKonsbetweenthem

•  JamesPustejovskyetal.(2003).TimeML:RobustSpecificaKonofEventandTemporalExpressionsinText,AAAITechnicalReportSS-03-07

•  Verhagen&Pustejovsky:TemporalProcessingwiththeTARSQIToolkit,Coling2008RAAI-2017,18thJune,Univ.Bucharest

Page 13: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Weareinterestedinconnectedsequencesofevents

•  InNLP,onnews– TimeLine:arepresentaKonofeventswhicharechronologicallyordered,mainlyspecifictoanenKty(acharacterorparKcipantinanacKon,ageographicalplaceorregion)

– StoryLine:groupsofinteracKngTimeLines,ormergersoftwoormoreTimeLineswherethesamecharactersorenKKesaretakingpartintheacKon.ThetextstructureobtainedisnotrelatedtotheflowofKme.

ChambersandJurafsky(2008).UnsupervisedLearningofNarraKveEventChains.InACL.

Laparra,AldabeandRigau(2015).FromTimeLinestoStoryLines:ApreliminaryproposalforevaluaKngnarraKves.InACL-IJCNLP.

Page 14: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

MoKvaKonandgoal

•  Largetextsaredifferentthennews– news:sequencesofevents,opinions,commentaries– novels:eventsareseldompresentedinnon-sequenKalorder,sameeventsareinterpretedfromdifferentperspecKves

•  CharactersparKcipateinevents•  Eachhasher/hisowntrajectory/desKny/evoluKon•  Althoughcharacters’trajectoriesintersectinKme,onewouldliketodisKnguish/separatethem

RAAI-2017,18thJune,Univ.Bucharest

Page 15: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TimeSegments

•  AconKguouspieceoftextcharacterisedbyunityof:– actors(whoisinvolved)– space(physicalorvirtual),alsoasasequenceoflocaKons(likeinjourneys)

– Kme(interval)–  type•  NAR–typicalnarraKons;storyKmeflowsconstantlyahead•  SUP–supposiKons,speculaKons,dreams,hopes•  GEN–generalknowledge;noKmeinvolved

– perspecKve(whoistheteller)RAAI-2017,18thJune,Univ.Bucharest

Page 16: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TimeSegments

•  ATSgroupsasequenceofeventsofonecharacterorastablegroupofcharactersoveraperiodofstoryKme,whichisuninterruptedlytoldinaspanoftext.–  inaTS,thestoryKmeevolveslinearlyornotatall– oneTScanbenarratedbyonlyonerelator

•  AbookismadeupofasequenceofTimeSegments

RAAI-2017,18thJune,Univ.Bucharest

Page 17: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TimeTracks•  OutofTSs,TimeTracks(TTs)canbeassembled.•  ATTisasequenceofTSsfilteredandorderedbytwocondiKons:oneormoreactorsthatconnectandascendantKme.

•  TTsputinevidencetrajectoriesofcharactersorgroupsinstorydevelopments(desKnies)

•  Space,mostowen,changeoverKmeinTTs•  ATTcanbenarratedbyoneormorerelators.

RAAI-2017,18thJune,Univ.Bucharest

Page 18: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

UnityofspaceversusconnecKvity

•  TobeinthesameTT,agroupofcharactersshouldbeconsciouslyconnectedwithinthesamespace:–  twofriendsthatmeetandtalkonthestreet– afamilysharingthesamehouse– colleaguesinschool,etc.–  twopeoplehavingaconversaKon•  facetoface=>samephysicalspace•  throughatelephoneline,etc.=>samevirtualspace

RAAI-2017,18thJune,Univ.Bucharest

Page 19: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Margaretinthekitchen…

•  TS1:[Inthekitchen,wai-ngforthewatertoboil,Margaretwonderedhowwasitthat]

•  TS2:[shejumpedsonaturallytoembraceAdam.]

•  TS3:[Shecouldnotrealizewhathadmade]•  TS4:[herfeelsohappytoseehimagain...]”

RAAI-2017,18thJune,Univ.Bucharest

Page 20: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TTsandTSsinMargaret&Adam’sepisode

commutepoints

RAAI-2017,18thJune,Univ.Bucharest

Page 21: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TheTimeYard

•  ATimeYard(TY)isarepresentaKon(resemblingadiagram)ofthecharacters’desKniesinatext,unfoldedonthestoryKmeaxis

•  ATYismadeoutofallTTsofthecharactersinthebook

RAAI-2017,18thJune,Univ.Bucharest

Page 22: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

BorderpointsofTTs

•  Timetrackscanbeborderedby:– startpoints–wheretheystart,– endpoints–wheretheyfinish,– splitpoints–whereoneKmetracksplitsintotwoseparateKmetracks,

–  joinpoints–inwhichtwodifferentKmetracksmeat

RAAI-2017,18thJune,Univ.Bucharest

Page 23: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Splitpoint

•  TS1:[UptoclimbintothetruckanddisappearaPerthetarpaulinfalldown,]

•  TS2:[hefollowedthemslowly,withhisclumsygait.]

RAAI-2017,18thJune,Univ.Bucharest

Page 24: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Joinpoint

•  TS1:[Itwasonlywhenshecametothedoorwaythatsherealized]

•  TS2:[someonewasthere,lyingonthefrontsteps.Hewasaboy,ateenager,almostcrouchedinthewomb.]

RAAI-2017,18thJune,Univ.Bucharest

Page 25: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TashAw’s“Mapoftheinvisibleworld”Abird’seyeKmeyard

RAAI-2017,18thJune,Univ.Bucharest

Page 26: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

AnXMLnotaKon–inaddiKontothoseofTimeML

•  AutomaKcsegmentaKonofthetext=>Actors,KmesegmentsandtemporalrelaKons: <ACTOR ID ALIAS-LIST>…</ACTOR>

<TS ID NAME ACTORS TYPE LOC PER>…</TS> <TREL ID FROM REL TO/>

•  AselecKonprocess=>Timetracks:<TT ID NAME ACTORS TS-LIST LEFT-EP RIGHT-EP/> –  LEFT-EP:“START”|IDofaSPLITend-point–  RIGHT-EP:“STOP”|IDaJOINend-point

RAAI-2017,18thJune,Univ.Bucharest

Page 27: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

ReadingtheTYdiagrams

•  Trackingcharacters’desKnies(developments)=>inboldinthefigure:Adam’strajectory=>amereselecKonoperaKoninthesetofTSelements=>producefocusedsummaries=>comparedifferentopinionsonthesamedevelopments…

RAAI-2017,18thJune,Univ.Bucharest

Page 28: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

ReadingtheTYdiagrams•  Whenabooknarratesaboutthefirst16yearsofMarys’life,beforemovingfromthehouseofherparentsinanothertowntofollowthelasttwoyearsofcollege,wefindouton100pagesmanydetails:•  eachdayMarywenttoschool,intheholidaysshewenttoher

grandparentshouseinthecountryside,andsheenjoyedgoingsomany-mestothecinema,mee-ngfriendsetc…

•  However,asummaryshouldsay:– Marylivedwithherfamilyun-ltheageof16…

=>puKngthetextfurtherawayfromtheeyes,aKmetrackcouldbesummarisedinmulKpleways

Page 29: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

TowardsalogicofTimeTracks

If:TT(p)↓Kme=[t1,t2]=selectfromTT(p)onlythosedevelopmentshappeningintheinterval[t1,t2](anorderedsetofsub-TTs)TT(p)↓Kme=theKmeintervalelapsedbetweenthefirsteventandthelasteventmenKonedinTT(p)TT(p)↓loc=setoflocaKonsofTT(p)

Then:wesaythatasetofcharactersP={p1,…,pk}sharethesamespacesduringaKmeinterval[t1,t2]iftheset{TT(pj)},withjɛ{1,...,k}issuchthatsɛTT(pj)↓Kme=[t1,t2]↓locforeachjɛ{1,...,k}and∩TT(pj)↓loc=s↓Kme⊃[t1,t2]

RAAI-2017,18thJune,Univ.Bucharest

Page 30: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

ReasoningabouttextswithTYMIf:TT(p)↓dur=theduraKonofTT(p)cood(s)=coordinatesofthelocaKonsS(C)=areaofacountryC

Then:WesaythatthesetofcharactersP={p1,…,pk}arecompatriotsinthecountryCifitistruethat∀pjinP,∀sɛTT(pj)↓locandcoord(s)ɛS(C):∑(TT(pj)↓loc=s↓dur)»∑(TT(pj)↓loc=l↓dur),∀lɛTT(pj)↓locbutcoord(l)∉S(C).ThisisbasedonthefollowingdefiniKonofsomeonelivinginacountry:theduraKonoflivinginthatcountryismuchhigherthanthatoflivingoutsideit.

RAAI-2017,18thJune,Univ.Bucharest

Page 31: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Justimagine…

•  …thatthereisatechnologythatrecordstheTTofpersonswithhighimpactinacountry

•  then...⇒ pagesofhistorycanbeautomaKcallywri�en,withaproperintelligentsummarisaKonagent

RAAI-2017,18thJune,Univ.Bucharest

Page 32: The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards reshuffling.ppt.pdf · • Every story is a menKon of a fabula, i.e., a sequence of chronologically

Acknowledgements•  ToHumanitasPublishingHouse,fortheRomanianversionofTash

Aw’snovelMapoftheinvisibleworldinthetranslaKonofFloricaSincu

•  TotheWylieAgency,UK,foragreeingtouseforreseachtheoriginalEnglishversionofTashAw’snovel

•  TomyclassesoffirstyearmasterstudentsinComputaKonalLinguisKcs,inbothseries2015-2016and2016-2017,forlivelyeveningdebatesduringseminarhoursthathelpedmerefinedetailsofthemodelandestablishannotaKonconvenKonsandfortheirparKcipaKoningroupannotaKonexperiments

•  TomyPhDstudentAndreeaMacovei,forannotaKngtheRomanianversionofthenovelandco-authoringpartsofthisresearch

•  ToIuliana-AlexandraFleșcan-Lovin-ArseniforannotaKngtheEnglishversionofthebook

•  ToEmiPeiaforimplemenKngtheannotatorandtheTYvisualiser