The Time Yards Model: Towards Reshuffling Puzzled Fabulas in ...dcristea/Talks/Towards...

TheTimeYardsModel:TowardsReshufflingPuzzledFabulas

inTextsDanCristea

“AlexandruIoanCuza”UniversityofIași,FacultyofComputerScienceRomanianAcademyIașibranch,InsKtuteforComputerScience

dcristea@info.uaic.ro

Fabula?...

•  Thebackboneofthestory.•  EverystoryisamenKonofafabula,i.e.,asequenceofchronologicallyorderedandlogicallyconnectedeventsinvolvingoneormoreactors.

J.Bruner,“Actualminds,possibleworlds”.Cambridge,MASS.,HarvardUniversityPress,1986.M.Bal,“Narratology:introducKontothetheoryofnarraKve”.Trans.ChrisKnevanBoheemen.2nded.Toronto:UofToronto,1997.

RAAI-2017,18thJune,Univ.Bucharest

Arefabulaspuzzled?Example1

•  Inthekitchen,wai-ngforthewatertoboil,MargaretwonderedhowwasitthatshejumpedsonaturallytoembraceAdam.Shecouldnotrealizewhathadmadeherfeelsohappytoseehimagain.

TashAw:Mapoftheinvisibleworld

RAAI-2017,18thJune,Univ.Bucharest

Example1:segmentaKon

•  [Inthekitchen,wai-ngforthewatertoboil,Margaretwonderedhowwasitthat]

•  [shejumpedsonaturallytoembraceAdam.]

•  [Shecouldnotrealisewhathadmadeher]

•  [feelsohappytoseehimagain.]

Margaret:inthekitchen,wonderingsmth

Margaret&Adam:somewhere,MargaretembracesAdam

Margaret:inthekitchen,notrealisingsmth

Margaret&Adam:somewhere,MargaretfeelshappyRAAI-2017,18thJune,Univ.Bucharest

Example1:ourpercepKonofKme

MargaretMargaret&Adam

RAAI-2017,18thJune,Univ.Bucharest

PuzzledfabulaExample2

•  BetweenthetworoundsofpreparingtomatosauceandaquickchatonFacebook,IrememberedthatIputTeodorBaconschi'sbook“Facebook.Factorynarcissism”,publishedthisyearbyHumanitas,amongthebookslabelled"tonecessarilyread”.Icouldnotstopmyselffromreadingittothelastline.

RAAI-2017,18thJune,Univ.Bucharest

Example2:segmentaKon•  [BetweenthetworoundsofpreparingtomatosauceandaquickchatonFacebook,Irememberedthat]

•  [IputTeodorBaconschi'sbook“Facebook.Factorynarcissism”…amongthebookslabelled"tonecessarilyread”.]

•  [publishedthisyearbyHumanitas,]

•  [Icouldnotstopmyselffromreadingittothelastline.]

RAAI-2017,18thJune,Univ.Bucharest

myself:somewhere1,cooking&chaang,remembering

myself:somewhere2,cooking&chaKng

Humanitas:somewhere3,publishing

myself:somewhere2,reading

Example2:ourpercepKonofKme

Humanitas

myself

RAAI-2017,18thJune,Univ.Bucharest

Goals•  AcomputaKonalrepresentaKonofnarraKvephenomenaoccurringintexts,withaspecialemphasison:– KmedevelopmentofnarraKves,involvementofcharacters,

– changesofKmeseangs:flashbacks(remembers)andflashforwards(supposiKons,dreams,hopes),

–  transiKonsfromoneplot(theme)toanother,– perspecKvesofdifferentnarratorsonthesamestory

RAAI-2017,18thJune,Univ.Bucharest

Mainideasinthismodel•  Storydevelopments(fabulas,happenings,plots)gluetogethercharactersoverKme

•  Timeisnotlinearintexts:– significantKmepoints:commute,rupture,joinandsplit

•  VisualisaKon:threadsthatinterlaceandseparate– muchlikerailwaysdoincomplexrailyards:-meyards

•  ProposenotaKonsfortheserepresentaKons•  ExploitaKon?

RAAI-2017,18thJune,Univ.Bucharest

Roots…•  Temporalreasoning(andtemporallogic:Allen,etc.)•  Muchinterest:–  informaKonextracKon– quesKonanswering–  textualentailment– decipheringsemanKccontentoftexts

See:ACLworkshoponSpa-alandTemporalReasoning(2001),LRECworkshoponAnnota-onStandardsforTemporalInforma-oninNaturalLanguage(2002)

RAAI-2017,18thJune,Univ.Bucharest

Relatedwork–  AnnotaKonconvenKons/standardstocopewithKmeas

menKonedinlanguageandtext•  TimeML

•  TIMEX3–explicittemporalexpressions(Kmes,dates,duraKons,etc.)•  SIGNAL–funcKonwordsthatindicatehowtemporalobjectsaretoberelatedtoeachother

(e.gon,during,when,if,etc.)•  TLINK,SLINK,ALINK–temporalrelaKonshipholdingbetweenevents,aspectualevents,

eventsandKmeexpressionsoreventsandsignals•  EVENT–eventnotaKon

–  TARSQIToolkitcapabletorecognise:•  temporalexpressions(TimeEx)•  events•  relaKonsbetweenthem

•  JamesPustejovskyetal.(2003).TimeML:RobustSpecificaKonofEventandTemporalExpressionsinText,AAAITechnicalReportSS-03-07

•  Verhagen&Pustejovsky:TemporalProcessingwiththeTARSQIToolkit,Coling2008RAAI-2017,18thJune,Univ.Bucharest

Weareinterestedinconnectedsequencesofevents

•  InNLP,onnews– TimeLine:arepresentaKonofeventswhicharechronologicallyordered,mainlyspecifictoanenKty(acharacterorparKcipantinanacKon,ageographicalplaceorregion)

– StoryLine:groupsofinteracKngTimeLines,ormergersoftwoormoreTimeLineswherethesamecharactersorenKKesaretakingpartintheacKon.ThetextstructureobtainedisnotrelatedtotheflowofKme.

ChambersandJurafsky(2008).UnsupervisedLearningofNarraKveEventChains.InACL.

Laparra,AldabeandRigau(2015).FromTimeLinestoStoryLines:ApreliminaryproposalforevaluaKngnarraKves.InACL-IJCNLP.

MoKvaKonandgoal

•  Largetextsaredifferentthennews– news:sequencesofevents,opinions,commentaries– novels:eventsareseldompresentedinnon-sequenKalorder,sameeventsareinterpretedfromdifferentperspecKves

•  CharactersparKcipateinevents•  Eachhasher/hisowntrajectory/desKny/evoluKon•  Althoughcharacters’trajectoriesintersectinKme,onewouldliketodisKnguish/separatethem

RAAI-2017,18thJune,Univ.Bucharest

TimeSegments

•  AconKguouspieceoftextcharacterisedbyunityof:– actors(whoisinvolved)– space(physicalorvirtual),alsoasasequenceoflocaKons(likeinjourneys)

– Kme(interval)–  type•  NAR–typicalnarraKons;storyKmeflowsconstantlyahead•  SUP–supposiKons,speculaKons,dreams,hopes•  GEN–generalknowledge;noKmeinvolved

– perspecKve(whoistheteller)RAAI-2017,18thJune,Univ.Bucharest

TimeSegments

•  ATSgroupsasequenceofeventsofonecharacterorastablegroupofcharactersoveraperiodofstoryKme,whichisuninterruptedlytoldinaspanoftext.–  inaTS,thestoryKmeevolveslinearlyornotatall– oneTScanbenarratedbyonlyonerelator

•  AbookismadeupofasequenceofTimeSegments

RAAI-2017,18thJune,Univ.Bucharest

TimeTracks•  OutofTSs,TimeTracks(TTs)canbeassembled.•  ATTisasequenceofTSsfilteredandorderedbytwocondiKons:oneormoreactorsthatconnectandascendantKme.

•  TTsputinevidencetrajectoriesofcharactersorgroupsinstorydevelopments(desKnies)

•  Space,mostowen,changeoverKmeinTTs•  ATTcanbenarratedbyoneormorerelators.

RAAI-2017,18thJune,Univ.Bucharest

UnityofspaceversusconnecKvity

•  TobeinthesameTT,agroupofcharactersshouldbeconsciouslyconnectedwithinthesamespace:–  twofriendsthatmeetandtalkonthestreet– afamilysharingthesamehouse– colleaguesinschool,etc.–  twopeoplehavingaconversaKon•  facetoface=>samephysicalspace•  throughatelephoneline,etc.=>samevirtualspace

RAAI-2017,18thJune,Univ.Bucharest

Margaretinthekitchen…

•  TS1:[Inthekitchen,wai-ngforthewatertoboil,Margaretwonderedhowwasitthat]

•  TS2:[shejumpedsonaturallytoembraceAdam.]

•  TS3:[Shecouldnotrealizewhathadmade]•  TS4:[herfeelsohappytoseehimagain...]”

RAAI-2017,18thJune,Univ.Bucharest

TTsandTSsinMargaret&Adam’sepisode

commutepoints

RAAI-2017,18thJune,Univ.Bucharest

TheTimeYard

•  ATimeYard(TY)isarepresentaKon(resemblingadiagram)ofthecharacters’desKniesinatext,unfoldedonthestoryKmeaxis

•  ATYismadeoutofallTTsofthecharactersinthebook

RAAI-2017,18thJune,Univ.Bucharest

BorderpointsofTTs

•  Timetrackscanbeborderedby:– startpoints–wheretheystart,– endpoints–wheretheyfinish,– splitpoints–whereoneKmetracksplitsintotwoseparateKmetracks,

–  joinpoints–inwhichtwodifferentKmetracksmeat

RAAI-2017,18thJune,Univ.Bucharest

Splitpoint

•  TS1:[UptoclimbintothetruckanddisappearaPerthetarpaulinfalldown,]

•  TS2:[hefollowedthemslowly,withhisclumsygait.]

RAAI-2017,18thJune,Univ.Bucharest

Joinpoint

•  TS1:[Itwasonlywhenshecametothedoorwaythatsherealized]

•  TS2:[someonewasthere,lyingonthefrontsteps.Hewasaboy,ateenager,almostcrouchedinthewomb.]

RAAI-2017,18thJune,Univ.Bucharest

TashAw’s“Mapoftheinvisibleworld”Abird’seyeKmeyard

RAAI-2017,18thJune,Univ.Bucharest

AnXMLnotaKon–inaddiKontothoseofTimeML

•  AutomaKcsegmentaKonofthetext=>Actors,KmesegmentsandtemporalrelaKons: <ACTOR ID ALIAS-LIST>…</ACTOR>

<TS ID NAME ACTORS TYPE LOC PER>…</TS> <TREL ID FROM REL TO/>

•  AselecKonprocess=>Timetracks:<TT ID NAME ACTORS TS-LIST LEFT-EP RIGHT-EP/> –  LEFT-EP:“START”|IDofaSPLITend-point–  RIGHT-EP:“STOP”|IDaJOINend-point

RAAI-2017,18thJune,Univ.Bucharest

ReadingtheTYdiagrams

•  Trackingcharacters’desKnies(developments)=>inboldinthefigure:Adam’strajectory=>amereselecKonoperaKoninthesetofTSelements=>producefocusedsummaries=>comparedifferentopinionsonthesamedevelopments…

RAAI-2017,18thJune,Univ.Bucharest

ReadingtheTYdiagrams•  Whenabooknarratesaboutthefirst16yearsofMarys’life,beforemovingfromthehouseofherparentsinanothertowntofollowthelasttwoyearsofcollege,wefindouton100pagesmanydetails:•  eachdayMarywenttoschool,intheholidaysshewenttoher

grandparentshouseinthecountryside,andsheenjoyedgoingsomany-mestothecinema,mee-ngfriendsetc…

•  However,asummaryshouldsay:– Marylivedwithherfamilyun-ltheageof16…

=>puKngthetextfurtherawayfromtheeyes,aKmetrackcouldbesummarisedinmulKpleways

TowardsalogicofTimeTracks

If:TT(p)↓Kme=[t1,t2]=selectfromTT(p)onlythosedevelopmentshappeningintheinterval[t1,t2](anorderedsetofsub-TTs)TT(p)↓Kme=theKmeintervalelapsedbetweenthefirsteventandthelasteventmenKonedinTT(p)TT(p)↓loc=setoflocaKonsofTT(p)

Then:wesaythatasetofcharactersP={p1,…,pk}sharethesamespacesduringaKmeinterval[t1,t2]iftheset{TT(pj)},withjɛ{1,...,k}issuchthatsɛTT(pj)↓Kme=[t1,t2]↓locforeachjɛ{1,...,k}and∩TT(pj)↓loc=s↓Kme⊃[t1,t2]

RAAI-2017,18thJune,Univ.Bucharest

ReasoningabouttextswithTYMIf:TT(p)↓dur=theduraKonofTT(p)cood(s)=coordinatesofthelocaKonsS(C)=areaofacountryC

Then:WesaythatthesetofcharactersP={p1,…,pk}arecompatriotsinthecountryCifitistruethat∀pjinP,∀sɛTT(pj)↓locandcoord(s)ɛS(C):∑(TT(pj)↓loc=s↓dur)»∑(TT(pj)↓loc=l↓dur),∀lɛTT(pj)↓locbutcoord(l)∉S(C).ThisisbasedonthefollowingdefiniKonofsomeonelivinginacountry:theduraKonoflivinginthatcountryismuchhigherthanthatoflivingoutsideit.

RAAI-2017,18thJune,Univ.Bucharest

Justimagine…

•  …thatthereisatechnologythatrecordstheTTofpersonswithhighimpactinacountry

•  then...⇒ pagesofhistorycanbeautomaKcallywri�en,withaproperintelligentsummarisaKonagent

RAAI-2017,18thJune,Univ.Bucharest

Acknowledgements•  ToHumanitasPublishingHouse,fortheRomanianversionofTash

Aw’snovelMapoftheinvisibleworldinthetranslaKonofFloricaSincu

•  TotheWylieAgency,UK,foragreeingtouseforreseachtheoriginalEnglishversionofTashAw’snovel

•  TomyclassesoffirstyearmasterstudentsinComputaKonalLinguisKcs,inbothseries2015-2016and2016-2017,forlivelyeveningdebatesduringseminarhoursthathelpedmerefinedetailsofthemodelandestablishannotaKonconvenKonsandfortheirparKcipaKoningroupannotaKonexperiments

•  TomyPhDstudentAndreeaMacovei,forannotaKngtheRomanianversionofthenovelandco-authoringpartsofthisresearch

•  ToIuliana-AlexandraFleșcan-Lovin-ArseniforannotaKngtheEnglishversionofthebook

•  ToEmiPeiaforimplemenKngtheannotatorandtheTYvisualiser