word-learning from visual prevalence: evidence from first ... · frequent nouns from the first,...
TRANSCRIPT
![Page 1: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/1.jpg)
Word-learningfromvisualprevalence:evidencefromfirst-
personinfantviews
ElizabethM.Clerkin,ChenYu, &LindaB.Smith
DepartmentofPsychologicalandBrainSciences,IndianaUniversity
11/4/16 BUCLD 1
![Page 2: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/2.jpg)
11/4/16 BUCLD 2
BreakingintowordlearningTheproblemofuncertainty&clutter
![Page 3: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/3.jpg)
Amappingproblem
• Thisconceptualizationisattheheartofcurrentdebatesaboutcross-situationalword-referentlearning(Medina,Snedeker,Trueswell,&Gleitman,2011;Smith,Suanda,&Yu,2014)
11/4/16 BUCLD 3
Cup
![Page 4: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/4.jpg)
11/4/16 BUCLD 4
![Page 5: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/5.jpg)
11/4/16 BUCLD 5
Today:Theveryearlysideofobjectnamelearning
8to10montholds
Birth& 12&months& 24&months&
First&words& Name&explosion&
![Page 6: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/6.jpg)
Today:Theproblemisonthevisualside
11/4/16 BUCLD 6
Long-timeassumptionthatbasiclevelcategoriesareperceptually“given”(Rosch,etal.,1976;Gentner,1982)However,humanvisionandmachinevisionresearchshowsthatvisualobjectrecognitionisnotatrivialproblembutonethatrequiresmassivevisualexperiencewithspecificcategories(Kourtzi&Connor,2011;Pinto,Cox,&DiCarlo,2008)Weknowalotaboutthewordsinfantshearandhowtheyarerelevanttoinfant’slaterwordlearning(seeHart&Risley,1995)
![Page 7: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/7.jpg)
11/4/16 BUCLD 7
Thenaturalstatisticsofobjectsininfants’viewsWeproposethatthenaturaldistributionofobjectsininfants’daytodayvisualenvironmentscanhelpsolvetheproblemsofreferentialuncertaintyandvisualobjectrecognition
Manynaturaldistributionsareextremelyright-skewed
Ifasmallsetofobjectsare pervasivelypresent,theycouldformanearlyselectsetofrecognizedobjectsforwordlearning
![Page 8: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/8.jpg)
11/4/16 BUCLD 8
Infantperspectivescenes
![Page 9: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/9.jpg)
11/4/16 BUCLD 9
HeadCamera(Looxcie)
![Page 10: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/10.jpg)
11/4/16 BUCLD 10
Corpuscollection
8infants(3male)Ranginginagefrom8.5to10.5months,M=9.2months
8.5totalhoursoffootage(meanpersubject=1.1,SD=0.54)Thetotalnumberofindividualmealtimeeventsinthesamplewas147• Meandurationof3.5min(SD=7.2)
The917,207(total)framesinthemealtimecorpusweresampledat1/5Hzforcoding• Thisyieldedatotalof5,775codedscenes
![Page 11: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/11.jpg)
11/4/16 BUCLD 11
Corpuscollection
• Imagesanalyzedwerecapturedduringinfantmealtimes• Mealtime=anyeating/foodrelatedevent• Occursmultiplestimesperdayeveryday• Likelyinvolvesalargevarietyofcommonobjects• Occursinmanydifferentcontexts
![Page 12: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/12.jpg)
11/4/16 BUCLD 12
Codingofthecorpus
About500naïveadults(AmazonMechanicalTurk)Task:namethefivemostobviousobjectsinthescene,usingbasiclevelnounsCoderssawimagesinsequentialsetsof20Eachscenewascodedby4individuals
![Page 13: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/13.jpg)
745uniqueobjectnames
FirstNouns(133)– normativelylearnedby16months(CommunicativeDevelopmentalInventory- CDI)EarlyNouns(59)– normativelylearnedbetween16and30months(ToddlerCDI)LaterNouns(553)– othernounsnamedbycodersthatwerenotoneitherinventory• AoA:6.15years(SD=1.56)
11/4/16 BUCLD 13
Objectnamecategories
![Page 14: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/14.jpg)
11/4/16 BUCLD 14
![Page 15: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/15.jpg)
11/4/16 BUCLD 15
![Page 16: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/16.jpg)
Areparentsnamingtheseobjects?
• Couldvisualpervasivenessitself– withouthigh-frequencynaming–supportlearningfirstobjectnames?• Wethinkthatitmight:• Byincreasingthestrengthofvisualobjectrepresentationsinclutteredscenes• Andthusthelikelihoodofselecting,remembering,andtherebyaggregatinganobjectasareferent
11/4/16 BUCLD 16
![Page 17: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/17.jpg)
• Thespeechfromtheseinfantheadcameravideoswastranscribedinentirety• Includingchild-directedspeech,adult-directedspeech,etc.
• “Namingmoments”wereextractedforeachofthe745objectsthatoccurredinthesescenes
11/4/16 BUCLD 17
Areparentsnamingtheseobjects?
![Page 18: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/18.jpg)
11/4/16 BUCLD 18
![Page 19: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/19.jpg)
11/4/16 BUCLD 19
![Page 20: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/20.jpg)
11/4/16 BUCLD 20
![Page 21: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/21.jpg)
11/4/16 BUCLD 21
![Page 22: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/22.jpg)
Anassociativemodelofword-referentlearning
11/4/16 BUCLD 22
• 50mostfrequentobjectsineachAoA category• Ineachtrialofthesimulation,thesystemwaspresentedwith5objectnamesdrawnfrom6differentnamingfrequenciesandalltheobjectscoderssaidwerepresentedinthatscene• 6differentnamingfrequencies:• Entirelyrandom- thatis:First,Early,andLaterNounswerenamedequallyoftenandwithnoregardtotheobjectsinthescene• Theobjectspresentinasceneandonlythoseobjectshadtheirnamespresentedtothesystem• Theother4conditionsareintermediatebetweenthesetwo
![Page 23: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/23.jpg)
• Aco-occurrencematrixwasbuiltfromthesetrainingtrials• On1,000simulations,thesystemwasprobedonthe50mostfrequentnounsfromtheFirst,Early,andLaterNounslists• Onthetesttrials,ifthemaximalcellintheco-occurrencematrixforeachobjectnamewasitscorrespondingobject,thetrialwascountedascorrect
11/4/16 BUCLD 23
Anassociativemodelofword-referentlearning
![Page 24: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/24.jpg)
11/4/16 BUCLD 24
![Page 25: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/25.jpg)
11/4/16 BUCLD 25
Howdoinfantsbreakintolearningobjectnames?
Thepervasivenessofafewobjectcategoriespresent– dayinanddayout–ininfants’visualenvironmentsmaysolvereferentialambiguity,andthisvisuallearningmaybeginbeforewordlearning
Thenon-uniformfrequencystatisticsofvisualobjectsineverydayscenesbringsforwardasignaloflikelyreferentsinavisuallynoisyandclutteredworld
![Page 26: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/26.jpg)
AcknowledgementsOurparticipatingfamiliesThemembersoftheCognitiveDevelopmentLabatIU,especiallyLizzieHart,ArielLa,Swapnaa Jayaraman,CaitlinFausey,DominiqueSaviano,andMaryLoftusOurfundingsources
The Cognitive Development Lab
11/4/16 BUCLD 26
![Page 27: Word-learning from visual prevalence: evidence from first ... · frequent nouns from the First, Early, and Later Nouns lists • On the test trials, if the maximal cell in the co-occurrence](https://reader035.vdocuments.mx/reader035/viewer/2022071215/60455c91821fa128876dab28/html5/thumbnails/27.jpg)
11/4/16 BUCLD 27
LaterNouns
Shelf
Bag
Container
Cabinet
Lid
Counter
Fireplace
Bin
Tablecloth
Straw
Painting
Handle
Seat
Wood
Outlet
EarlyNouns
Tray
Washing Machine
Napkin
Knife
Tissue
Basket
Sofa
Dryer
Bench
Can
Yogurt
Bucket
Sauce
Belt
Walker
FirstNouns
Table
Chair
Shirt
Bowl
Bottle
Spoon
Window
Cup
Plate
Glasses
Food
Door
Telephone
Couch
Picture