developmental changes in natural visual statistics · trial run: subjects & sampling four 1- to...
TRANSCRIPT
![Page 1: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/1.jpg)
DevelopmentalChangesinNaturalVisualStatistics
ChristinaDeSerioIndianaUniversity,Bloomington,IN,UnitedStatesMentors:LindaSmith,RowanCandy,JasonGold
![Page 2: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/2.jpg)
Adapted fromHochstein &Ahissar (2002)
![Page 3: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/3.jpg)
SleeperEffects
Earlyexperiencestunelater-developingareasofthevisualsystem• Densebilateralcataracts• Correctivesurgeryafewmonthsafterbirth• Normalentry-levelvisionby1to2yearsofage• SleeperEffectsEvidenced:
1. sensitivitytomidspatialfrequencies&highspatialfrequencies2. Holisticfaceprocessing3. Second-orderrelations(recognitionoffacialidentitybasedofthespacing
offeatures)
• Visualinputduringthefirstfewmonthsoflife– beforethereisanysignofsensitivitytothesehigherorderprocesses– istuningupcapabilitiesthatemergelaterindevelopment.
Maurer,Mondloch &Lewis(2007)DevelopmentalScience
![Page 4: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/4.jpg)
Weneedtobeconsideringwhatstatisticsaregettinginandwhatstatisticsareinfluencingthedevelopmentofthesystem.
Thestructureintheinfantvisualenvironmentmatters
![Page 5: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/5.jpg)
Natural visualstatistics
Theoreticallyviewedasthefixedanduniversalpropertiesoftheworld.Mostcommonmethod:Low-levelvisualstatistics(e.g.luminance,contrast,color,orientation,spatialfrequency)averagedacrossanumberofphotographstakenbyadults
![Page 6: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/6.jpg)
Visualexperienceoccursintimeanddependsonthebody,behaviorandlocationoftheperceiver
![Page 7: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/7.jpg)
SocialEnvironment
ImmaturevisualsystemEyesBrain
WheretheyareplacedMotorabilities
Mobility
PhysicalEnvironmentBrightnessContrastObjectiveness
#People
IntrinsicDevelopment
Held/carried/bouncedRockedDriven/pushed
HeadTorsoBody
Play(f-f)
Handled
Grabbing/reaching“Interest”
![Page 8: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/8.jpg)
Natural visualstatistics:limitations
Adultperspective:photostakenandframedbyadults
![Page 9: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/9.jpg)
Solution
Developmentally indexed:Egocentricviewsofnaturalscenes
![Page 10: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/10.jpg)
Anewwayoflookingatnaturalvisualstatistics
MostcommonmethodLow-levelvisualstatisticsaveragedacrossnumberofphotographstakenbyadults.
MymethodThedistribution of low-levelvisualstatisticsininfant-perspectivescenes obtainedfrombody-worncameras.
![Page 11: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/11.jpg)
Home-viewproject(withthesupportoftheNationalScienceFoundation)
A corpusofdevelopmentallyindexedegocentricscenes• 75infants(todate)• 3weeksto24months• 4to6hoursofhead-cameravideointhehome(noexperimenterspresent,camerasonhats)• Recordedat30Hz• Over5millionimagesextracted
1- to 3-month old infants11 total (5 female, 6 male)
6- to 8-month old infants12 total (7 female, 5 male)
Numberimagessampledat5Hz1- to3-montholds:738,788frames6- to8-montholds:1,082,233frames
Total(bothagegroups):1,821,021frames
![Page 12: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/12.jpg)
Theoverarchinghypothesis:differentstatisticsatdifferentages
1- to3-montholdinfantshavemore…Facescloseinview
Ceiling,wallsandhighcontrastthings
6- to8-montholdinfantshavemore…Touchingobjects
Crowdedscenes
Fausey, Jayaraman &Smith(2016)Cognition;Jayaraman,Fausey &Smith (2015)PLoS ONE
![Page 13: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/13.jpg)
Statisticsintime
![Page 14: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/14.jpg)
Whatvisualinformationisavailabletothedevelopingsystem?
Whatisphysicallyinfrontofthefaceandhowdoesitchangewithage?
![Page 15: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/15.jpg)
Measures&analyses
Measures
SpatialFrequencyOrientationContrast
Analyses
FourierAnalysis
Subband EntropyFeatureCongestionImageSegmentation
Clutter
![Page 16: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/16.jpg)
Trialrun:subjects&sampling
Four 6- to 8-month old infants at 02 HzFour 1- to 3-month old infants at 02Hz
26weeksold:2,517JPGs28weeksold:2,628JPGs30weeksold:2,500JPGs32weeksold:2,520JPGs
Total:10,175JPGs
4weeksold:2,567JPGs7weeksold:2,187JPGs8weeksold:2,500JPGs11weeksold:2,539JPGs
Total:9,793JPGs
Numberoftested02HzJPGS~20,000framestotal
~2,500framespersubject~10,000framespergroup
Total:19,968frames
![Page 17: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/17.jpg)
02Hzfromthe6-8monthagegroup32weeksold 2,520frames
02Hzfromthe1-3monthagegroup7 weeksold 2,187frames
Frequencyandorientationmap Frequencyandorientationmap
Frequencymap
MeasuresSpatialFrequencyOrientationContrast
![Page 18: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/18.jpg)
4weeksold:768JPGs 32weeksold:637JPGs
Justfaces
![Page 19: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/19.jpg)
Cluttermeasures
FeatureCongestion:visualsalienceofitemsLocalvariabilityinspecificimagefeaturessuchascolor,orientation,andluminance
Subband Entropy:amountofvisualinformationinadisplayameasureoftheefficiencywithwhichanimagecanbeencodedwhilemaintainingperceivedimagequality(similartothemethodusedinJPEGimagecompression)
FC=3.4 FC=4.3 FC=6.1
Empty Clean Messy
Rosenholtz,Li&Nakano(2007)JournalofVision
ComparingFeatureCongestionmeasureofclutterwithWolfe,Oliva,Horowitz,Butcher,andBompas(2002)searchtask
![Page 20: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/20.jpg)
FC=3.06SE=2.91
FC=2.31SE=3.41
FC=2.49SE=2.73
FC=6.15SE=4.27
FC=7.80SE=4.21
FC=1.45SE=1.54
![Page 21: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/21.jpg)
ImageSegmentationFelzenszwalb &Huttenlocher (2004)InternationalJournalofComputer
Vision
![Page 22: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/22.jpg)
numRegionsSpec =31numRegionsSpec =196
numRegionsSpec =220 numRegionsSpec =25
numRegionsSpec =36numRegionsSpec =107
originals k=800 k=5000
![Page 23: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/23.jpg)
numRegionsSpec =14numRegionsSpec =408
numRegionsSpec =17 numRegionsSpec =10
numRegionsSpec =11numRegionsSpec =34
originals k=800 k=5000
![Page 24: Developmental Changes in Natural Visual Statistics · Trial run: subjects & sampling Four 1- to 3-month old infants at 02Hz Four 6- to 8-month old infants at 02 Hz 26 weeks old: 2,517](https://reader033.vdocuments.mx/reader033/viewer/2022043022/5f3e42259e4bf8119b7f9637/html5/thumbnails/24.jpg)
Humancodingà AlgorithmicImplementations
Textureversusacollectionofobjects?
Lowinclutterversushighinclutter?
Howdotheseclassificationsdifferforyoungerandolderbabies?