the schepens eye research institute an affiliate of harvard medical school
DESCRIPTION
A. A. The Schepens Eye Research Institute An Affiliate of Harvard Medical School. The Effect of Edge Filtering on Vision Multiplexing Henry L. Apfelbaum, Doris H. Apfelbaum, Russell L. Woods, Eli Peli. SID 2005 May 23, 200541-2Boston, MA. Motivation. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/1.jpg)
The Schepens Eye Research InstituteAn Affiliate of Harvard Medical School
The Effect of Edge Filteringon Vision Multiplexing
Henry L. Apfelbaum,
Doris H. Apfelbaum, Russell L. Woods, Eli Peli
SID 2005
May 23, 2005 41-2 Boston, MA
A A
![Page 2: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/2.jpg)
Motivation
• Our lab is developing devices to help people with low vision
![Page 3: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/3.jpg)
Motivation
• Our lab is developing devices to help people with low vision– Central field loss (e.g., macular degeneration)
![Page 4: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/4.jpg)
Motivation
• Our lab is developing devices to help people with low vision– Central field loss (e.g., macular degeneration)– Peripheral vision loss (“tunnel vision”)
![Page 5: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/5.jpg)
Tunnel vision
![Page 6: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/6.jpg)
Motivation
• Our lab is developing devices to help people with low vision– Central field loss (e.g., macular degeneration)– Peripheral vision loss (“tunnel vision”)
• Our devices employ vision multiplexing
![Page 7: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/7.jpg)
Motivation
• Our lab is developing devices to help people with low vision– Central field loss (e.g., macular degeneration)– Peripheral vision loss (“tunnel vision”)
• Our devices employ vision multiplexing– Two different views presented to one or both eyes
simultaneously
![Page 8: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/8.jpg)
Vision multiplexing: HUD
![Page 9: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/9.jpg)
Motivation
• Our lab is developing devices to help people with low vision– Central field loss (e.g., macular degeneration)– Peripheral vision loss (“tunnel vision”)
• Our devices employ vision multiplexing– Two different views presented to one or both eyes
simultaneously– For tunnel vision, we have spectacles with a see-
through minifying display
![Page 10: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/10.jpg)
See-through minifying HMD
a
a
![Page 11: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/11.jpg)
See-through minifying HMD
Camera
a
a
![Page 12: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/12.jpg)
See-through minifying HMD
Camera
Display
a
a
![Page 13: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/13.jpg)
See-through minifying HMD
Beam-splitter
Camera
Display
a
a
![Page 14: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/14.jpg)
Motivation
• Our lab is developing devices to help people with low vision– Central field loss (e.g., macular degeneration)– Peripheral vision loss (“tunnel vision”)
• Our devices employ vision multiplexing– Two different views presented to one or both eyes
simultaneously– For tunnel vision, we have spectacles with a see-
through minifying display– We edge-filter the display to emphasize detail
needed for orientation and navigation
![Page 15: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/15.jpg)
See-through HMD
![Page 16: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/16.jpg)
Motivation
• Can the brain handle it?
![Page 17: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/17.jpg)
Neisser & Becklen experiment (1975)
![Page 18: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/18.jpg)
Count the slap attempts
![Page 19: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/19.jpg)
Did you see her?
![Page 20: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/20.jpg)
Motivation
• Can the brain handle it?
![Page 21: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/21.jpg)
Motivation
• Can the brain handle it?
• Inattentional blindness
![Page 22: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/22.jpg)
Motivation
• Can the brain handle it?
• Inattentional blindness:– Failure to notice significant events in one
scene while attention is focused on another scene
![Page 23: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/23.jpg)
Motivation
• Can the brain handle it?
• Inattentional blindness:– Failure to notice significant events in one
scene while attention is focused on another scene
• Hypothesis: Edge filtering can mitigate inattentional blindness
![Page 24: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/24.jpg)
Our experiment
• We reproduced the Neisser and Becklen experiment, introducing edge filtering to see if unexpected events would be noticed more readily
![Page 25: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/25.jpg)
Our experiment
• We reproduced the Neisser and Becklen experiment, introducing edge filtering to see if unexpected events would be noticed more readily
• 4 attended/unattended scene filtering combinations:
![Page 26: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/26.jpg)
Full video over full video
![Page 27: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/27.jpg)
Filtered ballgame over full handgame: Bipolar edges
![Page 28: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/28.jpg)
Filtered ballgame over full handgame: White edges
![Page 29: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/29.jpg)
DigiVision edge filter output
![Page 30: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/30.jpg)
Filtered handgame over full ballgame
![Page 31: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/31.jpg)
Both games edge-filtered
![Page 32: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/32.jpg)
Our experiment
• We reproduced the Neisser and Becklen experiment, introducing edge filtering to see if unexpected events would be noticed more readily
• 4 attended/unattended scene filtering combinations
![Page 33: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/33.jpg)
Our experiment
• We reproduced the Neisser and Becklen experiment, introducing edge filtering to see if unexpected events would be noticed more readily
• 4 attended/unattended scene filtering combinations
• 6 unexpected event scenes:
![Page 34: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/34.jpg)
Unexpected events
Juggler Lost ball Umbrella woman
Choose-up Handshake Ball toss
![Page 35: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/35.jpg)
Trials
• 36 subjects
• 4 practice trials
• 8 scored trials – Each game attended in half of the trials– 6 showed the 6 unexpected events– 2 had no unexpected event– All 4 filtering treatments used with each game– Edge/edge combination used for the trials without
unexpected events – Treatment/unexpected event pairings and
presentation order were balanced across subjects
![Page 36: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/36.jpg)
Trials (cont’d)• Subject clicked a mouse at each ball toss or
hand-slap attempt in the attended game
![Page 37: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/37.jpg)
Trials (cont’d)• Subject clicked a mouse at each ball toss or
hand-slap attempt in the attended game
• Questions asked after each trial:
![Page 38: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/38.jpg)
Trials (cont’d)• Subject clicked a mouse at each ball toss or
hand-slap attempt in the attended game
• Questions asked after each trial:– How difficult was that?– Any particularly hard parts?
![Page 39: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/39.jpg)
Trials (cont’d)• Subject clicked a mouse at each ball toss or
hand-slap attempt in the attended game
• Questions asked after each trial:– How difficult was that?– Any particularly hard parts?– Anything in the background that distracted you
or interfered with the task?
![Page 40: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/40.jpg)
Trials (cont’d)• Subject clicked a mouse at each ball toss or
hand-slap attempt in the attended game
• Questions asked after each trial:– How difficult was that?– Any particularly hard parts?– Anything in the background that distracted you or
interfered with the task?
• We scored– Number of unexpected events detected
![Page 41: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/41.jpg)
Trials (cont’d)• Subject clicked a mouse at each ball toss or
hand-slap attempt in the attended game
• Questions asked after each trial:– How difficult was that?– Any particularly hard parts?– Anything in the background that distracted you or
interfered with the task?
• We scored– Number of unexpected events detected– Hits rate (mouse click close to attended event)– Average response time to attended event “hits”
![Page 42: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/42.jpg)
Results: Unexpected event detections
0
2
4
6
8
10
0 1 2 3 4 5 6number of events detected
subj
ects
•57% of the 216 unexpected events presented were detected
![Page 43: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/43.jpg)
Results: Unexpected event detections
0
2
4
6
8
10
0 1 2 3 4 5 6number of events detected
subj
ects
•57% of the 216 unexpected events presented were detected
•Only 2 subjects detected all 6 events shown
•One subject detected none
![Page 44: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/44.jpg)
Results: Unexpected event detectionsAttended Full Full Edge
TotalUnattended Full Edge Full
Ball toss 10 10 11 31
Choose-up 9 10 9 28
Juggler 10 7 10 27
Umbrella 8 8 3 19
Handshake 4 3 4 11
Lost ball 3 2 2 7
Total 44 40 39 123
Edge filtering was not significant (p = 0.67)
![Page 45: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/45.jpg)
Results: Attended task accuracy
• Hit rates were high– 95.2% ballgame hit accuracy– 98.2% handgame hit accuracy
![Page 46: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/46.jpg)
Results: Attended task accuracy
• Hit rates were high– 95.2% ballgame hit accuracy– 98.2% handgame hit accuracy– No significant effect of cartooning or unexpected
events
![Page 47: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/47.jpg)
Results: Attended task accuracy
• Hit rates were high– 95.2% ballgame hit accuracy– 98.2% handgame hit accuracy– No significant effect of cartooning or unexpected
events
• Hit response times
![Page 48: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/48.jpg)
Results: Attended task accuracy
• Hit rates were high– 95.2% ballgame hit accuracy– 98.2% handgame hit accuracy– No significant effect of cartooning or unexpected
events
• Hit response times – Event scene had no significant effect (p > 0.65)
![Page 49: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/49.jpg)
Results: Attended task accuracy
• Hit rates were high– 95.2% ballgame hit accuracy– 98.2% handgame hit accuracy– No significant effect of cartooning or unexpected
events
• Hit response times – Event scene had no significant effect (p > 0.65) – Filtering the unattended task had no significant
effect (p = 0.37)
![Page 50: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/50.jpg)
Results: Attended task accuracy
• Hit rates were high– 95.2% ballgame hit accuracy– 98.2% handgame hit accuracy– No significant effect of cartooning or unexpected
events
• Hit response times – Event scene had no significant effect (p > 0.65) – Filtering the unattended task had no significant
effect (p = 0.37)– Filtering the attended task had a significant but
small impact (527 vs 498 ms, p < 0.001)
![Page 51: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/51.jpg)
Conclusions
• Good news: Edge filtering did not materially affect performance of the attended task
![Page 52: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/52.jpg)
Conclusions
• Good news: Edge filtering did not materially affect performance of the attended task
– We know that the relative ease with which salient features can be found in an edge-filtered view aids orientation and navigation
![Page 53: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/53.jpg)
Conclusions
• Good news: Edge filtering did not materially affect performance of the attended task
– We know that the relative ease with which salient features can be found in an edge-filtered view aids orientation and navigation
– Edge filtering also seems to make it easier to distinguish the views
![Page 54: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/54.jpg)
Conclusions
• Good news: Edge filtering did not materially affect performance of the attended task
– We know that the relative ease with which salient features can be found in an edge-filtered view aids orientation and navigation
– Edge filtering also seems to make it easier to distinguish the views
• Surprising news: Edge filtering did not aid (or hinder) the detection of unexpected events
![Page 55: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/55.jpg)
Future
• We plan to test subjects with tunnel vision (who need to scan to view the full scene)
![Page 56: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/56.jpg)
Future
• We plan to test subjects with tunnel vision (who need to scan to view the full scene)
• Some events are much more detectable than others, so we hope to learn more about just what affects detectability
![Page 57: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/57.jpg)
Future
• We plan to test subjects with tunnel vision (who need to scan to view the full scene)
• Some events are much more detectable than others, so we hope to learn more about just what affects detectability
• The context provided when one scene is viewed at two scales (as in our HMD, rather than two different scenes) may affect detectability
![Page 58: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/58.jpg)
Future
• We plan to test subjects with tunnel vision (who need to scan to view the full scene)
• Some events are much more detectable than others, so we hope to learn more about just what affects detectability
• The context provided when one scene is viewed at two scales (as in our HMD, rather than two different scenes) may affect detectability
• Bipolar edges are obviously better than white-only edges. A totally-video HMD could afford that advantage
![Page 59: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/59.jpg)
Acknowledgements
• Ulrich Neisser• Miguel A. Garcia-Pérez• Elisabeth M. Fine• The Levinthal-Sidman JCC• The JCC athletic staff
• James Barabas• Ben Peli• Aaron Mandel• Chas Simmons
• Supported in part by NIH grant EY 12890 and DOD grant W81XWH-04-1-0892
![Page 60: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/60.jpg)
THANK YOU!
http://www.eri.harvard.edu/faculty/peli/index.html
![Page 61: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/61.jpg)
QUESTIONS?
http://www.eri.harvard.edu/faculty/peli/index.html
![Page 62: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/62.jpg)
Results: Attended task hit rates
Hits MissesFalse
Alarms
Ballgame 95.2% 4.8% 5.2%
Handgame 98.2% 1.8% 3.0%
![Page 63: The Schepens Eye Research Institute An Affiliate of Harvard Medical School](https://reader035.vdocuments.mx/reader035/viewer/2022070406/568140a0550346895dac5512/html5/thumbnails/63.jpg)
Results: Attended task response times
Unattended scene
(not significant, p = 0.37)
Full Edges
Attended scene
(significant, p < 0.001)
Edges532 ms
(±84)
522 ms
(±96)
Full500 ms
(±97)
496 ms
(±100)