correlation between image reproduction preferences and viewing patterns measured with a head mounted...

22
Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Lisa A. Markel Jeff B. Pelz, Ph.D. Jeff B. Pelz, Ph.D. Center for Imaging Science Center for Imaging Science Rochester Institute for Technology Rochester Institute for Technology

Post on 20-Dec-2015

217 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Correlation Between Image Reproduction Preferences

and Viewing Patterns Measured with a Head Mounted Eye Tracker

Correlation Between Image Reproduction Preferences

and Viewing Patterns Measured with a Head Mounted Eye Tracker

Lisa A. MarkelLisa A. Markel

Jeff B. Pelz, Ph.D.Jeff B. Pelz, Ph.D.Center for Imaging ScienceCenter for Imaging Science

Rochester Institute for TechnologyRochester Institute for Technology

Page 2: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

HypothesisHypothesis

An eye tracker can be used to determine An eye tracker can be used to determine eye movements and fixations while eye movements and fixations while viewing pairs of imagesviewing pairs of images. .

Scenes type dependentScenes type dependent

PortraitsPortraits -> -> face and other exposed fleshface and other exposed flesh

Landscapes -> Landscapes -> sky and foliagesky and foliage

People In Nature -> People In Nature -> flesh, sky, and foliageflesh, sky, and foliage

Page 3: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

HypothesisHypothesis

There is also anticipation that there will There is also anticipation that there will be a distinct viewing pattern when be a distinct viewing pattern when comparing pairs or sets of images.comparing pairs or sets of images.

Patterns:Patterns:

OriginalOriginal->->ReproductionReproduction AlternationAlternation

OriginalOriginal->->Reproduction Overall ScanningReproduction Overall Scanning

Page 4: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Eye TrackerEye Tracker

Eye Tracking DeviceEye Tracking Device Applied Science Laboratories Applied Science Laboratories

Series 5000 Eye Tracking Series 5000 Eye Tracking SystemSystem

CharacteristicsCharacteristics Captures eye line of gaze Captures eye line of gaze

with respect to headwith respect to head Non-invasiveNon-invasive MobilityMobility

Page 5: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Series 5000 Eye Tracking SystemSeries 5000 Eye Tracking System

Eye MonitorEye Monitor Pupil ReflectionPupil Reflection Corneal ReflectionCorneal Reflection

Scene MonitorScene Monitor Scene displayScene display Eye line of gaze Eye line of gaze

Landscape Scene 1

Original

Reproduction 1

Reproduction 2

++

Page 6: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

MethodologyMethodology

ParticipantsParticipants 8 total participants8 total participants

Students and FriendsStudents and Friends 7 male and 1 female7 male and 1 female Normal Color VisionNormal Color Vision

Page 7: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

MethodologyMethodology

StimuliStimuli 5x7 inch Prints 5x7 inch Prints

KODAK DS 8650 Thermal PrinterKODAK DS 8650 Thermal Printer

One Original, Two ReproductionsOne Original, Two Reproductions Original - straight-through output pathOriginal - straight-through output path Reproductions - same as original with selective Reproductions - same as original with selective

changeschanges

Scene Categories with 12 Images EachScene Categories with 12 Images Each PortraitPortrait Landscape Landscape People in NaturePeople in Nature

Page 8: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Image PreparationImage Preparation

KODAK Photo KODAK Photo CDCD

Film OriginalsFilm Originals

Color AdjustmentColor Adjustment

KODAK DS 8650 Thermal PrintsKODAK DS 8650 Thermal Prints

Page 9: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Scene LayoutScene Layout

Landscape Scene 1

Original

Reproduction 1

Reproduction 2

Page 10: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

MethodologyMethodology

QuestionsQuestions Determine which of the two Determine which of the two

reproductions are preferredreproductions are preferred

Determine which of the two Determine which of the two reproductions most closely matches the reproductions most closely matches the originaloriginal

The order in which these two questions are The order in which these two questions are performed will alternate.performed will alternate.

Page 11: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Data CollectionData Collection

Initial Data Stored on 8mm tapeInitial Data Stored on 8mm tape

Landscape Scene 1

Original

Reproduction 1

Reproduction 2

++

Approximately 35 minutes for each subjectApproximately 35 minutes for each subject

Page 12: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Data CollectionData Collection

Tape data was Tape data was analyzed frame by analyzed frame by frame to acquire frame to acquire fixation informationfixation information Each subjectEach subject Every ImageEvery Image

Approximately 3 hrs Approximately 3 hrs per subjectper subject

Scene 1

A

B

Original

1

2

3

4

5

6

7 8

9

1011

12

13

14

15

1

16

17

18

Page 13: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Data AnalysisData Analysis

Points connected to Points connected to see view patternssee view patterns

Scene 1

A

B

Original

Page 14: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Data CollectionData Collection

Spread Sheet ParametersSpread Sheet Parameters Total Viewing Time for Each SceneTotal Viewing Time for Each Scene Viewing Location (Original, A, B)Viewing Location (Original, A, B) Total Number of FixationsTotal Number of Fixations Number of Fixations Per SecondNumber of Fixations Per Second Run Length (How many sequential Run Length (How many sequential

fixations in the same imagefixations in the same image Number of Point to Point CorrelationsNumber of Point to Point Correlations

Page 15: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Graphing DataGraphing Data

Spreadsheet was used to generate Spreadsheet was used to generate several graphsseveral graphs Provide graphic data for each parameters Provide graphic data for each parameters Show the distinctionsShow the distinctions

Between two questions asked and fixation Between two questions asked and fixation patternspatterns

Between Scene TypeBetween Scene Type

Page 16: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Results - Total Viewing TimeResults - Total Viewing Time

Total time for viewing Scenes

0

1

2

3

4

5

6

7

Tim

e (

seco

nds)

PortraitsLandscapesPeople in Nature

Page 17: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Results - Point to Point CorrelationResults - Point to Point Correlation

Number of Corresponding Points

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

4.50

PortraitsLandscapesPeople in Nature

Page 18: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Results - Total Number of FixationsResults - Total Number of Fixations

Number of Fixations Per Scene

0.00

5.00

10.00

15.00

20.00

25.00

PortraitsLandscapesPeople in

Nature

Page 19: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

General ResultsGeneral Results

Like BetterLike Better Match OriginalMatch Original

Page 20: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

General ResultsGeneral Results

FixationsFixations Time - Most subjects had longer fixation Time - Most subjects had longer fixation

when they were asked to choose which when they were asked to choose which they like betterthey like better

Correlation Points - Larger number when Correlation Points - Larger number when trying to match the originaltrying to match the original

Total Number of Fixation - Larger for Total Number of Fixation - Larger for matching originalmatching original

Page 21: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

General ResultsGeneral Results

Scene ContentScene Content Landscapes - General concentration to Landscapes - General concentration to

main subject in the scene, secondary focus main subject in the scene, secondary focus on sky, foliageon sky, foliage

Portraits - Concentration on facial features, Portraits - Concentration on facial features, secondary focus on clothingsecondary focus on clothing

People in Nature - Primary focus to flesh, People in Nature - Primary focus to flesh, secondary focus to foliage, skysecondary focus to foliage, sky

Page 22: Correlation Between Image Reproduction Preferences and Viewing Patterns Measured with a Head Mounted Eye Tracker Lisa A. Markel Jeff B. Pelz, Ph.D. Center

Further TestingFurther Testing

More SubjectsMore Subjects

Statistics - ANOVAStatistics - ANOVA

A final report will be available on the Web:A final report will be available on the Web:http://www.cis.rit.edu/~lam8488http://www.cis.rit.edu/~lam8488