visual analytics and imaging lab
DESCRIPTION
HUMAN COMPUTATION IN VISUALIZATION: USING PURPOSE DRIVEN GAMES FOR ROBUST EVALUATION OF VISUALIZATION ALGORITHMS. NAFEES AHMED, ZIYI ZHENG, KLAUS MUELLER. VISUAL ANALYTICS AND IMAGING LAB. DEPT OF COMPUTER SCIENCE. HUMAN COMPUTATION Relevance in visualization AN Example: Disguise - PowerPoint PPT PresentationTRANSCRIPT
HUMAN COMPUTATIONIN VISUALIZATION:USING PURPOSE DRIVEN GAMESFOR ROBUST EVALUATION OF VISUALIZATION ALGORITHMS
VISUAL ANALYTICS AND IMAGING LABDEPT OF COMPUTER SCIENCE
NAFEES AHMED, ZIYI ZHENG, KLAUS MUELLER
VISUAL ANALYTICS AND IMAGING LAB
HUMAN COMPUTATION Relevance in visualization AN Example: Disguise Findings Future thoughts
human ComputationWHAT & WHY?
VISUAL ANALYTICS AND IMAGING LAB
?
VISUAL ANALYTICS AND IMAGING LAB
?
VISUAL ANALYTICS AND IMAGING LAB
?
Crowd sourcing
VizWizSoylent
VISUAL ANALYTICS AND IMAGING LAB
?
PURPOSE DRIVEN games
ESP GameTag a tuneverbosity
fold.itEte-RNA
PhyloEye-wire
HUMAN COMPUTERSin VISUALIZATIONWHY DOES IT MAKE SENSE?
VISUAL ANALYTICS AND IMAGING LAB
VISUALIZATIONCreates Understandable and Meaningful pictures from data
In analyzing pictures and patternsstill far better than any computersHuman brain and vision
VISUAL ANALYTICS AND IMAGING LAB
ImageData
VISUALIZATION DESIGN
RAWData
DataAnalysi
s
PreparedData
FocusData
GeometricData
ImageData
Filtering
Mapping
Rendering
Design/SelectCandidate Visualize Data
Evaluate
Finalized Method
Not Satisfactory Satisfactory
RAWData
VISUALIZATION rendering
VISUAL ANALYTICS AND IMAGING LAB
Evaluation of visualizationUser evaluation• controlled environment
• Cost• Small number of samples
• Crowd sourced• Noisy data• Cost
evaluation:using an online gameDesign, implementation and findings
VISUAL ANALYTICS AND IMAGING LAB
problemDisc A has color Disc B has color When A is on top of B we perceive a blend
Transparency perception ability to perceive the ordering given the blended color
Evaluate blending algorithmIn terms of transparency perception
VISUAL ANALYTICS AND IMAGING LAB
Porter & Duff Hue Preserving
Local blending
Local blending
with blurring
Algorithms
[Chuang 09][Porter 84] [Wang 09]
VISUAL ANALYTICS AND IMAGING LAB
ARCADE | survival
VISUAL ANALYTICS AND IMAGING LAB
ARCADE | survival
VISUAL ANALYTICS AND IMAGING LAB
INTRUDER OVER COLLECTOR
HITINTRUDER
COLLECTOROVER INTRUDER
HITINTRUDER
SCORE
HEALTH
SCORE
HEALTH
ANYSTATE
HITCOLLECTOR
SCORE
HEALTH
ANY STATE
NO ACTION
SCORE
HEALTH
INTRUDEREXPLODES
ANY STATE
CLICKEMPTYSPACE
SCORE
HEALTH
correctness
VISUAL ANALYTICS AND IMAGING LAB
correctness• PLAYERS try to Optimize score• Score only improves with correct guessing
of order• Each click gives us feedback about
human perception of transparency ordering
VISUAL ANALYTICS AND IMAGING LAB
observations1. Playability
within 15 days of launch…
261 players
30,000+ data-points generated.
VISUAL ANALYTICS AND IMAGING LAB
observations2. Data collection speed
14.6 clicks per minute
1000 players x 24hr playtime= 21 million data points!
VISUAL ANALYTICS AND IMAGING LAB
observations3. cost
once developed and deployedalmost FREE!
VISUAL ANALYTICS AND IMAGING LAB
observations4. Data quality
Provides much less noisy data thanother web-based methods.trying to optimize score, not earning!
Extent of data-points collected
VISUAL ANALYTICS AND IMAGING LAB
observations
VISUAL ANALYTICS AND IMAGING LAB
observations5. limitations
TIME TO DEVELOPensuring correctness and funMAKING IT POPULAR
Future thoughtsIdeas, motivations
VISUAL ANALYTICS AND IMAGING LAB
Future thoughts
INTEGRATION WITH A LEARNING AGENT FOR ADAPTIVE DESIGN OF NEW ALGORITHMS
VISUAL ANALYTICS AND IMAGING LAB
Future thoughts
OPTIMIZATION OF VISUALIZATION PARAMETERS (transfer functions/ view angles)
THANK you
VISUAL ANALYTICS AND IMAGING LABDEPT OF COMPUTER SCIENCE
NAFEES [email protected]
Ziyi [email protected]/~zizhen/
Klaus [email protected]/~mueller/
http://vail.cewit.stonybrook.edu/Projects/HPU/Disguise