immersive visual data analysis - university at buffalo...reasoning about quantitative information....
TRANSCRIPT
![Page 1: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/1.jpg)
Immersive Visual
Data Analysis
Oliver Kreylos
W.M. Keck Center for Active Visualization
in the Earth Sciences (KeckCAVES)
University of California, Davis
![Page 2: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/2.jpg)
KeckCAVES
●Interdisciplinary research project
–Computer science
–Physical sciences
–Faculty, post-docs, graduate/undergraduate students
●Develops virtual reality (VR) for scientific data
analysis
–Methods, software, systems
●Visualization facility
–Shared access to high-end visualization systems
![Page 3: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/3.jpg)
KeckCAVES
![Page 4: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/4.jpg)
Principles of
Scientific
Visualization
![Page 5: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/5.jpg)
Data-Driven Science
●Modern science is in the business of creating,
processing, and consuming massive amounts
of data
●Data sizes are driven by high-resolution
sensors and high-performance computing
●Example: Computational Fluid Dynamics
(CFD)
●A single wind tunnel simulation can create
petabytes of data
![Page 6: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/6.jpg)
CFD: Cow at Mach 8
(from http://blogs.mentor.com/robinbornoff/blog/)
![Page 7: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/7.jpg)
Data-Driven Science
●End product of science is insight, not data
●Scientific process turns data into insight:
●Data analysis usually a multi-step pipeline
●Data analysis is often manual
DataAnalysis
RawData
DerivedData
![Page 8: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/8.jpg)
Visualization
“At their best, graphics are instruments for
reasoning about quantitative information.
Often the most effective way to describe,
explore, and summarize a set of numbers –
even a very large set – is to look at pictures of
those numbers.”
Edward R. Tufte, The Visual Display of
Quantitative Information (1983)
![Page 9: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/9.jpg)
CFD: Cow at Mach 8
(from http://blogs.mentor.com/robinbornoff/blog/)
Bow shock
![Page 10: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/10.jpg)
Classes of Data
●Two classes of scientific data:
–Non-spatial
●Gene co-expression networks
–Spatial
●Air flow around a cow
●Important sub-class:
–Three-dimensional spatial
●3D spatial data is problematic for traditional
visualization
–Traditional displays are two-dimensional
![Page 11: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/11.jpg)
3D Visualization in 2D
●Displaying 3D data in 2D requires projection
●Projection distorts...
–relative positions
–distances and sizes
–angles
–areas and volumes
●Projection can hide important structure
![Page 12: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/12.jpg)
Projection Distortion
![Page 13: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/13.jpg)
Projection Distortion
Not parallel
![Page 14: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/14.jpg)
Projection Distortion
Not same length
![Page 15: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/15.jpg)
Projection Distortion
Not a right angle
![Page 16: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/16.jpg)
Projection Distortion
Ceci n'est pas un cube
![Page 17: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/17.jpg)
2D Visualization
●Projection can also create spurious structure
(from http://moillusions.com)
![Page 18: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/18.jpg)
3D Visualization in VR
●VR is a display medium for 3D content
●VR presents 3D objects without projection:
–No distortion of positions, distances, angles, areas, or volumes
–No hidden or spurious structures
●VR is “holographic”
●VR lets users apply their full power of visual
perception to 3D data analysis
![Page 19: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/19.jpg)
Principles of
Virtual Reality
![Page 20: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/20.jpg)
Vision
![Page 21: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/21.jpg)
Vision
![Page 22: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/22.jpg)
Vision
![Page 23: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/23.jpg)
Vision
![Page 24: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/24.jpg)
Vision
![Page 25: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/25.jpg)
Vision
![Page 26: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/26.jpg)
Vision
![Page 27: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/27.jpg)
Movement
![Page 28: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/28.jpg)
Movement
![Page 29: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/29.jpg)
Movement
![Page 30: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/30.jpg)
Movement
![Page 31: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/31.jpg)
Movement
![Page 32: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/32.jpg)
Movement
![Page 33: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/33.jpg)
Movement
![Page 34: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/34.jpg)
Vintage VR
![Page 35: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/35.jpg)
Modern VR
![Page 36: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/36.jpg)
Head-mounted Displays
![Page 37: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/37.jpg)
Head-mounted Displays
![Page 38: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/38.jpg)
Head-mounted Displays
![Page 39: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/39.jpg)
Interactive
Visualization
![Page 40: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/40.jpg)
Static Visualization
VisualizationData Picture
Parameters
![Page 41: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/41.jpg)
Interactive Visualization
VisualizationData Picture
Parameters
User
![Page 42: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/42.jpg)
Interaction in VR
●VR is particularly good medium for interaction:
–“Holographic” 3D display
–Direct natural 3D interaction
●Hand-held 3D input devices
–Real-time feedback
![Page 43: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/43.jpg)
Immersive Visual
Data Analysis
![Page 44: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/44.jpg)
LiDAR Viewer
![Page 45: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/45.jpg)
3D Visualizer
![Page 46: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/46.jpg)
Nanotech Construction Kit
![Page 47: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/47.jpg)
Tele-Collaboration
![Page 48: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/48.jpg)
3D Video Avatars
![Page 49: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/49.jpg)
KeckCAVES
Software
![Page 50: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/50.jpg)
KeckCAVES Software
●All KeckCAVES software is publicly available
●Free and open-source (GNU GPL)
●Runs primarily on Linux, also on Mac OS X
●http://keckcaves.org
![Page 51: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/51.jpg)
Vrui VR Toolkit
●Foundation for everything else
●Lets VR software run on wide range of
hardware
–Laptop or desktop
–3D TVs
–Projected 3D screens
–CAVEs et al.
–Head-mounted displays
●http://idav.ucdavis.edu/~okreylos/
ResDev/Vrui
![Page 52: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/52.jpg)
LiDAR Viewer
●Analysis of massive 3D point cloud data
●http://idav.ucdavis.edu/~okreylos/
ResDev/LiDAR
![Page 53: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/53.jpg)
3D Visualizer
●Analysis of 3D gridded volumetric data
●http://idav.ucdavis.edu/~okreylos/
ResDev/DataExploration
![Page 54: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/54.jpg)
Nanotech Construction Kit
●Interactive creation of molecular structures
●http://idav.ucdavis.edu/~okreylos/
ResDev/NanoTech
![Page 55: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/55.jpg)
Tele-Collaboration
●Vrui add-on to connect multiple VR systems
●http://idav.ucdavis.edu/~okreylos/
ResDev/Collaboration
![Page 56: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/56.jpg)
3D Video Avatars
●Capture, transmit, and play 3D video
●http://idav.ucdavis.edu/~okreylos/
ResDev/Kinect
![Page 57: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/57.jpg)
VR Hardware
●Good VR hardware has hit the mass market
●Head-mounted displays:
–Oculus Rift
–HTC Vive
●works natively with Vrui
●Easy to buy
–Best Buy, Amazon, newegg
●Easy to set up
●VR no longer limited to central facilities
![Page 58: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/58.jpg)
Conclusions
●VR is a powerful medium for analysis of 3D
spatial scientific data
–Presents 3D data in “holographic” 3D
–Supports natural 3D interaction
–Supports natural collaboration
●KeckCAVES software is publicly available
–Free and open-source software (GNU GPL)
–Runs on Linux (and also Mac OS X)
–http://keckcaves.org
●Anyone can use VR
![Page 59: Immersive Visual Data Analysis - University at Buffalo...reasoning about quantitative information. Often the most effective way to describe, explore, and summarize a set of numbers](https://reader035.vdocuments.mx/reader035/viewer/2022070813/5f0c64077e708231d4352ac2/html5/thumbnails/59.jpg)
Demos!