bridging the gap to the real
DESCRIPTION
Bridging the Gap to the Real. Wojciech Matusik Adobe Systems, Inc. Computer Graphics: Past, Present, Future. Goal of this Talk Look at Trends Extrapolate New Challenges Disclaimer: My personal (very biased) view - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/1.jpg)
Bridging the Gap to the Real
Wojciech MatusikAdobe Systems, Inc.
![Page 2: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/2.jpg)
Computer Graphics: Past, Present, Future
• Goal of this Talk– Look at Trends– Extrapolate– New Challenges
Disclaimer: My personal (very biased) view I have not even taken a cg course.
TimeM
ilest
ones
![Page 3: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/3.jpg)
TimeM
ilest
ones
Computer Graphics: Past, Present, Future
• Goal of this Talk– Look at Trends– Extrapolate– New Challenges
Disclaimer:I will present my own biased view.
![Page 4: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/4.jpg)
A Simulation to Generate Images or Videos
Simulation
Lights
Shading
Motion
Geometry
![Page 5: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/5.jpg)
Traditional Computer Graphics
Simulation
Lights
Shading
Motion
Geometry
• Components– Hand Modeled– Procedurally
Defined– Analytical
Formulas
Courtesy of Wikimedia
![Page 6: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/6.jpg)
Traditional Computer Graphics: Geometry
Simulation
Lights
Shading
Motion
Geometry
axiom = Fproduction rule F -> FF-[-F+F+F]+[+F-F-F]
L-Systems
Fractals
Perlin Noise, Hypertextures
Courtesy of Wikimedia
Courtesy of Ken Perlin
Courtesy of Wikimedia
![Page 7: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/7.jpg)
Traditional Computer Graphics: Lights
Simulation
Lights
Shading
Motion
Geometry
Directional
Point
Spot
Courtesy of Wikimedia
![Page 8: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/8.jpg)
Traditional Computer Graphics: Shading
Simulation
Lights
Shading
Motion
Geometry
Cook’s Shade Trees
Phong
Blinn-Phong
Cook-Torrance
Courtesy of Rob Cook
![Page 9: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/9.jpg)
Traditional Computer Graphics: Animation
Simulation
Lights
Shading
Motion
Geometry
Animation Controllers
Keyframing
Courtesy of Jessica Hodgins
![Page 10: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/10.jpg)
Traditional Computer Graphics
Real WorldLights,
Geometry, Shading, Motion,
Simulations
Editing and User
Input
Computer Graphics
![Page 11: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/11.jpg)
Data-driven Computer Graphics: 90s - now
Real WorldLights,
Geometry, Shading, Motion,
Simulations
Input Devices
• Progress in development of sensors• Cheap storage and computation power for data
processing
![Page 12: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/12.jpg)
Data-driven Computer Graphics: Geometry
Simulation
Lights
Shading
Motion
Geometry
3D Scanning
Courtesy of Marc Levoy
![Page 13: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/13.jpg)
Data-driven Computer Graphics: Lights
Simulation
Lights
Shading
Motion
Geometry
Environment MappingHDR Imaging
Courtesy of Paul DebevecCourtesy of Wikimedia
![Page 14: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/14.jpg)
Data-driven Computer Graphics: Shading
Simulation
Lights
Shading
Motion
Geometry
Measured Appearance
Courtesy of Kristin DanaCourtesy of Wikimedia
![Page 15: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/15.jpg)
Data-driven Computer Graphics: Animation
Simulation
Lights
Shading
Motion
Geometry
Motion Capture
Courtesy of Wikimedia
![Page 16: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/16.jpg)
Data-driven Computer Graphics
Real WorldLights,
Geometry, Shading, Motion,
Simulations
Input Devices
![Page 17: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/17.jpg)
Data-driven Modeling and Editing
Real WorldLights,
Geometry, Shading, Motion,
Simulations
Input Devices
Editing and User
Input
![Page 18: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/18.jpg)
Data-driven Modeling and Editing: Geometry
Simulation
Lights
Shading
Motion
Geometry
Modeling by Example, 2004Funkhouser et al.
![Page 19: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/19.jpg)
Data-driven Modeling and Editing: Lights
Simulation
Lights
Shading
Motion
Geometry
Skyfinder : Attribute-based Sky Image Search, 2009Tao et al.
![Page 20: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/20.jpg)
Data-driven Modeling and Editing: Shading
Simulation
Lights
Shading
Motion
Geometry
Data-driven Reflectance Model, 2003Matusik et al.
![Page 21: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/21.jpg)
Data-driven Modeling and Editing: Animation
Simulation
Lights
Shading
Motion
Geometry
Motion Graphs, 2002Kovar et al., Lee et al., Arikan & Forsyth
![Page 22: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/22.jpg)
Data-driven Computer Graphics: 90s - now
Real WorldRepresentatio
ns AbstractionsSimulations
Input Devices
Editing and User
Input
![Page 23: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/23.jpg)
Computer Graphics: Future
Real WorldRepresentatio
ns AbstractionsSimulations
Input Devices
Output Devices
Editing and User
Input
![Page 24: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/24.jpg)
Shape Capture, Modeling, and Fabrication
Real Object 3D Model3D Scanning 3D Printing Output
User Edits
Courtesy of Wikimedia
![Page 25: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/25.jpg)
Motion Capture, Modeling, and Robotics
Human Motion Motion ModelMocap ControllerDesign
HumanoidRobot
User Edits
Courtesy of WikimediaCourtesy of Wikimedia
![Page 26: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/26.jpg)
Light Field Capture, Modeling, and Display
3D Scene Light FieldCameraArray
AutostereoscopicDisplay
Light Out
User Edits
Courtesy of M.Levoy
Courtesy of F. Durand
![Page 27: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/27.jpg)
Appearance Capture, Modeling, and Fabrication
Real Material Data-drivenModel
Measurement Fabrication Output
User Edits
![Page 28: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/28.jpg)
Challenges: Output Mapping
Data Abstraction
Device Capabilities Device
Capabilities
Data Abstraction
![Page 29: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/29.jpg)
Output Mapping Examples– Gamut Mapping
– Tone Mapping
– Image Retargeting
Courtesy of Wikimedia
Courtesy of Shai Avidan
Courtesy of Wikimedia
![Page 30: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/30.jpg)
• Different Phenomena– Reflectance, Scattering, Deformations, Motion
• Rules– Linear vs. Perceptually-Based– Global vs. Local
Generalized Output Mapping Algorithms
![Page 31: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/31.jpg)
• Complex aggregates from base materials with known properties
Future Printers, Displays, and Output Devices
![Page 32: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/32.jpg)
Future Output Devices
Future Printers, Displays, and Output Devices
Data-drivenRepresentatio
nsand
Abstractions
Output Mapping
![Page 33: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/33.jpg)
Computer Graphics: Closing the Loop
Real WorldRepresentatio
ns AbstractionsSimulations
Input Devices
Output Devices
Editing and User
Input
![Page 34: Bridging the Gap to the Real](https://reader036.vdocuments.mx/reader036/viewer/2022062501/568164ca550346895dd6e71e/html5/thumbnails/34.jpg)
My Vision Statement
The future of Computer Graphics and Interactive Techniques lies in novel input and output devices that operate in real-world environments and are accessible to everyone.