3d object manipulation in a single photograph using stock 3d models
DESCRIPTION
3D Object Manipulation in a Single Photograph using Stock 3D Models. Overview. Video: http://www.cs.cmu.edu/~ nkholgad/video/video.mp4 Key idea: 3D manipulation in 2D photograph - beyond Photoshop. Essentially a data-driven interactive single image modeling problem. Pipeline. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/1.jpg)
3D OBJECT MANIPULATION IN A SINGLE PHOTOGRAPH USING STOCK 3D MODELS
![Page 2: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/2.jpg)
Overview• Video: http://www.cs.cmu.edu/~nkholgad/video/video.mp4
• Key idea: 3D manipulation in 2D photograph - beyond Photoshop.
• Essentially a data-driven interactive single image modeling problem.
![Page 3: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/3.jpg)
Pipeline
![Page 4: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/4.jpg)
Geometric Correction – Data term
![Page 5: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/5.jpg)
Geometric Correction - Smoothness
![Page 6: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/6.jpg)
Geometric Correction - Symmetry
![Page 7: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/7.jpg)
Geometric Correction - Optmization
![Page 8: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/8.jpg)
Illumination and Appearance Estimation
• Lambertian Surface
![Page 9: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/9.jpg)
Illumination and Appearance Estimation
• Light model
![Page 10: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/10.jpg)
Illumination&Appearance - Objective function
![Page 11: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/11.jpg)
Illumination&Appearance - Data term
![Page 12: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/12.jpg)
Illumination&Appearance – Illumination Prior• Sparse light sources
![Page 13: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/13.jpg)
Illumination&Appearance – Appearance Prior
• Appearance similar to the stock model
![Page 14: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/14.jpg)
Relating Hidden & Visible Parts via Symmetries
• Relating Hidden & Visible Parts via Symmetries• Completing Appearance via MRF
![Page 15: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/15.jpg)
Relating Hidden & Visible Parts via Symmetries
![Page 16: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/16.jpg)
Completing Appearance via MRF
![Page 17: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/17.jpg)
Results
![Page 18: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/18.jpg)
Results
![Page 19: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/19.jpg)
Results - Comparisons
![Page 20: 3D Object Manipulation in a Single Photograph using Stock 3D Models](https://reader036.vdocuments.mx/reader036/viewer/2022062520/568160ef550346895dd02783/html5/thumbnails/20.jpg)
Results - Comparisons