Upload File

a method for refocusing photos using depth from defocus · focus frames blur maps for near/far...

  • Home
  • Documents
  • A Method for Refocusing Photos using Depth from Defocus · focus frames Blur maps for near/far focus frames Combine: near + far Depth map Refocus by spatially vary blur with depth
1
A Method for Refocusing Photos using Depth from Defocus Benjamin Wiberg Department of Electrical Engineering, Stanford University Motivation Image Processing Pipeline Related Work Experimental Results • Depth information from single viewpoint • Extract image that is sharp everywhere • Adjust blur “look” after taking photo • Uses normal camera, more accessible than light field Capture stack of frames from same viewpoint while varying focal depth “through” scene Focal Focal Focal stack Sharp image Gaussian blur with increasing sigmas (σ) Select pixel Select pixel Select pixel from frame with highest sharpness Uniformly Uniformly Uniformly blurred stack (σ) Focal Focal Focal stack Align with Align with Align with homography and RANSAC First frame (near focus) Last frame (far focus) Select sigma Select sigma where diff is smallest Blur map focus frames Blur maps for near/far focus frames Combine: near + far Depth map Refocus by spatially vary blur with depth Refocused image 10 images 7 images depth depth refocused refocused Most DfD methods estimate physical depth by estimating aperture, focal length and frame focal depths. • Depth from Focus with Your Mobile Phone, S. Suwajanakorn, C. Hernandez, S. Seitz • An investigation of methods for determining depth from focus, J. Ens, P. Lawrence Here we approximate depth by blurriness directly to reduce computation time, which is good enough for refocusing purposes. The major drawback is that the depth map does not contain physical distances to objects in the scene.

Upload: others

Post on 17-Jul-2020

7 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: A Method for Refocusing Photos using Depth from Defocus · focus frames Blur maps for near/far focus frames Combine: near + far Depth map Refocus by spatially vary blur with depth

A Method for Refocusing Photos using Depth from DefocusBenjamin Wiberg

Department of Electrical Engineering, Stanford University

Motivation Image Processing Pipeline

Related Work Experimental Results

• Depth information from single viewpoint • Extract image that is sharp everywhere • Adjust blur “look” after taking photo • Uses normal camera, more accessible than light field

Capture stack of frames from same viewpoint while varying focal depth “through” scene

Focal stackFocal stackFocal stack

Sharp image

Gaussian blur with increasing

sigmas (σ)

Select pixel from frame with highest sharpness

Select pixel from frame with highest sharpness

Select pixel from frame with highest sharpness

Uniformly blurred stack

Uniformly blurred stack

Uniformly blurred stack (σ)

Focal stackFocal stackFocal stack

Align with homography and RANSAC

Align with homography and RANSAC

Align with homography and RANSAC

First frame (near focus)

Last frame (far focus)

Select sigma where diff is

smallest

Select sigma where diff is

smallest

Blur map for near/far focus frames

Blur maps for near/far focus frames

Combine: near + far

Depth map

Refocus by spatially vary blur

with depth

Refocused image

10 images 7 images

dept

h

dept

h

refo

cuse

d

refo

cuse

d

Most DfD methods estimate physical depth by estimating aperture, focal length and frame focal depths. • Depth from Focus with Your Mobile Phone, S. Suwajanakorn, C. Hernandez, S. Seitz

• An investigation of methods for determining depth from focus, J. Ens, P. Lawrence

Here we approximate depth by blurriness directly to reduce computation time, which is good enough for refocusing purposes. The major drawback is that the depth map does not contain physical distances to objects in the scene.

REVISTA BLUR

Focus and Depth of Field - Research | MIT CSAIL · 2006-05-27 · • Problem 1: depth of field blur is not shift-invariant – Depends on depth – Blur is not a convolution, hard

Algorithms for Rendering Depth of Field Effects in ...barsky/Blur/... · Algorithms for Rendering Depth of Field Effects in Computer Graphics Brian A. Barsky1,2 and Todd J. Kosloff1

Bayesian partial out-of-focus blur removal with parameter ... · the out-of-focus blur that is widely used to accentuate the depth of field during image acquisition. In general,

Blur Tooth

Motion Blur

Near-Invariant Blur for Depth and 2D Motion via Time-Varying Light Field Analysisbandy/invariant/SIG13... · 2013-07-28 · Near-Invariant Blur for Depth and 2D Motion via Time-Varying

Packets never lie An in-depth overview of 802.11 frames small.pdf

Depth-Aware Motion Deblurring · 2012. 3. 20. · 3. Depth-Involved Blur Model In this section, we analyze the motion blur model when taking depth and two-view stereopsis into consideration

Blur Image Classification based on Deep Learningdoip.buaa.edu.cn/4.pdf · blur, Gaussian blur, defocus blur and motion blur) accurately and effectively. II. METHODOLOGY A. Image Blur

Dual Aperture Photography: Image and Depth from a … · Dual Aperture Photography: Image and Depth from a Mobile ... ference is used to estimate the relative blur between ... 3

Chapter 7 Case Study 1: Image Deconvolution. Different Types of Image Blur Defocus blur --- Depth of field effects Scene motion --- Objects in the scene

Depth from Stationary Blur with Adaptive Filteringcs.iupui.edu/~jzheng/accv07motion.pdf · 2007-09-18 · Depth from Stationary Blur with Adaptive Filtering 43 slit. The degree of

Depth of Field Postprocessing For Layered Scenes Using ...barsky/Blur/GI.2009.dof.rectangle.spreading.pdf2.1 Classic Depth of Field Methods The first depth of field rendering algorithm

Faking It: Simulating Background Blur in Portrait Photography ...Faking It: Simulating Background Blur in Portrait Photography using a Coarse Depth Map Estimation from a Single Image

Faking It: Simulating Background Blur in Portrait ...wscg.zcu.cz/wscg2016/short/A67-full.pdf · Faking It: Simulating Background Blur in Portrait Photography using a Coarse Depth

Lenses & Exposure · • Depth of Field • Lens Speed • ... Motion Blur. Stop Action. Subject. Moderate Blur. Extensive Blur. Traffic Trails: 30 sec. 90 sec: Waterfall. 1/5 sec:

Blur Clarified: A review and synthesis of blur discrimination

DoF 4.0 A Depth of Field Calculator - dl-c.comdl-c.com/DoF/DoF_Reference_Manual.pdf · DoF 4.0 – A Depth of Field Calculator ... Sometimes focus blur is undesirable, and sometimes

APERTURE AND SHUTTER PRIORITY for · Slow shutter speeds blur motion. The slower the shutter speed the more pronounced the blur. They also allow for greater depth of field in landscape

Deep Depth from Defocus: how can defocus blur improve 3D

Graduated Background Blur - Richard Seeley...Photoshop CS6 offers the Blur Gallery. One of the blur methods is the Tilt-Shift blur. This blur method allows the user to create a graduated

Create Depth of Field - Corel Corporation Depth of Field Page 4 Blur the Background 8. Choose Selections > Invert. 9. To apply the first blur, choose Adjust > Blur > Gaussian Blur.In

VPL-VW365ES - Sonysonypremiumhome.com/pdfs/VPL-VW365_Brochure.pdf · Combination mode uses Sony’s Film Projection and Motion Enhancer capabilities, adding frames to reduce blur

Camera controls: Blur, depth of field, close up

Blur clarified: A review and synthesis of blur discrimination

Blur Digitalizado

Depth Estimation and Blur Removal ... - saeed-anwar.github.io · S. ANWAR, Z. HAYDER, F. PORIKLI: DEPTH ESTIMATION AND DEBLURRING 1 Depth Estimation and Blur Removal from a Single

Intel RealSense™ Depth Module D400 Series Custom Calibration · 2018-07-31 · The calibration frames are not synced. To avoid possible motion blur, calibrate the device with images

Faking It: Simulating Background Blur in Portrait ...€¦ · bokeh effect, given an image and its depth map, (see, e.g., [BFSC04]) It is in fact wrong to use a Gaussian blur (like

Depth Estimation from Blur Estimation - Tim Zaman Estimation from Blur Estimation Tim Zaman Delft University of Technology 1 Introduction When images are captured with a small depth

DAVANet: Stereo Deblurring With View Aggregation...Depth-Varying Blur. In [40], Xu and Jia have analyzed the relationship between blur size and depth. In Figure 2(a), we simply restate

Aperture, Exposure, and Equivalent Exposure · Controls Depth of Field. Each full stop on the aperture (f-stop) either doubles or halves the ... depth of field, blur or freeze motion)

Photos for SCA Websites - baronllwyd.org · Affects depth-of-field “Portrait mode” creates low depth of field to emphasize the subject and blur the background Low f-stop (e.g

Digital Visual Effects Yung-Yu Chuangcyy/courses/vfx/18... · DLP 800:1 LCD 300:1 diffuser Theoretically, 240,000:1. Due to imperfect optical depth, ... blur s blur s blur s s a s