detail preserving shape deformation in image editing

Download Detail Preserving Shape Deformation in Image Editing

Post on 24-Feb-2016




0 download

Embed Size (px)


Detail Preserving Shape Deformation in Image Editing. SIGGRAPH 2007 Hui Fang and John C. Hart. Abstract. We propose an image editing system Preserve its detail and orientation by resynthesizing texture from the source - PowerPoint PPT Presentation



Detail Preserving Shape Deformation in Image EditingSIGGRAPH 2007Hui Fang and John C. HartWe propose an image editing system

Preserve its detail and orientation by resynthesizing texture from the sourcePatch-based texture synthesis that aligns texture features with image features

AbstractA novel image editing system that allows a user to select and move one or more image feature curvesReplacing any texture stretched by the deformation with texture resynthesizedAnisotropic feature-aligned texture synthesis step to preserve texture detailDistortion to the texture coordinates for each patch to align the target image featuresGraphCut textures [Kwatra et al. 2003]IntroductionA new method that distorts the coordinates of patchImage Analogies [Hertzmann et al. 2001] can synthesize a texture to adhere to a given feature lineYields more high-frequency noise unlike modern patch-based synthesisImage Quilting [Efros and Freeman 2001] could fill different silhouettes with a textureBoundary patches appeared to repeatFeature matching and deformation for texture synthesis [Wu and Yu 2004] distorted neighboring patches to connect their feature linesNot as global as what us didIntroductionDeformationDraw feature curves in the source image, and then move them to their desired destination positionsCurvilinear CoordinatesDefine curvilinear coordinates using curve tangent vectors & Euler integrationTextured Patch GenerationA pair of curvilinear coordinate is generatedTexture synthesis over the destination grid from sourceImage SynthesisFinalize the synthesis via GraphCutOverviewDeformationpi(t)p'i(t)D(p'f) = pf p'fD(I) = 06DeformationOriginalDeformed

Curvilinear Coordinatesp'i(t)T'Since the parametrization of each feature curve is arbitrary, one can encounter global orientation inconsistenciesCalculate separate tangent field for each curve then use only the field which is the closestWe integrate these diffused tangents to construct a local curvilinear coordinate system extending from any chosen origin pixelCurvilinear Coordinates

Curvilinear Coordinatesp'i(t)jkTime-step = 130 ~ 40 pixels along spines (j direction)15 ~ 30 pixels wide ribs (k direction)Two pixels short of nearby feature curve to prevent overlapping

Smooth the coordinates with several Laplacian iterations

= 0.7Removes singularities and self-intersections that can occur Does not completely solve the problem (Not very noticeable)

Curvilinear Coordinates

Curvilinear Coordinates

Source origin q0,0 = D(q'0,0)

Bilinear filter to find the color at the source image

Unit-radius cone filter centered at each destination to accumulate the synthesized textureSmall reduction in the resolution of the resynthesized texture detailTextured Patch GenerationUse GraphCut [Kwatra et al. 2003]Generate patches individually, using a priority queue to generate first patches whose origin pixel is closest to the feature curve and adjacent to a previously synthesized patchGenerate a pool of candidate textured patches synthesized from source patches grown from origins randomly chosen from an 1111 pixel region surrounding the point D(q'0,0)Choose one with the least overlapping difference with previously synthesized neighboring patchesImage SynthesisSelected patch merges into destination via GraphCut

Use Poission Image Editing when the seam produces by GraphCut is unsatisfactoryImage SynthesisThe deformation field D can potentially compress a large source area into a small target areaCause blocky artifacts and seamsOccur when the origin pixels of neighboring patches in the target map to positions in the source with different texture characteristics

Can be overcome by altering the texture synthesis samplingScale Adaptive RetexturingScale Adaptive Retexturing

We detect these potential problems with a (real) compression field C'

Clamp the compression field to values in [1,3] to limit its effectThe spine length and rib breadth of patches are reduced by C'(x,y)Scale Adaptive Retexturing

Scale Adaptive Retexturing

Accelerated the construction of source feature curves by using portions of the segmentation boundary produced by Lazy Snapping [Li et al. 2004]Feature curves do not need to match feature contours exactly, as deformed features were often aligned by the texture search

Used the ordinary Laplacian deformation for interactive previewDenoted some feature curves as passive to aid texture orientationResultsFiltering used for curvilinear grid resampling removes some of the high frequency detailCould be recovered by sharpening with histogram interpolation and matching [Matusik et al. 2005]





Failure case

Sharp image changes (like shading changes) should identified by feature curvesLack of feature curves will cause unrealistic discontinuities in the result

Poisson image editing hides some of these artifactsby softly blending the misaligned featuresResultsResultsMeasured on a 3.40GHzPentium 4 CPU(31 x 31 search domain for beach)

Stretched texture details can be adequately recovered by a local retexturing around user-defined feature curvesAssumes that the orientation of texture detail of an image is related to the orientation of nearby feature curvesMatting can be used to eliminate unwanted artifacts (Fig. 5)In practice the success of this approach depends primarily on the selection of the feature curvesThe most promising direction of future work in this topic would be to add the automatic detection and organization of image feature curvesConclusion


View more >