detecting tampered image regions - site.ieee.org · previous work. 2005. determined that a digital...

25
Detecting Tampered Image Regions Victoria A Gunning MIT Computer Vision Lab MIT Edgerton Center

Upload: others

Post on 22-Apr-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Detecting Tampered Image Regions

Victoria A GunningMIT Computer Vision Lab

MIT Edgerton Center

Page 2: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Previous Work2005Determined that a digital image’s origin can be identified.2009Determined that portions of an digital image can be identified as tampered.

Page 3: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Noise SourcesPRNU (Photoresponse Non-uniformity)DSNU (Dark Signal Non-uniformity)Shot NoiseReadout NoiseQuantization

Page 4: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Denoising & Noise ExtractionFlat Fielding

Filters for Estimation: Box, Median, Gaussian, Bilateral, Bilateral Grid, ...

Page 5: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Denoising & Noise ExtractionPrevious work used a combination of a Wiener filter and 8-tap Daubechies wavelet.

Page 6: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Gaussian FilterSmooth change in dependency on neighbors as the distance increases

Page 7: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Bilateral FilterTakes the pixel value distance in account as well as physical distance

Page 8: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Modeling CamerasGenerate synthetic imagesModel the noise sources

Page 9: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Deadleaf Images

Page 10: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

PRNU

Page 11: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Gaussian Noise

Page 12: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Quantization Noise

Page 13: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Extracting K

Page 14: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Averaging K

Page 15: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

D200 Images Frequencies

Page 16: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

D200 Extracted K

Page 17: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Classifying Images

Page 18: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Tampered RegionsThe first test was using patch correlation. The middle of the image was from a different camera.

Page 19: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Tampered RegionsMasking the tampered and original areas, the mean and variance of each pixel region can be calculated.

Page 20: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Tampered RegionsThe first test was using patch correlation. The middle of the image was from a different camera.

Page 21: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Tampered RegionsMasking the tampered and original areas, the mean and variance of each pixel region can be calculated.

Page 22: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Markov Random FieldsThe last tests used MRF and Loopy Belief Propagation.

Page 23: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Markov Random Fields

Page 24: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

References

[1] Fridrich, J. (2009). Digital image forensics using sensor noise.[2] Hirakawa, K. and Parks, T. W. (2005). Adaptive homogeneity-directed demosaicing algorithm.[3] Luk, J., Fridrich, J., and Goljan, M. (2005). Determining digital image origin using sensor imperfections. Technical report, Binghamton University.[4] Paris, S. and Durand, F. (2006). A fast approximation of the bilateral filter.[5] Tomasi, C. and Manduchi, R. (1998). Bilateral filtering for gray and color images. In Sixth International Conference on IEEE.

Page 25: Detecting Tampered Image Regions - site.ieee.org · Previous Work. 2005. Determined that a digital image’s origin can be identified. 2009. Determined that portions of an digital

Thanks to my mentor Katie Bouman and advisor Bill Freeman.