NATASHA KHOLGADE BANERJEEhttp://www.cs.cmu.edu/~nkholgad/

CAMPUS ADDRESS224 Smith Hall, 5000 Forbes Avenue, Pittsburgh, PA 15213Email: nkholgad@cs.cmu.edu

EDUCATIONPh.D. IN ROBOTICS, May 2015 (expected), Advised by Yaser SheikhRobotics Institute, Carnegie Mellon University, Pittsburgh, PAPh.D. Thesis: 3D Manipulation of Objects in Photographs.M.S. IN COMPUTER ENGINEERING, July 2009, Advised by Andreas SavakisComputer Engineering, Rochester Institute of Technology, Rochester, NYM.S. Thesis: Recognition of Human Activities and Expressions in Video Sequences using Shape Context Descriptor.B.S. IN COMPUTER ENGINEERING, July 2009Computer Engineering, Rochester Institute of Technology, Rochester, NYGPA: 3.978, Highest Honors/Honors Program

RESEARCH INTERESTSMy research lies at the intersection of computer graphics and computer vision. I use large databases of 3D models—to represent and manipulate the geometry, illumination, and appearance of images in 3D.

PUBLICATIONSNatasha Kholgade, Tomas Simon, Alexei Efros, and Yaser Sheikh (2014). 3D Object Manipulation in a Single Pho-tograph using Stock 3D Models. ACM Transactions on Graphics, 33(4).Natasha Kholgade, Iain Matthews, and Yaser Sheikh (2011). Content Retargeting Using Parameter-Parallel FacialLayers. Symposium on Computer Animation, pp. 195-204.Natasha Kholgade and Andreas Savakis (2009). Human Activity Recognition Using the 4D Spatiotemporal ShapeContext Descriptor. International Symposium on Visual Computing, 2, pp. 357-366.

PRESS[Visit http://www.cs.cmu.edu/~nkholgad/press.html for complete list.]POPULAR SCIENCE BEST OF WHAT'S NEW, TOP 100 INNOVATIONS OF 2014, 3-D Manipulation.NEW YORK TIMES, 3-D Tool Guesses What a Photo Is Missing.GIZMODO, Free Photo Editing Software Lets You Manipulate Objects in 3D.TECHCRUNCH, New Wizardry Allows Researchers To Turn Photos into Three-Dimensional Objects.WIRED (UK), Editing tool lets you manipulate 3D objects in 2D photos.

PROJECT WORK3D OBJECT MANIPULATION IN A SINGLE PHOTOGRAPHProvided full-range 3D manipulation of objects such as rotation, translation, 3Dcopy-paste, and deformations in a single photograph. Corrected the geometry,appearance, and illumination of 3D models to match photographed objects,and seamlessly revealed hidden object parts in photographs.http://www.cs.cmu.edu/~om3d/CONTENT RETARGETING USING PARALLEL FACIAL LAYERSAnimating the content of a variety of characters by retargeting the motion of anactor's facial expression. Deconstructed actor's facial content as basis coef-ficients and weights of emotion, speech, and blink layers. Transferred contentto parallel character layers.http://www.disneyresearch.com/project/content-retargeting-using-parameter-parallel-facial-layers/ACTIVITY RECOGNITION WITH SPATIOTEMPORAL SHAPE CONTEXTDeveloped the spatiotemporal shape context descriptor by accounting for theframe-to-frame time variation of the activity. Showed improved activity classi-fication over original shape context descriptor.

RESEARCH EXPERIENCEGRADUATE RESEARCH ASSISTANT Aug 2009 to PresentRobotics Institute, Carnegie Mellon University, Pittsburgh, PA.Performing research on manipulating photographed objects in three dimensions by aligning 3D models to pho-tographs. Retargeted facial animation from an actor to characters in prior research.STUDENT RESEARCHER Jan 2014 to PresentSoftware Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.Conducting research to assist in assessing mission readiness of forensic examiners in conjunction with MachineLearning Department and Software Engineering Institute at Carnegie Mellon University. Accelerating template-matching algorithms using dimensionality reduction.RESEARCH ASSISTANT June 2007 to Aug 2009Computer Engineering, Rochester Institute of Technology, Rochester, NY.Performed research on recognition of activities for the purpose of displaying advertising content based on gestures.Developed the four-dimensional spatiotemporal shape context to classify a variety of actions.

TEACHING EXPERIENCEGUEST LECTURER, Computational Photography Nov 2014Robotics Institute, Carnegie Mellon University, Pittsburgh, PA.Taught students lectures on estimating 3D illumination and 3D geometry in images for insertion and manipulation of3D content. Also taught lecture on big visual data in computational photography. Class taught by Kris Kitani.TEACHING ASSISTANT, Computational Photography Sep 2011 to Dec 2011Robotics Institute, Carnegie Mellon University, Pittsburgh, PA.Taught recitations on MATLAB, image filtering, and exam review, and assisted students with assignments. Set upassignment on pinhole camera, and graded assignments, midterm, and final project. Class taught by Alexei Efros.STUDENT TUTOR Sep 2007 to Feb 2008KGCOE Student Services, Rochester Institute of Technology, Rochester, NY.Assisted students with problems in homeworks, lab assignments, and exam preparations for courses in mathemat-ics, physics, computer engineering, and computer science.

MENTORSHIPZHE CAO, Undergraduate Student, Wuhan University, China Jun 2014 to PresentAdvising Zhe on implementing GPU-accelerated vectorized normalized cross-correlation for real-time rigid poseestimation using the Kinect. Zhe successfully demonstrated illumination robust real-time pose estimation to Toyota.DAVID ALLEN, Undergraduate Student, Carnegie Mellon University Jun 2013 to PresentAdvising David on implementing GPU-accelerated estimation of deformable pose by exhaustively searching overthousands of templates using local patches. Advised David on implementing GPU-accelerated real-time 3D manip-ulation of objects in photographs in 2013. Through this experience, David obtained an internship at NVIDIA.TAYLOR STINE, Software Developer, Branding Brand August 2012 to May 2013Advised Taylor on data-driven inference of the continuous deformation space of natural objects such as mangoes,and manufactured objects such as wine bottles when he was a graduate student at Carnegie Mellon University.WENNIE TABIB, Graduate Student, Carnegie Mellon University Feb 2010 to May 2014Advised Wennie as part of School of Computer Science Sisters Program when she was an undergraduate studentat Carnegie Mellon University on joining industry versus pursuing academia. Wennie has now joined the graduateprogram in the Computer Science Department at Carnegie Mellon University.

PATENTSNatasha Kholgade, Iain Matthews, and Yaser Sheikh (pending). Content Retargeting Using Parameter-Parallel FacialLayers. Docket No. 11-DIS-308-PR-US-UTL.Natasha Kholgade, Tomas Simon, Alexei Efros, and Yaser Sheikh (filed provisional). 3D Object Manipulation in aSingle Photograph using Stock 3D Models. Filing reference 2014-184.

TALKS AND POSTERS[Click on links to access Keynote presentations.][Visit http://www.cs.cmu.edu/~nkholgad/talks.html for complete list of PDFs and Keynote presentations.]LECTURE ON BIG DATA IN COMPUTATIONAL PHOTOGRAPHY Nov 201415-463: Computational Photography, Carnegie Mellon University, Pittsburgh, PA.LECTURE ON MANIPULATING IMAGES IN THREE DIMENSIONS Nov 201415-463: Computational Photography, Carnegie Mellon University, Pittsburgh, PA.LECTURE ON IMAGE-BASED LIGHTING Nov 201415-463: Computational Photography, Carnegie Mellon University, Pittsburgh, PA.3D MANIPULATION OF OBJECTS IN A SINGLE PHOTOGRAPH USING STOCK 3D MODELS Aug 2014SIGGRAPH, Vancouver, Canada.PHOTO-EDITING USING 3D MODELS Jun 2013Disney Research, Pittsburgh, PA.INVITED TALK: PHOTO-EDITING USING 3D MODELS Oct 2012Rochester Institute of Technology, Rochester, NY.POSTER: PHOTO-EDITING USING 3D MODELS Jun 2012Anita Borg Scholarship, Google, Mountainview, CA.CONTENT RETARGETING USING PARAMETER-PARALLEL FACIAL LAYERS Aug 2011Symposium on Computer Animation, Vancouver, Canada.

ACTIVITES AND AWARDSGOOGLE ANITA BORG SCHOLARSHIP (finalist) Jun 2012PUBLICITY CHAIR, Robotics Institute Seminar, Carnegie Mellon University Aug 2009 to Aug 2011OUTSTANDING UNDERGRADUATE AWARD MEDAL Rochester Institute of Technology Mar 2008SECRETARY, Tau Beta Pi Engineering Honors Society, Rochester Institute of Technology Aug 2008 to Aug 2009NORMAN E. MILES SCHOLARSHIP, Highest Ranking Junior, Rochester Institute of Technology May 2007

INTERNSHIPSRESEARCH INTERN, Disney Research, Pittsburgh, PA Jun 2013 to Aug 2013Performed research on predicting environment maps from low dynamic range outdoor images by leveraging a largedataset of high dynamic range (HDR) images of the sky. Collected HDR sky images at various times of the day overa period of nine months spanning sunny and cloudy sky conditions.RESEARCH INTERN, Pixar Animation Studios, Emeryville, CA Jun 2011 to Aug 2011Analyzed animator control of secondary motion of characters' flesh given primary motions of walking and running.SOFTWARE ENGINEERING INTERN, Carestream Health, Rochester, NY Jun 2008 to Aug 2008Developed the framework for management of medical files in C++ and C#. Wrote software to create interactivegraphs for enhancing the visualization of data.