final project presentation - and Mobile Computing CS 528: Final Project Presentation Kewen Gu Yuheng Huo Shaochen Ding Computer Science

Download final project presentation -   and Mobile Computing CS 528: Final Project Presentation Kewen Gu Yuheng Huo Shaochen Ding Computer Science

Post on 07-Mar-2018

215 views

Category:

Documents

2 download

Embed Size (px)

TRANSCRIPT

  • UbiquitousandMobileComputingCS528:FinalProjectPresentation

    KewenGuYuhengHuo

    ShaochenDing

    ComputerScienceDept.WorcesterPolytechnicInstitute(WPI)

  • Introduction

    Wedesignedandimplementedalightweightedutilityappthatcanreadtextfromimages/photos

    Textsareorganized,andstoredinlocaldatabase Thestoredtextscanbeuploadedtocloudstorage,suchasGoogleDrive,andDropBox

    StoredTextcanalsobesentviaemail,orsenttoyourEvernoteaccount

    StoredTextcanalsobesharedthroughsocialnetworksuchasFacebook,Weibo,andTwitter

  • Design

    Threebuttons: Threeactivities

    Aneditabletextfield Twobuttons: Savethetextto

    database Discardthetext

  • Implementation

    ThreeActivities Accesstocameraonthephone,takeaphoto,andsendtoTesseractOCRenginetoextractthetextintheimage,thenretrievethetextback.

  • Implementation

    Accessthephotolibrary,choosethephototorecognize,andsendthephotototheOCRengine,thenobtaintherecognizedresult

  • Implementation

    Accessthelocallystoredtextthoughalistview Searchthroughthelistoftext Accesstheindividuallistitem,toedit,deleteorsharethetext

  • Facebook Email Evernote

  • Results

    Thisapplicationworkswellforupto200words/image,onNexus6p,with8MPcamera,andtheprocesstakesseveralseconds

    Itperformsfairlyaccurateonmanymajorfonttypes,e.g.TimesNewRome,Georgia,Courier

    MostoftheCPUofthisappisconsumedbyconvertingimagestoBitmapsandperformingOCRonimagebitmaps.Themorethewordsontheimage,thelongerittakestorecognizethem

  • Limitations

    Rightnow,itsunabletorecognizesymbolsandpunctuations

    Itsunabletorecognizehandwritingandrarefonts

    itsaccuracyishighlyenvironmentdependent,suchasweathercondition,lightintensity

    Iftheamountoftextontheimageislarge,itrequireshighdefinitioncameraonboard

  • FutureWork

    Supportrecognitionofsymbolsandpunctuations Supportmorefonttypes Tesseractcanbetrainedtorecognizeunknownfonts

    Supportmorelanguages Tesseractsupportsmultilanguagerecognition

    Refinedatabase,addmorepropertiestodatabase

    Performmoretasksonthelistofitems,suchassorting,filtering,andcategorizing

  • ANYQUESTIONS?

    Thankyou