personal informaon management systems and …abiteboul.com/presentation/16.pimsthymeflow.pdfpersonal...

Personalinforma-onmanagementsystemsand

knowledgeintegra-on

SergeAbiteboulInria&EcoleNormaleSupérieureCachan

[email protected] http://abiteboul.com

Organiza8on

1.  Personaldata2.  ThePims

1.  TheconceptofPims2.  ThePimsarearrivingandthatiscool

3.  Researchissues4.  Anillustra8onwiththeThymeflowsystem

Disc2016 SergeAbiteboul 2

1.Personaldata

Personaldataoutthere

SergeAbiteboul 4Disc2016

Personaldataoutthere•  Variety

–  Structured,semi-structured,unstructured–  Metadataandknowledge(RDF)–  Differentlanguages,terminologies,ontologies,structures

•  Veracity–  Varyingquality:errors,opinions,missingdata…–  Varyingimportance:hardtoassess

•  Velocity–  Changes,staleness…–  Recentdataistypicallyveryvaluable

−  Volume(???)–  GrowingbutnoBigdata

+  Distributed–  Inmanyautonomoussystemsthatactassilos–  Differentsystems,protocols

5SergeAbiteboulDisc2016

•  Lossoffunc8onali8esbecauseoffragmenta8on–  Youdon’tknowwhereyourdatais,howtomaintainituptodate,howtogetitsome8mes

–  Difficulttodoglobalsearch,maintenance,synchroniza8on,archiving...

•  Lossofcontroloverthedata–  Difficulttocontrolprivacy–  Difficulttocontrolsharing–  Leaksofprivateinforma8on

•  Lossoffreedom–  Vendorlock-in

Badnews(1)

6SergeAbiteboulDisc2016

Badnews(2)

•  Afewcompaniesconcentratemostoftheworld’sdataandanaly8cpower–  Theyhavethemeanstodestroybusinesscompe88oninlargepor8onsoftheeconomy

•  Afewcompaniescontrolallyourpersonaldata–  Theydeterminewhatinforma8onyouareexposedto–  Theyguidemanyofyourdecisions–  Theypoten8allyinfringeonyourprivacyandfreedom


2.ThePims

FromManagingyourdigitallifewithaPersonalinforma5onmanagementsystem,withBenjaminAndré&DanielKaplan,Communica-onsoftheACM2015

Alterna8ves

•  Con8nuewiththisincreasingmess–  Seeashrinktoovercome thefrustra8on

•  Gatherallyourdatainoneplaform–  Google,Apple,Facebook,…,anewcomer–  Seeashrinktoovercomeresentment

•  Study2yearstobecomeageek–  Geeksknowhowtomanagetheirinforma8on–  Seeashrinktosurvivetheexperience

9SergeAbiteboul

Wheredoyoukeepyourdata?

Disc2016

OrmovetoPims!Amemexisadeviceinwhichanindividualstoresallhisbooks,records,andcommunica5ons,andwhichismechanizedsothatitmaybeconsultedwithexceedingspeedandflexibility.Itisanenlargedin5matesupplementtohismemory. VannevarBush,TheAtlan8cMonthly,1945

Defini8onforthistalk:aPersonalInforma-onManagementSystemisacloudsystemthatmanagesalltheinforma5onofaperson

OnePims,twoPims…manyPims


ThePims:achangeinparadigmManyWebservicesEachonerunning

•  Onsomeunknownmachines

•  Withyourdata

•  Somesokware

YourPims•  Yourmachine•  Withyourdata

–  possiblyreplicaofdatafromsystemsyoulike

•  Wrappertosomesokware

–  Externalservice•  Oryoursokware

–  Decentralizedservice


ThePimsare(Ibelieve)arriving!

Why?For3kindsofreasons:•  Society•  Technology•  Industry


Societyisreadytomove

•  Growingresentment–  Againstcompanies:intrusivemarke8ng,cryp8cpersonaliza8onandbusinessdecisions(e.g.,onpricing),creepy"bigdata"inferences

–  Againstgovernments:NSAanditsEuropeancounterparts•  Increasingawarenessofthedissymmetry

–  betweenwhatthesesystemsknowaboutaperson,andwhatthepersonactuallyknows

•  Emergingunderstandingofthevalueofpersonaldataforindividuals–  Quan8fiedself


Societyisreadytomove(2)

•  Privacycontrol:regula8onsinEurope•  Informa8onsymmetry:Vendorrela8onmanagement•  Manyreports/proposalsthataffirmtheownershipofpersonaldatabytheperson

•  Personaldatadisclosureini8a8ves–  SmartDisclosure(US);MiData(UK),MesInfos(France)–  Severallargecompanies(networkoperators,banks,retailers,insurers…)agreeingtosharewithcustomersthepersonaldatathattheyhaveaboutthem


Technologyisgearingup

•  Systemadministra8oniseasier–  Abstrac8ontechnologiesforservers–  Virtualiza8onandconfigura8onmanagementtools

•  Open-sourcealterna8vestoproprietaryonlineservicesareincreasinglyavailable

•  Priceofmachinesisgoingdown–  Ahostedlow-costserverisascheapas5€/month–  Payingisnolongerabarrierforamajorityofpeople

Youmayhavefriendsalreadydoingit


Technologyisgearingup(2)

•  Manysystems&projects–  Lifestreams,Stuff-I’ve-Seen,Haystack,MyLifeBits,Connec8ons,Seetrieve,PersonalDataspaces,ordeskWeb.

–  YounoHost,Amahi,ArkOS,OwnCloudorCozyCloud

•  Someonpar8cularaspects– Mailpileformail–  LimaforaDropbox-likeservice,butathome.–  PersonalNAS(network-connectedstorage)e.g.Synologie–  PersonaldatastoreSAMIofSamsung...

•  Manymore SergeAbiteboul 16Disc2016

IndustryisinterestedPre-digitalcompanies

•  E.g.,hotelsorbanks•  DisintermediatedfromtheircustomersbypureInternetplayerssuchasGoogle,Amazon,Booking.com,Mint.

•  InPims,theycanrebuilddirectinterac8on•  Theplayingfieldisneutral

–  UnlikeontheInternetwheretheyhavelessdata•  Theycanoffernewserviceswithoutcompromisingprivacy


Industryisinterested(2)Homeappliancescompanies

•  Manydevicesdeployedathomeorindatacenters–  Internetserviceprovider“boxes”,NASservers,“smart”metersprovidedbyenergyvendors,homeautoma8onsystems,“digitallockers”…

•  Personaldataspacesdedicatedtospecificusage•  Couldevolvetobecomemoregeneric•  ControlofprivateInternetofthings


Industryisinterested(3)PureInternetplayers

•  Amazon:greatknow-howinprovidingservices•  Facebook,Google:cannotaffordtobeoutofamovementinpersonaldatamanagement

•  Veryfarfromtheirbusinessmodelbasedonpersonaladver8sement

•  Movingtothisnewmarketwouldrequiremajorchanges&theclarifica8onoftherela8onshipwithusersw.r.t.datamone8za8on


Advantages–rebalancetheWeb

•  Usercontrolovertheirdata– Whohasaccesstowhat,underwhatrules,todowhat

•  Userempowerment–  Theychooseservicesfreely&theycanleaveaservice

•  Par8cipa8oninamore“neutral”Web– Withthe“networkeffect”,themainplaformsareaccumula8ngdata/customersanddistor8ngcompe88on

–  ThePimsbringbackfairnessontheWeb–  Goodprac8cesareencouraged,e.g.,interoperability,portability


ThePimswillprimarilyarrivebecauseofnewfunc8onali8es

Thisis(forme)thekeyingredientforadop8on

Newfunc8onali8es➸Newopportuni8es

NewplayingfieldforstartupsNewplayingfieldforresearchers


3.ResearchissueswiththePims

FromPersonalInforma5onManagementSystems,tutorialinExtendedDataBaseTechnologyConference,2015,withAmélieMarian

R&Dissueswewillnotconsidermuch

Someoldproblemsrevisited•  Epsilon-principle(epsilon-user-administra8on)•  Backups&Tasksequencing•  Accesscontrol&Exchangeofinforma8on•  Security(e.g.works@INRIARocquencourt)•  Connectedobjectscontrol


R&Dissueswewillbrieflyillustrate

Someoldproblemsrevisited•  Personalinforma8onintegra8on•  Synchroniza8on•  Personaliza8onandcontextawareness•  Personaldataanalysis


4.Anillustra8onwiththeThymeflowsystem

DemoinInterna8onalConferenceonInforma8onandKnowledgeManagement(CIKM’16)withDavidMontoya,ThomasPellissier-Tanon,FabianM.Suchanek

Pimsarefirstaboutdataintegra8on


mimi

lulu

zaza

loca8on

webSearch

calendar

mail

contacts

facebook

TripAdvisor

banks

WhatsApp

Facebook Integra8onoftheusersofaservice

Integra8onoftheservicesofauser

ALICEX

X

X

X

X

X

X

X

X

Orratheronknowledgeintegra8on

•  Data/Informa-on➼Knowledge–  Personaldata/infomanagementisgeyngtoocomplicated– Machinespreferstructuredknowledgetounstructuredinforma8onorseman8c-freedata

•  Thesis:Letusturnallourinforma8onintoadistributedknowledgebase

ERCWebdam,hzp://webdam.inria.fr(endedin2015)


TheThymeflowKnowledgeBase

•  ThymeflowisaKB,anextensionofaperson’smemory–  Episodicalmemory(typicallyrelatedtospa8o-temporalevents)and–  Seman8cmemory(knowledgethatholdsirrela8vetoanysuchevent)

•  Thymeflow’sknowledgeis–  Extractedfromalltheinforma8ontracesoftheperson–  ObtainedfromtheWeb(Wikidata,OpenStreetMap…)–  DerivedbysokwaremodulesthatanalyzetheKB

•  Thymeflowisanapplica8onfortheWebandmobilephones–  Loading:calendar,contacts,mails,geoloca8on(GPS),socialnetworks…–  Derivinglinksbetweenthesedatasourcesandotherknowledgebases–  Suppor8ngqueryprocessinganddataanaly8cs


Datasourcesloading/sync

Architecture


synchronizersynchronizer



synchronizer

ThymeflowKB

enricherenricher

enricherenricher

enricherenricher

enricher

KBenriching

Externalsourcesquerying

PersistentKB

QueryingVisualiza-onAnaly-cs

•  Backend:–  HTTPserver–  RESTAPI–  SPARQLendpoint

(Sesame)

•  Frontend:Webapp•  Mobileapp

–  forgeoloca8on

RDFknowledgebase

•  RDFmodel–  RDFTriples

subject–predicate–object•  Schema

–  hzp://schema.org/–  hzp://thymeflow.com/personal

•  Mostusefulclasses–  personal:Agent –  schema:Event –  schema:Place –  schema:EmailMessage


Queryexamples

•  Atwhat8medoIusuallysendemails?

•  Full-textqueryinmyen8rememory


Maincomponent:synchronizer

•  Transformdataintoknowledgeandsynchronizeadatasourcewiththeknowledgebase

Examples•  CalDavSynchronizer/CardDavSynchronizer:

– ManageiCalendar(.ical)andvCard(.vcf)

•  EmailSynchronizer–  IMAPtoconnecttomailservers


ThymeflowKB

Updatepropaga8onFromdatasourcestoKB FromKBtodatasources(1)


ThymeflowKB

ThymeflowKB

PersistentKB PersistentKB

PersistentKB

FromKBtodatasources(1)

ThymeflowKB

ThymeflowKB

ThymeflowKB

PersistentKB

???

Maincomponent:enricher

•  Alignconceptscomingfromdifferentdatasources•  AddknowledgetotheKBExamples•  Alignagentsbasedon,e.g.,theirnames,emails… •  Addgeoloca8onstocalendarevents•  Addseman8cstoplacesphysicallyvisited•  Aligncalendareventstoplacesphysicallyvisited


Dataanaly8cs

•  SmalldataanalysiswithPims–  Learnfrompersonaldata,e.g.,

•  Personalhealthandwell-being•  Digitalpersonalassistant:no8fica8on&planning

–  Issues•  Muchsmalleramountsofdata–sta8s8csharder•  Varyingdataquality:imprecision,inconsistencies

•  BigdataanalysisfromPims–  AggregatedatafromlargenumberofPims–  DeriveknowledgeusefulforPims,e.g.,trafficjams–  Issue:dataprivacy


Conclusion

GoalMakethedigitalworldabezerplacetolivein

ThePimsseemapromisingdirec8onforthatLotsofresearchissuesremaining


personal informaon management systems and …abiteboul.com/presentation/16.pimsthymeflow.pdfpersonal...

Documents