DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 1 OverviewonSmartCity SmartCityforBeginners 2014, Part 9, Corso di Sistemi Distribuiti Scuola di Ingegneria di Firenze Prof. Paolo Nesi DISIT Lab Dipartimento di Ingegneria dellInformazione Universit degli Studi di Firenze Via S. Marta 3, 50139, Firenze, Italia tel: +39-055-4796523, fax: +39-055-4796363 http://www.disit.dinfo.unifi.it paolo.nesi@unifi.it DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 2

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Motivations Societalchallenge Weseeastrongincrementofpopulationofour cities,sinceinthecitiesthelifeissimpleandof higherqualityintermofservicesandworking opportunities Thecitiesneedstobeadaptedtotheincrementof population,tonewevolvingages,tothenew technologiesandexpectationsofpopulation Sustainabilityofthegrowth DISITLab,Univ.Florence,2014 3

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 4

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 5

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 6

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 7

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it SustainabilityoftheGrowth Tobeplannedandmanagedwithrespecttoincrementof populationandtheirneeds incrementofefficiency: compensationoftheincrementsofcosts Incrementofqualityoflife: compensationofthedecrementofqualityoflife provisioningofnewservices: compensationoftheinadequacyofservices Decisionsupportforstrategicaspects Corrections,prediction,newservices,etc. Towardscitizens Informingcitizensonthenewadaptations,makingthem awareaboutthat Formingcitizenstoadoptvirtuousbehaviourintheusageof servicesandresourcesDISITLab,Univ.Florence,2014 8

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smartness,smartcityneeds6features SmartHealth SmartEducation SmartMobility SmartEnergy SmartGovernmental Smarteconomy Smartpeople Smartenvironment Smartliving SmartTelecommunication DISITLab,Univ.Florence,2014 9

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smart health (can be regarded as smart governmental) Onlineaccessingtohealthservices: bookingandpaying selectingdoctor accesstoEPR(ElectronicPatientRecord) Monitoring servicesandusersfor, learnpeoplebehavior,createcollective profiles personalizedhealth Informcitizenstotherisksoftheirhabits Improveefficiencyofservices redistributeworkload,thusreducingthe peakofconsumption DISITLab,Univ.Florence,2014 10

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smart Education (can be regarded as smart governmental) DiffusionofICTintotheschools: LIM,PAD,internetconnection,tables,.. Primaryandsecondaryschools university industry&services Monitoring thestudentsandqualityof service, learnstudentbehavior,createcollectiveprofiles, personalizededucation suggestingbehaviorto Informingthefamilies moderatethepeakofconsumption increasethecompetenceinspecificneeded sectors,etc. Increaseformationimpactandbenefits DISITLab,Univ.Florence,2014 11

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smart Mobility Publictransportation: bus,railway,taxi,metro,etc., Publictransportforservices: garbagecollection,ambulances, Privatetransportation: cars,deliveringmaterial,etc. Newsolutions(publicand/or private): electriccars,carsharing,car pooling,bikesharing,bicyclepaths Online: ticketing,monitoringtravel, infomobility,accesstoRTZ,parking, etc. DISITLab,Univ.Florence,2014 12

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smart Mobility and urbanization Monitoring thecitystatus, learncitybehavioronmobility learnpeoplebehavior createcollectiveprofiles trackingpeopleflows ProvidingInfo/service personalized Infoaboutcitystatusto helpmovingpeopleand material educationonmobility, moderatethepeakof consumption Reasoningto makeservicessustainable makeservicesaccessible Increasethequalityofservice DISITLab,Univ.Florence,2014 13

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smart Energy Smartbuilding: savingandoptimizingenergyconsumption, districtheating renewableenergy:photovoltaic,windenergy, solarenergy,hydropower,etc. Smartlighting: turningon/offonthebasisoftherealneeds Energypointsforelectric:c ars,bikes,scooters, Monitoring consumption,learnpeople/city behavioronenergyconsumption,learn peoplebehavior,createcollectiveprofiles Suggestingconsumers differentbehaviorforconsumption:different timetousethewashingmachine Suggestingadministrations restructuringtoreducetheglobal consumption, moderatethepeakofconsumption DISITLab,Univ.Florence,2014 14

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smart Governmental Services Servicetowardcitizens: onlineservices: register,certification,civil services, taxes,useofsoil, Paymentsandbanking: taxes,schools,accesses Garbagecollection: regularandexceptional Qualityofair: monitoringpollution Watercontrol: monitoringwaterquality, waterdispersion,riverstatus DISITLab,Univ.Florence,2014 15

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Smart Governmental Services Servicetowardcitizens: CulturalHeritage:ticketingonmuseums, Tourism:ticketing,visiting,planning,booking (hotelandrestaurants,etc.) socialnetworking: gettingservicefeedbacks, monitoring Socialsustainabilityofservices: crowdservices Socialrecoveringofinfrastructure, Newservices,exploitinginfrastructures Monitoring consumptionandexploitationof services,learnpeoplebehavior,createcollective profiles Discoveringproblemsofservices, Findingcollectivesolutionsandnewneeds DISITLab,Univ.Florence,2014 16

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Telecommunication, broadband FixedConnectivity: ADSLormore,fiber, MobileConnectivity: Publicwifi,ServicesonWiFi, HSPDA,LTE Monitoring communication infrastructure Providinginformationand formationon: howtoexploitthe communicationinfrastructure Exploitingthecommunication fortheotherservices, moderatethepeakof consumption DISITLab,Univ.Florence,2014 17

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 18

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Profiled Services Profiled Services SmartCityParadigm DISITLab,Univ.Florence,2014 19 Interoperability Data processing SmartCity Engine Data Harvesting Data/info Rendering Data/info Exploitation Suggestions andAlarms RealTime Data SocialData trends Data Sensors DataIngesting andmining Reasoning and Deduction DataActing processors RealTime Computing Traffic control Social Media Sensors control Peripheral processors Energy central eHealth Agency eGov Data collection Telecom. Services . Citizens Formation Applications

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Challenges (addressed byDISIT) SocialMediabloganalysis EnergyControlforbikesharing WiFiasasensorforpeoplemobility InternetofThingsassensors LowcostsBluetoothmonitoring devices Vehiclekitswithsensors Sensorsnetworksspreadinthecity andmanagedbycentrals Trafficflowsensors .. DISITLab,Univ.Florence,2014 20 Traffic Control Social Media Sensors control Peripheral processors Energy Central eHealth Agency eGov Data collection Telecom. Services .

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Challenges (addressed byDISIT) OD/LOD,OpenData/LinkedOpenData: gathering,collection, DataMining: ontologymapping,integration, semanticallyinteroperable reconciliation,enrichment, qualityassessmentandimprovement DataFilteringonStreaming BlogVigilance DISITLab,Univ.Florence,2014 21 Data Harvesting RealTime Data SocialData trends Data Sensors DataIngesting andmining

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Challenges (addressed byDISIT) ReasoningandDataprocessing Dataanalytics,Semanticcomputing LinkDiscovering Inferentialreasoning Identificationofcriticalcondition unexpectedcorrelations predictions,etc. RealtimeComputingoutofperipherals Action/reaction Activationofrules Firingconditionsforactivatingcomputing Acceptanceofexternalrules DISITLab,Univ.Florence,2014 22 Data processing SmartCity Engine Reasoning and Deduction Realtime Computing

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Challenges (addressed byDISIT) Userprofiling,collectiveprofiles ComputingSuggestions: Informationandformation Virtuousbehaviorstimulation Forcitizensandadministrators Dataexport: API,LOD,.. ConnectionwithotherSmartCity DISITLab,Univ.Florence,2014 23 Profiled Services Profiled Services 23 Data/info Rendering Data/info Exploitation Suggestions andAlarms DataActing processors Citizens Formation Applications Interoperability

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 24

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 25 SiiMobility (Smart City) nuove tecnologie e soluzioni intelligenti per migliorare l'interoperabilit dei sistemi di gestione, di infomobilit urbana e metropolitana, e di accesso a dati integrati collegati. (TRASPORTI E MOBILIT TERRESTRE ) Coll@bora (Smart City Social Innovation) strumenti collaborativi e di protezione nel supporto fra strutture sanitarie, associazioni e famiglie con disabili. (TECNOLOGIE WELFARE E INCLUSIONE) Contesto:SmartCity DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Coll@bora Title: Collaborative Support for Parents and Operators of Disabled Objectives: providing strong advantages for 1. Relatives interested in facilitating relations with the management team; 2. Associations in order to offer a better service to the families and people with disabilities by providing a collaborative support to the involved teams, but also to manage the wealth of knowledge, to support the training of the staff, etc. Coll@bora provides a secure collaboration tool for the teams and for the association to support the families and the disabled people. Link: http://www.disit.dinfo.unifi.it/collabora.html DISITLab,Univ.Florence,2014 26

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 27

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Sii-Mobility Title:SupportofIntegratedInteroperabilityforServices toCitizensandPublicAdministration Objectives: 1. Reduction of social costs of mobility; 2. Simplify the use of mobility systems; 3. Developing working solutions and application, with testing methods; 4. Contribute to standardization organs, and establishing relationships with other smart cities management systems. The SiiMobility platform will be capable to provide support for SME and Public Administrations. SiiMobility consists in a federated/integrated interoperable solution aimed at enabling a wide range of specific applications for private services to citizen and commercial services to SME. Coordinatore Scientifico: Paolo Nesi, DISIT DINFO UNIFI Partner: ECM; Swarco Mizar; University of Florence (svariati gruppi+CNR); Inventi In20; Geoin; QuestIT; Softec; T.I.M.E.; LiberoLogico; MIDRA; ATAF; Tiemme; CTT Nord; BUSITALIA; A.T.A.M.; Sistemi Software Integrati; CHP; Effective Knowledge; eWings; Argos Engineering; Elfi; Calamai & Agresti; KKT; Project; Negentis. Link: http://www.disit.dinfo.unifi.it/siimobility.html DISITLab,Univ.Florence,2014 28

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 29

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it SiiMobility DISITLab,Univ.Florence,2014 30

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 31 Sperimentazioni principalmente inToscana Sperimentazioni piucompleteinaree primarie adalta integrazione dati Integrazione coni sistemi presenti SiiMobility

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it SiiMobility:Scenari principali soluzionidiguida/percorsoconnessa/o servizipersonalizzati,segnalazioni,ilveicolo/lapersonariceve comandieinformazioniintemporealema modopersonalizzatoecontestualizzato; Piattaformadipartecipazioneesensibilizzazione perriceveredalcittadinoinformazioni,ilcittadinocomesensoreintelligente,informareeformareilcittadino, tramitetotem,applicazionimobili,webapplications,etc.; gestionepersonalizzatadellepolitichediaccesso Politichediincentivazioneedidissuasionedellusodelveicolo,Creditidimobilit,monitoraggioflussi; interoperabilitedintegrazionedeisistemidigestione contribuzioneastandard,verificheevalidazionedeidati,riconciliazionedeidati,etc.; integrazionedimetodidipagamentoediidentificazione Politichepayperuse,monitoraggiocomportamentodegliutenti; gestionedinamicadeiconfinidelleareeatrafficocontrollato tariffazionedinamicaepercategoriadiveicoli; gestioneretecondivisadiscambiodatifraservizi(PAeprivati) affidabilitdeidatieseparazionedelleresponsabilit,Integrazionediopendata,riconciliazione,.; monitoraggiodelladomandaedelloffertaditrasportopubblicointemporeale soluzioniperlintegrazioneelelaborazionedeidati. DISITLab,Univ.Florence,2014 32

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it SupportodiInteroperabilitaIntegrato Architettura SiiMobility DISITLab,Univ.Florence,2014 33 Supporto:dataanalytics, semanticcomputing DataProcessing: validation,integration, geomap..,reconcil, Orari,percorsi,fermate, Valori attuali,politiche di azione,etc. profiles, modelli di costo,users, .. Interfaccia diControllo e Monitoraggio APIDatapublicationverso altricentridiServizioUtenti Centrale Operativa: Supportoalle decisioni, simulazioni, APIaltri SiiMobility APIaltre Centrali SC Gestori: Gestori Flotte,AVM, TPL,Parcheggi, Autostrade,Car Sharing,Bike sharing,ZTL, direzionatori .. Agrgegazionedati, propagazioneazioni APICentrali nazionali SocialMedia: twitterFaceBook,Blogs Dataingestionand preprocessing Acq Dati Emegenza OpenData: ambientali,energia, ordinanze,grafo,. Supporto:bigliettazione, prenotazione,pianificazione, Additional algorithms,.... BigDataprocessinggrid Sistemi diGestione Dati integrati dalterritorio Interoperabilit daeversoaltri sistemi digestione integrata eSC Infomobilitepublicazione Piattaforma dipartecipazione edi Sensibilizzazione Info.Servicesfor Totem,Mobile,.. Applicazioni WebeTotem Applicazioni Mobili InfrastrutturaHWSiiMobility Sensorie Apparatidi Rilevazione KitveicolieAttuatori

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Linee Azioni(versionebreve) interoperabilit, integrazionee modellazionedati Interoperabilit, verifiche e validazione dei dati, riconciliazione, etc. sistemidistribuitiemobili,mobilecomputing,datasecurity,user privacy,.. datamodeling,integrazioneOpenData/LODPubblicieprivati,.. socialmedia,crowdsourcing,naturallanguage processing analisied elaborazionedatiin automatico semanticcomputing,knowledgemanagement,verifichediconsistenzae completezza,user profiling,soluzionidisentiment andaffective analysis, dataanalytics ericercaoperativa,artificial intelligence; stimadi predizioni, percorsiottimi, correlazioniinattese,tariffedinamiche,costimedi,.. Bigdata,indicizzazionenavigazioneedelaborazione sensoriedattuatori innovativi sensor network,communication system emobile,istrumentare lacitt, raccoltadatidiflusso,velocitedambientali,attuazione kitperveicoli, sistemidi informazione sensor KITevoluti(bus,car,bike). Integrazioneconmetodidipagamento,gestioneeaperturavarchi, direzionatori Comunicazionee azioneversoil cittadino modellidicomunicazioneconilcittadino,sistemidiinformazione Valutazioneestimolocomportamentivirtuosi,informazionecriticaedi criticit DISITLab,Univ.Florence,2014 34 SiiMobility:Linee diRicerca

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 35

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Problematiche diRicerca Smart Modellazionedellaconoscenzaconsemanticacoerenteper effettuarededuzionicorrettesfruttandoinformazioninumerichee simboliche,sugrandivolumieflussididati,automazione Problematiche derivatedaoltre1000ODePD,serviziconmodellidiversi eformatidiversi:resilienza,qualit,misura,accesso,integrazionereal time, Tecnichedi:modellazione,semanticcomputing,scheduling, Ricercasuintegrazioneemodellazionedati: Altolivello:predizionesuserviziecomportamenti,correlazioni inattese,situazionicritiche,flussodeiviaggiatori, Problemiealgoritmidiriconciliazionedeldato,tracciamentoe versionamento,reputazione,filtraggio,integrazioneODeLOD internazionali/nazionali,validazioneeverificaformale,... 36DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Why:Createanontologythatallowstocombine alldataprovidedbythecityofFlorenceandthe Tuscanregion. Problems:datahavedifferentformats,theymust bereconciledinordertobeeffectively interconnectedtoeachother,butsometimes informationisincomplete. Objective:takeadvantageofthecreated repositoryandontologytoimplementnew integratedservicesrelatedtomobility; toprovide repositoryaccesstoSMEs tocreatenewservices. DISITLab,Univ.Florence,2014 37 Research objectives

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Analysis of Available Data 519 OpenData (Municipality of Florence) 145 OpenData (Tuscany Region) TPL Timetable and TPL Route Street Graph Point of Interest Real Time Data from traffic sensors Real Time Data from parking sensors Real Time Data from AVM systems Weather Forrecast (consortium Lamma) DISITLab,Univ.Florence,2014 38

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it FromMIICwebservices(realtime) o ParkingpayloadPublication (updatedeveryh) o TrafficsensorspayloadPublication (updatedevery510min) o AVMclientpullservice(updatedevery24h) o StreetGraph FromMunicipalityofFlorence: o Tramline:KMZfilethatrepresentsthepathoftraminFlorence o StatisticsonmonthlyaccesstotheLTZ,touristarrivalsperyear,annual salesofbustickets,accidentsperyearforeverystreet,numberof vehiclesperyear o MunicipalityofFlorenceresolutions FromTuscanyRegion: o Museums,monuments,theaters,libraries,banks,courierservices, police,firefighters,restaurants,pubs,bars,pharmacies,airports,schools, universities,sportsfacilities,hospitals,emergencyrooms,doctors' offices,governmentoffices,hotelsandmanyothercategories o WeatherforecastoftheconsortiumLamma (updatedtwiceaday) DISITLab,Univ.Florence,2014 39 DataSet already integrated

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Le misurazioni comprendono dati come distanza media tra veicoli, velocit media di transito, percentuale di occupazione della strada, transiti orari, ecc. I sensori sono divisi in gruppi, ciascuno identificato da un codice di catalogo che viene passato come parametro in fase di invocazione del web service Un gruppo un insieme di sensori che monitora un tratto stradale I gruppi producono una misurazione ogni 5 o ogni 10 minuti Attualmente sono attivi 71 gruppi su tutto il territorio toscano, per un totale di 126 sensori AnalisideidatiattualiMIIC Sensori traffico: dati relativi alla situazione della viabilit stradale provenienti da gestori di sistemi di rilevamento a sensori 40DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Lo stato di un parcheggio viene descritto da dati come il numero di posti totali e occupati, il numero di veicoli in entrata e in uscita, ecc. I parcheggi sono divisi in gruppi, ciascuno identificato da un codice di catalogo che viene passato come parametro in fase di invocazione del web service Un gruppo corrisponde allinsieme di parcheggi appartenenti a un comune La situazione di ogni parcheggio viene pubblicata circa ogni minuto Attualmente vengono monitorati 50 parcheggi AnalisideidatiattualiMIIC Parcheggi: dati relativi allo stato di occupazione dei parcheggiprovenienti da gestori di aree di parcheggio. 41DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 42 DISITLab,Univ.Florence,2014 ModelsforKnowledgeRepresentation ExplicittypologiesofKnowledgewhichcanbemade machinereadable andmachineunderstandable: Structured Knowledge (Ontologies,Taxonomies etc.) Semistructured (DBMS) Weakly structured (HTML,Tablesetc.) Not structured (Natural Languageunstructured text, images,drawings etc.)

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 43 DISITLab,Univ.Florence,2014 WebOntologiesandLanguages InComputer/InformationScience,anOntology is defined as theconceptualization ofaspecific domainofinterest,expressed through entities (Classes),descriptors (Attributes),relationships (Properties)andapredefined rule corpus(Semantics). Representation syntax canbeequivalently expressed inXMLbased formats,as well as inthefollowing triple format: . LanguageusedforOntologiesrepresentation: OWL (WebOntologyLanguage)is theW3CstandardforOntologydefinition forSemanticWeb. RDF/XML Ntriples,N3 etc. Interrogation/Querylanguages: SPARQL SERQL

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Macroclasses Connections DISITLab,Univ.Florence,2014 44

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it MapsandGeographicalinformation:formedby classesRoad,Node,RoadElement,AdministrativeRoad, Milestone,StreetNumber,RoadLink,Junction,Entry, andEntryRule, Manoeuver,isusedtorepresentthe entireroadsystemofTuscanyregion. PointofInterest:economicalservices(publicand privates),activities,whichmaybeusefultothecitizen andwhomayhavetheneedtosearchforandtoarrive at.Classificationwillbebasedonthedivisioninto categoriesplannedatregionallevel. Weather:includingstatus andforecasts fromthe consortiumLamma inTuscany. DISITLab,Univ.Florence,2014 45 Ontology Macroclasses

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Transport:datacomingfrommajorLPTcompanies includingscheduledtimes,therailgraph,datarelatingto realtimepassageatbusstops.Classes:busline,Ride, Route,record,RouteSection,BusStopForeast,RouteLink. Sensors:concerningdatacomingfromsensors;theymay includeinformationsuchaspressure,humidity,pollution, carflow,carvelocity,numberofpassedcars andtracks,etc. Administration:includes informationcoming frompublic administrations such as resolutions issuedbyeach administration,plannedevents,changes inthetraffic arrangement,planned VIPvisits,sports events,etc. DISITLab,Univ.Florence,2014 46 Ontology Macroclasses

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it RoadElement:delimitedbyastartnodeandanendnode (ObjectProperties "starts"e"ends"); Road:composed by RoadElement andNode ("contains") AdministrativeRoad:connected to RoadElement (isComposedeforming),to Road(coincideWith). Road:AdministrativeRoad =N:M.Both ina1:Nrelation with RoadElement; EntryRule:connected to RoadElement ("hasRule", "accessTo "); Maneouvre:linked to EntryRule ("isDescribed"). Described through "hasFirstElem","hasSecondElem"and "hasThirdElem"."concerning"fastes amaneouvre to the concerned junction. DISITLab,Univ.Florence,2014 47 Maps Macroclass

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Node:georeferenced through geo:latandgeo:long. Milestone:associated with 1AdministrativeRoad ("placedIn"),georeferenced through geo:latand geo:long. StreetNumber:alwaysrelatedtoatleast1entry(internal orexternal).Connected to RoadElement andRoad ("standsIn"and"belongTo");reverse:"hasStreetNumber". Entry:connected to StreetNumber through "hasInternalAccess"and"hasExternalAccess",with cardinality resrictions,subclass of geo:SpatialThing, maximum cardinality restriction 1to geo:latandgeo:long "ownerAuthority"and"managingAuthority":linked to PA macroclass. DISITLab,Univ.Florence,2014 48 Maps Macroclass

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 49 Maps Macroclass

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it OTN: anontologyoftrafficnetworksthatismore orlessadirectencodingofGDF(GeographicData Files)inOWL; dcterms: setofpropertiesandclassesmaintained bytheDublinCoreMetadataInitiative; foaf: dedicatedtothedescriptionoftherelations betweenpeopleorgroups; vCard: foradescriptionofpeopleand organizations; wgs84_pos: vocabularyrepresentinglatitudeand longitude,withtheWGS84Datum,ofgeoobjects. DISITLab,Univ.Florence,2014 50 Reused Vocabulary

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 51

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 52

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 53 RDFStore, Knowledge base BigDataStore DatiStatici ETL Transfor mation ETL Transfor mation ETL Transfor mation ETL Transfor mation Mapping processe s Temp Store Triple Generati on Data Integrati onTool DISIT Ontology for SmartCity R2RML Model ReconciliationconsolleProcess Scheduler Ingestion Temp Store SQLStore NoSQLStore BigDataStore DatiRealTime SQLStore ETL Transfor mation Validation Query SPARQL LinkedOpenGraph Log.disit.org ServiceMap servicemap.disit.org Mapping SPARQLendpoint Access Server

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 54 Phase1:collectdatafromdifferentsources (MIICWebService,Portale dellOsservatorio dei Trasporti edella Mobilita,Municipalityof FlorenceandTuscanyRegionWebSites). Phase2:firstprocessingmeansETLtooland NoSQL databasestorage. Phase3:secondtransformationusingETL toolsandRDFtriplescreation. Phase4:SavingtripleinRDFstore. From Open Data to Triples

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it ETLTrasformation TorealizetheR2RMLmodel RDFStore DISITLab,Univ.Florence,2014 55 Helpful Tools

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 56 GET URL HTTPGET condizionata Trasformazione HBase Process Table Parametro: nomefile GET last_update Process Table Aggiornamento last_update Process Table Ingestion,unesempio EseguitadaPentaho Kettle (softwareETL) 1) Sipassailnomedelfiledaprocessare 2) VienerecuperatolURLdellarisorsa 3) Downloaddelfile(solosestatoaggiornanodallultimavolta) 4) Aggiornamentodelladatadidownload 5) Trasformazionerisorsa:daXMLaformatabulare,eliminazionecaratteri speciali,creazionechiavi,informazioniaggiuntive 6) MemorizzazionesuHBase DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Ingestion (unesempio) 57DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Toautomatethedifferentphases,wehave createdanarchitecture thatincludesaprocess scheduler. Theprocessschedulerimplementationwas necessarytorepeatthe4 phases,fromingestion totransformationintriple. WestoringdatainHbase accordingtoa programmedrate,whichiscloselylinkedtothe typeofdata(static/realtime): o Realtimedata:every10min; o Otherdata:2 15timesaday; o Staticdata:onceamonthormore. DISITLab,Univ.Florence,2014 58 Architecture

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majorproblemswiththedata: o inconsistentdata(differentmunicipalitytothesame service,citynamesthatarenotamunicipality) o missingdata(streetnumber) o incorrectdata(spellingerrors) Needtovalidatethedata,butaboveallto reconcilethemtobeabletoconnectwitheach other: o Service StreetNameReconciliation o Service CoordinateReconciliation DISITLab,Univ.Florence,2014 59 Data Validation & Reconciliation

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Services:~30.100(all over Tuscan region)of which: o Geolocalized Services:~12.400 o Serviceslocatedatstreetlevel:~8.300 Remaining Services:~9.000of which: o Nonunique results to locatetheserviceatstreet level o StreetNumbermissing o Unusual letters inmunicipality names orstreet names o AddressdoesnotexistonStreetGraph:~ 2.200(next step:usetheGooglegeocoding API) DISITLab,Univ.Florence,2014 60 Reconciliation Numbers

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Weather:286filesuploadedtwiceaday 270,000Hbase rows/month ~4million triples/month; Sensors:126activesensors 18.000Hbase rows/day,50supervisedparking ~10GB/mese; StreetGraph:68Mtriples. Foranamount of~ 80MTriples onrepository DISITLab,Univ.Florence,2014 61 Real Time Data Numbers

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 62

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it LinkedOpenGraph(LOG):atooldevelopedto allowexploringsemanticgraphoftherelation amongtheentities.Itcanbeusedtoaccessto manydifferentLODrepository. (http://log.disit.org/) Maps:servicebasedonOpenStreetMaps that allowstosearchservicesavailableinapreset rangefromtheselectedbusstop. (http://servicemap.disit.org/) DISITLab,Univ.Florence,2014 63 App Examples

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 64 log.disit.org/

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it DISITLab,Univ.Florence,2014 65 servicemap.disit.org

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it http://servicemap.disit.org DISITLab,Univ.Florence,2014 66

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Integrationofrailgraphintotheontology; Insertionofotherstaticdatasetsfromthe municipalityofFlorenceandotherTuscanyPA; UsingGoogleGeocoding APItofinishservices reconciliation; Improvementofserviceslistandtheir geolocation; CreationofotherappsthatsuggesttoSMEand PAhowtousedata. DISITLab,Univ.Florence,2014 67 Future Works

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Majortopicsaddressed SmartCityConcepts ArchitectureofSmartCityInfrastructures Peripheralprocessors Dataingestionandmining ReasoningandDeduction DataActingprocessors Progetto SmartCity Coll@bora Progetto SmartCity SiiMobility DataMiningeProblematiche smartCity DISITSmartCityOntology Dataingestionandintegration ServiceMapandLinkedOpenGraph BlogVigilanceviaNaturalLanguageProcessing DISITLab,Univ.Florence,2014 68

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Search Q&A Graph ofRelations SocialPlatform 69 DISITLab,Univ.Florence,2014 KnowledgeWorkflow:fromSourcestoFinalUsers Semantic Repository Databases, OpenData Archives, OpenArchives Web Pages Semantic Computing NLP Inference &Reasoning Recommendations &Suggestions Link Discovering Reconciliation& Disambiguation (Names,GeoTagsetc.)Text Documents Publications Metadata, Descriptorsetc.

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 70 DISITLab,Univ.Florence,2014 DataIntegrity:Accuracy andReliabilityofData BigDataMiningissues Manydifferentformats Ambiguitiesandinconsistenciesofdescriptors,metadataetc. Unstructured,decontextualizeddatadoesnotallowtoextracthighlevel information SeveraldifferenteffortsofstructureKBs,ontologies,taxonomiesetc.inmany fieldsofKnowledge Thereisnecessityof: Reconciliationanddisambiguationofingesteddata Organizedataintoproperformsofstructuredknowledge Standardizedefinitions,languages,vocabulariesetc. Linkdiscoveringamongdifferentknowledgebases Makeinferencetoproduceadditionalknowledge Detectunexpectedcorrelations,producesuggestionsandrecommendations Providesemanticinteroperabilityamongresourcesandapplications.

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 71 DISITLab,Univ.Florence,2014 NewApproaches TheSemanticWeb Webofdocuments(HTML) VS Webofdata (RDFTriples) RelationalDBMS VS SemanticDatastores (Ontologiesetc.) KeywordbasedSearchEnginesVS NLPQ&A Tools

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it CrawlingStrategies:WebCrawler Architecture: Document/PagesParsing:RobotExclusionProtocol DISITLab,Univ.Florence,2014 72 WebCrawlingandDataMining # Robots.txt for http://www.springer.com (fragment) User-agent: Googlebot Disallow: /chl/* Disallow: /uk/* Disallow: /italy/* Disallow: /france/* User-agent: MSNBot Disallow: Crawl-delay: 2 User-agent: scooter Disallow: # all others User-agent: * Disallow: /

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it Findingrelationshipsbetweenentities,LODsetc., withindifferentRDFdatasources. DISITLab,Univ.Florence,2014 73 LinkDiscovering Source:SILK http://events.linkeddata.org/ldow2009/papers/ldow2009_paper13.pdf Semantic Store Semantic Store ... Config LINKS CoreLogic ComparisonLoop Resource Lister Metrics Definition &Evaluation Resource Indexer SPARQL SPARQL

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 74 NaturalLanguage Text Syntactical Analysis Tokenizer Morphologic Analysis PartofSpeechTagger Chunker Syntactical Parse SemanticAnalysis NaturalLanguagesentences aresubsequently processed andcoded into asemantic representation (bymeans of logic formalisms,semantic networksandontologies) Textis segmented into sequences ofcharacters (tokens). Agrammar category is assigned toeach token Each wordofasentence/period is annotated withits logicalrule (subject,predicate, complement etc.) This phase uses previous annotations togroup nominal andverbal phrases foreach sentence Produces theSyntactic ParseTree foreach sentence NLP NaturalLanguageProcessingPhases DISITLab,Univ.Florence,2014

DISIT Lab, Distributed Data Intelligence and Technologies Distributed Systems and Internet Technologies Department of Information Engineering (DINFO) http://www.disit.dinfo.unifi.it 75 OverviewonSmartCity SmartCityforBeginners Corso di Sistemi Distribuiti Scuola di Ingegneria di Firenze Prof. Paolo Nesi DISIT Lab Dipartimento di Ingegneria dellInformazione Universit degli Studi di Firenze Via S. Marta 3, 50139, Firenze, Italia tel: +39-055-4796523, fax: +39-055-4796363 http://www.disit.dinfo.unifi.it paolo.nesi@unifi.it DISITLab,Univ.Florence,2014