augmenting open government data with social media data
TRANSCRIPT
© Information Systems Lab – 2012
W3C USING OPEN DATA Workshop19-20 June 2012, Brussels
Augmenting Open Government Data with
Social Media Data
Evangelos Kalampokis, Efthimios Tambouris, Michael Hausenblas and Konstantinos Tarabanis
© Information Systems Lab, University of Macedonia
Open Gov Data (OGD) and Social Media Data (SMD) Open Government Data (OGD)
– Come in various formats
– Come in large numbers
– Mostly are created by the public sector
– Some are open
– Are objective
– Are used for new value-added services
Social Media Data (SMD)
– Come in various formats
– Come in large numbers
– Mostly are created by Social Media users
– Some are open
– Are subjective
– Are used for new value-added services and research (e.g. for predictions)
© Information Systems Lab, University of Macedonia
Open Government Data
© Information Systems Lab, University of Macedonia
Social Media Data
© Information Systems Lab, University of Macedonia
Our Research Agenda
Aim: Investigate and exploit the integration of OGD and SMD
Steps:
1. Understanding OGD
2. Understanding SMD
3. OGD/SMD Integration
4. Proof-of-concept: UK elections 2010
© Information Systems Lab, University of Macedonia
1. Understanding OGD: A Classification Scheme
Kalampokis, E., Tambouris, E., Tarabanis, K.: A Classification Scheme for Open Government Data: Towards Linking Decentralized Data. International Journal of Web Engineering and Technology 6(3), 266–285 (2011)
24 official OGD initiatives were classified based on that framework in 2010 (this classification may now have changed)
© Information Systems Lab, University of Macedonia
2. Understanding the Use of Social Media Data: An Analysis Framework
Evangelos Kalampokis, Efthimios Tambouris and Konstantinos Tarabanis (XXX) "Understanding the Use of Social Media for Predictions", [submitted for evaluation]
list of important factors
list of important factors
list of important factors
list of important factors
Based on the review of ~60 relevant scientific publications
© Information Systems Lab, University of Macedonia
3. Integrating Open Government and Social Data
Some challenges:
– Stage Model (putting everything in context)
– Identify relevant datasets
– Transforming noisy SMD into high quality structured data (e.g. using NER etc.)
– Integrating data based on common elements (e.g. using Linked data, etc.)
– Platform for data analytics (dashboard)
– Explanatory and predictive models
– Meaningful case studies!!
© Information Systems Lab, University of Macedonia
A Stage Model for OGD
Kalampokis, Ε., Tambouris Ε. and Tarabanis Κ., Open Government Data: A Stage Model. In: M. Janssen et al. (Eds): EGOV2011. LNCS 6846, 235-246, 2011.
© Information Systems Lab, University of Macedonia
A Linked Data based Architecture
Kalampokis, E., Hausenblas, M. and Tarabanis, K., Combining Social and Government Open Data for Participatory Decision-Making. In: E. Tambouris, A. Macintosh, and H. de Bruijn (Eds.): ePart 2011, LNCS 6847, 36–47, 2011.
© Information Systems Lab, University of Macedonia
4. Proof of Concept (UK elections of 2010)
What OGD and SMD reveal about UK elections 2010?
We envisage two complementary views: one objective (based on OGD) and one subjective (based on SMD) as well as one integrated
© Information Systems Lab, University of Macedonia
Objective view based on OGD (UK elections 2010)
Labours won 7 out of 200 constituencies with % of children in poverty below 17%
Labours won 74 out of 77 constituencies with % of children in poverty over 30%
Data source (X-axis): Children in poverty per parliament constituency (data.gov.uk)(Y-axis): UK elections 2010 Labours results per constituency
© Information Systems Lab, University of Macedonia
Subjective view based on SMD (UK elections 2010)
Data source: Tweets about UK elections (#ge2010, #ukelection, #election2010 and #ge10) during the last month before elections (moving average k = 4 days)
Data source: Poll results (YouGov)
© Information Systems Lab, University of Macedonia
Integrated view based on OGD + SMD
Work still in progress (results to be announced soon)
From a technological view, we aim to develop a dashboard like the following:
Objective view(based on OGD)
Subjective view(based on SMD)
Integrated view(based on OGD+SMD)
© Information Systems Lab, University of Macedonia
Conclusions and Future Work
OGD and SMD have a huge potential for added value services besides “trivial” apps
This requires significant advances in exploiting OGD, SMD and their integration.
Our aim is to provide the infrastructure (framework, methods, tools, platforms) necessary to exploit this potential.
© Information Systems Lab, University of Macedonia
Acknowledgments
The work presented in the paper is partly funded by
© Information Systems Lab, University of Macedonia
Thank you for your attention!!
Contact us at:
Evangelos Kalampokis: [email protected]
Themis Tambouris: [email protected]