d7.5 final dissemination communication and networking report … · 2019-11-06 · d7.5 – final...

D7.5 – Final Dissemination, communication and networking report - Version 1.0 - Final. Date: 30.09.2019

Project Title: CITADEL Contract No. GA 726755

www.citadel-h2020.eu

of 53

Empowering Citizens to Transform European Public Administrations

Deliverable D7.5

Final Dissemination, communication and networking report

Editor(s): Judith Clifton, Gonzalo Llamosas García

Responsible Partner: University of Cantabria

Status-Version: Final – v1.0

Date: 30/09/2019

Distribution level (CO, PU): PU




of 53

Project Number: GA 726755

Project Title: CITADEL

Title of Deliverable: Final Dissemination, communication and networking report

Due Date of Delivery to the EC: 30/09/2019

Workpackage responsible for the Deliverable:

WP7 - Communication and Dissemination

Editor(s): University of Cantabria

Contributor(s): All partners

Reviewer(s): Leire Orue-Echevarria (TECNALIA)

Approved by: All Partners

Recommended/mandatory readers:

All WPs

Abstract: This deliverable will explain the dissemination and communication activities followed during the last year of the project as well as the results from these activities and will update project’s dissemination and communication plan respectively. This report will also contain the relevant activities executed to foster a close collaboration with projects related to CITADEL, as well as future networking plans. This document will also provide details about the annual activities with the Advisory group and outcomes of T6.4.

Keyword List: Communication, dissemination, networking, events, scientific publications, social networks

Licensing information: This work is licensed under Creative Commons Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0) http://creativecommons.org/licenses/by-sa/3.0/

Disclaimer This document reflects only the author’s views and neither Agency nor the Commission are responsible for any use that may be made of the information contained therein

http://creativecommons.org/licenses/by-sa/3.0/




of 53

Document Description

Document Revision History

Version Date Modifications Introduced

Modification Reason Modified by

v0.1 11/06/2019 First draft version (ToC) University of Cantabria, Innova Puglia

V0.2 25/06/2019 Second draft version (ToC) University of Cantabria, Innova Puglia

V0.3 30/08/2019 Comments and suggestions received by consortium partners

All partners

V0.5 09/09/2019 Pre-final document University of Cantabria, Innova Puglia

V0.6 23/09/2019 Modifications after the internal review University of Cantabria, Innova Puglia

V1.0 26/09/2019 Ready for submission TECNALIA




of 53

Table of Contents

Table of Contents .......................................................................................................................... 4

List of Figures ................................................................................................................................ 5

List of Tables .................................................................................................................................. 5

Terms and abbreviations ............................................................................................................... 6

Executive Summary ....................................................................................................................... 7

1 Introduction .......................................................................................................................... 8

1.1 About this deliverable .................................................................................................. 9

1.2 Document structure ..................................................................................................... 9

2 Considerations of overall CITADEL results .......................................................................... 11

2.1.1 Main CITADEL dissemination results ..................................................................... 11

2.1.2 Main CITADEL communication results .................................................................. 11

2.1.3 Main CITADEL networking results ......................................................................... 12

3 Elaboration and provisioning of dissemination material .................................................... 12

3.1 Website updates ........................................................................................................ 12

3.2 Dissemination materials ............................................................................................ 13

3.2.1 Brochure ................................................................................................................ 13

3.2.2 Demonstrative Videos of CITADEL ecosystem and promotional video ................. 14

3.3 Attended and organized events ................................................................................. 15

3.4 Scientific and business publications .......................................................................... 17

4 Analytic trends and considerations in monitoring and evaluation of main dissemination activities during the project lifetime ........................................................................................... 26

4.1 Overview .................................................................................................................... 26

4.2 Attended and organized events ................................................................................. 26

4.3 Scientific and Business Publications .......................................................................... 28

5 Elaboration and provisioning of communication material in the 3rd year .......................... 30

5.1 Social media measures .............................................................................................. 30

5.2 Materials .................................................................................................................... 30

5.3 Press releases ............................................................................................................. 31

5.4 Blog posts ................................................................................................................... 31

6 Analytic trends and considerations in monitoring and evaluation of main communication activities during the project lifetime ........................................................................................... 33

6.1 Analytics of project’s web site ................................................................................... 33

6.2 Social Network activities ............................................................................................ 36

7 Advisory Board meetings .................................................................................................... 43

8 Collaboration and networking activities ............................................................................. 43

8.1 Considerations on collaboration activities with EU funded projects ........................ 43




of 53

8.2 CITADEL focus groups ................................................................................................ 45

8.3 Further collaborations and reuse of CITADEL achievements beyond the end of the project 45

9 Final conclusions ................................................................................................................. 46

Annex 1 – Press release ............................................................................................................... 47

Annex 2 – Number of access to the project website from each country ................................... 50

List of Figures

FIGURE 1. A SCREEN OF THE PROMOTIONAL VIDEO ................................................................................ 15 FIGURE 2. CITADEL FEATURED IN CORDIS. ........................................................................................ 18 FIGURE 3. TYPES OF EVENTS BY YEAR ................................................................................................... 27 FIGURE 4. FREQUENCY OF ATTENDED EVENTS BY YEAR ........................................................................... 27 FIGURE 5. LEVEL OF IMPACT OF SCIENTIFIC PUBLICATIONS ...................................................................... 28 FIGURE 6. BUSINESS PUBLICATION BY YEAR .......................................................................................... 29 FIGURE 7. CITADEL AGENDA ............................................................................................................ 31 FIGURE 8. MAP CHART OF ACCESS BY COUNTRIES .................................................................................. 34 FIGURE 9. TREND CHART OF ACCESS MONTH BY MONTH ......................................................................... 34 FIGURE 10. CHARTS OF WEBSITE CONTENT ........................................................................................... 36 FIGURE 11. BART CHART OF TWITTER FOLLOWERS FROM EACH COUNTRY .................................................. 39 FIGURE 12. BAR CHART OF LINKEDIN FOLLOWERS FROM EACH COUNTRY................................................... 40 FIGURE 13. TREND CHART OF ENGAGEMENT IN TWITTER ........................................................................ 40 FIGURE 14. TREND CHART OF ENGAGEMENT IN LINKEDIN IN LAST 6 MONTHS............................................. 41 FIGURE 15. PIE CHART OF USER CATEGORIES IN TWITTER ........................................................................ 42 FIGURE 16. PIE CHART OF USER CATEGORIES IN LINKEDIN ....................................................................... 42 FIGURE 17. SLACK COMMUNITY CREATED FOR ALL CULT-COOP-11 PROJECTS .......................................... 44

List of Tables

TABLE 1. EXPECTED AND ACHIEVED OBJECTIVES AT THE END OF THE PROJECT ............................................... 8 TABLE 2. WEBSITE UPDATES IN THE 3ER YEAR ........................................................................................ 12 TABLE 3. LIST OF NEWSLETTERS PUBLISHED DURING THE PROJECT ............................................................ 14 TABLE 4. OTHER EVENTS ATTENDED/ORGANIZED IN THE 3ER YEAR ............................................................ 16 TABLE 5. LIST OF PUBLISHED ARTICLES IN THE SECOND YEAR OF PROJECT ................................................... 19 TABLE 6. TYPE OF ANALYSIS AND MEASURE OF DISSEMINATION................................................................ 26 TABLE 7. SOCIAL MEDIA NUMBERS IN THE 3ER YEAR (AS OF 15.09.2019) .................................................. 30 TABLE 8. LIST OF BLOGPOSTS PUBLISHED DURING THE PROJECT ................................................................ 32 TABLE 9. TYPE OF ANALYSES/MEAN OF COMMUNICATION ...................................................................... 33 TABLE 10. NUMBER OF ACCESS FROM EACH COUNTRY (FIRST 10 COUNTRIES) ............................................ 33 TABLE 11. TYPE OF WEBSITE CONTENT ................................................................................................ 35 TABLE 12. NUMBER OF TWITTER FOLLOWERS FROM EACH COUNTRY ........................................................ 36 TABLE 13. NUMBER OF LINKEDIN FOLLOWERS FROM EACH COUNTRY ....................................................... 37 TABLE 14. NUMBER OF FOLLOWERS/FRIENDS BY CATEGORY.................................................................... 41 TABLE 15. NUMBER OF ACCESS TO THE PROJECT WEBSITE FROM EACH COUNTRY ........................................ 50




of 53

Terms and abbreviations

EC European Commission

SJR SCImago Journal Rank

CDB Common Dissemination Booster

ICT Information and Communication Technologies

CIP Communicating Interacting Processes

NGOs Non-governmental organization

REA Research Executive Agency

FP7 7th Framework Programme for Research and Technological Development

PAs Public Administrations

PO Project officer

EU European Union

SMEs Medium-sized enterprises

JRC Joint Research Centre




of 53

Executive Summary

This dissemination, communication, and networking report collects information as regards activities carried out by CITADEL partners across the last year of project. In this third year (October 2018 – September 2019) CITADEL project has achieved such level of maturity that has allowed a great development in outputs. Several scientific and business publications have been published, accepted and others are still under review which will be important project results in a near future. In other cases, this knowledge has already been transferred to the scientific world and society through international conferences, workshops, seminars and other lecturing events. The CITADEL ecosystem does not finish with the end of the project, but also opens up multiple opportunities for expansion through the acquired knowledge during these three years as well as the possibilities offered by this accumulated experience for future research projects.

As the previous year, this deliverable includes relevant information as regards three main contexts: dissemination, communication and networking. As a novelty, this also includes a particular section on trends and considerations in terms of results in all project lifetime. The results are clearly explained using a simplified categorization system.

This delivery follows the advices and recommendations implemented in the second dissemination, communication, and networking report as result of the first project review held in November 2017 in Brussels.




of 53

1 Introduction

This third dissemination, communication and networking report reflects the final contributions that each CITADEL partner has made across this last year. This deliverable includes, as a new feature, a framework that analyzes the main trends and consideration in monitoring and evaluation of main dissemination activities carried out during the project lifetime. In terms of dissemination, the CITADEL project has achieved high impact in scientific publications as regards the involvement of citizens in public services’ co-creation and public-private partnership capabilities. In so doing, CITADEL partners have taken advantage of the CITADEL approach to explore different public administration issues concerning how to make citizens more involved in public services. The experience obtained from participation in multiple conferences, workshops, and seminars is that CITADEL results are very relevant and scientifically valued. Many publications, which have been achieved during this project, and some that remain to be achieved, have been possible to the work of CITADEL partners in publicizing project values.

This third year of project has improved the results obtained during the first and second years of project, both in terms of publications as well as scientific impact and quality. Scientific publications have been obtained in journals of the SJR first quartile such as Public Management Review and Strategic Management Journal. In addition, during this year, renowned academic workshops, organized and funded by CITADEL, have taken place, such as the IIAS Study Group on Coproduction of Public Services Conference This conference is the capstone in a process of extensive research on public services’ co-creation and it has hailed as a success by participants and organizers alike. Besides this event, CITADEL partners have participated in other international conferences related to public administration such as EGOV 2019, EGPA Conference 2019 in Belfast, and IRSPM Annual Conference 2018 in Edinburgh. Moreover, CITADEL partners have organized conferences more focused on public servants and other stakeholders such as the Riga event organized by VARAM and the Bari conference organized by InnovaPuglia, which have put in value the results and knowledge generated in the project.

All the activities registered in this deliverable have been collected by dissemination, communication, and networking reports provided to CITADEL partners. These reports are to be provided along with a file containing “evidence based on attended events” to prove that specific reported activities have been actually developed by partners. CITADEL dissemination, communication and, networking outcomes are therefore the basis for reflecting the project’s progress across its lifetime.

Table 1. Expected and achieved objectives at the end of the project

Expected objectives Achieved objectives

To widely disseminate and communicate the project concept, developments and findings to identified stakeholders (i.e. industry, academia, Public Authorities) using effective communication means and strategies.

Effective communication tools and strategies have been used to widely disseminate and communicate the project concept. Some examples are the following: the CITADEL website, social networking, dissemination materials, promotional CITADEL videos on Youtube, prestigious conferences and events, scientific publications in high impact journals and so on.




of 53

Expected objectives Achieved objectives

To ensure that all the relevant communities will be reached out to in an interactive way, integrating their feedback at key timestamps of the project: namely specification requirements, market analysis, design, development and evaluation periods, as well as during exploitation tasks.

Different dissemination and communication channels are used by CITADEL partner to achieve several communities in an interactive way: Blogposts, Youtube, Facebook, Twitter, LinkedIn, academic publications, business publications and so on.

To create and publish scientific contributions valuable for the research community.

Top-ranking publications in scientific journals located in the Q1 JCR

• To collaborate with other European projects in the relevant topics of CITADEL.

CITADEL has collaborated with CULT-COOP-11 project (TROPICO, CO-VAL and CO-GOV).

To participate in appropriate European and worldwide events (workshops, seminars, conferences, etc.) targeted at industry and academia with the ultimate goal not only to showcase CITADEL results and subsequently to prepare the way for a successful commercial exploitation of the project outcomes, but also to create a CITADEL community mobilizing its members whenever it is needed (requirements definition process, evaluation period, etc.).

Many scientific and business events have been attended and organized by CITADEL partners. Around 80 events held in more than 15 countries throughout Europe, America, Asia and Oceania.

1.1 About this deliverable

This document distinguishes between dissemination, communication and networking activities. First, dissemination activities consist of scientific articles, business publications, conferences and other events. Also, this includes a description of the material used by partners in the development of this activities. Tables in this section include original information on type of event, partners, country, link or reference to the activity and so on.

Second, CITADEL communication activities follow the principle of communication as clear and easy as possible. The communication strategy is focused on stimulating people to be informed about CITADEL events and promote active participation from them. To this end, the project has gone one step forward with the launch of a series of blogposts published by the partners, which have been used as an inbound marketing tool. Finally, to be active and look for interaction in websites and social networks are part of the steps to do a good communication activity.

Third, this document reports collaboration and networking activities that open new opportunities up to the potential of exploitation and scientific value of CITADEL project results.

1.2 Document structure

This deliverable is structured as follows. Section 2 provides considerations of overall CITADEL results in terms of dissemination, communication and networking. Section 3 and 4 include information related to dissemination aspects such as specific dissemination material, attended and organized events and scientific and business publications, and analytic trends and considerations as regards monitoring and evaluation of main dissemination activities during the




of 53

project lifetime. The communication material, the follow-up of communication activities, and the main analytical trends and considerations regarding communication activities during the project lifetime are presented in Section 5 and 6, respectively. Finally, section 7 summarizes the efforts of CITADEL partners for expanding the CITADEL community, seeking for networks and other collaborative initiatives with other funded projects. The conclusion reflects all the remarks and ideas included in these sections.




of 53

2 Considerations of overall CITADEL results

Based on the need that the CITADEL project aims to solve, the main communication objectives have been the following:

1) To promote the project’s activities and aims and contribute to the uptake of its results 2) To support the relevance of our audience among potential researchers interested in the

topic. 3) To engage in a two-way communication with the scientific community, potential

partners and European Commission’s workers, end-users, policy-makers, and particularly, citizens.

4) To raise public awareness on co-creation activities in which the role of digitalization has an important role to improve the public service provision.

2.1.1 Main CITADEL dissemination results

This section reflects the dissemination results in terms of objectives achieved since the beginning of the project. The implementation of the Common Dissemination Booster (CDB) in the project has been a positive action to enhance our dissemination results in terms of identifying a portfolio of results that shows how best to disseminate to end-users, with an eye on exploitation opportunities. As regards attended and organized events, these results demonstrate a clear growth, particularly in the quality of the attended conferences at scientific level. H2020 CITADEL project has achieved a high level of recognition among public administration researchers as it has been proved in scientific conferences such as EGPA, EGOV 2019, IIAS Study Group Conference, EuroAsia SPI 2018, the annual IRSPM Conference 2018 and so on. As regards scientific and business publications, CITADEL project has reached scientific excellence within the field of public administration and public services’ co-production. CITADEL scientific articles have been published in journals such as Strategic Management Journal, Public Management Review, Global Policy, Journal of European Public Policy, International Review of Administrative Sciences, Information Polity, and Media Communication. Besides these publications, there are other studies still under revision that are expected to be published in the following months.

2.1.2 Main CITADEL communication results

The outputs created during the last three years of project needs to be communicated through the use of effective channels according to the specific target audience to be achieved as well as the features of each of these channels. The implementation of the Common Dissemination Booster (CDB) has allowed to improve the analysis of our communication results. For example, the application of this tool has introduced different approaches such as temporal and geographical analysis. As regards the project’s web site, there has been a significant increase in the number of visits obtained after the introduction of blogposts. As regards social network activities, statistics reflects the engagement of users in terms of interactions with posts on Twitter and Facebook. The analysis carried out in section 6 reflects a predominance of the country of the partner involved in the project.




of 53

2.1.3 Main CITADEL networking results

As result of the recommendations provided by the CDB and the participation of CITADEL in the Common Dissemination Booster (CDB), important progress has been made in terms of networking activities. CITADEL initiated and has taken part in diverse networking activities performed together other EU funded projects such as TROPICO, CO-VAL, ENLARGE and CO-GOV. The central topic of these projects, the co-creation of public services, has been the main pivot in the backbone. Besides these networking initiatives, there has been other collaborations with CULT-COOP-11 projects as regards exchange practices. As regards partners, VARAM and Latvia University have shown interest in exploiting synergies with other projects such as the Latvian School of Public Administration focused on the use of ICTs in training purposes. VARAM and Latvia University has contributed to other collaborative initiatives with EU Interreg Europe programme project SKILLS+ focused on advancing public policies promoting ICT skills among SMEs.

3 Elaboration and provisioning of dissemination material

3.1 Website updates

During the third year, the project website was updated monthly or bi-monthly periodically. The updates have included new blogposts, the updating of news as regards the project and the inclusion of additional dissemination and communication materials. Table 1 shows all the project website’s updates in the last year.

Table 2. Website updates in the 3er year

Month Type of contents Links

M25 – October 2018

• News

• Blogpost

• www.citadel-h2020.eu/news/varam-actions-improve-use-case

• www.citadel-h2020.eu/news/latest-citadel-dissemination-and-networking-activities

• www.citadel-h2020.eu/news/more-citadel-results-available-and-next-steps

M26 – November 2018

• Blogpost • www.citadel-h2020.eu/news/digimat-%E2%80%93-egovernment-maturity-assessment

M27 – December 2018

• Blogpost • www.citadel-h2020.eu/news/historical-coproduction-excursus-and-citadel-latvian-case

M28 – January 2019

• News

• Blogpost

• www.citadel-h2020.eu/news/collaboration-municipality-bari

• www.citadel-h2020.eu/news/citadel-dissemination-and-networking-glance-new-initiatives-progress

• www.citadel-h2020.eu/news/co-creation-latvia-actions-numbers-and-consideration-varam

http://www.citadel-h2020.eu/news/collaboration-municipality-bari

http://www.citadel-h2020.eu/news/collaboration-municipality-bari

http://www.citadel-h2020.eu/news/co-creation-latvia-actions-numbers-and-consideration-varam





of 53

Month Type of contents Links

M29 – February 2019

• Blogpost • www.citadel-h2020.eu/news/co-creation-puglia-role-house-technical-partner-innovation-and-development-public-administration

M30 – March 2019

• News

• Blogpost

• www.citadel-h2020.eu/news/citadel-achievements-smart-working-italy

• www.citadel-h2020.eu/news/iias-study-group-2019-citadel-will-be-present-two-partners-event

• www.citadel-h2020.eu/news/citadel-key-performance-indicator-toolbox-calculating-kpis-using-linked-open-data

M31 – April 2019

• Blogpost • www.citadel-h2020.eu/news/coming-soon-citadel-legal-vademecum-practical-answer-legal-hurdles-pa-might-face-when-transforming-their-services

M32 – May 2019

• Blogpost

• Brochure

• www.citadel-h2020.eu/news/forthcoming-article-ict-enabled-co-production-public-services-barriers-and-enablers-systematic-review

• www.citadel-h2020.eu/sites/citadel.drupal.pulsartecnalia.com/files/documents/CITADEL_brochure_tools_0.pdf

M34 – July 2019

• News

• Blogpost

• www.citadel-h2020.eu/news/latest-citadel-dissemination-and-networking-activities-0

• www.citadel-h2020.eu/news/citadel-and-future-government

M36 -September 2019

• News

• Blogpost

• Press release

• www.citadel-h2020.eu/news/dissemination-activities-related-citadel

• www.citadel-h2020.eu/news/what-about-antwerp-use-case

• www.citadel-h2020.eu/sites/citadel.drupal.pulsartecnalia.com/files/documents/press-release-CITADEL.pdf

3.2 Dissemination materials

3.2.1 Brochure

The final version of the CITADEL ecosystem and the maturity reached by the implementation of the use cases has allowed to create a brochure that outlines the tools and the methodologies processed in the ecosystem as well as the final target of the use cases. The brochure was initially distributed to all participants during the meeting "Capire per poi Trasformare" (see section 3.3) held in Bari on 12th April 2019. Furthermore, the brochure was disseminated online on the social media pages of the project and on the Slideshare platform on www.slideshare.net/Citadelh2020/citadel-brochure-tools-155.644.500.

During the month of July of every year a newsletter was prepared including all the most important innovations and achievements in the project and accordingly published on the project’s website. Table 2 shows the main topics covered in the releases.

http://www.citadel-h2020.eu/news/citadel-achievements-smart-working-italy

http://www.citadel-h2020.eu/news/citadel-achievements-smart-working-italy

http://www.citadel-h2020.eu/news/iias-study-group-2019-citadel-will-be-present-two-partners-event

http://www.citadel-h2020.eu/news/iias-study-group-2019-citadel-will-be-present-two-partners-event

http://www.citadel-h2020.eu/news/forthcoming-article-ict-enabled-co-production-public-services-barriers-and-enablers-systematic-review



https://www.citadel-h2020.eu/sites/citadel.drupal.pulsartecnalia.com/files/documents/CITADEL_brochure_tools_0.pdf



http://www.citadel-h2020.eu/news/latest-citadel-dissemination-and-networking-activities-0

http://www.citadel-h2020.eu/news/latest-citadel-dissemination-and-networking-activities-0

http://www.slideshare.net/Citadelh2020/citadel-brochure-tools-155.644.500




of 53

Table 3. List of newsletters published during the project

Release Link Topics

1st www.citadel-h2020.eu/documents2/first-newsletter-citadel

• CITADEL KICK OFF AND GENERAL ASSEMBLIES

• DISSEMINATION HIGHLIGHTS

• Where can you meet CITADEL next?

2nd www.citadel-h2020.eu/documents2/citadel-newsletter-2-online

• A Vignette Study experiment concerning the effects of input legitimacy on public officials’ willingness to care about public participation.

• CITADEL tools for users engagement and e-participation as a support in PAs digital transformation

• Monthly updated blogposts to favour debate and awareness of CITADEL ecosystem development.

• The co-creation methodology in CITADEL

• CITADEL Dissemination, Communication and Networking actions and prosecutions from 2017 to 2018.

3rd www.citadel-h2020.eu/documents2/available-citadel-newsletter-3

• The final scenarios of the usecase: the interaction with the Ecosystem and the estimated improvements

• CITADEL Ecosystem: tools improvements and Co-Creation methodology tool

• Blogposts, Materials and other Dissemination and Communication actions from 2018 to 2019 to favour debate and awareness of CITADEL ecosystem development

• CITADEL Networking: actions for the prosecution beyond the project lifetime.

3.2.2 Demonstrative Videos of CITADEL ecosystem and promotional video

In order to share the CITADEL knowledge with a non-technological specialized audience in a simple way, a demonstrative video has been created to explain the execution flow of the CIP tool implemented in the Ecosystem. These videos were developed using the presentation or the cartoon style with a total duration of about 2 minutes each one. The demonstrative videos have been uploaded to the CITADEL Youtube channel (link at www.youtube.com/channel/UCEel62sFX0Yo484q42rtQJA) and disseminated by the project social pages.

https://www.citadel-h2020.eu/documents2/first-newsletter-citadel



https://www.citadel-h2020.eu/documents2/citadel-newsletter-2-online



https://www.citadel-h2020.eu/documents2/available-citadel-newsletter-3



https://www.youtube.com/channel/UCEel62sFX0Yo484q42rtQJA




of 53

In addition, CITADEL partners have created a promotional video aimed at involving general audience and other social groups which may find difficulties to understand and use user stories dealing with everyday problems. The promotional video has also been uploaded to the CITADEL YouTube channel and the link is available at www.youtube.com/watch?v=E1SQlZkdX5E and www.youtube.com/watch?v=RQBB-WM9V0I for the subtitled version.

Figure 1. A screen of the promotional video

A video tutorial explaining the DIGIMAT is also available on Youtube. This video was aimed to be presented in the ReSPA Seasonal School on Digital Transformation in Montenegro and introduces the CITADEL project and how the eGovernment maturity model has been designed. The link of this video is: https://www.youtube.com/watch?v=zQJPRviJYDQ

3.3 Attended and organized events

The attended and organized events allowed the discussion of results and achievements of the project. In particular, the most significant events are described below, while other events are collected in the attaching table. A brief recap of the CITADEL events held in Riga and Bari, reporting the type of audience, the topics and purposes of the meetings, the awareness of the participating public of the potentialities of CITADEL ecosystem were provided by partners.

• Capire per poi Trasformare: this event was organized in Bari (Italy) on 12th April 2019 by CITADEL Italian partners with the aim to share the Ecosystem tools and methodologies. The event includes the lectures of Andrea Servida (Head of the Task Force Legislation Team, Directorate General Communication Networks, Content & Technology, European Commission), Marisa Escalante as technical coordinator of the project, and Inese Grospine who recounted the experience of her national use case. At the end of the event, a focus group (see section 7.2) was held during this event in which participants could express their ideas on the situation of digital public services in Regione Puglia.

http://www.youtube.com/watch?v=E1SQlZkdX5E

http://www.youtube.com/watch?v=RQBB-WM9V0I

https://www.youtube.com/watch?v=zQJPRviJYDQ




of 53

To engage local stakeholders (representatives from other institutions outside VARAM, partners and NGOs) in the process, a conference was organized in Riga in 2019 to disseminate CITADEL approach and collect insights to shape further CITADEL activities:

• In January 2019, VARAM organized a conference on designing services based on different aspects: user needs, CITADEL co-creation approach, and other features of the citizen engagement. Presentations were held by CITADEL partners, as well as UK representatives, and local presenters from Latvia. Around 100 people from approximately 70 institutions, NGOs and some private companies attended the conference and more than 200 viewed it online.

• Other activities were also held within VARAM use case in the project where different stakeholders were engaged. For example, co-creation sessions with end-users at national and local level (www.latvija.lv) and meetings with other authorities and institutions of the Republic of Latvia. These activities are further described in D5.3. “Final technical Implementation of the use cases development”. In table 4 other attended events are reported.

Table 4. Other events attended/organized in the 3er year

Attended events Location Partner Date

Annual work conference at Netherlands institute of Government

Netherlands KUL 1-2 November 2018

Organization of H2020 CITADEL GA Meeting, with especial focus on public services’ co-creation results

Spain UC 17-18 September 2018

Symposium Digital transformation: a government (r)evolution

Belgium KUL 11 December 2018

Workshop-cocreation session with entrepreneurs about improvements in portal latvija.lv in collaboration with Ministry of Economics (EM) and Investment and Development Agency of Latvia (LIAA)

Latvia VARAM 11 October 2018

Workshop-cocreation session with computer science students about improvements in portal latvija.lv

Latvia VARAM 18 October 2018

Comune di Bari - Sperimentazione Lavoro Agile su DLT (blockchain)

Italy FINCONS 10 January 2019

Pakalpojumu koprade. Klientu vajadzìbu izpète

Latvia VARAM 10 December 2018

VARAM workshop about user involvement and data protection in (smart) city

Latvia VARAM-KUL-TECNALIA

18 January 2019

Attended one seminar to regional municipalities about public service delivery and presented presentation about co-creation and user centric service design

Latvia VARAM 23 January 2019

CITADEL INNOVATION PLATFORM presented by InnovaPuglia to the

Italy InnovaPuglia 4 events in January 2019

http://www.latvija.lv/




of 53

Attended events Location Partner Date

municipalities of Capurso, Acquaviva and Conversano and the Regione Puglia citizens participation office

EGOV 2019 - Joint conference EGOV-CedEM-ePART, University of Camerino

Italy KUL 2-5 September 2019

EGPA, Queen’s University Belfast United Kingdom

KUL 11-13 September 2019

Public Governance Institute, KU Leuven – Lunch seminars

Belgium KUL 14 May 2019

IIAS Study Group on Coproduction of Public Services Conference Belgium UC 28 May 2019

International Conference “Economy and Business”

Latvia LU 20-24 August 2019

International scientific conference: RSU Conference "Knowledge for Practice" and "Places"

Latvia LU 1 April 2019

Guest lecture on co-creation at University of Applied Sciences and Arts Northwestern Switzerland, Business Administration (International Management) bachelor’s degree programme)

Latvia LU 19 September 2019

3.4 Scientific and business publications

Scientific publications have significant importance in dissemination activities as regards CITADEL project. These project’s outcomes approach CITADEL project to a scientific audience, increasing interactions with other researchers, and creating new synergies.

During the third year of the project, the IAAS Study Group event held in Leuven in May 2019 was dedicated to the co-creation process. This conference included 4 scientific papers written by CITADEL partners.

Some CITADEL outcomes were also considered in the paper "Behind the Scenes of Coproduction of Smart Mobility: Evidence from a Public Values' Perspective" that received the Best Paper Award at the eGov2019 conference held in Italy in September 2019.

Another relevant publication was “Data Harvesting, Curation and Fusion Model to Support Public Service Recommendations for e-Governments”: the publication addresses the heterogeneity problem common to sources and formats of data related to e-Government services. This provides an architectural model that allows harvesting data from various sources, curating datasets that originate from a multitude of formats and fusing them into semantically enhanced data, on which key performance indicators for the utility of e-Government services can be calculated.

CITADEL is featured, as part of 10 additional e-government projects in CORDIS, in a Results Pack. The results pack is a thematic collection of project results tailored to the needs of specialized audiences who can further exploit them.




of 53

The article is included in the Results Pack on eGovernment, based on a request from REA and DG CONNECT and can be found in the link https://cordis.europa.eu/project/rcn/205682/brief/en

Figure 2. CITADEL featured in CORDIS.

https://cordis.europa.eu/project/rcn/205682/brief/en




of 53

Table 5. List of published articles in the second year of project

Title Name of authors and organizations

Title of the periodical or the series

Number, data or frequency

Publisher Place of publication

Year of publication

Relevant pages

Permanent identifiers (if available)

Is/Will open access be provided to this publication?

Technology Readiness and Acceptance Model” as a Predictor for the Use Intention of Data Standards in Smart Cities

Raf Buyle, Mathias Van Compernolle, Eveline Vlassenroot, Ziggy Vanlishout, Peter Mechant, Erik Mannens

Vol 6, No 4 (2018): E-Government and Smart Cities: Theoretical Reflections and Case Studies

Media and Communication

2018 https://bit.ly/2mg4vvd

Y

Co-creatie van overheidsdiensten door burgers, private organisaties en overheid samen: strooit de AVG roet in het eten?

Pieter Gryffroy Tijdschrift Privacy & Persoonsgegevens (Politeia)

2019 6-13 N

Factors influencing citizens’ co-production of environment services: a multi-level analysis

José Manuel Alonso, Rhys Andrews, Judith Clifton and Daniel Díaz-Fuentes

Public Management Review

Public Management Review

2019 https://doi.org/10.1080/14719037.2019.1619806

N

Explaining citizens’ co-production through

Judith Clifton, Daniel Díaz Fuentes &

IIAS Study Group on ‘Coproduction of Public Services’

2019 https://soc.kuleuven.be/io/english/researc

N

https://doi.org/10.1080/14719037.2019.1619806

https://doi.org/10.1080/14719037.2019.1619806

https://doi.org/10.1080/14719037.2019.1619806

https://doi.org/10.1080/14719037.2019.1619806




of 53





Year of publication

Relevant pages



ICTs in health: A multi-level model analysis

Gonzalo Llamosas Garcia

seventh annual conference, Leuven, Belgium, 28 May 2019.

h/iias-conference/programme

Traditional vs ICT-enabled co-production in healthcare: The case of Northern Ireland

Judith Clifton, Daniel Díaz-Fuentes & Gonzalo Llamosas-García

Public Management Review (Under review)

Forthcoming

N

ICT-enabled co-production of public services: Barriers and enablers. A systematic review


Information Polity

2019 https://content.iospress.com/articles/information-polity/ip190122

N

A behavioral perspective on saving decisions. Empirical evidence for policymakers in the European Union


Global Policy 2019 N

Doctoral dissertation: Essays on Citizens’ Economic Behavior in

Gonzalo Llamosas-Garcia

Universidad de Oviedo, Universidad de

Santander (Spain)

September (2019)

Y




of 53





Year of publication

Relevant pages



Services of Public Interest. A European Union Perspective

Cantabria & Universidad del País Vasco

Explaining Co-production in Compulsory Secondary Education by Children and Parents: the Influence of ICTs

Judith Clifton, Daniel Díaz Fuentes & Marcos Fernández Gutiérrez

Forthcoming

https://soc.kuleuven.be/io/english/research/iias-conference/programme

Governance by targets and the performance of cross-sector partnerships: Do partner diversity and partnership capabilities matter?

José Manuel Alonso & Rhys Andrews

Strategic Management Journal

2018 https://doi.org/10.1002/smj.2959

Y

Bari, Comune sperimenta lo smart working: dipendenti al

Fincons team Web 2019 https://bit.ly/2meEKLH

https://doi.org/10.1002/smj.2959



https://bit.ly/2meEKLH





of 53





Year of publication

Relevant pages



lavoro fuori ufficio 1 giorno a settimana

https://bit.ly/2kMKtrR https://bit.ly/2lOmsko https://bit.ly/2kBhoQb https://bit.ly/2kM4dM2 https://bit.ly/2kBhvLB https://bit.ly/2meEKLH https://bit.ly/2lVdW2N

https://bit.ly/2kMKtrR

https://bit.ly/2kMKtrR

https://bit.ly/2lOmsko

https://bit.ly/2lOmsko

https://bit.ly/2kBhoQb

https://bit.ly/2kBhoQb

https://bit.ly/2kM4dM2

https://bit.ly/2kM4dM2

https://bit.ly/2kBhvLB

https://bit.ly/2kBhvLB



https://bit.ly/2lVdW2N

https://bit.ly/2lVdW2N




of 53





Year of publication

Relevant pages



https://bit.ly/2kKWBJU https://bit.ly/2lOmybK https://bit.ly/2kM6TJD https://bit.ly/2lQuKIx https://bit.ly/2lOmAAo

CITADEL: Un'esperienza europea verso il 2021-2027

Marco Di Ciano web 2019 Published on http://www.sistema.puglia.it/

Feasibility Study of Innovative Public Policy Client-Accordance Index

Romans Putans IIAS Study Group on ‘Coproduction of Public Services’ seventh annual

2019

https://bit.ly/2kKWBJU

https://bit.ly/2kKWBJU

https://bit.ly/2lOmybK

https://bit.ly/2lOmybK

https://bit.ly/2kM6TJD

https://bit.ly/2kM6TJD

https://bit.ly/2lQuKIx

https://bit.ly/2lQuKIx

https://bit.ly/2lOmAAo

https://bit.ly/2lOmAAo




of 53





Year of publication

Relevant pages



conference, Leuven, Belgium, 28 May 2019.

From Design to Service Design, and Co-production

Solvita Zarina IIAS Study Group on ‘Coproduction of Public Services’ seventh annual conference, Leuven, Belgium, 28 May 2019.

2019

Digitalization in the Regional Context: The Case of E-Government Services in Latvia.

Dr. Muravska Tatjana, Dr, Stacenko Sergejs, Dr. Zeibote Zane

Studia Europejskie – Studies in European Affairs

Latvia 2019 ISSN 1428-149X

N

Behind the Scenes of Coproduction of Smart Mobility: Evidence from a Public Values’ Perspective.

Ana Paula Rodriguez SpringerLink 2019 DOI https://doi.org/10.1007/978-3-030-27325-5_26 -- Print ISBN 978-3-030-27324-8 -- Online ISBN 978-3-030-27325-5

Y




of 53





Year of publication

Relevant pages



E-government and smart cities: theoretical reflections and case studies

Peter Mechant,. & N. Walravens

4 Media & Communication

2018 119-122 https://www.cogitatiopress.com/mediaandcommunication/article/view/1848

Y

Explaining non-adoption of electronic government services by citizens. A study among non-users of public e-services in Latvia.

Steven Van de Walle, Zane Zeibote, Sergejs Stacenko, Tatjana, Muravska, Koen Mgchelbrink

4 Information Polity

2018 399-409 https://content.iospress.com/articles/information-polity/ip170069

N

Digitalization in the Regional Context: The Case of E-Government Services in Latvia

T Muravska, S Stacenko, Zane Zeibote

4 Studies in European Affairs

2018 251-267 ISSN 1428-149X

N




of 53

4 Analytic trends and considerations in monitoring and evaluation of main dissemination activities during the project lifetime

4.1 Overview

In this section, the objective is to analyze the main trends that have characterized the data collected by partners across the lifetime of the project as regards to dissemination activities. The purpose of the analysis seeks to reflect the general trends in terms of publications as well as attended and organized events. In particular, the attention is first put on the analysis of attended and organized events in terms of year and country. Secondly, this section reflects an analysis on scientific publications by year, scientific impact and business publications by year. This analytical framework aims therefore at providing comparative knowledge to identify the evolution of the project over time. In particular, this stresses the importance of evaluating activities related to dissemination as regards the requests of the reviewers who stressed during the first year the need of a better follow-up approach. As result of these recommendations and advices, CITADEL decided to incorporate, following the indication provided by each project partner, an initiative promoted by EC to support FP7 that allows to amplify these dissemination activities thanks to a direct interaction with other projects (project clusters).

Table 6. Type of analysis and measure of dissemination

Type of analysis

Measures of dissemination

Frequency by year

Frequency by partner

Scientific relevance of publications

Event locations

Business and Scientific publications

X X

Attended and organized events

X X X

4.2 Attended and organized events

In this section, we evaluate the main trends as regards attended and organized events for the lifetime of the project. We can observe in Figure 3 that the second year of project was highly prolific in events’ activities in comparison with the first and second years of project. During this period, CITADEL partners organized or attended 39 events, among which, we find conferences, seminars, workshops, lectures, experiments, focus groups and others. Figure 3 shows the main trends related to different types of events by partners across the lifetime of project. For example, it can be observed that attendance to conferences, seminars and workshops was more important during the first and second year of project than the third one. This can be explained because during the last year of project CITADEL partners were more focused on the consolidation and publication of results.




of 53

Figure 3. Types of events by year

As regards to events by country, Figure 4 reports the frequency of attended and organized events across different countries. The results show that CITADEL partners mainly attended conferences and workshops in European Union’s countries such as Belgium, Latvia and Spain. We also can highlight attended events outside Europe such as Switzerland, Canada and China. Regarding specific features of these events by period of time, most events in Belgium, for example, were held in the second year of project, in Spain during the first year, and in Latvia during the third year of project. According to those events attended by CITADEL partners in countries outside the EU, they were held specifically during the second year of project.

Figure 4. Frequency of attended events by year

0

2

4

6

8

10

12

14

16

2017 2018 2019

Conference Seminar Workshop Lecture

Experiment Focus group Others

21

39

19

2017 2018 2019




of 53

4.3 Scientific and Business Publications

In this section, we include the main trends for scientific and business publications. We begin reporting a summary of the main results by year and impact of scientific publications. As regards the impact of scientific publications, we measure this impact by distinguishing between high impact, medium impact and low impact. High impact is related to scientific journals including an impact factor located between the first and second SJR quartiles (Scimago Journal Ranking). Medium Impact is related to scientific journals with an impact factor located between the third and four SJR quartiles. Finally, low impact is associated to scientific journals whose impact is not evaluated by SJR, but they included topics with a scientific interest or relevance for science.

In this vein, CITADEL partners have published during the lifetime of the project different scientific articles in high impact journals such as Strategic Management Journal, Public Management Review, Global Policy, Journal of European Public Policy, and International Review of Administrative Sciences. They have also published in other journals with a medium impact factor such as Information Polity and Media and Communication. Finally, other publications have been accepted or published in low impact journals such as International Journal of e-Planning Research, Studies in European Affairs, University of Latvia Press and so on.

Figure 5. Level of Impact of scientific publications

Moving now onto business publications, Figure 6 shows the distribution of business publications across the lifetime of the project. It should be noted that most business publications were carried out in the first year of project. CITADEL partners have an active role in updating posts in blogs, websites, and other Internet platforms related to CITADEL consortium and its ecosystem, particularly after the deployment of the CITADEL blog in the website.

8

6

6

Low Medium High




of 53

Figure 6. Business publication by year

14

5

2

2017 2018 2019




of 53

5 Elaboration and provisioning of communication material in the 3rd year

5.1 Social media measures

During the third year of the project, Communication activities were carried out on social networks, using the main social platforms such as Twitter, LinkedIn, Facebook, Slideshare, and Youtube. The following summary table shows all the measurements in accordance with the 4C’s model imported during the second year of the project, following the recommendation received in reporting period 1 to address the ‘so what’ question.

Table 7. Social media numbers in the 3er year (as of 15.09.2019)

Social Medium

Brand Awareness Brand Engagement Word of Mouth

Twitter Number of tweets about the brand

328 Number of followers 285 Number of retweets 304

LinkedIn Number of members

19 Number of views 633 Number of followers 58

Blogs

Number of unique visits (sum of all blog posts pages)

422 Average length of time on site (among all blog posts pages)

91,5 secs

Number of shares/retweets on social networks (Twitter + Facebook + LinkedIn)

36

Facebook Number of posts

62 Number of friends 35 Number of shares 21

YouTube Number of videos

11 Number of views 425 Number of reaches/impressions on social networks

58/ 376

Slideshare Number of presentations

24 Number of views 2457

Number of shares/retweets on social networks (Twitter + Facebook + LinkedIn)

18

5.2 Materials

The production of paper materials during the third year is characterized by the creation of customized agendas including the CITADEL logo. These materials are disseminated during the organized and attended events by partners to better capture the attention of the event audience. Figure 7 reflects some examples of CITADEL dissemination material.




of 53

Figure 7. CITADEL agenda

5.3 Press releases

Along with the press releases already declared in D7.4 section 5.3, during the second year of project, an additional press release was released by imec partners in English, which describes the activities carried out by them with particular reference to the implementation of use cases and some ecosystem tools and methodologies.

The text of press release is reported in annex 1 of this deliverable.

The CITADEL press release has been launched through various communication channels:

• www.ugent.be/mict/en/news-events/news/citadel.htm

• twitter.com/imec_mict_UGent/status/1150780514099482624

• www.facebook.com/imec.mict.ugent/

During the CITADEL 3rd year, the LU has published 2 press releases:

1. 03.12.2018 – press release on the LU website: “How to co-produce public services?” https://www.lu.lv/cets/news/t/45999/

2. 30.05.2019 – press release on the LU website and tweet. https://www.lu.lv/cets/news/t/50710/

5.4 Blog posts

All CITADEL partners published during the last two years a monthly blogpost with the objective of discussing topics on the subjects proposed in the project and related to partners’ competences and features.

http://www.ugent.be/mict/en/news-events/news/citadel.htm

https://twitter.com/imec_mict_UGent/status/1150780514099482624

https://www.facebook.com/imec.mict.ugent/

https://www.lu.lv/cets/news/t/45999/

https://www.lu.lv/cets/news/t/50710/




of 53

Table 8. List of blogposts published during the project

Partner name Partner category

Date of delivery

Status Link

TECNALIA Technical Oct-18 Published on website

• www.citadel-h2020.eu/news/more-citadel-results-available-and-next-steps

Latvijas Universitate

Academic Nov-18

Published on website

• www.citadel-h2020.eu/news/historical-coproduction-excursus-and-citadel-latvian-case

VARAM Use case Dec-18 Published on website

• www.citadel-h2020.eu/news/co-creation-latvia-actions-numbers-and-consideration-varam

InnovaPuglia Technical Jan-19


• www.citadel-h2020.eu/news/co-creation-puglia-role-house-technical-partner-innovation-and-development-public-administration

Regione Puglia

Use case Feb-19


• www.citadel-h2020.eu/news/get-touch-citadel-apulian-use-case-assess-co-creation-and-digital-maturity

imec Academic/ Technical

Mar-19


• www.citadel-h2020.eu/news/citadel-key-performance-indicator-toolbox-calculating-kpis-using-linked-open-data

Time.Lex Legal Apr-19


• www.citadel-h2020.eu/news/coming-soon-citadel-legal-vademecum-practical-answer-legal-hurdles-pa-might-face-when-transforming-their-services

Universidad de Cantabria

Academic May-19


• www.citadel-h2020.eu/news/forthcoming-article-ict-enabled-co-production-public-services-barriers-and-enablers-systematic-review

FINCONS Technical Jun-19 Published on website

• www.citadel-h2020.eu/news/citadel-and-future-government

Katholieke Universiteie Leuven

Academic Jul-19 Published on website

• www.citadel-h2020.eu/news/coproduction-smart-services-opening-discussion

Stad Antwerpen

Use case Sep-19 Published on website

• www.citadel-h2020.eu/news/what-about-antwerp-use-case

http://www.citadel-h2020.eu/news/more-citadel-results-available-and-next-steps



http://www.citadel-h2020.eu/news/historical-coproduction-excursus-and-citadel-latvian-case







http://www.citadel-h2020.eu/news/co-creation-puglia-role-house-technical-partner-innovation-and-development-public-administration




http://www.citadel-h2020.eu/news/get-touch-citadel-apulian-use-case-assess-co-creation-and-digital-maturity




http://www.citadel-h2020.eu/news/citadel-key-performance-indicator-toolbox-calculating-kpis-using-linked-open-data





http://www.citadel-h2020.eu/news/coming-soon-citadel-legal-vademecum-practical-answer-legal-hurdles-pa-might-face-when-transforming-their-services










http://www.citadel-h2020.eu/news/citadel-and-future-government



http://www.citadel-h2020.eu/news/coproduction-smart-services-opening-discussion



http://www.citadel-h2020.eu/news/what-about-antwerp-use-case

http://www.citadel-h2020.eu/news/what-about-antwerp-use-case




of 53

6 Analytic trends and considerations in monitoring and evaluation of main communication activities during the project lifetime

In this section, the objective is to analyze the main trends with respect to the data collected on communication activities. This analysis consists on observing the profiles and characteristics of users who accessed and consulted CITADEL communication channels. In particular, the attention is focused on the analytics related to the CITADEL website and its social networks that represent the main activities with measurable feedback. In both cases, temporal and geographical analyses are performed during the lifetime of project to study the improvements suggested by the Common Dissemination Boost described in D7.4 as well as the first review recommendations. As regards the CITADEL website, analyses are focused on most viewed pages and time spent on each page in order to understand the topics of greatest interest. As regards social networks, the statistics also concerning the engagement of the users (as the interaction with posts for Twitter and Facebook accounts and the number of views for LinkedIN) and the category of belonging of the users who have followed the social pages of CITADEL (Twitter and LinkedIN followers and Facebook friends) have been analysed.

Table 9. Type of analyses/mean of communication

Type of analysis

Mean of communication

Geographical origin of followers

Posts engagement during the

lifetime project

Visits number

during the lifetime project

Time of visit on

the pages

User categories

Project’s web site X X X

Project’s social pages X X X

6.1 Analytics of project’s web site

In respect to the geographical analysis of the website, a relevant number of visits from United States are found. Other activities held in other countries such as dissemination and networking events and the sharing of social posts by followers have allowed to spread the project results in other countries and public administrations. An interesting detail is that our website has been consulted from approximately 107 countries in all continents. The complete list of countries is available in Annex 2.

Table 10. Number of access from each country (first 10 countries)

Country Number of visits

United States of America 717

Spain 474

Italy 443

Belgium 442




of 53


Latvia 205

United Kingdom 140

Netherlands 124

Germany 92

India 81

Greece 56

Figure 8. Map chart of access by countries

In the following trend chart, we can observe the number of monthly visits to the project website. There has been a significant increase in the number of visits after introducing the blog, which made it possible to report different aspects from partners in the project context. Figure 9 identifies the main trends of monthly access to the website. The blog posts were publicized in the social network profiles in order to generate leads to the website, create interest in the readers and increase the time spent on the project’s site.

Worst value Best value

Figure 9. Trend chart of access month by month




of 53

The table below shows how the visits have been distributed. Analyzing the data, it indicates that most read contents were the Project description pages and the Project deliverables.

Table 11. Type of website content

Content Number of visits Time of visits

Legal blogposts 41 150,19

Academic blogposts 34 128,20

Use case blogposts 123 108,18

Technical blogposts 224 69,84

News 836 68,85

Project description pages 2670 86,73

Project deliverables 652 151

Others (newsletters, materials…) 22 39,17

The table is schematically shown in the following charts.




of 53

Figure 10. Charts of website content

6.2 Social Network activities

As far as the analysis of CITADEL social networks is concerned, this analysis is carried out separately for each social network in which the project is presented. This analysis shows relevant geographical aspects such as the importance of partners’ countries and a higher interaction of visitors from those countries where the CITADEL dissemination activities were conducted.

Table 12. Number of Twitter followers from each country

Country Number of followers

EU projects and initiatives 113

Belgium 32

Spain 37

1% 1% 3%5%

18%

58%

14%

0%

Number of visits

Legal blogposts Academic blogposts Use case blogposts

Technical blogposts News Project description pages

Project deliverables Others (newletters, materials,…)

150,19

128,2

108,18

69,84

68,85

86,73

151

39,17

0 20 40 60 80 100 120 140 160

Legal blogposts

Academic blogposts

Use case blogposts

Technical blogposts

News

Project description pages

Project deliverables

Others (newletters, materials,…)

Time of visits (secs)




of 53

Country Number of followers

Latvia 9

Netherlands 8

United Kingdom 9

Hungary 1

Italy 25

Germany 5

Australia 1

Switzerland 1

Not spec. 11

United States 9

Norway 5

Estonia 2

Portugal 2

Sweden 2

Turkey 2

East Europe 1

France 1

Mexico 1

Luxemburg 1

Ireland 1

India 1

Greece 1

Nepal 1

Denmark 1

Israel 1

Austria 1

Table 13. Number of LinkedIn followers from each country


EU projects and initiatives 22

Belgium 12




of 53


Spain 8

Latvia 5

United Kingdom 2

Netherlands 2

Hungary 2

Italy 1

Germany 1

Australia 1

Bulgaria 1

Cyprus 1

The data in the preceding tables is schematized in the following charts.




of 53

Figure 11. Bart chart of Twitter followers from each country

0 20 40 60 80 100 120

EU projects and initiatives

Spain

Belgium

Italy

Not spec.

Latvia

United Kingdom

United States

Netherlands

Germany

Norway

Estonia

Portugal

Sweden

Turkey

Australia

Austria

Denmark

East Europe

France

Greece

Hungary

India

Ireland

Israel

Luxemburg

Mexico

Nepal

Switzerland

Twitter




of 53

Figure 12. Bar chart of LinkedIn followers from each country

Another relevant measure is the engagement related to the published posts, such as the number of interaction that the users had with the post (e.g. likes, retweets or mentions) that facilitated to measure in which periods there was a greater interest in projects’ activities. This analysis is monthly carried out and it is represented below through trend charts.

Figure 13. Trend chart of engagement in Twitter

0 5 10 15 20 25

EU projects and initiatives

Belgium

Spain

Latvia

United Kingdom

Netherlands

Hungary

Italy

Germany

Australia

Bulgaria

Cyprus

LinkedIn

0

50

100

150

200

250

300

350

400

Twitter




of 53

Figure 14. Trend chart of engagement in LinkedIn in last 6 months

The last analysis involves the type of users who interacted with CITADEL social networks: similar categories to the topics covered by the project were considered so that they could understand which users were most involved in the project’s achievements.

Table 14. Number of followers/friends by category

Category Number of Twitter followers

Number of LinkedIn followers

Legal 5 4

Academic 105 8

Public Administrations 11 6

Technical 30 13

General public 21 5

EU Projects and other collaboration initiatives pages

113 22

The following pie charts summarize the values declared above:

0

50

100

150

200

250

Mar-19 Apr-19 May-19 Jun-19 Jul-19 Aug-19 Sep-19

LinkedIn




of 53

Figure 15. Pie chart of user categories in Twitter

Figure 16. Pie chart of user categories in LinkedIn

2%

37%

4%10%7%

40%

Number of Twitter followers

Legal

Academic

Public Administrations

Technical

General public


7%

14%

10%

22%9%

38%

Number of LinkedIn connections

Legal

Academic

Public Administrations

Technical

General public





of 53

7 Advisory Board meetings

In this period (M25 – M36) no advisory board meetings have been held. Instead, the CITADEL consortium considered more relevant to organize focus groups in pilot locations (e.g. Riga, Antwerp and Bari) as well as events holding a higher number of stakeholders, in particular civil servants.

The organization of focus groups have provided with more relevant and focused insights into the needs of public administrations and how CITADEL could take advantage of this. On the other hand, the organization of larger events such as the ones held in Riga and Bari have provided CITADEL with a thorough understanding of what the public sector is seeking for, as reported in section 4 and 8, especially in what respects to the policy perspective of the project.

These two approaches provided CITADEL partners with a deep knowledge as regards the engagement of civil servants (PA) and citizens in public administration, in some cases going beyond what it would have been expected from an advisory board.

8 Collaboration and networking activities

8.1 Considerations on collaboration activities with EU funded projects

On October 8th, 2018 the first cluster meeting with the rest of the CULT-COOP-11 (CC-11) projects was held. These projects are TROPICO, CO-VAL and CO-GOV. All four projects were present in different stages of the meeting, being CITADEL the most mature. The meeting was attended by the project coordinator, Leire Orue-Echevarria (TECNALIA), who was also the main driver for this meeting to take place.

The CC-11 relevance and expectations of the cluster meeting were as follows:

1. This a group of projects that is of interest for DG CONNECT because they are bringing

together the vision on (e)government

2. To re-use of information for PAs including EU: what have we learnt from these projects

that could be shared with other public administrations? What could another PAs reuse?

What works, and what does not? For instance, deliverables around the methodological

description and a new framework for co-creation across the EU, policy briefs, concrete

tools.

3. Support for the projects: how to link to other PAs and how to get external feedback on

their projects, share with the EC news and upcoming events, which can further

disseminate through the project means, etc.

4. Create a community around the topic: synergies / complementarities / added value

The goal of this meeting was firstly to understand which aspects of co-creation were covered by each project and secondly which type of collaboration was expected by each project. CITADEL shared some topics and aspects previously covered by the project in the online community, Slack, created by the PO.




of 53

Figure 17. Slack community created for all CULT-COOP-11 projects

The first meeting had two distinct blocks. The first session devoted time to discussing among all four projects the collaboration expectations as well as the means to collaborate. Three levels of collaboration were envisioned:

1. Processes / methodologies, which consists in developing new processes and methodologies.

2. Dissemination, is especially focused on trust and legitimacy, including the joint publication of papers.

3. Bridge the public sector and academia in a more strategic way, through the organization of joint events.

The second session devoted time to assessing a methodology and some serious games developed by the JRC as part of the FutureGov2030+ initiative.

CITADEL was also present in the European Week of Regions and Cities, which took place on 9th October 2019 in Brussels. The project coordinator participated in the following sessions with an active role:

- Citizen-centric Design and Delivery of Digital Public Services. This session discussed best practices in the domain of user-centricity in local and regional administrations. The final message that can be derived from that session is that successful user-centric public services can only be achieved when citizens are involved in the design and creation along with the public administrations.

- OpenGoV Co-production & Co-creation: Sharing experiences from Regions and Cities: this session included some presentations as well as roundtable discussions running in parallel, where aspects related to synergies and sustainability, the use of big data for Open Governance, and inclusiveness issues were discussed. The conclusions drawn from the discussions is that co-creation needs to have a clear scope, role, goals and methods where the expertise and knowledge of participants is key to understand what the community needs.

The second cluster meeting took place on July 4th, 2019. To this end, a position / discussion paper written by Mr. Paul Waller was shared among the projects so that they could express their position either before or during the event. On behalf of CITADEL, Inese Viktorija Grospine from VARAM and Leire Orue-Echevarria from TECNALIA were present.

The discussion revolved around the following topics:




of 53

- Key challenges and key findings per project - Topic 1 - Anchoring the research in the constitutional context of the EU and Member

States - The implications of the Rule of Law for collaboration in and transformation of public administration

- Topic 2 - Anchoring the research in the constitutional context of the EU and Member States - The adaptation required in applying private sector models and logic to the public sector

- Topic 3 - Adapting language for the project audiences and demonstrating impact in their terms - Clarifying concepts and terminology

- Topic 4 - Adapting language for the project audiences and demonstrating impact in their terms - Establishing a clear and robust methodology for generalising from cases

- Next steps

The concluding remarks of this meeting included the participation of CITADEL project representatives in the events that both TROPICO and CO-VAL plan to organize in 2020.

8.2 CITADEL focus groups

The importance of organizing focus groups lies in the fact that we should understand the needs of users interested in CITADEL outcomes and in many cases, they have performed the function of “reservoir” for data entries in some of the platforms proposed in CITADEL.

In the event "Capire per poi Trasformare" (see section 3.3) a focus group was organized and served to share the feelings and ideas of the participants in the event regarding digital public services in Puglia. Institutional representatives from the Regione Puglia and local Public Administrations of the SMEs exposed their opinions and the meeting allowed to increase the needs collected on CIP, the co-design platform used by Regione Puglia in its use case.

8.3 Further collaborations and reuse of CITADEL achievements beyond the end of the project

Project representatives of CITADEL, especially the coordinator is willing to participate in events (co-)organized by CC-11 projects, where the results of the project can be shared further.

Moreover, the project’s source code has been released in an open source repository and is accessible by anyone that wishes to reuse it or modify it. The address is: https://git.code.tecnalia.com/CITADEL_Public/CITADEL_Components.

https://git.code.tecnalia.com/CITADEL_Public/CITADEL_Components




of 53

9 Final conclusions

This final deliverable provides key trends on dissemination, communication and networking activities by partners during the lifetime of project. CITADEL partners have actively taken part in several events, including conferences, seminars, workshops, lectures and so on. Main trends in the project show, for example, a higher level of activity in attending these events in the second year of project. A similar trend is also found for scientific and business publications. This analysis reflects a greater scientific activity during the second year of project than during the rest of period. As regards business publications, we find a maximum of publications during 2017. The impact of these publications is measured using SJR impact factors. In this vein, these results show that scientific publications with a high and medium impact double those with a low impact, which clearly shows the great quality of the publications achieved by the consortium.

With respect to communication activities, our analysis of main trends identifies a significant increase in visits, interactions and followers related to CITADEL main social networks such as Twitter, and Linkedin. For example, the number of interactions in Twitter has substantially increased in the last year of project, with a peak of 361 interactions in February 2019. In particularly, the greatest number of interactions has been especially carried out from the countries of some project partners such as Belgium, Latvia, and Spain. This group of countries has joined the United States, which although it has no representation in the project, has been very present at conferences, seminars and other events.

Finally, in relation networking activities, many efforts have been carried out by CITADEL partners. CITADEL has been a part of the CULT-COOP-11 including European projects such as TROPICO, CO-VAL and CO-GOV. The CITADEL action in this cluster has consisted in looking for synergies with other projects as regards co-creation of public services across the EU, policy issues, best practices on dissemination and future collaborations. Furthermore, the source code used by CITADEL partners to develop their technological tools is located in an open source repository, accessible for anyone who wants to reuse it.

In conclusion, this deliverable provides clear evidence that improvements from the first review session and the Common Dissemination Booster’s implementation has been positive actions to enhance dissemination, communication and networking results. Our trend analysis offers evidence of a significant improvements in terms of identifying opportunities and best practices on how to disseminate to end-users.




of 53

Annex 1 – Press release




of 53




of 53

Annex 2 – Number of access to the project website from each country

Table 15. Number of access to the project website from each country


United States of America 717

Spain 474

Italy 443

Belgium 442

Latvia 205

United Kingdom 140

Netherlands 124

Germany 92

India 81

Greece 56

China 53

Brazil 50

France 46

Canada 46

Russia 45

Estonia 36

Austria 29

Poland 29

Portugal 29

Philippines 28

Sweden 28

Finland 26

Norway 24

Switzerland 20

(not set) 19

Denmark 17

Ukraine 17

South Korea 15

Romania 15




of 53


Hungary 12

Mexico 14

Slovenia 13

Ireland 13

Lithuania 12

Serbia 12

Turkey 12

South Africa 12

Czechia 11

Hong Kong 9

Japan 10

Australia 9

Croatia 8

Israel 7

Nigeria 8

United Arab Emirates 7

New Zealand 7

Slovakia 7

Singapore 6

Bulgaria 5

Egypt 5

Kazakhstan 5

Malaysia 5

Thailand 5

Luxembourg 3

North Macedonia 4

Malta 4

Saudi Arabia 4

Albania 3

Colombia 3

Cyprus 3

Algeria 3




of 53


Ecuador 3

Indonesia 3

Jordan 2

Morocco 3

Mozambique 3

Peru 3

Pakistan 3

Taiwan 3

Argentina 1

Bangladesh 2

Bahamas 2

Belarus 1

Chile 2

Ethiopia 2

Georgia 2

Iran 2

Sri Lanka 2

Mongolia 2

Somalia 2

Tunisia 2

Uganda 2

Vietnam 1

Kosovo 2

Andorra 1

Armenia 1

Aruba 1

Azerbaijan 1

Bolivia 1

Belize 1

Congo - Kinshasa 1

Congo - Brazzaville 1

Ghana 1




of 53


Gibraltar 1

Jersey 1

Kenya 1

Cambodia 1

Lebanon 1

Moldova 1

Mauritius 1

Maldives 1

Nepal 1

Palau 1

Qatar 1

Trinidad & Tobago 1

Uruguay 1

St. Vincent & Grenadines 1

d7.5 final dissemination communication and networking report … · 2019-11-06 · d7.5 – final...

Documents