artemis joint undertaking annual activity report 2013 · the artemis joint undertaking was created...

ARTEMIS-ED-2014.75

ARTEMIS JOINT UNDERTAKING

Annual Activity Report 2013

ARTEMIS-ED-2014.75

ARTEMIS-ED-2014.75 2

ARTEMIS Joint Undertaking – AAR 2013

EXECUTIVE SUMMARY ............................................................................................................................. 3

1. INTRODUCTION ................................................................................................................................. 5

2. KEY ACTIVITIES AND ACHIEVEMENTS ...................................................................................................... 6

2.1. POLICY-RELATED ACHIEVEMENTS ............................................................................................................. 6 2.2. R&D AND INNOVATION ACTIVITIES AND ACHIEVEMENTS ............................................................................ 8 2.3. SET UP ACTIVITIES AND ORGANISATIONAL ACHIEVEMENTS ........................................................................ 34

3. MANAGEMENT, COMMUNICATIONS AND INTERNAL CONTROL ............................................................ 35

3.1. MANAGEMENT AS AUTONOMOUS ENTITY ................................................................................................. 36 3.2. COLLABORATION WITH ARTEMIS MEMBER STATES ............................................................................... 36 3.3. COLLABORATION WITH THE INDUSTRY ASSOCIATION ............................................................................... 37 3.4. BUDGET, COMMITMENTS, TRANSACTIONS ................................................................................................ 37 3.5. COMMUNICATION .................................................................................................................................. 39 3.6. JU STAFF AND OUTSOURCING ................................................................................................................. 57 3.7. INTERNAL CONTROL FRAMEWORK (ICF) ................................................................................................ 57 3.8. EX-POST AUDIT ..................................................................................................................................... 60 3.9. FINANCIAL CIRCUITS, DOCUMENTATION OF PROCEDURES, REGISTRATION OF DOCUMENTS ........................... 62 3.10. INTERNAL AUDIT ................................................................................................................................... 62 3.11. IT SYSTEMS .......................................................................................................................................... 63

4. DECLARATION OF ASSURANCE .............................................................................................................. 65

APPENDIX 1: FINANCIAL REPORT: FINANCIAL YEAR 2013, ADMINISTRATIVE BUDGET ............................................... 67 APPENDIX 2: LIST OF NATIONAL FUNDING AUTHORITIES HAVING SIGNED AN ADMINISTRATIVE AGREEMENT WITH THE

ARTEMIS JU ..................................................................................................................................................... 75 APPENDIX 3: MEMBERS OF ARTEMIS GOVERNING BOARD IN 2013 ...................................................................... 76 APPENDIX 5: MEMBERS OF ARTEMIS INDUSTRY AND RESEARCH COMMITTEE IN 2013 .......................................... 78



EXECUTIVE SUMMARY

By Alun Foster, Acting Executive Director of the

ARTEMIS Joint Undertaking

Instead of being what could have been anticipated to be a year of “business as usual”, 2013

was in fact a year of change, in many ways.

After a long career in private industry and more recently in the public sector, Eric Schutz –

Executive Director of the ARTEMIS JU – retired in July 2013, prompting the Governing

Board to invite me to take over ad interim as Acting Executive Director. In this role, I was

fortunate to be able to call upon Eric’s corporate wisdom and experience in the European

institutions, in his subsequent part-time engagement as Special Adviser. Eric has been active

in ARTEMIS since its very inception, in 2004, and I feel justified in recognising, on behalf

the whole ARTEMIS community, the important contribution Eric has made in those 10 years

in establishing this new venture.

2013 was also the year of the last Call of the ARTEMIS-JU. Sadly, the increased momentum

of ARTEMIS Member States’ contributions seen in 2012 with the introduction of the

“ARTEMIS Innovation Pilot Projects” (AIPPs) was not continued. Of the 20 eligible

proposals submitted, 12 were above the technical selection threshold yet only four were

potentially fundable. In response to the mandate given to the Acting Executive Director by the

PAB, the ARTEMIS-JU Office staff launched the negotiations of these four project proposals

within the additional constraint – in view of the impending set-up of the new ECSEL joint

Undertaking in 2014 – of having to finalise them before the end of the calendar year, de facto

in parallel with the final signature of all Call 2012 projects. The dedication and

professionalism of the Programme Officers and all supporting Office staff entrusted with

these negotiations, undertaken in challenging circumstances, is surely to be recognised and

commended. Despite the reduced budget commitments, these four substantial projects still

represent a total R,D&I investment in excess of 163M€, including one very substantial AIPP

called EMC² of roughly 94M€ investment, which addresses the efficient (and therefore

competitive) programing of multi-processor platforms embracing also mixed criticality.

Together with the other three projects, ALMARVI, DEWI and R5-COP with respectively

17M€, 40M€ and 13M€ total costs, this Call has also contributed valuable and focussed

momentum – augmenting the "critical mass" – for the European Embedded Systems

community.

The completion of negotiations of Call 2013, being the last of the ARTEMIS Calls, allows a

preliminary evaluation of the whole ARTEMIS programme to be made. Subject to variations

during execution, ARTEMIS has leveraged a total RD&I investment of ~1.1 b€, 52% of

which is provided by the R&D actors in the projects.

As in previous years, the ARTEMIS strategy for creating impact of its R,D&I results through

project clustering and the seeding of “Self-Sustaining Innovation Ecosystems” has been

continued through activation and management of the relevant community, particularly

through the ARTEMIS Industry Association (demonstrating the power and relevance of the

PPP model), backed by a significant activity on communication and dissemination. The



development of the beta version of the ARTEMIS Repository Tool is also a significant

achievement, also of specific benefit to the European ICT research community at large. The

largest single such dissemination event was the annually recurring “Co-Summit” event,

organised together with ITEA and held in Stockholm. The close interaction with ITEA was

also evidenced by the publication of the commonly agreed “High Level Vision ITEA-

ARTEMIS 2030” document by the Sherpa-like working group, describing a common long-

term vision on embedded/software-intensive systems. Collaboration with ENIAC and the

other three JTIs in the “Innovation in Action” event, held at the European parliament in

October 2013, also served to some extent as a kick-off for the planned transition, in 2014, to

the ECSEL JU. Indeed, in the latter part of the year resources of the ARTEMIS-JU were

already being dedication to preparing the way for this merger.

Change would indeed seem to be the only constant, and this Annual Activity report is the last

full report of the ARTEMIS Joint Undertaking. This is a landmark occasion for me

personally, as I too have been involved with ARTEMIS since its very beginning. I would like

to personally thank all of the people who have helped make this amazing project for Europe

possible; at the Commission, the representatives of the ARTEMIS Member States, the team at

the Industry Association and the many contributors to the Working Groups. And of course to

the ARTEMIS-JU Office staff and the participants in the projects who themselves are

contributing directly to the concrete results of the programme. While the National

contributions may indeed have fallen short of plans, ARTEMIS-JU has demonstrated the

power of the Private-Public Partnership model in collaborative research and innovation, and

has shown that a tri-partite funding model does indeed work and is an effective instrument. I

look forward to seeing these special characteristics being continued in the context of the

ECSEL JU.



1. INTRODUCTION

The ARTEMIS JU was created by Council Regulation (EC) No 74/2008 of 20 December

20071 under Article 171 of the Treaty (Article 187 of The Treaty of Lisbon) as a legal entity

responsible for the implementation of a Joint Technology Initiative on Embedded Computing

Systems. Its date of establishment is 7 February 2008, following the publication of the

Council Regulation and of the Statutes annexed to it in the Official Journal of the European

Union on 4th

February2. The ARTEMIS Joint Undertaking was created for a period up to 31

December 2017 and its seat is in Brussels.

This is the sixth Annual Activity Report (AAR) of the ARTEMIS3 Joint Undertaking (JU) in

line with Article 19 of its Statutes and Article 40 of its Financial Rules4, which specify that:

Article 19 of the Statutes: The Annual Activity Report shall present progress made by the ARTEMIS Joint

Undertaking in each calendar year, in particular in relation to the Multiannual Strategic Plan and the Annual

Implementation Plan for that year. It shall also include information on the participation of SMEs in Joint

Undertaking's R & D Activities. The Annual Activity Report shall be presented by the Executive Director

together with the Annual Accounts and balance sheets.

Article 40 ARTEMIS Financial rules: The authorising officer shall report to the Governing Board on the

performance of his/her duties in the form of an annual activity report, together with financial and

management information confirming that the information contained in the report presents a true and fair

view except as otherwise specified in any reservations related to defined areas of revenue and expenditure.

This report shall indicate the results of his/her operations by reference to the objectives set, the risks

associated with these operations, the use made of the resources provided and the efficiency and

effectiveness of the internal control system. The internal auditor within the meaning of Article 72 shall take

note of the annual activity report and any other pieces of information identified.

By no later than 15 June each year, the Governing Board shall send the budgetary authority and the Court of

Auditors an analysis and an assessment of the authorising officer's annual report on the previous financial

year. This analysis and assessment shall be included in the annual activity report of the Joint Undertaking,

in accordance with the provisions of Article 19 of the Statutes.

Joint Technology Initiatives (JTIs) are long term public-private partnerships which can be

implemented through Joint Undertakings within the meaning of Article 171 of the Treaty

(Article 187 of The Treaty of Lisbon). These partnerships combine private sector investment

and national and European public funding, including grant funding from the Research

Framework Programme, in order to speed up the development of major technologies. JTIs

were foreseen in the Seventh Framework Programme5 for research, technological

development and demonstration activities, as well as in the Council Decision for the

Cooperation Programme6. They contribute to the Lisbon Growth and Jobs Agenda7 by

1 The missing footnote regarding Article 23(3.4.2) was published in OJ L 219, 14.08.2008, p. 73 and in OJ L

259, 27.09.2008, p. 19. 2 OJ L 30 of 04.02.2008.

3 ARTEMIS stands for Advanced Research and Technology in EMbedded Intelligence and Systems

4 ARTEMIS-GB-13/08

5 Decision No 1982/2006/EC of the European Parliament and of the Council of 18 December 2006

concerning the Seventh Framework Programme of the European Community for research, technological

development and demonstration activities (2007-2013). 6 Council Decision 2006/971/EC of 19 December 2006 concerning the specific programme 'Cooperation'

implementing the Seventh Framework Programme of the European Community for research, technological

development and demonstration activities (2007-2013). 7 OJ L 400, 30.12.2006, p.86. Corrected by OJ L 54, 22.2.2007, p.30.



developing favourable conditions for investment in knowledge and innovation in the Union to

boost competitiveness, growth and jobs.

The Union supports the ARTEMIS JU from the budget of the ICT priority of the Cooperation

Programme.

2. KEY ACTIVITIES AND ACHIEVEMENTS

The major activity of the Joint Undertaking in 2013 concerned the launch of its sixth and last

Call for R&D proposals.

2.1. Policy-related achievements Since breaking new ground in 2008 and becoming a reference (both in terms of piloting a new

model for public-private partnerships in research and in enabling R&D projects co-financed

by both Union and National funds) the ARTEMIS JU has successfully launched and managed

44 projects from its first four Calls, launched negotiations on 8 projects from its fifth Call and

initiated preparations for its sixth and final Call. Its policy objectives can by now

demonstrably be declared as effective: These objectives include the fostering of effective

collaboration between the public and private sectors within the public-private partnership

represented by the JU; combining Union and national efforts in order to support the best

European collaborative R&D that contributes to the technology and industrial objectives of

the ARTEMIS JTI; increasing overall R&D investments in the field of Embedded Computing

Systems; and promoting the involvement of SMEs in the JU activities.

2.1.1. An effective public-private partnership

Call 2013 has built further on the successes and lessons learned from the preceding five Calls,

and specially from the 2012 Call, through the confirmation of a new type of activity, the

AIPPs comparable to the “Pilot Lines” already known in other schemes. AIPPs are an answer

to Recommendation 4: (for the ARTEMIS JU) of the Second Interim Evaluation, that states

that “ARTEMIS projects should build, where appropriate, on previously developed ARTEMIS

technology, making reference to what has been funded before and demonstrating, in addition

to novelty, the appropriate re-use of previous project results combined with a suitable

progression to higher TRL levels. The proportion of funding for projects targeting generic

applications and services (Applications projects) should be increased. Such applications

projects could also be used as a way of testing and improving the quality of platforms or of

tools that have been developed under ARTEMIS funding.” As in 2012, a single-phase Call

procedure needed to be used - Full Project Proposals phase only – in order to meet the

timescales for an annual Call. In 2013, an additional timing constraint was put on the JU in

view of the change-over to Horizon2020: negotiations of the resulting projects and therefore

the finalisation of the actual JU funding budget, had to be completed before the end of

December 2013: this was achieved.

Concurrently, the running projects from the previous Calls were monitored, and the selected

proposals from the Call 2012 negotiated and the resulting projects launched, with all Joint

Undertaking Grant Agreements (JUGAs) being signed before the end of the year.

In 2013, the many and frequent interactions between the JU Office staff and the staff

members of the participating National Authorities, as well as with the wider ARTEMIS



community actually executing the projects continued. As stated previously, the success of

ARTEMIS depends on close and balanced collaboration between industry and public

authorities. The open and pragmatic way of working has stimulated participation, certainly

from industry as well as from the participating public authorities in spite of the technical

difficulties associated with the novel funding model..

This private-public cooperation also continued to respect the principle of separation between

the roles of the private and public parties. On the one hand, the Public Authorities Board

(nominated by the public authorities) has sole responsibility for the approval of the Annual

Work Programmes, the Calls for proposals and for the final selection of projects and

allocation of public funds. On the other hand, the Industry and Research Committee

(nominated by ARTEMIS-IA) takes the lead in defining the Multi Annual Strategic Plan

including the Research Agenda, in proposing the Annual Work Programmes and in industrial

policy and related innovation activities. Any potential conflicts of interest with the private

partners are thus avoided, and the role of the Joint Undertaking office is clearly established as

that of an enabler and promoter of the programme for the benefit of all stakeholders.

2.1.2. Increasing overall R&D investment in embedded computing

systems

The ARTEMIS JU has the potential to ramp up R&D investment in Europe by providing

incentives to Member States and industry to increase their R&D expenditure. This is partly

because of the ARTEMIS R&D funding mechanism in which the more national budget is

committed to Calls the more additional Union funding is leveraged for R&D actors, thus

creating a virtuous cycle.

When looking at the first 4 years of ARTEMIS, we observe a negative trend in the size of the

commitments of the Member States. The introduction in 2012 of the concept of AIPPs

(ARTEMIS Innovation Pilot Projects) has reversed this negative trend. This concept of very

large projects, closer to the market, has been positively welcomed by many Member States,

resulting in the highest ever commitment for an ARTEMIS Call. Unfortunately, the 2012

positive trend has not been confirmed in 2013, for the last Call. The ARTEMIS Community

has confirmed its interest for AIPPs and its overall demand, unfortunately not matched by the

various commitments of the Member States for this last Call of the programme. This gives a

clear indication of the direction to go for ECSEL, the future Joint Undertaking, to be created

within Horizon 2020.

2.1.3. Horizon 2020

Under coordination of the Commission, further talks have taken place with the Member States

on one side, and with ARTEMIS-IA, AENEAS and EPoSS on the other side. A common

High Level Strategic Research and Innovation Agenda has been developed by the three ETPs,

in view of the creation of a future Joint Undertaking. On July 10th

, 2013, the Commission

adopted a proposal for a Council Regulation on the ECSEL Joint Undertaking. This proposal

has been further discussed with the Council, the Parliament and the Private Members

(ARTEMIS-IA, AENEAS and EPoSS).



2.2. R&D and innovation activities and achievements 2.2.1. Overview of the achievements

The overall aim of ARTEMIS is to develop key technologies for Embedded Computing

Systems across different application areas in order to strengthen European competitiveness

and sustainability, and to allow the emergence of new markets and societal applications. The

overall strategy for achieving this aim is laid out in the Multiannual Strategic Plan whereas the

Annual Work Programme provides the basis for launching annual Calls for R&D project

proposals.

A main achievement of ARTEMIS was the launch of the sixth and last Call for proposals, Call

2013, which is described in detail below. In summary, the Call was opened on February 26th

and closed on June 6th

. 22 proposals were submitted, of which two were declared ineligible by

the JU. All other proposals were declared eligible, leaving 20 proposals for further evaluation.

The technical evaluation procedures yielded an ordered list with 12 projects above the

technical threshold. The PAB decision of September 6th

gave a mandate to the Executive

Director to start negotiations on 4 proposals, with 5 proposals put onto a reserve list.

Negotiations on the 4 proposals were started end of September 2013.

With the completion of this 6th

Call and the launching of the projects resulting from it, the

ARTEMIS-JU programme is in essence “complete” in terms of its projects. In 2012, a

preliminary Portfolio Analysis was presented, which gave a picture of the way in which the

technical results of the programme were addressing the technical objectives. It is the intention,

in 2014 onward, to follow the execution of the still running projects and complete an update of

the Portfolio Analysis, now including all of the ARTEMIS projects. This is a technically

complex task that will take time. However, an initial evaluation of the participation can

already be mentioned, as summarised here.

When looking at the overall achievements through the 6 Calls, we can observe the following:

TOTAL PROGRAMME

TYPE LE PRO SME Grand Total

Participations 550 461 409 1420

Participants 268 208 295 771

Total Cost (M€) 615 271 213 1.099



We can highlight:

A total programme size of about 1.1 B€, may be disappointing when we look at the

original plans, due to commitments from the Member States significantly below the

original expectations.

Nevertheless, ARTEMIS has been the largest programme ever on Safety Critical

Systems and on Multi-core Technology

When looking at the individual participations, 38% come from SMEs, which is a

significant achievement.

2.2.2. The Multiannual Strategic Plan (MASP/RA)

A new MASP (with connected Research Agenda) was approved in December 2012, including

further developments related to AIPPs. In view of the creation of ECSEL, it includes also

some new developments with AENEAS and EPoSS.

2.2.3. The Annual Work Programme (AWP)

The Annual Work Programme for 2013 was adopted by the ARTEMIS Public Authorities

Board in December 20128 based on the proposal of the Industry and Research Committee.

The call consisted of two parts, described below. In order to meet the desire to introduce

selectivity in this last Call of ARTEMIS, to focus the resulting work on domains requiring

further effort so as to achieve programme-level balance in the technical topics addressed, sub-

programmes in each part were suppressed.

8 ARTEMIS-PAB-2012-D.20



The AWP part A (ASPs) addresses in principle the three industrial priorities of

ARTEMIS (reference designs and architectures, seamless connectivity and

middleware and design methods and tools) through 8 sub-programmes (ASPs) on (1)

safety-relevant embedded systems, (2) health, (3) smart environments, (4)

manufacturing, (5) computing environments, (6) security, (7) sustainable urban life

and (8) human centric design. For the last call in 2013, sub-programme 7 is not open.

The AWP part B (AIPPs) addresses in principle six areas: Critical Systems

Engineering Factories, Innovative Integrated Care Cycles, Seamless communication

and interoperability - Smart environments: the Neural System for society, Production

and Energy Systems Automation, Computing platforms for embedded systems and

Intelligent-Built” environment and urban infrastructure for sustainable and “friendly”

cities. For the last call in 2013, the first, fourth and sixth subjects are not open.

2.2.4. Publication of the Call

The ARTEMIS Call 2013 was published on 26 February 2013 and closed on 6 June 2013.

The indicative budget was €75.702.000. This call had no PO phase, the consortia must submit

directly a full project proposal (FPP). The consortia however could submit a non-mandatory

expression of interest (EoI) by 8 March.

The Call closed on June 6th at 17h00. One proposal missed the deadline and 22 proposals

were successfully submitted. Of the 22 proposal submitted, the following were found to be

ineligible at JU level: ADMINVENTOR (only one partner) and Bioclues (only 2 ARTEMIS

Member States).

Proposal

submitted

Proposals

in panel

Ineligible Failed

threshold(s)

Above

threshold

AIPPs 5 4 1 2 2

ASPs 17 16 1 6 10

Total proposals 22 20 2 8 12

In the following data analysis, only the 20 JU-eligible proposals are taken up.

The proposals represent 412 M€ Total Costs, with 555 participations by 406 individual

participants.

Split by Partner Type

LE PRO SME Total

All participations 235 149 171 555

Individual participants 180 92 139 406

All participations 42% 27% 31%

Individual participants 44% 23% 34%



Total Costs (M€) 229,00 92,32 90,45 411,77

Total Costs 56% 22% 22%

ASP/AIPP count of Proposals



ASP / AIPPs by Total Cost of all eligible proposals

Proposals Total Costs

Proposal Tot

Cost ASP

EMC2 98,42 AIPP5

ICC 73,41 AIPP2

DEWI 45,88 ASP3

ES4ICS 34,46 ASP6



COMIT 19,69 ASP1

Almarvi 19,13 ASP5

Crystal Bulb 18,93 ASP5

R5-COP 18,58 ASP4

ALDES 14,18 ASP1

DiQi 13,04 ASP4

ECOSYSTEM 12,34 ASP2

WE-SPEAR2 11,03 ASP2

FRESHEYE 9,69 ASP3

ACCORD 7,52 ASP8

TakeGoodCare 3,80 AIPP2

ComingTV 3,55 AIPP3

INTEROADS 3,28 ASP3

RACEFIT 2,54 ASP5

REHABINECT 1,83 ASP2

ES4GSHP 0,46 ASP4

Total Cost, National Funding and Oversubscription (all eligible proposals)

Notes on National Funding:

Most overscubsriptions are around factor 2 to 3. Participation is requested in Greece at 0€

Nat. Funding. National budget is requested in Romania though non is available in the Call.



Requested participations from non-ARTEMIS Member States: Turkey (in Almarvi),

Lithuania (in COMIT) and Serbia (in ALDES). All are Member or Associated States so may

receive JU funding.

The technical evaluation and the final panel of experts took place in the week of 8 to 12 July.

The evaluation process followed the rules for FPP evalution as described in ARTEMIS-PAB-

2012.D.18, with the evaluation criteria and scoring defined in the Annual Work Programme

ARTEMIS-PAB-2013-D.24 Annex 1 and Annex 2. Above and below threshold lists were

communicated to the PAB.

ABOVE

Threshold

BELOW

Threshold

Almarvi DiQi

EMC2 ALDES

DEWI TakeGoodCare

R5-COP REHABINECT

Crystal Bulb INTEROADS

ICC ComingTV

COMIT RACEFIT

WE-SPEAR2 ES4GSHP

FRESHEYE

ES4ICS

ECOSYSTEM

ACCORD

The members of the Public Authorities Board had been previously asked to provide feedback

on the eligibility of partners and costs for this Call via the E2 forms, and also to provide their

“votes” for use in the PAB decision aid tool. All of these documents were duly received in

time for the PAB meeting of 5th

September 2013.

Concerning the voting scheme. This is a new support tool (i.e. not a decision making tool) to

help the PAB come to a funding decision based on a clear expression of National strategic

interests. Each country can provide “votes” (up to 10) for particular projects, which are added

to the technical scores of the projects, thereby influencing the ranking. The votes are weighted

using a complex scheme, whereby a country’s votes are proportional to their National budget

contribution to the Call, and the importance of the eligible costs requested in the project by

that country’s participants. The incremental scores coming from the votes are further adjusted

such that the maximum incremental score can be at most one half of the “span” of technical

scores (span = maximum score – minimum above-threshold score). Countries may also vote

“neutral”, meaning that they wish to follow the technical scoring provided by the experts, or

abstain (no vote).

Pleasingly, all countries who had provided budget to the call supplied votes, with one formal

abstention. Of the 20 member countries who voted, 14 voted “neutral” (= agreeing with the

Technical scores), including the EC (of whom a neutral standpoint can of course be

anticipated) and 6 provided specific votes for a selection of projects.

Ranking of the proposals after applying the votes is shown below.



Proposal Experts’

score

PAB

voted

score

Almarvi 51 55,28

EMC2 50 55,07

DEWI 49 53,34

R5-COP 47 50,34

Crystal Bulb 45 47,36

COMIT 44 46,37

ICC 44 45,91

WE-SPEAR2 44 45,56

ES4ICS 42 43,09

FRESHEYE 42 42,78

ECOSYSTEM 42 42,78

ACCORD 40 40,00

Based on these scores and on the availability of National funding, the PAB decided to

mandate the Executive Director to launch negotiations on the top four projects (Almarvi,

EMC2, DEWI and R5-COP)9, retaining the following projects on a reserve list, to be

negotiated if funds become available due to unsucessful negotiation of the top four (ICC,

COMIT, WE-SPEAR2, FRESHEYE, ES4ICS).

Negotiations were started at the end of September.

Some statistics. The selected projects for negotiation from Call 2013 show the following

profile as concerns their contribution to the various ASPs/AIPPs (NB – pre-negotation figures

are used): the contribution to each ASP is as defined by the evaluators i.e. not the self-

declared allocation).

9 Decision ARTEMIS-PAB-2013-D.25



The distribution of total cost per partner type in the top four projects (pre-negotiation data) is:

TOTAL COST (E2 corrected, k€)

LE PRO SME Grand Total

Almarvi 7,447 8,685 2,994 19,126

DEWI 33,246 7,437 5,060 45,742

EMC2 64,538 15,688 18,495 98,720

R5-COP 9,021 4,791 4,034 17,846

Grand Total 114,251 36,600 30,583 181,435

This distribution demonstrates a preponderance of Large Enterprises. However, the project

DEWI and AIPP EMC2 are both very large projects, in which the large enterprises are able to

invest at a much higher level. Taking the count of the participants gives the picture below,

which is a little closer to the norm for the ARTEMIS programme:

Count of participants (all participations)

LE PRO SME

Grand

Total

Almarvi 3 9 5 17

DEWI 37 14 13 64

EMC2 48 24 24 96

R5-COP 14 10 11 35

Grand Total 102 57 53 212

48% 27% 25%

And counting the UNIQUE participations (each participant only counted once) yields:

LE PRO SME Total

84 44 46 174

48% 25% 26% 100%



Showing again a high level of SME participation in these projects.

During the 4th

quarter, the negotiations of the four projects selected by the PAB for funding

were concluded. No recourse to the Reserve List was required nor indeed possible.

The conclusions of the negotiations were distributed to the relevant coordinators by the end of

December, clearing the way for a rapid signature of the corresponding JU-GAs in the first

quarter of 2014.

The outcome of the negotiations as per funding allocation is summarised in the table below:

Almarvi EMC2 DEWI R5-COP

Total

Allocated

AT - 2.968.601,00 1.263.804,00 - 4.232.405,00

BE-VL - 328.325,00 1.604.713,00 - 1.933.038,00

CZ 875.966,00 1.131.004,00 - - 2.006.970,00

DE - 6.399.999,77 - - 6.399.999,77

DK - 549.541,00 - 750.459,00 1.300.000,00

ES - 2.479.405,48 2.655.759,86 247.084,00 5.382.249,33

FI 2.678.353,74 - 1.398.623,00 606.450,00 4.683.426,74

FR - 910.136,61 520.409,85 - 1.430.546,46

HU - - - 500.000,00 500.000,00

IE - 415.064,00 541.189,58 - 956.253,58

IT - 999.388,69 - - 999.388,69

LV - - 219.912,00 219.912,00 439.824,00

NL 1.841.046,00 4.478.931,00 680.023,00 - 7.000.000,00

NO - 1.030.350,00 - 518.751,44 1.549.101,44

PL - - 1.487.857,00 511.813,52 1.999.670,52

PT - 536.294,00 633.301,00 - 1.169.595,00

SE - 2.523.206,00 447.992,00 - 2.971.198,00

UK - 1.993.925,00 - - 1.993.925,00

Tot National 5.395.365,74 26.744.171,55 11.453.584,29 3.354.469,96 46.947.591,53

JU 2.784.985,69* 15.684.745,37 6.615.393,35 2.195.913,10 27.281.037,50

Tot Funding 8.180.351,43 42.428.916,91 18.068.977,64 5.550.383,05 74.228.629,03

Total Cost 16.676.561,00* 93.920.630,95 39.613.133,83 13.149.180,22 163.359.506,00

*The Almarvi project has 2 participants from Turkey (associated country), with an eligible cost of

1.406.400,00€ and a corresponding JU fundig of 234.868,80€. These amounts are included in the JU

funding and Total cost for Almarvi.

The split of participation by partner type, as measured by the Total costs (investment in M€)

is:


100.8 34.5 28.0 163.4



Or graphically:

The higher investment capacity of the large enterprises is evident here. However, counting the

participations by partner type yields:


90 61 52 203



2.2.5. Programme Monitoring and Review

Monitoring and review of the Call 2008, 2009, 2010, 2011 and 2012 projects

The procedure for monitoring and review of projects is based on Decision ARTEMIS-PAB-

08/09 and on the accompanying "Guidance notes and templates for Project Technical Review

involving independent expert(s)" (ARTEMIS-ED-21-09) and "Guidance Notes on Project

Reporting" (ARTEMIS-ED-20-09). In total, 33 project reviews were organised in 2013.

With regard to project monitoring and review, Recommendation 3: (for the ARTEMIS JU) of

the second Interim Evaluation report ( “JTI project reviews, including a final post-project

review that should be held, the panel concludes, between 6 and 12 months after the end of a

project, should monitor more closely and rigorously the actual and planned exploitation of

project results, and the measures put in place by project partners to achieve such planned

exploitation”) has been partially addressed by the compilation of and internal note “Policies

for assuring IPR protection and Dissemination in Projects”, to serve as a guide.

At the end of 2013, the status of each ARTEMIS project can be described as follows:

Call 2008 projects

Project Start

Date

Last review

date

Statu

s

Next review

date Comment

CAMMI 15/12/2008 27/04/2011

NA Project ended.

CESAR 1/03/2009 3/07/2012

NA Project ended.

CHARTER 1/04/2009 27/06/2012

NA Project ended. All payments done.

Green light – project fully on track.

Amber light – some issues requiring correction, but project is essentially OK.

Red light – Critical issues affecting the project. Payments in danger of being put on

hold.



CHESS 1/02/2009 04/07/2012

NA Project ended.

eDIANA 1/02/2009 21/03/2012

NA Project ended.

EMMON 1/03/2009 25/05/2012

NA Project ended.

ilAND 1/03/2009 26/06/2012

NA Project ended.

INDEXYS 1/04/2009 5/06/2012


SCALOPES 1/01/2009 28/03/2011


SMART 1/05/2009 19/04/2013 (final review)

NA Project ended

SOFIA 1/01/2009 20-21/03/2012

NA Project ended

SYSMODEL 1/01/2009 6/3/2012


Call 2009 projects

Project Start Date Last review

date

Statu

s

Next review

date Comment

ACROSS 1/04/2010

25/07/2013

Final review

N.A. Project ended on 31/07/2013 with good results.



ASAM 1/05/2010 Intermediate review – March 2013

March-April 2014 - Final

review.

One partner – COMPAAN B.V. - has declared bankruptcy. The technical results will not be severely influenced by this bankruptcy, because the latter occurred in a late stage of the project and the partner has a relatively small role at this stage. The remaining activities of COMPAAN will be performed by TU/e. There is an issue with some prepaid amount to COMPAAN, which needs to be recovered. The related financial figures have been estimated. The TA has been revised accordingly, the project has been extended with another 4 months and remaining funds have been reallocated in NL through Amendment No.4 dated 24/10/2013.

CHIRON 1/03/2010 04/06/2013

16/01/2014

An extension of 9 months has been granted. New end date is 30/11/2013. Good progress, Observation studies are going on.

eSONIA 1/03/2010 27/02/2013

N.A.

Project ended on 28/02/2013 with excellent results. Final deliverables have been received and the final review report has been sent out.

iFEST 1/04/2010 27/06/2013

N.A.

Project ended on 31/05/2013 with very good results, especially on exploitation and standardization activities. Final deliverables have been received and the final review report has been sent out.

ME3GAS 1/05/2010 21+22/11/2013

N.A.

Successful final review held at the premises of Gas Natural and out and about in the town of A Coruña, Spain. Final Review Report distributed on 11/12/2013.



POLLUX 1/03/2010 23-25 September 2013

NA Project ended

pSHIELD 1/06/2010 Final review held on 14/02/2012

NA Project ended

R3-COP 1/05/2010

30-31/10/2013

Final review

N.A.

Project ended on 31/10/2013 with very good results. The robot demonstrators were evaluated on-site by the experts in October, before the review. Final review report is being prepared.

RECOMP 1/04/2010

21/03/2013

Final review

N.A.

Project ended with very positive results. All main objectives have been met. Final review report has been sent out.

SIMPLE 1/06/2010 2+3 July 2013

N.A.

Very successful final review held at the site of partner Gorenje, Slovenia, with impressive live demonstration of the SIMPLE project’s innovative results. Technical Review Report distributed on 16/12/2013.

SMARCOS 1/01/2010 14/03/2013

N.A.

Project ended on 31/03/2013 with good results. Final deliverables have been received and the final review report has been sent out.

SMECY 1/02/2010 04/04/2013

N.A.

Project has ended 31/01/2013. Project showed good results. Final review report sent.



Call 2010 projects

Project Start

Date

Last review

date

Statu

s

Next review

date Comment

pSafeCer 1/4/2011 28/10/2013

N.A.

Final review was held as planned via Webex teleconference to approve the final deliverables and assure take-up in the nSafeCer project. Technical Review Report distributed on 11/12/2013.

WSN-DPCM 1/10/2011 Intermediate remote review in June 2013

1 April 2014

Missing NGAs in IT! The project was extended with 6 months due to difficulties in IT and GR. Based on the conclusions of the intermediate review and the updated project timeline; it was decided to postpone the second review till April 1st.

IoE 1/05/2011 15-16 July 2013

September 2014

Amendment n 1 into force. Project extended 7 months

Positive progress at review. Report issued and communicated to NFA

nSHIELD 01/09/2011 14-15/11/2012

October 2014

Good progress

Amendment n1 on-going (change of consortium configuration).

MBAT 01/11/2011 10-11/12/2013

November 2014

Good progress, report review on-going

ENCOURAGE 01/06/2011 1-2/10/2013

September 2014

Review showed good progress.

Amendment n2 ongoing

EZMON issue solved (NGA signed)

D3COS 01/03/2011 24/04/2013

26/27 February 2014 (final)

Good progress.



PRESTO 01/04/2011 06/06/2013

June 2014

Good progress. 2nd

year review report submitted to the Consortium and to the National Funding Authorities. No pending amendments, quite stable Consortium.

ASTUTE 01/03/2011 22/05/2013

Q2 2014

Project has been extended with 3 months. One Spanish partner went bankrupt – work has been taken over by other partners. Thales Avionics has reduced their contribution. Amendment nr.2 was issued in December 2013

HIGH PROFILE

01/04/2011 3/07/2013

July 2014

Addition of 1 IT partner has been finalised with amendment nr 2. Project extension with 3 months has been accepted with amendment nr 3.

Call 2011 projects

Project Start

Date

Last

review

date

Status Next review

date Comment

e-GOTHAM 1/04/2012 4/06/2013

June 2014

Good first review held. Impressive collaboration on a challenging topic. Report sent on 12 July.

VeTeSS 1/05/2012 20/06/2013

June 2014

The first review concluded that the work was progressing very well; deliverables have been uploaded on time. The first review report has been sent out. The contact person for the coordinator has been changed.



CRAFTERS 1/06/2012 02/07/2013

11/02/2014 (interim review)

The project is progressing well and each technical Work Package has been making satisfactory progress this first year in relation to the Technical Annex. The review report of the first review meeting was sent out. An interim review is planned to show mainly status of deliverables due at M18 and first results in tool integration.

An amendment was performed beginning December 2013 due to the withdrawal of Infineon UK. Another amendment is pending due to the bankruptcy of Spanish partner Vista Silicon (new budget proposal under approval by the Spanish NFAs)

DEMANES 01/05/2012 27/06/2013

Q1 2014 (remote intermediate review)

Work is progressing well, some deliverables were resubmitted

nSafeCer 1/04/2012 28/10/2013

May 2014

See also pSafeCer. Intermediate review (remote) held on to assure correct take-up of pSafeCer output into this extension project. Good progress is still being made and the (difficult to do) handover from pSafeCer has been successfully carried out.

DESERVE 01/09/2012

30-31 October 2013

November 2014

Good progress. Some delay in submission of deliverables.

Review report on-going

SESAMO 1/05/2012 28/06/2013

June 2014

The first review concluded that the work was progressing very well; deliverables have been uploaded on time. The first review report has been sent out.



VARIES 1/05/2012 23/05/2013

Q2 2014 Project is progressing well.

PaPP 1/09/2012

22/10/2013

Q4 2014

Project showed good progress at the first review. Report was sent on 20/12/2013.

Call 2012 projects

Project Start

Date

Last

review

date

Statu

s

Next

review date Comment

CRYSTAL 1/05/2013

10-11/

02/2014.

July 2014

JU GA in force

Amendment n1 ongoing (changes in consortium).

Documents delivery started

Arrowhead 1/03/2013 14/11/2013

September 2014

First review covering the initial 7 months of the project took place in Brussels on the 14/11/2013. Review report has been sent out. Review showed very good progress of the project together with an extremely good cooperation among partners facilitated by an excellent management. More detailed information about the review in section 2.1.2 “Project review details” of this document.

An amendment needs to take place in order to introduce a number of changes that are happening in the Consortium as the replacement of Fagor Electrodomesticos by Fagor Electronica, the split of Ford into Ford + HSMMI, the replacement of Outokumpu Steinless by Outokumpu Chrome and the replacement of Personal Space Technologies by PS-Tech. Amendment on going.

JUGA has been signed and project has entered into force on 13/12/2013.



COPCAMS 1/04/2013 N.A.

2nd

half May 2014

Project is progressing (first due deliverables already received) although with some difficulties. Three partners want to withdraw from the project: ASLV, BS and ST-France who is the platform provider (multicore STHORM). The solution found by the Consortium to overcome this major issue is that the coordinator (CEA), who was also involved in the development of the chip together with ST, will support and even continue the development of the chip. The extend of this statement still needs to be clarify by the Consortium as well as how the whole exploitation plan of the project would be affected by this situation. Amendment still on preparation by the Consortium.

JUGA has been signed and project has entered into force on 02/12/2013.

With-Me 1/6/2013 N.A.

June / July 2014

The project is progressing well. An amendment needs to be done in order to reflect withdrawal of Spanish partner La Factoria.

JUGA has been signed on 6/12/2013. Project has not yet entered into force (no A3 forms received).

E-SCOP 1/03/2013 N.A.

March 26th

2014 The project is progressing well.

CONCERTO 1/05/2013 N.A.

May/June 2014

The project is progressing well.

ACCUS 1/06/2013 N.A.

June/July 2014

The project is progressing well technically. Small consortium changes after EoN with no practical influence on the technical work – two partners withdrew, one joined the consortium and the TA has been updated accordingly. After the consortium has been stabilized, the JUGA was finally signed on 18/12/2013.



HoliDes 1/10/2013 N.A.

Q4 2014

Project has started on 1/10/2013. The kick-off meeting of 22-24 October was attended by representatives from the JU and DLR. JUGA is signed and project entered into force 19/12/2013. 1 partner in Germany (Bosch) has been replaced (by Takata).

End of projects

The eSONIA project ended on 28/02/2013 and the final review was held on 27/02/2013 in

Turin (Italy). The review showed excellent project results with very good perspective for

exploitation. Good improvement in the dissemination activities for the last year of the project.

The SMARCOS project ended on 31/03/2013 after 3 months extension and the final review

was held on 14/03/2013 in Brussels. The review panel concluded that the project has

delivered good results although two deliverables need to be resubmitted and the exploitation

plans for several partners need to be better defined in the due final deliverable. A positive

aspect of the project is the decided open source approach that needs to be made more visible

to the Communities.

The RECOMP final review was held on 21/03/2013 in Brussels. The project ended with very

good results, which were demonstrated during the review. The project objectives were largely

achieved; the partners reached a common cross-domain understanding of the processes and

requirements regarding the certification for trusted multicore platforms. The consortium did

extra work beyond the TA; the dissemination strategy was comprehensive and effective,

which gained high visibility of the project.

The SMART project was officially completed on 31 Jan 2013 following an extension of 9

months. The final review was held on 19/04/2013 at Hellenic Aerospace (near Athens,

Greece) showing good results. The scope of the project was reduced due to numerous funding

problems. Given the circumstances, the consortium took the correct approach to show the

functionality in different smaller demos. Clear commercialisation opportunities were showed

by several partners.

The iFEST project ended on 31/05/2013 after two months extension. The final review held on

27/06/2013 in Brussels showed excellent results. Special attention should be given to the

exploitation activities of the project where several members of the Consortium are setting up a

Joint Venture (Open iFEST) to exploit the project results. Standardization related activities

were also another important aspect of the project, in particular within the OSLC Community.

The project has filed two US patents.

The final review of the SIMPLE project was held on 2nd

and 3rd

July 2013, in Verenje,

Slovenia. SIMPLE has developed an impressive technology with far-reaching applications

impact, for WSNs in general. Work on the project has already allowed one participant to have

their RFID tag products adopted by DHL for a cold-chain guaranteed shipment service, while



another partner reports having set up a spin-off company to further develop and market

consulting services around the (Open-source) SIMPLE middleware platform.

The final review of the SMECY project was held at CEA on 04/04/2013 in Grenoble

(France).Overall the project has made good progress towards achieving its final technical

objectives, showing improved focus and integration over the final period of the project. The

production of a book describing the achievements of the project is an excellent outcome for

which the partners are to be commended. Most of the partners have identified the exploitable

results and how they will use them. Some partners will continue their collaboration in other

projects, like COPCAMS and PaPP.

The ACROSS final review took place at the ARTEMIS premises in Brussels on July 25th

2013. The project objectives, as stated by the TA have been largely achieved. All WPs have

been successfully finished on time and their results have been presented in the deliverables

and at the project final review. The quality of results is good and they are promising. Strong

coordination and integration of project work packages and activities has been demonstrated.

The work has gone without significant deviations from the objectives set in the work plan and

the partners contributed to the project activities as a coherent team.

The final review of the POLLUX project was held in Toulouse on the 23-25 September in the

frame of the NESEM Conference. The review confirmed that the project has fulfilled its

objectives. The project showed a large number of Supply Chains (SC) clusters with relevant

technology development. In addition several demonstrators were given: 5 electric cars

(including an already commercialized hybrid car) each equipped with some technology

development occurred within the project. These 5 electric cars constitute the validation

platform of the POLLUX innovation .

The R3-COP final review took place in Stuttgart on October 30th

- 31st 2013. The conclusions

of the review panel are that the project made an excellent progress. The developed technology

has been successfully implemented in a number of demonstrators. The project has contributed

to the state-of-the art within several area among them 3D vision and perception, vision-based

navigation, etc…. A larger focus on dissemination in early project phase could have benefited

the overall research community but the exploitation plans are concrete and convincing.

The ME3GAS project final review was held on the 21st and 22

nd November 2013 in A Coruña

(Spain). While the consortium had to face a number of administrative issues since the start of

the project and in particular the withdrawal of partners, the contributing partners have all

worked substantially toward meeting the project’s ambitious objectives. The business

opportunities are in particular well elaborated with clear output regarding existing

opportunities in the professional market, while potential opportunities for addressing the

domestic market have not been explored in a similar level of detail. Despite the difficulties

encountered, the project was successful at its finish.



2.2.6. Innovation environments

To support the (non-R&D) activities of "Innovation Environments", as described in the

ARTEMIS-SRA and MASP documents, ARTEMIS-IA operates a number of "Working

Groups" (WGs) that are contributed to on a voluntary basis by members of the ARTEMIS

community. These WGs are followed by the Programme Group of the ARTEMIS-JU, to

assure synchronisation of strategies between these non-R&D activities and the general

running of the ARTEMIS-JU programme.

WG-SRA Responsible for the ARTEMIS technical programme

WG-Success

Criteria and

Metrics

Proposes methods for measuring the progress of the programme

WG-Tool Platforms Proposes measures for the community of tool developers to

synchronise their work

WG-SME

Involvement

Proposes and monitors measures for constructively enrolling SMEs

into the innovation cycle

WG-CoIE Proposes structures to stimulate the emergence of "Innovation Eco-

systems"

WG-Standards Proposes strategies for augmenting European industrial influence on

and participation in international standards.

WG-Education and

Training

Proposes measures for augmenting the interactions between academia

and industry

WG-Repository

Defines and maintains an on-line resource that collects output from

ARTEMIS projects and makes these available to researchers, system

developers and commercial exploiters of the results.

WG-

Communications

Has the charter to reinforce and harmonise the communications

activities of both ARTEMIS-IA and the ARTEMIS-JU through a

common Communications Strategy (document).



WG-SRA. In 2013, this working group has, as there can be no ARTEMIS Call in 2014,

focused on preparing the Embedded Systems contributions to the work programme related

documents for the upcoming ECSEL JU. This covers a completely reworked version of the

MASP, delivering the ARTEMIS contribution to the MASRIA to be proposed by Industry to

the ECSEL JU, as well as a descriptive update of the ARTEMIS SRA to match.

The WG-SC&M followed up on the preliminary report (published in book form in 2011) by

initiating a second questionnaire. This questionnaire had been extensively re-worded, in 2012,

taking into account the experience of the first one, in order to achieve increased participation

of the community of projects it was sent to, as well as to obtain more explicitly usable results

(for example by limiting the amount of unstructured feedback on open questions by using a

multiple-choice format). Response from the community was good, and the full analysis of the

findings of this action was published in book form in 2013. This is too voluminous to repeat

here, but the full publication can be found at http://www.artemis-ju.eu/publications.

The WG-Tool Platforms aims to address the fragmentation of the both the supply market and

the research executed in Europe on system design tools and methods. To that end, it had

published a "strategy and implementation" document that identifies a strategy and the key

labelling criteria for candidate tool-platforms (a tool platform can be likened to a specific type

of CoIE). In 2012, the first Tool Platform label was accorded to the Reference Technology

Platform developed in the ARTEMIS CESAR project. The RTP and IOS, originally

developed in CESAR, are extended and complemented by developments in iFEST, MBAT,

CRYSTAL, SAFE, HOLIDES and others.

The CESAR dissemination and business plan foresees two flavors building on the same

Interoperability Specification (IOS),

CRTP: Collaboration RTP for use in R&D, prototype implementations, integration /

compliance tests, IOS extensions,…

IRTP: Industrial RTP for commercial / industrial use with various implementations by

Tool Vendors, In-House developments of End-Users, etc. possible.

The CRTP is to be hosted by EICOSE with objectives to:

Be the catalyst of the CSE (Critical Systems Engineering) tool development eco –system

Sustain R&D Results and Collaboration beyond projects

Sustain Interoperability Specification IOS

Legal issues however need to be sorted out, since many project results are not (yet) in the

public domain and can therefore not be part of the CRTP in its present form. A proposal to

improve this is in preparation.

WG-Standards: Continuing from the successful adoption, reported in previous Annual

Activity Reports, by ARTEMIS-IA of the “Strategic Agenda for Standardisation document

for ARTEMIS” (that aids the ARTEMIS programme in evaluation of project proposals that

involve standardisation activities), , one of the main topics of action in 2013 has been the IOS

standardisation. This is closely related to the CESAR RTP (Reference Technology Platform).

OSLC/OASIS standardisation activities are based on CESAR results.

http://www.artemis-ju.eu/publications



Several well-attended meeting have been held (Vienna, Brussels). Three WG’s interact on

IOS standardisation. Preparations for, a support action have been started. A questionnaire to

investigate more closely the standardisation activities in projects has been set-up and will be

executed in 2014.

The WG-Education and Training: Contributions to the last ARTEMIS WPs, MASP and

SRA: E&T part of the „Innovation Ecosystem“, key to sustainability. Linking with projects:

e.g. the ARTEMIS projects MBAT, SafeCer and R3-COP have some E&T focus (in SafeCer

even an „E&T use case“) to provide guidelines, tool-subsets for E&T to promote use of

project results.

WG-Repository: In 2010, the WG-SRA had organised a meeting that made a first survey of

the programme execution and of the experiences of participants, especially SMEs, which

highlighted the strong need for easy access to information about (the results of) previous

collaborative projects in order to better establish a “state of the art” for new proposals and to

provide pointers to interested parties on how to access these results. To achieve this, the WG-

Repository was established in 2011. The WG has defined an implementation, selection and

maintenance policy, as well as clear rules that protect the IPR of the originator yet give

visibility to the results. In 2012, initial work to produce a demonstrator tool to allow a data-

base of project information to be consulted in a structured manner was started. Realising that

this work was in many ways common to a similar activity being undertaken by the ITEA2

office (with who the ARTEMIS-IA office shares an IT infrastructure), and with a view to

possible future collaboration on this tool, the activities were linked so as to share a common

(though still separate) data base structure, while each organisation would develop its own

interface layer, best adapted to the needs of each community. This prototype tool was

demonstrated to “Sherpa-like working group” and some representatives of the ARTEMIS

PAB, and at the ARTEMIS-ITEA Co-summit. Sadly, due to major structural changes in the

company leading this WG, further work to develop the processes for accepting data into this

tool was delayed. During 2013, the technical development work was completed and a start

made on getting a meaningful set of data loaded into it. The tool was demonstrated informally

at the CoSummit 2013, in anticipation of full release early in 2014.

WG-Communication: While no formal meetings of this group were held in 2013, work

continued and expanded along the strategic lines previously developed by it.. In particular, the

focus on “community building” was initiated, with the formalisation of “digital

communications” as part of the general strategy for dissemination, in particular extending the

use of some social-media based activities (a LinkedIn group, a You-tube channel, and Twitter,

used at specific events…), The WG will become particularly important in assuring the

continuation of communication about the already running ARTEMIS projects in and after

2014.

2.2.7. Relations with EUREKA/ITEA2

In 2013, intensive contact was maintained, primarily focused around the very successful

CoSummit that took place in Stockholm, in December 2013. As before, a programme

management team comprising representations from ITEA, ARTEMIS-IA and ARTEMIS-JU

met regularly by conference-call in order to agree all messages and aspects of the event.

In addition, the work of the AICC “Sherpa-Like” working group was continued to assure a

publishable version of the Vision 2030 document. This has been augmented with information



from an extensive survey carried out by the Roland Berger Company on behalf of ARTEMIS-

IA, covering the economic aspects of digital technology. This publication is also available at

http://www.artemis-ju.eu/publications.

2.3. Set up activities and organisational achievements 2.3.1. Operations of the JU bodies

The running of the Governing Board (GB) and the Public Authorities Board (PAB) continued

smoothly during 2013.

The Governing Board hold two meetings in 2013 while the PAB met three times.

The Industry and Research Committee (IRC) hold two official meetings.

Appendices 3, 4 and 5 (section 4) list the members of the three governing bodies of the

ARTEMIS JU as of 31 December 2013.

2.3.2. Service Level Agreements/MoU

One Service level Agreement was signed by ARTEMIS in 2013:

Service/DG Content Date

DG BUDG Amendment to ABAC SLA 04.07.2013

2.3.3. General Financing Agreement

A General Financing Agreement (GFA) between the EC and the ARTEMIS JU was signed on

17 October 2009 determining the modalities and conditions applicable to the Union

contribution to be provided to the Joint Undertaking and other items defining mutual rights

and obligations as considered appropriate by the parties.

Administrative Agreements

An Administrative Agreement was signed with the Walloon Region (Belgium) in April 2013.

2.3.4. Internal Control

In April 2013 the discharge was granted by the Budgetary Authority to the ARTEMIS JU

Executive Director for the financial year 2011.

2.3.5. Personnel

A new Secretary started in January 2013, filling a position vacant from October 2012.

In August 2013, Eric Schutz, ARTEMIS Executive Director, reached the age of retirement.

As of August 1st, he was replaced by Alun Foster as Acting Executive Director. Eric Schutz

continued to support the ARTEMIS Joint Undertaking in the quality of Special Adviser to the

JU.

http://www.artemis-ju.eu/publications



3. MANAGEMENT, COMMUNICATIONS AND INTERNAL CONTROL

ARTEMIS is a public-private partnership (PPP) between industry and other research actors in

the field of embedded systems, as represented by the ARTEMIS-IA association, the Union

and now 23 States (21 EU Member States, Cyprus having decided to no longer participate,

and Norway. Belgium finances participation separately for Flanders, Brussels and now also

Wallonia). On the other hand, the Joint Undertaking is set up as a Community body as

referred to in Article 185 of the Financial Regulation. Being a Community body does not

however mean that a JU is a Community agency since its objective is to create a public-

private partnership10

. In practice, however, Joint Undertakings are often assimilated to

regulatory/traditional agencies as evident, for example, from their financial rules.

In this context, the management of the JU presents several challenges. Firstly, it should

facilitate the process of identifying the common ground and building consensus among this

broad partnership; this is essential given the overall operational objective of ARTEMIS,

which is to align the Union and Member States activities to co-finance a strategy and

programme developed by industry. This means that the JU has an important role to play as the

"honest broker".

Secondly, the co-existence of industry and the Union in the same body needs to be carefully

managed. The Community body status of the JU results in a number of rules, e.g. for finances

or for staff, that may often seem as too bureaucratic to industry; on the other hand, the

Commission is reluctant to make any concessions that could seem to compromise rigour in

the management of public funds. It is therefore of extreme importance that the right balance is

struck so that both the private and public parts of the partnership feel at ease; or else the

whole concept of PPPs under Union law is put in doubt.

Thirdly, ARTEMIS is fully dependent on its Member States' annual commitments for

determining its annual R&D budget (which equals 55% of the sum of national commitments).

These commitments should be in appropriate amounts that reflect a country's weight in

embedded systems R&D and allow consumption of the earmarked Union budget. This is

important to minimise the risk that some partners in selected projects are left without national

funding. Although the JU does not play a direct role in determining these annual national

commitments, it plays coordination and communication roles that are very important; it

should thus take all actions under its responsibility to encourage balanced budget

commitments by Member States. The introduction of the concept of AIPPs (ARTEMIS

Innovation Pilot Project) has been an initiative of the Joint Undertaking’s Executive Director,

further successfully developed by the Industry, through ARTEMIS-IA.

A fourth challenge relates to the leanness of the JU organisation. This is by design: the

ARTEMIS model relies on the financial processing and verification operations of national

administrations (see section 3.2), whereas some services functions such as communications,

internal audit capability may be outsourced to private organisations.

As a result, the number of staff needed was around 10 by end 2009, rising to no more than 13

in 2012. The fact that the majority of running costs (including salaries) is to be contributed by

the private partner reinforces a constant vigilance for avoiding any hiring that is not essential.

On the other hand, ensuring all the functions and procedures implied by the Financial Rules,

10

see section 5.1 in SEC/2007/692



the Staff Regulation, the Implementing Rules, etc. to obey all the very many rules of a Union

Body with just 10 or even 20 staff is not obvious. Management needs to constantly show

creativity in optimising procedures in order to ensure not only effectiveness but also

efficiency, retaining only activities that have a clear added value.

3.1. Management as autonomous entity

As from October 26th

2009, the ARTEMIS JU operated in a fully autonomous way, while the

coaching of the Commission staff previously reported during the first months of autonomy

dropped to zero, as was planned. With a staff of 13 people in total, all needed financial

transactions (payment of salaries, payments to project participants…) could be made

according to the Financial Regulation, with all financial circuits being defined, including the

necessary back-ups. This strict compliance with the Financial Regulation and its

Implementing Rules has been kept, by the whole team, as a first and mandatory objective.

Besides the necessary standard control procedures, a major management concern has been to

further motivate the team and increase its cohesion and motivation. Therefore, regular staff

meetings have been organized, complemented by off-site events, mainly focused on the

interaction processes between the members of the team. All these exchanges have created a

team culture, which, combined with an increased motivation, guarantees an optimal

functioning, with minimal resources. Between the members of the team, avoidance of

information retention has been established as a fundamental rule.

3.2. Collaboration with ARTEMIS Member States

Collaboration with and between ARTEMIS Member States and the EC in 2013 was excellent,

continuing in the same line since the establishment of the JU. As in previous years, the result

of this collaboration was the integration of all national requirements and rules in the Call. For

the Call itself, and according to the evaluation and selection procedures of the JU, national

authorities intervened for verifying the national eligibility criteria for funding and the legal

and financial viability of project participants and generally provided the results back to the JU

in a timely fashion. In addition, for the Call of 2013, use was made of a new “voting”

mechanism that gave the participating countries (including the EC should they so wish) an

objective possibility to influence the ordering of projects to be selected for financing. During

the project negotiation stage, the well-established and strong interaction between the JU and

national authorities continued, to ensure that changes in project finances or partnership are

accepted by all parties and that the ARTEMIS JU and the national grant agreements will be

coherent.

This method of implementation has several advantages: it allows for a lean administrative

structure for the ARTEMIS JU, is not disruptive for national administrations, and uses

contractual models that are familiar to the R&D actors. It should also be very cost-effective as

it avoids duplication of evaluation and technical review procedures and of checking cost

claims or the financial viability of partners. In addition, efficiency is enhanced by the JU

making use of various EC services, through SLAs, for example for payrole (DG-HR), and

particularly for the financial system ABAC (DG-BUDG). Collaboration with these services,

as well as with the operational DG CNCT, has remained at a very satisfactory level

The collaboration between the JU Office and the ARTEMIS Member States continued in

general to go very well, with open and frequent communications between all parties. In 2013,

many more ARTEMIS projects from Call 2008 and Call 2009 came to end, which confirmed,



to a greater extent than anticipated, the diversity of the processes used in the various

ARTEMIS Member States for the finalisation of their contracts regarding the final cost

analysis and ex-post audit certification by the Member States.

3.3. Collaboration with the Industry Association

During 2013, the continuous interaction continued between the JU team and ARTEMIS-IA in

support of the renewed SLA(*) which exists between the JU Office and the Industry

Association for Communications activities. Intensive collaboration contributed to the success

of the many events during the year: the ARTEMIS Spring Event, the ARTEMIS Summer

Camp, the ARTEMIS-ITEA2 Co-Summit, etc… Coordination of these many

Communications activities and their associated publications was assured through weekly

conference-calls and monthly bi-lateral meetings (in Eindhoven or Brussels) between the

Programme Manager and the relevant actors and decision-makers at ARTEMIS-IA.

Besides these communication activities and the support and participation to the SRA

development, the Programme Manager and Programme Officers of the JU participate in all

working groups of ARTEMIS-IA and attend, where possible, the various events organised on

behalf of the industrial participants in the programme. In that way, there is a permanent

interaction between the JU and the Industry. This is important, also to ensure mutual visibility

on the technical aspects of the programme and its execution: it has been a major contributor to

the remark that ARTEMIS is visible as a Programme, rather than as a collection of projects.

This is a strong feature of the PPP configuration that can serve as a reference for future

initiatives.

(* For reference, the Communications Strategy of the ARTEMIS-JU relies on close

cooperation between the private and the public members. To that end, an annually

renewed SLA between the JU and the Industry Association covering Communications

activities was put in place.)

3.4. Budget, commitments, transactions The following table shows the commitment credits implemented by the ARTEMIS JU for

Operational Expenditures:

Budget Position

B0301 Call 2008 (*) 30,782,285.90

Call 2009 37,086,500.00

Call 2010 36,000,000.00

Call 2011 26,000,000.00

Call 2012 (**) 49,776,833.15

Call 2013 30,343,708.83

Totals 209,989,327.88

(*) includes only the RAL transferred by the EC (**) includes 10.2M of carry forwarded amounts from calls 2010 and 2011

All the details concerning the Budgetary and Financial transactions of the ARTEMIS JU for

the year 2013 are given in Appendix 1.



For the year 2013, it was agreed between the Commission and ARTEMIS-IA that all

administrative expenditure (running costs) would be paid according to the following

repartition: ARTEMIS-IA 1.6 MEUR and the European Commission 0.7 MEUR. At the end

of the year the needs of ARTEMIS JU for administrative expenditures reached 2.1M and as a

consequence the contribution from the European Commission was limited to 0.5M EUR.



3.5. Communication

3.5.1. GENERAL

In the 1st quarter 2013, the main activities were:

• ARTEMIS Brokerage Event – London

• Setting-up Call 2013 folder & webpages

• Realisation of ARTEMIS Book of Successes

• Local Brokerage Events / workshops for Call 2013

• ARTEMIS Spring Event > Information Day – Brussels

• ARTEMIS Spring Event > ARTEMIS Successes – Brussels

In the 2nd quarter:

• the production of the ARTEMIS Magazine #14

• organisation of the ARTEMIS Post-Brokerage for EoI Event 2013 – Brussels

• organisation of the Co-summit 2013 – Stockholm

• organisation of the JTI-Event 2013 – Brussels

In the 3rd quarter:

• the production of the ARTEMIS Magazine #15

• the organisation of the Co-summit 2013 – Stockholm

• the organisation of the JTI-Event 2013 – Brussels

In the 4th quarter:

• Running the JTI-Event “Innovation in Action” 2013 – Brussels

• Running the Co-summit 2013 – Stockholm

• the participation of the ICT2013 – Vilnius

The Communications & PR activities in support these events and activities were coordinated

through regular (monthly) meetings between the JU Communications responsible and the

team in ARTEMIS-IA.

3.5.2. EVENTS

3.5.2.1.ARTEMIS Brokerage Event for Call 2013, 15 & 16 January – London,

UK

An important and key activity in the first quarter of the year is the promotion of

the ARTEMIS Call 2013. The Call was launched on 26 of February with an

accelerated cycle and closed on 06 June 2013. On 23rd

April a meeting was

organised to provide for summary feedback on the Expression of Interest (EoI)

phase. In January, the ARTEMIS Industry Association organised the “ARTEMIS

Brokerage Event”. Following this, National ARTEMIS Brokerage events were

organised by the respective national platforms in cooperation with ARTEMIS

Programme Officers. There were 216 participants.



Next to 10 National Contact Points and 7 Associated partners and 4 persons

in the category ‘others’ we had: 61 from LE, 38 from SMEs, 48 from

Research Organisations, 59 from Universities and 47 Non-Members (so

affiliation unclear).

The statistics and follow-up evaluation for this event are given here, summarising also the events from

previous years. The high appreciation of the ARTEMIS community for the quality and content of this

event is evident from the 92% score.

Participants Brokerage 2013 Electronic evaluation

Registrants 227 2013 2012

Participants 216 Overall impression 3.6 3.4

Call 2013 Call 2012 Call 2011 Plenary opening 3.7 3.5

Large enterpr: 61 (35 org.) 50 (27) 37 (26 ) Plenary project pitch 3.5 3.4

SME’s: 38 (28) 36 (32) 39 (29) Poster session 3.2 3.1

Research org. 48 (28) 53 (32) 55 (32) Breakout session 3.3 2.9

Universities: 59 (40) 62 (35) 90 (44) Location 3.2 4.0

Non-Member: 47 (42) 52 (48) 58 (50) Reached its goal 92% 90%

In addition to this core event, other local brokerages were held:

- ARTEMIS Local Brokerage/Workshop in France organised by DGCIS at Ubifrance in Paris

(04.02.2013)

- ARTEMIS Local Brokerage/Workshop in Austria organised by AIT in Vienna (12.02.2013)

- ARTEMIS Local Brokerage/Workshop in Finland organised by TEKES in Helsinki

(13.02.2013)

- ARTEMIS Local Brokerage/Workshop in Belgium organised by IWT and Sirris in Brussels

(04.03.2013)

3.5.2.2.ARTEMIS Call 2013 Info Day, 13th March 2013 – Brussels

ARTEMIS Joint Undertaking held its international

ARTEMIS Information day for Call 2013 in Brussels as

part of the Spring Event 2013 (13.03.2013). For both days

in total 169 visitors participated in Spring Event; 10

National Contact Points, 9 Associated partners, 46 LE, 23

SMEs, 30 RO, 29 UN and 49 Non-Members.

During the ARTEMIS Information day participants were informed about Call 2013, procedure for

Expression of Interest (IoE) including feedback, how to find partners, consortium agreement etc.



New at the ARTEMIS Information day was the presentation about the Communications Support & the

online community – with a ‘live demonstration’ of a LinkedIn posting. Key message focuses on the

deliverables of ARTEMIS and the framework ARTEMIS provides to starting consortia – all facing the

ARTEMIS branding – to keep the message clear. Next to the ‘static approach’ based on branding and

corporate identity – the ARTEMIS online community was discussed and introduced. The ‘dynamic

approach’ focuses on the social media in which ARTEMIS is active in 3 channels: LinkedIn, YouTube

and Twitter – with an invitation to join actively; by posting news, films, events, message & respond on

others.

3.5.2.3.ARTEMIS “Post-Brokerage Event” for Call 2013, 23rd May – Brussels

An important and key activity in the second quarter of this year– next to the promotion of the

ARTEMIS Call 2013 – is the feedback on the Expression of Interest (EoI).

On 23 April, during the ARTEMIS-JU Post-Brokerage for Expression of Interest (EoI) –

organised in the White Atrium in Brussels – project proposers had the possibility to meet and

discuss the feedback they received on the Expressions of Interest (EoI) with the ARTEMIS-

JU Programme Officers on an individual basis.

The event also offered a forum to proposers to present their ideas and needs to enroll

additional partners to the community present. There were also timeslots available for the

participants to briefly present themselves as candidate partners. The Post Brokerage event had

been aligned with the similar ‘Consortium Building event’ of the ENIAC Joint Undertaking,

on Wednesday 24th April at the same location, with a common networking evening held on

April 23rd.

ARTEMIS-IA had set-up the following:

- Event webpages, including registration page

- Pre-announcement Post-Brokerage

- Invitation Post-Brokerage, including registration

- Reminder Post-Brokerage

Participants Post- Brokerage 2013

Registrants 112

Participants 95

Countries 17

NCP: Netherlands, Latvia, Czech Rep.

Large enterpr: 21 (16 org )

SME’s: 15 (12)

Research org. 23 (18)

Universities: 18 (15)

other (NCP , Association) 18 (16)

Non-Member: 38 (34)



3.5.2.4.JTI Event 2013, 30 September – 04 October, European Parliament

Brussels, Belgium

This (up to now) bi-annual event, organised together with the five Joint Technology

Initiatives – Clean Sky, Innovative Medicines Initiative, Fuel Cells and Hydrogen, ENIAC

and ARTEMIS – is a joint event on the future of R&D and innovation in Europe. The event

took place at the European Parliament and included an exhibition and thematic panel debate

session. The event was hosted by MEP Ms. Carvalho and MEP & Chairman of STOA Mr.

Antonio Fernando Correira de Campos.

The event was mentioned to be successful in Brussels. In the ARTEMIS Magazine #15 one

can read a detailed report upon the event.

To improve the recognition of the event and showing it’s a follow-up of the Joint Technologies event

of 2011, all Communications & promotions materials for the 2013 event were designed and produced

in the same format and highlighting the theme “Innovation in Action”. ARTEMIS undertook the

development, design and production of the promotion materials on behalf of all involved JTIs.

The following items were produced:

• Web elements (side banner, button, and header)

• E-invitation with announcement for event

• A3 posters for announcing the event

• PowerPoint Template – for presentations during the press breakfast

& panel discussion

• Hand-out with – programme and agenda

• Programme poster, including agenda

• Penguin

• Badges for crew members only

The announcement, including the e-invitation of Innovation in Action was sent in April. Beginning of

September the invitation including a collective registration was send to a select group of invitees. For

the ‘on invitation only’ VIP lunch on 2 October – the invitees received a personal invitation. The press

contacts received an invitation for the Press Breakfast. After the Press Breakfast the press release was

disseminated on 02 October 12.00 hours.



To inform all target groups on the most up-to-date programme, a webpage

was made.

All registrants have received a confirmation for participating in the JTI

Event.

ARTEMIS had a booth for 5 days at the ground floor of the European

Parliament – at the ASP building. ARTEMIS main message during the JTI-Event focused on: Past-

Present-Future. Therefore ARTEMIS Successes were highlighted in the booth with roll-ups –

presenting the successes: AIPPs, CoIEs and Tool platform. The future message focusses on the merge

with ENIAC JU.

3.5.2.5.ICT 2013, Create Connect Grow, 06-08 November, Vilnius – Lithuania

ICT2013 was a mega event organized by the European

Commission with over 5.000 visitors from all over

Europe. At the ICT2013 exhibition the ARTEMIS booth

of 12m2 was fully staffed for the two and a half days of

the event. The successes of ARTEMIS were presented at

the booth by means of four roll-ups, a rolling presentation

and a special flyer made about the ARTEMIS Innovation Eco System. Many questions about

ARTEMIS and future ECSEL were answered from a continuous stream of interested people at

the ARTEMIS booth. A successful networking session of ARTEMIS with EPoSS about

ECSEL was organized, which attracted many participants (far too many for the room size!)

ICT2013 brought together Europe's best & brightest in ICT research, with businesses old &

new, web start-ups and digital strategists to chart a path for Europe's ICT research policy.

ARTEMIS participated with a booth (also providing local support for ENIAC). The booth

focused on the ARTEMIS Successes as a programme. The application for an ARTEMIS

Networking session was withdrawn: an alternative had been submitted via the Commission.

The general ARTEMIS message has been fine-tuned specifically for this event:

“Research and innovation are critical for creating new, sustainable jobs and economic growth, to

improve quality of life and to boost Europe's global competitiveness. Partnerships between EU

Member States, EU-industry and European Commission, implemented as Joint Technology Initiatives

(JTIs), are the most effective way of boosting Europe’s electronics design and manufacturing

capabilities in economic sectors such as cars, planes, trains, medical equipment, home appliances,

energy networks and security systems. Between 2008 and 2012, the ARTEMIS JU has achieved; 52

projects worth 935 M€ with public funding 448 M€ (EU + Member states) involving more than 720

organisations (with more than 1200 project participations) of which around 39% are SMEs, 33% large

enterprises and 28% research organisations. In 2014 the JTI’s ARTEMIS, ENIAC and EPoSS will join

forces and merge into, one stronger JTI on Electronic Components and Systems called ECSEL

(Electronic Components and Systems for European Leadership).”

3.5.2.6.ARTEMIS-ITEA Co-summit 2013, 4-5

December Stockholm, Sweden

The Co-summit is the largest ARTEMIS event of the year, and it is a

major high level event with significant exposure. More than 700

participants from all over Europe are generally expected at these “Co-

Summits”. The main target group is the public authorities. The



Programme Committee in which the Executive Director and Programme Manager participate

on behalf of the ARTEMIS JU defined the concept and the joint theme: “Software

innovation: boosting high-tech employment and industry”.

This annual event organised together with ITEA 2 and it is by far the biggest event for

ARTEMIS. The event is an important showcase of the ARTEMIS projects to the ARTEMIS

community and the public authorities, with ARTEMIS presentations and an exhibition space

for 27 projects, including a ‘Walk of Fame’ for the 12 projects completed in 2013 and earlier

ARTEMIS Recognition Awards.

In both the special focus area and the general exhibition

floor for ARTEMIS projects, a novel and effective

layout has been used. In order to provide both high

visibility to the project results and to encourage

networking, a layout using triangular “pillars” was used

in the central floor area, with well-spaced, flat-sided

booths around the perimeter. This invention of the

ARTEMIS communications team was shown to be

highly effective in attaining the desired community

interactions. Feedback from stand personnel and

visitors alike was highly positive about this innovative approach.

Just as the previous year, an extra ARTEMIS

action was involved in extending the set-up for

the ARTEMIS Community Session. Focussing

on the Special Focus Area theme – “Smart

Cities” – an interesting line-up of participants

took part in the vivid debate, moderated by Irene

Lopez de Vallejo. Patrick Pype held an

introduction speech on the theme, followed by

‘one-minute-elevator-pitches’ & ‘one-slide-

with-project-goals’ of: ACCUS –Santiago

Benito Gregorio, ARROWHEAD – Jerker

Delsing, DEMANES –Matthijs Leeuw and ENCOURAGE – Arne Skou. Everybody was

trained in advance, on their pitches and their slides, including a dry-run on 04 December.

The debate was followed by the ARTEMIS Recognition Award ceremony for all in 2013

completed projects – by handing over a personalised project Recognition Award. After the

Community Session a photo shoot for all 2013 Recognition Award winners took place in the

ARTEMIS Wall of Fame – including signing their ‘own-project-star’.

The set-up of the ARTEMIS exhibition (which appeared to be very successful in 2011 and

2012) was this year continued and is now a blueprint for the overall Co-summit exhibition set-

up.

The project CRYSTAL was granted the ARTEMIS prize for best exhibition stand, where the

main criterion is the clarity of the presentation of the work being done and the results

achieved. This year the way to cast the vote for the best exhibition stand was again via voting

terminals (the personal QR-code, printed on the Co-summit badges, could be used to login



onto the terminal system. In addition to the voting, it was also possible to on the terminal the

up-date programme information, to plan a tour at the exhibition and to find some extra

information concerning the exhibition).

The branding of the Co-summit in the ARTEMIS-ITEA community is becoming visible as

one could witness on the vivid and dynamic exhibition floor where the projects all together

could meet and match and where several project posters of ARTEMIS and of ITEA cross-

referenced projects, particularly in the Special Focus Area with the theme: “Smart Cities”.

New on this years’ Co-summit were the Speakers Corners, for which projects were invited to

prepare their own thematically session, including guided tours, by reserving timeslots. For the

exhibition of Co-summit 2013, a new approach will be offered by giving the entire projects a

bigger platform. In the afternoon of the first Co-summit day the exhibition hosted “speakers’

corners” in which project participants had the opportunity to give a 30 minutes presentation.

Additionally, extra guided tours were organised, aiming at the projects presented in the

speakers’ corners. These are all important elements for putting the projects even more in the

spotlight. Via a ‘Call for Submission’, executed in June, projects could apply and get

allocated stage time.

The Co-summit has been evaluated online. See below some details (e.g. number of

participants, etc.).



Press presence Co-summit

This quarter, the following press representatives were present at the Co-summit 2013 –

Press event, in Stockholm.



3.5.3. PUBLICATIONS

3.5.3.1.ARTEMIS Book of Successes

Designed as a “marketing” version of the Portfolio

Analysis executed in 2012, the ‘ARTEMIS Book of

Successes’ is a luxurious, printed summary of all

important success of the ARTEMIS JTI and goes more

in depth on the ‘specific topics of successes’ – all

addressing ARTEMIS and to show that ARTEMIS has

built a community and is more than a funding

programme. The success of ARTEMIS extends beyond

project results and especially the community that has

been built over the past 6 years with its CoIE’s, its Tool

Platform(s) and its the special big AIPP projects is an

achievement not to be ignored.

And showing these results are indeed unique achievements:

The “Make it happen” chapter of the SRA really is under implementation

An active R&D&I community has been built over the past 6 years around R&D

for embedded systems, where this was previously fragmented

ARTEMIS is decidedly “more than a funding programme”.



The original Portfolio Analysis document was also prepared for release and was published on

the ARTEMIS-JU web-site in 1Q2013.

3.5.3.2.Metrics and success criteria for ARTEMIS

3.5.3.3.ARTEMIS JU & IA Combi folder

Reprint of the existing ARTEMIS JU & IA Combi folder.

3.5.3.4.ARTEMIS Call 2013 Leaflet ARTEMIS Project Call leaflets & posters

2009/2010/2011/2012

For the promotion of the Call 2013 a special leaflet has been developed

and distributed at the Brokerage Event in London. A more detailed

explanation of the accelerated cycle is published in this leaflet, including

the calendar.

For call 2012 new posters & leaflets have been produced. For the calls

2010 & 2011 the posters & leaflets have been updated. All in 2013

completed projects got a poster in the ARTEMIS Walk of Fame,

The book “Metrics and success criteria for ARTEMIS”

represents a solid base for measurement of the ARTEMIS

achievements.

It has been established thanks to the dedicated

engagement of many volunteers, many individuals and

institutions affected by the ARTEMIS projects, their

feedback and impressions provide this representative

overview of the success achieved and prospects for

improvement for the road ahead…



including a ‘completed’ star and ‘star-floor-sticker’. The in 2011 & 2012 awarded projects

were also visible on posters.

Regarding the leaflets; the samples of each running project have been reduced to 50 samples

and of each in 2013 completed project have been reduced to 30 samples– by emphasising that

all leaflets are also available digitally on the ARTEMIS websites.

3.5.3.5.ARTEMIS Magazine #14

ARTEMIS Magazine 14 was produced in March-April- May and published in May.

The production of this Magazine is a joint collaboration with the

Industry Association. This magazine is the second issue with the

new design and look & feel. It has 48 pages including covers and

‘Spring Event 2013’ photo spread. About 20 pages are open for

ARTEMIS JU News and the ARTEMIS projects.

2000 Magazines are printed.

Magazines are posted to 700 contacts:

o ITRE, SME-NCP, EC, NCP’s, GB,

o Project leaders, Members of the Association.

Magazines will also be distributed at the

several local events and is distributed during the ARTEMIS-IA

Summer Camp in Madrid, Spain.

3.5.3.6.ARTEMIS Magazine #15

Edition number 15 of the ARTEMIS Magazine has been

produced and printed for publication in December. The

production of this Magazine is a joint collaboration with the

Industry Association. This magazine is the third issue with the

new design and look & feel. It exists of 48 pages including

covers and ‘JTI Event’ & ‘E-mobility Event’ photo spread.

About 20 pages are open for ARTEMIS JU News and the

ARTEMIS projects.

ARTEMIS Magazine #15 focuses on ‘High-Level Vision 2013

and the impact of software innovation on revenue and jobs in



Europe and is/was a preview of the Co-summit 2013. Next to that the magazine includes an

in-depth article of Smart Cities and an ARTEMIS-IA around the table article.

• 2000 Magazines are printed.

• Magazines are posted to 600+ contacts: ITRE, SME-NCP, EC, NCP’s, GB, Project leaders,

Members of the Association.

• Magazines will also be distributed at the several local events and is distributed during the

Co-summit in Stockholm, Sweden.

3.5.3.7.ARTEMIS-ITEA Vision 2030

The important “Vision 2030 – opportunities for Europe” report of the AICC was produced

and published in (printable) book form, for first release at the Co-Summit meeting in

Stockholm.

For the purpose of compiling this document, an extensive survey of the electronics and

software markets and applications was carried out, based on a survey by Roland Berger, in the

report “Global market for Digital Technology”, 2013 [RB2013]. Together with the report of

the WG Metrics described above, this report goes some way to addressing Recommendation

15: (for the JUs) of the Second Interim Evaluation report.

3.5.4. PR and PRESS

3.5.4.1.Press Releases

The press-releases issues in 2013 are listed below:

- Press release ‘Successful start for ARTEMIS Call 2013’ was distributed (January)

- The pre-announcement for the ARTEMIS Proposers Day was wired to the press database

(February)

- Press release ‘ARTEMIS Spring Event – story of successes’ was distributed (March)

- Interview ‘Systems of the future’ was published in the Pan European Networks, with theme

‘Government’ (#6, May 2013)

- Press Release “Time to ECSEL” to 100+ press contacts out of Press Database

ARTEMIS Industry Association

- Press Invitation “Innovation in Action to 100+ press contacts out of Press Database

ARTEMIS Industry Association

- JTI Event 2013, Innovation in Action press release

- Co-summit 2013, Pre press release



- Co-summit 2013, Vision 2013 press release

- Co-summit 2013, Post press release

- ARTEMIS Recognition Awards winners (during the Co-summit 2013); a press release

was sent out in the week of 16 December.

3.5.4.2.Press exposure

This quarter, ARTEMIS got the following press exposure:

PEN: Pan European Magazine

- “PEN speaks to ARTEMIS Joint Undertaking’s Acting Executive Director, Alun Foster, about

the programmes’ successes and how the field of Embedded Systems has developed: Embedding

Successes”.

- Co-summit2013_Pan European Networks_6-12-2013_Smart Cities

- Co-summit2013_PanEuropeannetworks_04-12-2013_Start Co-summit

- Co-summit2013_PanEuropeanNetworks_04-12-2013_Vision 2030

- “With ARTEMIS and the European Commission both devoting efforts to building smart cities,

Horizon 2020 Projects speaks to the Arrowhead project on implementing collaborative

automation technology”: interview with Jerker Delsing

- Co-summit 2013_ Pan European Networks_03-12-2013_Key meeting highlights importance of

innovation

- http://www.paneuropeannetworks.com/ST9/#50

- http://www.paneuropeannetworks.com/featured-post/key-meeting-highlights-importance-of-

innovation/

Research Media

After Co-summit Press Event – spread of 10 pages and interview with Alun Foster.

Bits&Chips (no. 9, 01 November – 13 December)

“Beeldverwerkingsketens bekijken met dezelfde bril”.

AUTOMA (12122013)

“Inovace softwaru jako příležitost pro vzdělané zaměstnance a pro rozvoj průmyslu”

Horizon 2020 projects (website)

http://horizon2020projects.com/il-nano-elec-photon-interviews/the-eu-next-system-in-

electronics/

http://horizon2020projects.com/pr-interviews/joint-partners-in-innovation/

http://horizon2020projects.com/il-ict-interviews/key-meeting-highlights-importance-of-

innovation/

http://horizon2020projects.com/il-ict/eureka-clusters-itea-2-fpp-call-closed/

http://horizon2020projects.com/il-ict/iteaartemis-co-summit-opens/

http://horizon2020projects.com/il-ict/itea-artemis-vision-2030-paper/

http://www.paneuropeannetworks.com/ST9/#50

http://www.paneuropeannetworks.com/featured-post/key-meeting-highlights-importance-of-innovation/

http://www.paneuropeannetworks.com/featured-post/key-meeting-highlights-importance-of-innovation/

http://horizon2020projects.com/il-nano-elec-photon-interviews/the-eu-next-system-in-electronics/

http://horizon2020projects.com/il-nano-elec-photon-interviews/the-eu-next-system-in-electronics/

http://horizon2020projects.com/pr-interviews/joint-partners-in-innovation/

http://horizon2020projects.com/il-ict-interviews/key-meeting-highlights-importance-of-innovation/

http://horizon2020projects.com/il-ict-interviews/key-meeting-highlights-importance-of-innovation/

http://horizon2020projects.com/il-ict/eureka-clusters-itea-2-fpp-call-closed/

http://horizon2020projects.com/il-ict/iteaartemis-co-summit-opens/

http://horizon2020projects.com/il-ict/itea-artemis-vision-2030-paper/



European Commission (website) https://ec.europa.eu/digital-agenda/futurium/en/content/artemis-successes

https://ec.europa.eu/digital-agenda/futurium/en/futurium-hexagon/artemis

https://ec.europa.eu/digital-agenda/en/content/action-129-key-transformative-action-pooling-

european-public-and-private-resources-micro-and

3.5.5. E-mailings

- ARTEMIS Brokerage Event: Note the date , invitation, reminder were sent out to 4000

contacts in the database of ARTEMIS Industry Association;

- ARTEMIS Spring Event: Note the date , invitation, reminder were sent out to 4000 contacts in

the database of ARTEMIS Industry Association

- ARTEMIS Local Brokerage Event: Announcement was send out to 4000 contacts in the

database of ARTEMIS Industry Association

- ARTEMIS Post Brokerage on EoI Event: Save the date , invitation, reminder were sent out to

2900 contacts in the database of ARTEMIS Industry Association;

- ARTEMIS Post Brokerage on EoI Event: registration confirmation, e-ticket were sent out to

100 registrants in the database of ARTEMIS Industry Association;

- ARTEMIS Communications Planning for Project leaders: message was send out to

27 contacts in the database of ARTEMIS Industry Association

- ARTEMIS JTI Event: Save the date, invitation, confirmation were sent out to 300+

(Save the date) and 120+ (invitation) contacts in the database of ARTEMIS Industry

Association;

- ARTEMIS Co-summit: Save the date and invitation were sent out to nearly 5000

contacts in the database of ARTEMIS Industry Association;

- ARTEMIS Co-summit – project preparations: Call for submission, Exhibition

Requirements, Project requirements (posters, leaflets and PowerPoint) were sent out to

all running ARTEMIS Projects: 27 contacts in the database

- ARTEMIS Co-summit – Recognition Award: Invitation to join the Award Ceremony

and Walk of Fame was sent out to all technical contacts of the in 2013 finished

ARTEMIS projects: 284 contacts in the database

3.5.6. Other Communications Tools

3.5.6.1.Roll ups

For emphasising the “ARTEMIS Successes” message – 4 roll ups were produced with all

focussing on a specific “ARTEMIS Successes theme”: ARTEMIS Innovation Eco-system,

ARTEMIS Innovation Pilot Projects (AIPPs), ARTEMIS Centre of Innovation Excellence

(CoIEs) and ARTEMIS Tool platform. Main purpose is to have a general approach on the

ARTEMIS Successes – and to stay aligned on the ARTEMIS Message – during all important

upcoming events; JTI Innovation in Action (Brussels, October 2013), ICT 2013 (Vilnius,

November 2013) and Co-summit (Stockholm, December 2013).

https://ec.europa.eu/digital-agenda/futurium/en/content/artemis-successes

https://ec.europa.eu/digital-agenda/futurium/en/futurium-hexagon/artemis

https://ec.europa.eu/digital-agenda/en/content/action-129-key-transformative-action-pooling-european-public-and-private-resources-micro-and

https://ec.europa.eu/digital-agenda/en/content/action-129-key-transformative-action-pooling-european-public-and-private-resources-micro-and



Based on the ARTEMIS Successes roll-ups a folder was produced with a

summary of the content.

3.5.6.2.Website

The structure and design of the ARTEMIS-IA web-site

has refreshed as part of an on-going implementation

process. During this time the website remains on line to

communicate with the ARTEMIS target groups.

The web-site of the ARTEMIS-JU has been updated such

that the common pages (such as “news”, “events”, ..) link

directly into the site of the Industry Association. This has

greatly simplified the task

of keeping the JU web-site

up to date, and relieves the

pressure on getting the

”look and feel” to be more compatible. The ARTEMIS-JU staff

have then been able to focus on maintaining the important legal

documents up to date on the site (Call information, PAB/GB

decisions, all key reference documents …) . The JU’s Legal

Officer and one Programme Officer have also been trained in

the use of the CMS and now contribute actively to the site

maintenance.

For events such as the ARTEMIS Spring Event / Proposers’



day complete websites were developed at the front end. The development of such a website,

including registration facilities and publication of the presentations, requires 40-60 production

hours. In addition to these tasks, the technical team also executes:

- Technical implementation of frontend components needed for the rendering of the new style

and layout of the ARTEMIS-JU website.

- Technical implementation of backend components to reduce maintainability and optimize

efficiency (e.g. data coupling component ARTEMIS-IA CMS to ARTEMIS-JU, which

reduces the need for manual synchronization between the ARTEMIS websites).

- Ad hoc support in content management activities (publications, complex HTML rewrite).

In addition to the technical work, much layout and special

graphic design has been needed, with many specific buttons

produced for the ‘slide scroll’ on the webpages of the Project

Calls and for the Co-summit website.

3.5.6.3.Artemis Repository Tool

Since the Co Summit of 2012 the activity working group repository has kicked up a notch: the

WG-Repository now has a new and active leader. Currently in development is the integration

of CESAR's Process4Exchange in the Repository tool and refactoring the version 1.0 of the

Repository Tool. This in order to allow the submission of project results by project

contributors in the interface and updating

the interface in order to allow better

dissemination of the public and

confidential ARTEMIS project results.

(Demonstrator version of the Repository

tool, already available on the ARTEMIS-

IA web-site.)



3.5.6.4.Event App

For the Brokerage Event an “event app” was developed and was visible on

smartphones, tablets, laptops and the presented screens, to make the

consortium building more interactive and to give an insight where ‘project

ideas’ were meeting.

3.5.6.5.ARTEMIS Power Point presentations

New Specific Call 2013 presentations were developed and are in use to spread the ARTEMIS

Call 2013 message via website and via face to audience presentations.

3.5.7. Communications activities by the Executive Director

1Q2013

Presentations and speeches at the ARTEMIS Spring Event (March 13-14)

Participation to an ARTEMIS-IA Presidium meeting focusing on the new JU

Participation to teleconferences with the ARTEMIS-IA Presidium

Participation to the Board of Directors meeting of Pictor (the Flemish ICT Platform)

on January 25th

2Q2013

Participation to the ARTEMIS Post-Brokerage Event on April 23rd

;

Participation to the event on "EU’S FUTURE STRATEGY FOR MICRO- AND

NANO-ELECTRONICS”, on May 29th

;

Participation to the ARTEMIS Summer Camp in Madrid on June 10-12th

;

Participation to teleconferences with the ARTEMIS-IA Presidium, mainly focused on

the Commission proposal for the new ECSEL JU;

Discussions with CNECT.A.3 about the new Commission Work Programme;

Participation to the Digital Agenda Assembly in Dublin, on June 19-20th

April.

3Q2013

Participation to the EC event launching the proposal for ECSEL JU (July 10th

);

Working Group SRA meeting (August 13th

+ 14th

)


ARTEMIS Austria meeting, Graz:

o workshop "Towards European Clusters of Design Centres for Embedded ICT"

organised by the European Commission

o Contributions to ECSEL vision

4Q2013

JTI event “Innovation in Action” at the European Parliament, with plenary

presentation (introducing ECSEL) and associated press interviews

Cyber-Physical systems event organised by the EC in Brussels: moderated the panel

on CPS.




CoSummit 2014, Stockholm, Speaking roles, including a Press Breakfast and several

press interviews.



3.6. JU staff and outsourcing A new Secretary started in January 2013, filling a position vacant from October 2012.

3.7. Internal Control Framework (ICF)

A revised ICF was approved by the Governing Board in its meeting of September 22nd

2010.

The ICF uses as starting point the current Commission control systems but is tailored to the

specificities and small size of the JU. It is based on the assumption that it has to be

progressive and evolve over time according to the operational needs and the volume of the JU

activities and in line with the Executive Director's assessment of risks.

On May 14 ARTEMIS Joint Undertaking received from IAS the final report on “Expert

Management Audit” with some recommendations and requesting the Joint Undertaking to

propose an action plan.

Three “important” findings were addressed in that report and other three were considered as

“desirable”. The important ones are:

1. Review the sensitivity of programme officer post.

2. Adopt confidentiality policy.

3. Review rules of workload allocation.



That report was sent to the Governing Board on May 15 and the Executive Director submit

the action plan to the IAS on June 3.

On June 11 the IAS has considered the Action Plan “adequate” and asked to be informed

about the follow-up of such Action Plan.

In addition, the following ICS were addressed:

ICS Action taken Next action

ICS4 –Staff evaluation and

development

The appraisal of the staff was

done with the inclusion of

the Career Development

Plan.

Progress in taking account of

the career development plans

ICS 5 – Objectives and

performance indicators

AAR 2012 includes a well-

defined organizational KPI

(TTG, TTP, number of

project reviews, number of

dissemination activities and

time to receive the End of

Project Certificates/Audit

reports from the National

Funding Authorities)

Because 2013 was the last

year with Calls on FP7, some

KPI need to be revised

ICS6 – risk Management

Process

Follow-up IAS observations,

introduction of annual non

conflict of interest

declarations by POs

Redeployment of resources as

necessary.

For the year 2014, the JU will give priority to the following ICS:

- ICS 2 –Ethical and Organisational Values

- ICS 5 – Update of organizational KPI;

- ICS 12 – Information and Communication.

Key Performance Indicators 2013

Time to pay: 95% of payments were done within the contractual time limits with a total

average (including 64 late payments) of 20 days.

Time to grant: This is the period lasting from the closing of the Full Project Proposal (FPP)

phase until the signature of the grant agreement as a standard measure to calibrate the

performance of the office.



The reason is double:

a) to harmonize the calls with a PO phase and the ones with no PO phase,

b) to clarify that after the End of Negotiation, the signature of National Grant

Agreements by the National Authorities with the coordinators, being an essential

requirement to sign the Joint Undertaking Grant Agreement, is not under the control of

ARTEMIS JU .

Year 2012 2013

Call 2011 2012

Days From FPP closing to End of Negotiation date. (average)

198

188

Days From FPP closing to Signature of Grant Agreement:

361 431 *

*The time to grant has increased with respect to last year due to higher level of

complexity for the first AIPPs negotiations (Arrowhead and CRYSTAL), in particular

with respect to the large number of participants. An internal procedure has been put in

place to improve this situation in future calls.

Project reviews:

This KPI obviously depends on the number of Grant Agreements in force. Its value is to

measure the efforts from ARTEMIS JU to ensure the technical quality of the projects.

The minimum ratio is 1:1 (one review per project per calendar year).

2012 2013

Experts Reviewers 55 64

On-going Projects 31 40

KPI 1,7 1,6

* Based on the experts payment

Number of End-of-Project Certificates received

In 2013, 120 End-of-Project certificates have been received, reaching a total of 191 since the

implementation of this measure. This affects all projects. For Call 2008 projects, it represents

143 EoP from a total of 207 beneficiaries that have acceded the Grant Agreement (69%) and

84% of the JU funding.

The evolution of this indicator will be useful to better understand the problem of closing calls

and be more precise in asking help to the NFA.

Dissemination Activities

Communication activities about the activities of the funded projects are important to promote

the ARTEMIS JU, both within the industry and to a broader public. ARTEMIS projects are



specifically evaluated on their dissemination activities during technical reviews (by means of

a specific question to be answered by the evaluators). In addition, projects are expected to

provide publishable information and material support (e.g. demonstrators, staff, …) at the

various events organised by the ARTEMIS Industry Association (in cooperation with the JU

Office), even after their official ending date; the most important being the ARTEMIS Spring

Event and the ARTEMIS-ITEA “Co-Summit”.

During 2013, the WG Repository has made significant progress. This new tool will allow to

show the project results by project contributor and to better disseminate the ARTEMIS project

results.

3.8. Ex-post audit

At the end of the fourth quarter, the ex-post analysis is calculated to cover the entirety of ex-

post audit certificates received since the start of this performance monitoring action. The

results are summarised here.

End of Project Certificates Received up to 31/12/2013

EoP A) Total Costs B) Requested Eur C) Accepted D) Rejected % D/B

Call 2008 144 €142.777.487,98 €131.269.636,79 €128.643.549,32 €2.626.087,47 2,0%

Audited 61 €72.650.062,08 €63.775.772,06 €62.625.229,68 €1.150.542,38 1,8%

To be audited 10 €8.110.737,19 €7.346.103,78 €7.296.301,04 €49.802,74 0,7%

No Audit 73 €62.016.688,71 €60.147.760,95 €58.722.018,60 €1.425.742,35 2,4%

Call 2009 40 €30.642.153,93 €31.108.838,73 €30.899.359,57 €209.479,16 0,7%

Audited 9 €5.147.716,00 €5.215.393,46 €5.213.494,46 €1.899,00 0,0%

To be audited 3 €2.745.308,00 €2.694.721,29 €2.686.830,68 €7.890,61 0,3%

No Audit 28 €22.749.129,93 €23.198.723,98 €22.999.034,43 €199.689,55 0,9%

Call 2010 7 €3.544.448,00 €3.938.182,78 €3.872.219,31 €65.963,47 1,7%

Audited 2 €133.326,00 €132.489,36 €66.525,89 €65.963,47 49,8%

No Audit 5 €3.411.122,00 €3.805.693,42 €3.805.693,42 €0,00 0,0%

Grand Total 191 €176.964.089,91 €166.316.658,30 €163.415.128,20 €2.901.530,10 1,7%

Audited 72 €77.931.104,08 €69.123.654,88 €67.905.250,03 €1.218.404,85 1,8%

To be audited 13 €10.856.045,19 €10.040.825,07 €9.983.131,72 €57.693,35 0,6%

No Audit 106 €88.176.940,64 €87.152.178,35 €85.526.746,45 €1.625.431,90 1,9%



The total number of End of Project (EoP) Certificates received by the end of 2013 is 191.

Within these EoP certificates, the total amount of requested costs is: €166.316.658,30, while

the total amount of costs accepted by the national authorities is €163.415.128,20.

The total amount audited in the 72 audit reports already received is €69.123.654,88 which

represents 42% of the requested costs.

In addition, NFAs have indicated that 13 audits are committed to be made in the future,

representing €10.040.825,07 total costs, or 6% of the total costs.



This means that the total of audited and to be audited costs is €79.164.480 or 48% of the

requested costs.

The rejected amount of total costs is €2.901.530,10, which represents 1.7% of requested costs.

Out of 247 End-of-Project certificates received from the NFA, 106 include audit certificates

representing 87MEur out of 194MEur of total accepted costs (45%). The JU considers this as

sufficient and found no reason to ask for more specific audits: the proportion of grants audited

in terms of amounts exceeds by far the requirement of 20% coverage.

As a reminder, in 2012 ARTEMIS JU proposed to adapt its ex-post audit strategy to the

reality of those in the Member States, in the sense that the ex-post audit mainly refers to the

final payments. The proposal was adopted early 2013 by the Governing Board - GB-2012-

D.49. In the Annual Activity Report of 2012 significant information was disclosed about the

state of play of the ex-post audit information received from the Member States.

The implementation of the ex-post audit strategy comprises two major axes: the collection of

ex-post audit policies of the participating member states on the one hand, and on the other a

continuous analysis of the audit results supplied to the JU by the member states. The latter

analysis, as has been reported in quarterly reports and as consolidated above, measures the

amount of residual deviation (as claimed costs vs audited costs) on a continuous basis, thereby

exceeding the minimum requirement of an annual analysis. With the greatly increased number

of audit certificates received during 2013, the coverage in terms of funding amounts has

already increased significantly.

However, the collection and interpretation of details of the National audit policies that lead up

to these audit reports remains a recognised weakness, which is the subject of ongoing work to

develop a more satisfactory approach that is implementable given the legal constraints that the

JU must operate under in its relations with the Member States. However, that being said,

ARTEMIS JU has received to date, documents of varying completeness describing ex-post

audits procedures from 16 Member States that represents 97% of the total costs of the

projects, or 1 052MEur over 1 087MEur.

For these reasons, ARTEMIS JU is hopeful that a resolution to the ex-post audit question can

be found short term, with a goal of removing the concerns from 2014 onward.

3.9. Financial circuits, documentation of procedures, registration of documents

In 2013, around 2800 documents were registered in the document registration system

(TriDoc). This represents 200 more than in 2012.

3.10. Internal audit

The audit of the Internal Audit Service on “Expert Management” took place on February 4

and ended on February 8.



On May 14 ARTEMIS Joint Undertaking received from IAS the final report on “Expert

Management Audit” with some recommendations and requesting the Joint Undertaking to

propose an action plan.

Three “important” findings were addressed in that report and three others were considered as

“desirable”. The important ones are:

1. Review the sensitivity of programme officer post,

2. Adopt a confidentiality policy,

3. Review the rules of workload allocation.

The IAS report was sent to the Governing Board on May 15 and the Executive Director

submitted the action plan to the IAS on June 3.

On June 11, the IAS considered the Action Plan as “adequate” and asked to be informed about

the follow-up of such Action Plan.

Status of the three “important” findings, addressed in report of the IAS referring to Expert

Management.

1. Review the sensitivity of programme officer post,

a. Analysis of the sensitivity has shown that the suggestion of assuring rotation of

POs between projects is not only impractical but also undesirable, given the

loss of knowledge about the project that this entails.

b. On the other hand, a declaration of non-conflict-of-interest has been introduced

that each PO must sign annually. For 2013 these have already been signed.

2. Adopt a confidentiality policy,

a. A standard e-mail signature referring to confidentiality has been produced and

is now in general use.

b. However, a confidentiality classification system has not yet been put in place.

Its implementation will be postponed in the light of the impeding merger into

the ECSEL Joint Undertaking.

3. Review the rules of workload allocation.

a. This is no longer relevant for ARTEMIS as the last Call (2013) is now

finished.

3.11. IT systems

The IT infrastructure in the White Atrium building (shared amongst the 5 JU’s) was installed

during 2011 and is maintained by external contractors:

RealDolmen for the servers, workstations and internal network infrastructure. RD has

one person on-site for support and maintenance.

Getronics for the internet connection and telephony.



The common IT needs of the JU’s and the interface towards the external contractors are the

responsibility of the IT-Group, in which each JU has one representative (with an additional

person from IMI for contractual matters). The operation of this IT-group is under the

governance of the Executive Directors (through quarterly reports and meetings).

The follow-up with the contractors is through monthly reports and meetings with RealDolmen

(revision of KPIs for the IT Managed Services contract, corrective actions or need for

optimisations) and bimonthly meetings with Getronics.

Complementary to the external contractors, the JU’s are also joining framework contracts

from the Commission for the future supply of additional hardware, software and services.

All JUs use ABAC for all financial transactions (accessed through a physically segregated

and encrypted line, the S-TESTA) and Microsoft Office solution for administration. The S-

TESTA secured line also assures connection for the dedicated project management tools (FP7

tools, where access is granted by the relevant system owners; Commission services, REA,

DG-BUDG, etc.).

For ARTEMIS the list of IT tools includes the following:

URF – Registration facility for FP7 Legal Entities (owned by the REA)

CPS - Call Passport (owned by the REA)

CaP – Call Publications (owned by the DIGIT)

EFP – Evaluation Floor Planning (owned by the REA)

EMI/EMM – expert database (owned by Dg-RTD)

CED – Central exclusion database (DG-Budg)

SEP - Submission and Evaluation of Proposals (owned by the REA, managed by DIGIT)

ESS – Evaluation tools (owned by the DG-RTD, managed by the REA)

PDM – Project Data Management (owned by REA)

NEF – Tool supporting Contract negotiation (owned by DG-INFSO)

CPM – Contract Management Tool (owned by DG-RTD)

The Business Continuity Plan and associated Disaster Recovery Plan as proposed in 2011 are

under revision, to obtain a better alignment with the needs of the 5 JU’s and the cost involved.



4. DECLARATION OF ASSURANCE

Statement of reasonable assurance

I, the undersigned, Alun Foster, Acting Executive Director of ARTEMIS Joint Undertaking, in

my capacity of authorising officer,

- Declare that the information contained in the Annual Activity Report 2013 gives a true,

reliable and complete view;

- State that I have reasonable assurance that the resources assigned to the activities

described in this report have been used for their intended purpose and in accordance with

the principles of sound financial management, and that the control procedures put in place

give the necessary guarantees concerning the legality and regularity of the underlying

transactions;

This reasonable assurance is based on my own judgment and on the information at my

disposal;

- Confirm that I am not aware of anything not reported here which could harm the interest

of the Joint undertaking;

- However, the following reservation concerning the ex-post audit strategy should be noted:

the ex-post audit strategy, amended in 2013, is based on information to be received from

the Member States compiled in accordance with their own national rules. In the course of

2013, despite the elevated number of Certificates audited by the Member States (44% of

the total payments with an additional 6% in process to be audited) and the work done by

the Member States in application of the principles of subsidiarity and proportionality,

ARTEMIS Joint Undertaking does not have the means nor the legal capacity to assess the

legality and regularity of the underlying transactions of each Member State. In order to

mitigate this insufficiency and to remove the qualified opinion of the European Court of

Auditors, an action plan has been agreed in cooperation with ENIAC Joint Undertaking

and following the recommendations of the European Court of Auditors. The plan consists

of augmenting the measures already in place with visits to the Member States, to better

understand their internal procedures.

Done in Brussels, on 5th May 2014

Alun Foster

Acting Executive Director



APPENDICES

Appendix 1: Financial report: financial year 2013, administrative budget

Appendix 2: List of national funding authorities having signed an administrative agreement

with the ARTEMIS JU

Appendix 3: Members of ARTEMIS Governing Board in 2013

Appendix 4: Members of ARTEMIS Public Authorities Board in 2013

Appendix 5: Members of ARTEMIS Industry and Research Committee in 2013



Appendix 1: Financial report: financial year 2013, administrative budget

Financial Reports - ARTEMIS JU - Financial Year 2013

Administrative Budget

Table 1 : Commitments

Table 2 : Payments

Table 3 : Commitments to be settled

Table 4 : Average Payment Times

Table 5 : Income

Table 6 : Recovery of undue Payments

Table 7 : Ageing Balance of Recovery Orders

Table 8 : Waivers of Recovery Orders

Additional comments Balance sheet and P&L will be reported in the Annual Accounts 2013



Commitment

appropriations

authorised *

Commitments

made%

1 2 3=2/1

A-11 STAFF SALARIES 1.30 1.30 100.00 %

A-12 STAFF RECRUITMENT 0.02 0.02 100.00 %

A-14 SOCIAL INFRASTRUCTURE AND TRAINING 0.02 0.02 100.00 %

A-17 MISSIONS AND REPRESENTATION 0.09 0.09 100.00 %

1.42 1.42 100.00%

A-20 BUILDINGS AND ASSOCIATED COSTS 0.28 0.28 100.00 %

A-21 INFORMATION TECHNOLOGY 0.09 0.09 100.00 %

A-22 MOVABLE PROPERTY AND ASSOCIATED COSTS 0.01 0.01 100.00 %

A-23 CURRENT ADMINISTRTATIVE EXPENDITURE 0.01 0.01 100.00 %

A-24 TELECOMMUNICATIONS 0.01 0.01 100.00 %

A-26 R&D SUPPORT 0.25 0.25 100.00 %

A-27 INNOVATION 0.01 0.01 100.00 %

A-28 COMMUNICATION 0.21 0.21 100.00 %

A-29 AUDITS 0.01 0.01 100.00 %

0.88 0.88 100.00%

B3-1 SELECTED PROJECTS R&D EC CONTRIBUTION 30.55 30.35 99.34 %

30.55 30.35 99.34%

32.85 32.65 99.38 %

Total Title A-2

Title B0-3 OPERATIONAL EXPENDITURE

Total Title B0-3

TOTAL ARTEMIS

* Commitment appropriations authorised include, in addition to the budget voted by the legislative authority,

appropriations carried over from the previous exercise, budget amendments as well as miscellaneous

commitment appropriations for the period (e.g. internal and external assigned revenue).

TABLE 1: OUTTURN ON COMMITMENT APPROPRIATIONS IN 2013 (in Mio €)

Chapter

Title A-1 STAFF

Total Title A-1

Title A-2 BUILDINGS EQUIPMENT & OPERATING EXPENDITURE

99. %

99. %

99. %

100. %

100. %

100. %

100. %

A-11A-12A-14A-17A-20A-21A-22A-23A-24A-26A-27A-28A-29B3-1

% Outturn on commitment appropriations



Payment

appropriations

authorised *

Payments

made%

1 2 3=2/1

A-11 STAFF SALARIES 1.30 1.21 93.18 %

A-12 STAFF RECRUITMENT 0.02

A-14 SOCIAL INFRASTRUCTURE AND TRAINING 0.02 0.01 27.63 %

A-17 MISSIONS AND REPRESENTATION 0.10 0.05 52.10 %

1.44 1.27 88.10%

A-20 BUILDINGS AND ASSOCIATED COSTS 0.28 0.26 92.17 %

A-21 INFORMATION TECHNOLOGY 0.11 0.06 54.50 %

A-22 MOVABLE PROPERTY AND ASSOCIATED COSTS 0.01 0.00 12.62 %

A-23 CURRENT ADMINISTRTATIVE EXPENDITURE 0.02 0.01 44.56 %

A-24 TELECOMMUNICATIONS 0.01 0.01 73.65 %

A-26 R&D SUPPORT 0.31 0.23 74.86 %

A-27 INNOVATION 0.03 0.00 2.75 %

A-28 COMMUNICATION 0.29 0.20 69.02 %

A-29 AUDITS 0.01

1.06 0.77 72.33%

B3-1 SELECTED PROJECTS R&D EC CONTRIBUTION 30.22 20.53 67.94 %

30.22 20.53 67.94%

32.72 22.57 68.97 %

Total A-2


Total B0-3

TOTAL ARTEMIS

* Payment appropriations authorised include, in addition to the budget voted by the legislative authority,

appropriations carried over from the previous exercise, budget amendments as well as miscellaneous payment

appropriations for the period (e.g. internal and external assigned revenue).

TABLE 2: OUTTURN ON PAYMENT APPROPRIATIONS IN 2013 (in Mio €)

Chapter

Title A-1 STAFF

Total A-1


0. %

10. %

20. %

30. %

40. %

50. %

60. %

70. %

80. %

90. %

100. %

A-11 A-12 A-14 A-17 A-20 A-21 A-22 A-23 A-24 A-26 A-27 A-28 A-29 B3-1

="% Outturn on pay ment appropriations"



Commitments

2013

Payments

2013RAL 2013

% to be

settled

1 2 3=1-2 4=1-2//1

A-11 1.21 -1.21 0.00 0.00 %

A-12 0.02 0.00 0.02 100.00 %

A-14 0.02 0.00 0.01 79.55 %

A-17 0.09 -0.05 0.03 40.66 %

1.33 -1.27 0.07 4.98%

A-20 0.28 -0.26 0.02 6.90 %

A-21 0.09 -0.06 0.03 38.73 %

A-22 0.01 0.00 0.00 95.81 %

A-23 0.01 -0.01 0.01 55.88 %

A-24 0.01 -0.01 0.00 30.89 %

A-26 0.25 -0.20 0.05 18.52 %

A-27 0.01 0.00 0.01 91.75 %

A-28 0.21 -0.15 0.06 26.80 %

A-29 0.01 0.00 0.01 100.00 %

0.88 -0.69 0.19 21.72%

B3-1 30.35 0.00 30.34 99.99 %

30.35 0.00 30.34 99.99%

32.55870815 -1.96 30.60 93.99 %

Total B0-3

TOTAL ARTEMIS

INNOVATION

COMMUNICATION

AUDITS

Total A-2


SELECTED PROJECTS R&D EC

CONTRIBUTION

BUILDINGS AND ASSOCIATED COSTS

INFORMATION TECHNOLOGY

MOVABLE PROPERTY AND ASSOCIATED

COSTS

CURRENT ADMINISTRTATIVE EXPENDITURE

TELECOMMUNICATIONS

R&D SUPPORT

STAFF SALARIES

STAFF RECRUITMENT

SOCIAL INFRASTRUCTURE AND TRAINING

MISSIONS AND REPRESENTATION

Total A-1


TABLE 3 : BREAKDOWN OF COMMITMENTS TO BE SETTLED AT 31/12/2013 (in Mio €)

2013 Commitments to be settled

Chapter

Title A-1 STAFF

0.00

5.00

10.00

15.00

20.00

25.00

30.00

35.00

A-11 A-12 A-14 A-17 A-20 A-21 A-22 A-23 A-24 A-26 A-27 A-28 A-29 B3-1

="Breakdow n of Commitments remaining to be settled (in Mio EUR)"



Legal Times

Maximum

Payment Time

(Days)

Nbr of

Paymen

ts

within

Percentage

Average

Payment

Times (Days)

Nbr of Late

PaymentsPercentage

Average

Payment

Times (Days)

30 242 99.18 % 8.97107438 2 0.82 % 40.5

45 1021 94.28 % 18.30264447 62 5.72 % 91.69354839

Total Number

of Payments1263 95.18 % 64 4.82 %

Average

Payment Time16.51464766 90.09375

Target Times

Target

Payment Time

(Days)

Nbr of

Paymen

ts

within

Target

Percentage

Average

Payment

Times (Days)

Nbr of Late

PaymentsPercentage

Average

Payment

Times (Days)

30 1113 83.87 % 13.88409704 214 16.13 % 52.20093458

Total Number

of Payments1113 83.87 % 214 16.13 %

Average

Payment Time13.88409704 52.20093458

Suspensions

Average

Report

Approval

Suspension

Days

Number

of

Suspen

ded

Paymen

% of Total

Number

Total Number

of Payments

Amount of

Suspended

Payments

% of Total

Amount

Total Paid

Amount

0 262. 19.74 % 1,327. 6,773,253.55 30.91 % 21,914,185.00

Table 4: Average Payment Times

ARTEMIS 65010000 Interest expense on late payment of charges 872.54

872.54

20.06330068

Average

Payment

Suspension

Days

90

Late Interest paid in 2013

Agency GL Account Description Amount (Eur)

20.06330068

Total Number

of Payments

1327

1327

Total Number

of Payments

244

1083

1327



Title DescriptionYear of

Origin

Revenue and

Income

recognized

Revenue and

Income cashed

Outstanding

Balance

A-2REVENUES AND

CONTRIBUTIONS2013 21933123.68 21,929,526.26 3,597.42

21933123.68 21,929,526.26 3,597.42

TABLE 5 : SITUATION ON REVENUE AND INCOME IN 2013

TOTAL ARTEMIS



INC

OM

E

BU

DG

ET

RE

CO

VE

RY

OR

DE

RS

IS

SU

ED

IN

2013

Ye

ar

of

Ori

gin

(co

mm

itm

en

t)N

br

RO

Am

ou

nt

Nb

rR

O A

mo

un

tN

br

Nb

rR

O A

mo

un

t

Su

b-T

ota

l

EX

PE

NS

ES

BU

DG

ET

Nb

rA

mo

un

tN

br

Am

ou

nt

Nb

rA

mo

un

tN

br

Am

ou

nt

Nb

rA

mo

un

tN

br

Am

ou

nt

INC

OM

E L

INE

S IN

INV

OIC

ES

NO

N E

LIG

IBL

E IN

CO

ST

CL

AIM

S

CR

ED

IT N

OT

ES

Su

b-T

ota

l

GR

AN

D T

OT

AL

% Q

ua

lifi

ed

/To

tal

RC

Err

or

Irre

gu

lari

tyO

LA

F N

oti

fie

dT

OT

AL

Qu

ali

fie

dTO

TA

L R

C(i

ncl.

no

n-q

ua

lifi

ed

)

TA

BL

E 6

: R

EC

OV

ER

Y O

F U

ND

UE

PA

YM

EN

TS

(Nu

mb

er

of

Re

co

ve

ry C

on

tex

ts a

nd

co

rre

sp

on

din

g T

ran

sa

cti

on

Am

ou

nt)

TO

TA

L Q

ua

lifi

ed

TO

TA

L R

C(i

ncl.

no

n-q

ua

lifi

ed

)%

Qu

ali

fie

d/T

ota

l R

C

RO

Am

ou

nt



Year of

Origin

Number at

01/01/2013

2013

Totals 1 3,597.42

Number at

31/12/2013Evolution

Open Amount

(Eur) at

01/01/2013

Open Amount

(Eur) at

31/12/2013

Evolution

1 3,597.42

TABLE 7: AGEING BALANCE OF RECOVERY ORDERS AT 31/12/2013 FOR ARTEMIS JU

Waiver Central

Key

Linked RO

Central Key

RO Accepted

amount (Eur)LE Account Group

Commission

DecisionComments

1.

TABLE 8 : RECOVERY ORDER WAIVERS IN 2013 >= EUR 100.000

Total ARTEMIS JU

Number of RO waivers



Appendix 2: List of national funding authorities having signed an administrative agreement with the ARTEMIS JU

Country National Funding Authority

Date of signature of the Administrative

Agreement

AT Österreichische Forschungsförderungsgesellschaft mbH (FGG) 29.08.2008

BE

Instituut voor de Aanmoediging van Innovatie door Wetenschap en Technologie in Vlaanderen (IWT)

24.06.2008

Institut Bruxellois pour la Recherche et l’Innovation (INNOVIRIS)

5.07.2011

SPW-DGO6 (Wallonia) 16.04.2013

CZ Ministry of Education, Youth and Sports 14.07.2008

DK Danish Council for Technology and Innovation 17.06.2008

EE Estonian Science Foundation 17.06.2008

FI Finnish Funding Agency for Technology and Innovation (TEKES) 16.06.2008

FR Direction Générale des Entreprises du Ministère de l'économie, de l'industrie et de l'emploi

3.10.2008

DE Bundesministerium für Bildung und Forschung 25.08.2008

EL General Secretariat for Research and Technology of the Ministry of Development

14.06.2008

HU Hungarian National Office for Research and Technology (NKTH) 16.08.2008

IE Enterprise Ireland 23.06.2008

IT Ministero dell’Istruzione, dell'Università e della Ricerca (MIUR) 5.09.2008

LV Ministry of Education and Science 9.12.2009

NL SenterNovem 7.07.2008

NO Research Council of Norway 23.06.2008

PT Fundação para a Ciência e a Tecnologia (FCT) 3.09.2008

RO Centrul National de Management Programe – CNMP 25.08.2008

SI Ministry of Higher Education, Science and Technology (MHEST) 25.08.2008

ES Ministerio de Industria, Turismo y Comercio 25.08.2008

SE VINNOVA - Swedish Governmental Agency for Innovation Systems

26.08.2008

UK Engineering and Physical Sciences Research Council (EPSRC) 12.09.2008

Technology Strategy Board (TSB) 23.06.2008

PL National Centre for Research and Development 10.01.2012



Appendix 3: Members of ARTEMIS Governing Board in 2013

ARTEMIS-IA Jan Lohstroh Heinrich Daembkes

IE Michael Hughes Stephen O’Reilly

AT Michael Wiesmüller Kerstin Zimmermann

IT

Mario Al Aldo Covello Alberto Sangiovanni Vincentelli Enrico Macii

BE Leo Van de Loock Francis Deprez Nico Deblauwe

LV Maris Alberts Modris Greitans

CY Kalypso Sepou NL Jasper Wesseling Wilbert Schaap

CZ Jiri Kadlec Jana Bystricka

NO Tron Espeli Paul Gretland

DE Erasmus Landvogt Doreen Becker

PT

Luis Melo Rui Durao Filipa Duarte Elisabete Pires

DK Jan Madsen Lisbet Elming

PL Majos Wieslaw

EE Toivo Raim

RO Angela Ionita

ES Jose Angel Alonso Jimenez Salvador Dueñas Fernando Rico Rios

SE Joachim Karlsson Nabiel Elshiewy

FI Kari Tilli Kari Markus

SI Ales Mihelic Barbara Zalar

FR Cecile Dubarry Fabien Terraillot

UK Lee Vousden

EL Maria Koutrokoi Constantinos Kyriakopoulos Georgios Prinotakis

EC

Khalil Rouhana Willy Van Puymbroeck Michel Hordies

HU Szonja Czuzdi Sandor Bottka

Joao Serrano Gomes Max Lemke Werner Steinhoegl



Appendix 4: Members of ARTEMIS Public Authorities Board in 2013

AT

Michael Wiesmüller Doris Vierbauch Kerstin Zimmermann Georg Niklfeld Thomas Zergoi

IT

Mario Ali Aldo Covello Enrico Macii Alberto Sangiovanni Vincentelli

BE

Leo Van de Loock Nico Deblauwe Francis Deprez Mathilde Remaux Nicolas Delsaux

LV Modris Greitans Dina Berzina

CY Lina Tsoumpanou NL Wilbert Schaap Walter de Wit

CZ Jiri Kadlec Lukas Levak

NO Tron Espeli Paul Gretland

DE Erasmus Landvogt Doreen Becker Michael Weber

PT

Luis Melo Rui Durao Filipa Duarte Elisabete Pires

DK Lisbet Elming PL Leszek Grabarczyk Anna Ostapcuzuk Maria Bojanowska

EE Toivo Raim RO Nicoleta Dumitrache Andrei Paraschiv

ES

Joaquim Abati Gomez Maria Eugenia Taillefer de Prado Fernando Rico Rios Juan Pérez

SE Nabiel Elshiewy Joachim Karlsson

FI Markus Kari Ahola Kimmo

SI Ales Mihelic Barbara Zalar

FR Patrick Schouller Fabien Terraillot

UK Myrddin Jones

EL Maria Koutrokoi Pavlidou Niovi

EC

Khalil Rouhana Willy Van Puymbroeck Michel Hordies

HU Nora Jeney Sandor Bottka

Joao Serrano Gomes Max Lemke Werner Steinhoegl

IE Michael Hughes Stephen O’Reilly


Appendix 5: Members of ARTEMIS Industry and Research Committee in 2013

At the end of 2013 the IRC consisted of 23 members.

From SME’s

Pauli Kuosmanen TIVIT Ltd.

Pedro Ruiz Integrasys S.A.

Rodrigo Maia Critical Software

From Universities and Research institutes

Estibaliz Delgado TECNALIA

Irene Lopez de Vallejo Tekniker IK4

Jerker Delsing Lulea University of Technology

Tatu Koljonen VTT

Roberto Uribeetxeberria Mondragon Goi Eskola Politeknikoa

From Large Enterprises

Jan van den Biesen Philips

Patrick Candry Barco

Heinrich Daembkes EADS/Cassidian

Gerard Beenker NXP Semiconductors

Giovanni Barontini Finmeccanica

Angel Garcia Sanchez INDRA SISTEMAS, S.A.

Josef Affenzeller AVL List GmbH

Karlheinz Topp Robert Bosch GmbH

Knut Hufeld Infineon Technologies AG

Laila Gide Thales

Lothar Borrmann Siemens AG

Marc Frouin Dassault Systemes SA

Rafael Socorro ACCIONA

Sylvain Prudhomme AIRBUS France

Roberto Zafalon STMicroelectronics