indicators, monitoring and evaluation in esif programme and … · session i: monitoring and...

This two-day workshop focuses on the following topics:

Monitoring and Evaluation (M&E) Framework in this programming period and outlook into 2021-2027

Consequences of Mid-term evaluation of 2018 and outlook into ex post evaluation

Indicators: how to select, use and implement them

Practical exercise on how to define indicators for a specific project/programme and which thresholds have to be met

Monitoring: requirements, obligations, systems Collection, processing and assessment of data Best case describing monitoring process through

the life cycle of a real life project Assignment of evaluation to external services Writing Terms of Reference and procurement of

evaluation services Implementation of evaluation plan Process evaluation and impact evaluation (theory

based vs. counterfactual evaluation) Audit of performance data - new responsibility of

audit authorities Performance Audit – perspective from the

European Court of Auditors

Please contact: Ms Enrica Corpace +49 (0)30-81 45 06 27 [email protected] or visit: www.lexxion.eu

Indicators, Monitoring and Evaluation in ESIF Programmeand Project Management (2020)Interactive Workshop | 25 – 26 March 2020 | Milan

Experts:

Bernd SchuhMember of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

Stanislaw BieniasPresident of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw

Olga GuzaDeputy Director of EU Funds Audit Department, Ministry of Finance of the Republic of Latvia

Kurt BungartzPrincipal Auditor, European Court of Auditors, Luxembourg

mailto:[email protected]

http://www.lexxion.eu/

Overviewf

Monitoring and evaluation is an essential part ofmanagement and implementation of European Structuraland Investment Funds. The European Union legislation inthe programming period 2014-2020 puts a strongeremphasis on monitoring and evaluation than ever before.Join our interactive workshop on Indicators, Monitoringand Evaluation of ESIF Programmes and Projects and getknowledge about:

• Which obligations do involved authorities haveregarding monitoring and evaluation duringmanagement and implementation of OperationalProgrammes and ESIF projects inside OPs?

• Which indicators exist, what are their role andimplications for the project cycle?

• Which monitoring systems and IT systems exist inorder to collect, process and assess data?

• Which data has to be assessed for the respectiveevaluation?

• Which evaluation activities can be conductedinternally and which have to be outsourced?

• How to write terms of reference and procurement ofevaluation services?

• How to manage and steer the work of externalevaluation experts?

• What is the role of process and impact evaluation?• What are the most appropriate evaluation

methodologies and for which type of operations dothey apply?

• How can beneficiaries reach targets and contribute tothe collection of data?

• What are the reporting responsibilities of thebeneficiaries?

• What should beneficiaries be aware of regarding thecontrol and audit activities of Managing and AuditAuthority?

• How can an Audit Authority include the auditing ofindicators and performance in an Audit Strategy?

Methodology

The participants will be actively involved in the workshop.The sessions will combine presentations, case studies anddiscussion on practical problems. You will have ampleopportunities to present your own problematic issues anddiscuss them with the speakers and participants fromother Member States.

Just send to us your cases and questions in advance! Wewill forward them to our speakers, who will include yourissues in the programme and answer them during thetraining. All information concerning such problems andcases will be treated confidentially.

Indicators, Monitoring and Evaluation in ESIF Programme and Project Management (2020)Interactive Workshop | 25 – 26 March 2020 | Milan

General Information

Who should participate?

• Representatives from public authorities in charge of management, control, monitoring and evaluation of ESI Funds, especially from:

o Managing Authorities

o Audit Authorities

o Intermediate Bodies

o Regional and local authorities

o Court of Auditors

• External evaluators

• Beneficiaries of EU funded projects, i.e.: Private and public companies, associations, research institutes

• Bodies working in European Territorial Cooperation

• Public and private banks and other financial intermediaries

• International, national and local associations and networks

• Consultants and lawyers specialised on ESI Funds

Why should you participate?

Update your knowledge on Monitoring and Evaluation Framework in 2014-2020

Learn about consequences of the Performance Framework Verification

Exchange experience on selection, use and implementation of indicators

Learn about monitoring requirements and obligations

Receive expert advice on monitoring IT systems

Discuss how to assign evaluation to external services

Practice on writing Terms of Reference and procurement of evaluation services

Update your knowledge on implementation of evaluation plan

Learn about process evaluation and impact evaluation

Practice on theory based and counterfactual evaluation

Receive knowledge on the new responsibility of audit authority - audit of performance data

Discuss Performance Audit together with the speaker form the European Court of Auditors

Have a platform to exchange ideas and challenges within your organisation and receive practical advice on your individual questions

08:30 Registration & Welcome Coffee

09:00 Welcome note by Lexxion and Chair, Introduction Round

Chair:Bernd Schuh, Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

Session I: Monitoring and Evaluation (M&E) Framework in the Programming Period 2014-2020 and Outlook into

2021-2027

09:30 Monitoring and Evaluation (M&E) Framework

• Legal framework of M&E system• Role and significance of M&E for Operational

Programmes• Stakeholders involved and share of obligations• Relevant terminology: input, activities,

outputs, results, impact• Consequences of Mid-term evaluation of 2018

and outlook into ex post evaluation

Bernd Schuh

10:15 Coffee Break

Session II: Indicators

10:45 Indicators – a Tool to Strengthen the Result Orientation

• The role and selection of indicators: Successful measurement of results and its limits

• Which indicators exist and how to use them?• Selection and implementation of result

indicators• Use of indicators for different levels of

implementation: OPs to priority axes/single projects

• Measurement and verification of indicators

Bernd Schuh

12:00 Lunch Break

Session III: Monitoring

13:00 Monitoring in Practice (incl. 30 min coffee break)

• Monitoring requirements and obligations• Monitoring systems and IT systems• Collection, processing and assessment of data

(which data)• Data collection tools• Monitoring through life cycle of the project• Measurement and verification of indicators

Bernd Schuh

16:30 Evaluation in Practice – Step-by-Step Perspective

• Which activities can be conducted inhouseand which external

• Contracting out and cooperation with independent external evaluators: What needs to be considered?

• Drafting Terms of Reference• Use of evaluation results• ESIF real-life ToR examples

Stanislaw Bienias , President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw

17:00 End of Day 1



Programme Day 1



Session IV: Evaluation

09:00 Methodological Approaches in Evaluation of ESI Funds in 2014-2020 Programing Perspective(incl. coffee break)

Theory based impact evaluation

• What is „theory“ in theory based impact evaluation

• Foundations of causal inference in theory based impact evaluation

• Good practice examples

Counterfactual impact evaluation (CIE) –What is it?

• Random Control Trial as a “golden standard” for analysis of intervention effects

• Quasi experimental methods as a substitute of Random Control Trial

• Data requirements – precondition for counterfactual impact evaluation


Processe evaluation of ESIF implementation

• How process evaluation helps you to increase programme efficiency

• What aspects of implementation process are worth to be evaluated


Stanislaw Bienias , President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw

Bernd Schuh , Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

12:30 Workshop: Writing Terms of Reference and Procurement of Evaluation Services in ESIF

• Use your new knowledge of methods and write your own Terms of Reference for ESIF evaluation

• Tips and tricks in procurement of evaluation services

Stanislaw Bienias

13: 30 Lunch Break

Session V: Auditor’s Perspective to Monitoring and Evaluation

14:30 Audit of Performance Data – New Responsibility of Audit Authoritie

• System audits on performance data reliability• Audits of operations with regard to indicators• Verification of management declaration• Audit opinion: formation and considering

fulfilment of indicators• Results of the first audits of performance data

Olga Guza, Deputy Director of EU Funds Audit Department, Ministry of Finance of the Republic of Latvia

15:30 Coffee Break

15:45 Performance Audit – Perspective from the European Court of Auditors

Performance Audit

• Different types of audit: Financial, complianceand performance audits

• Performance audit concepts• Performance audit approaches and

methodologies; similarities and differencesversus evaluation

• Typical findings from Performance audits in ESIF

Kurt Bungartz, Principal Auditor, European Court ofAuditors, Luxembourg

16:15 Best Practice: Performance auditing in practice – a ‚real life‘ performance audit

• Results from an audit in the energy policy sector

Kurt Bungartz

16:45 End of the Workshop and Distribution of Certificates



Programme Day 2



Venue

Sina De La VilleVia Hoepli, 6Milan, ItalyPhone +39 02 8791311

Participation fee

□ YES, I would like to participate for the reduced fee for public authorities EUR 1.240,00 (excl. VAT).

□ YES, I would like to participate for the regular fee of EUR 1.640,00 (excl. VAT).

22% Italian VAT will be added where applicable.

The participation fees include the workshop material, drinks and snacks during the breaks and lunch.

Newsletter subscription

□ Please send me information about Structural and Investment Funds issues for free. I may unsubscribe from this service any time.

Cancellations

Cancellations should be made in writing per post or fax. Pleasenote that the full fee will be charged for cancellations receivedafter 11 March 2020. Nomination of a substitute remainspossible. A cancellation arising by reason of too small a numberof participants is effected no later than two weeks prior to theseminar. In this case the participation fee will be refunded. Arequirement for reimbursement of travel and accommodationexpenses as well as loss of working hours is not possible, unlesssuch costs result from wantonly negligent or deliberatebehaviour on the part of the organiser. For more detailedinformation, scope and conduct of contract as well ascancellation policy, please check the Terms & Conditions on ourwebsite.

Please register with:

Enrica CorpaceLexxion PublisherGüntzelstr. 63 | 10717 Berlin, GermanyPhone: +49 (0)30-81 45 06-27Fax: +49 (0)30-81 45 06-22E-mail: [email protected]: www.lexxion.eu/events

________________________________________________________Name

_______________________________________________________Position, Department

_______________________________________________________Company Name

_______________________________________________________Address

_______________________________________________________

_______________________________________________________Phone, Fax

_______________________________________________________E-Mail

_______________________________________________________VAT Reg.-No.

_______________________________________________________Date, Signature

For more information on any of our events please visit: www.lexxion.eu

Upcoming Event:

Irregularities and Fraud in ESI Funds and Public Procurement Now and in 2021-2027

Summer Course | 17-19 June 2020 | Athens, Greece

The number of irregularities and fraud cases reported to the European Commissionremains high, therefore member states need to continue their efforts to minimizethe rate of irregularities and to prevent and combat fraud on project andprogramme level. As a consequence, this topic remains high on agenda for nationalauthorities managing ESI Funds


Registration

indicators, monitoring and evaluation in esif programme and … · session i: monitoring and...

Documents