m tool set vfinal 2

8/8/2019 m Tool Set Vfinal 2

1/35

M-Tool SET

1 / 35

CONTENTS

Sec tion INA Contex t to Deve lop Monitoring Visits to LLP Partnerships 2

Section IIM-Too l Strateg y for Monitoring Educ ationa l Partnerships 4

Sec tion II. AM-Tool Strateg y - Methodo logy 4

Sec tion II. BM-Tool Strategy - Too ls 5

1. NA Memo 52. Letter to the institution 63. Qualitative techniques for collecting data 74. Summ ary of the Interview Gu ide 105. General interview Guide 156. Guide for analysis of monitoring data 31

Example of the ana lysis g rid fo r the interview 32

Example of the ana lysis g rid fo r observa tion 32

7. NA Monitoring report 338. Follow-up rep ort 35


2/35


3/35

M-Tool SET

3 / 35

2. Estab lish a na tional m onitoring strateg y acc ording to the EC orientations:2.1. Structured ap proac h c onsidering, a t na tional leve l, the o bjec tives and target groups of the LLP sec toral program me (nationa l

c riteria to selec t p rojec ts for monito ring).

2.2. NA Purpose : Co llec ting information on the quality in mana ge ment of the LLP Sec torial Prog ram me and the e ffic iency o f the

impleme nta tion of the projec t in the institution / organizat ion and in the ed uc a tional comm unity.

2.3. NA Aims: To c ollec t informat ion rega rd ing the qua lity in ma nag eme nt of the p rojec ts. To suppo rt the bene fic iaries in p rojec t imp lementa tion. To lea d the b ene fic ia ries to possible solutions of the prob lems de tec ted in the implem enta tion. To be fam iliar w ith the rea l resources (huma n, ma terial a nd institutiona l) a pp lied to the p rojec ts. To assess the p rogress of the p rojec ts. To dissem inate exam ples of g oo d prac tices. To e stab lish a c lose relation b etw een the be neficiaries and the NA by rec og nising their projec t w ork.

2.4. Use of the monitoring results (NA Rep orts, Institution Follow-up Rep orts and NA sta ff experienc e): To e nlarge a nd imp rove the pe da go gica l and te c hnic al supp ort given b y the NA to be nefic iaries and po tential projec t

ma kers in orde r to enha nc e the pa rtnerships qua lity.

To identify suc cess sto ries and exam ples of best p rac tice s useful for va lorisa tion p urposes (d issem ination and exp loitation ofresults).

To e sta b lish imp ac t assessme nt ind ica to rs.


4/35

M-Tool SET

4 / 35

Sec tion II.

M-TOOL STRATEGY FOR MONITORING EDUCATIONAL PARTNERSHIPS

Sec tion II. A

M-TOOL STRATEGY - METHODOLOGY

WORK PHASE PROCEDURE TOOL / OUTCOME

1 Memo with information ab out the monitoring strate gy. NA Mem oPrepa ration o f the

field monitoring

process

2 Letter to the institution

(At lea st one wee k before the visit) to inform a bo ut the a im a nd method ology of

the visit.

Letter to the

institution

Field wo rk /

Collec ting data

3 Monitoring visit in agreement with the principles of qualitative techniques for

c ollec ting da ta (interview and ob servation).

Using the General Interview Guide during the visit and carrying out direct

ob servation of do c uments and premises.

One da y or half-day visit.

General Interview

Guide

Data analysis and

interpretation

4 Guide for ana lysis/ interpretation of mo nitoring d ata :

Rec ord the co llec ted da ta in written a nd organize them subseq uent to thevisit.

Emp loy a c omm on me thod to ana lyse a nd to interpret the da ta (Conte ntAna lysis).

Guide for ana lysis of

monitoring da ta

Reporting 5 NA Report to the institution with feed bac k on the mo nitoring visit. NA Monitoring Rep ort

Follow-up 6 Follow-up Rep ort on the impleme ntation of the NA rec om me nda tions. Follow -up Rep ort


5/35

M-Tool SET

5 / 35

Sec tion II.B

M-TOOL STRATEGY - TOOLS

1. NA MEMOTOPICS

General selection criteria of the institution (regarding the NA Guide orientations). Specific selection criteria reg arding a c onc rete p roject:

o Defining the purpose of the visit (due to difficulties detected, using the criterion visits to coordinators, to choose aspe c ific thema tic , etc ).

o Selec ting spec ific p rojec t loc al a c tivities and mobilities em pha sized in the wo rk plan / c ontrac t (one or seve ral ma inactivities; e.g. the more recent, the ones that involved more persons, the one with more visibility, the only ones

imp lemente d), by using a princ iple of p urposive sam pling.

Basic Data ab out the projec t:o Institution data (identific at ion, typ e, level, nature, co ntac ts);o Projec t basics (cod e, typ e, title, coun tries);o Projec t c ontent (co nc rete aims, ta rge t-group s, thema tic a rea s);o Qua lity assessme nt (sc ore a nd ove ra ll c om me nts).

Definition o f NA staff. Lette r to the institution.


6/35

M-Tool SET

6 / 35

2. LETTER TO THE INSTITUTIONTOPICS

Communicating the objectives, bo th general (regarding the General Interview Guide) and specific (concerning the specificselec tion c riteria related to the c ase study i.e. this c onc rete projec t).

Informing a bo ut the m ethod of the visit, reg a rding the use o f the g roup interview . Defining the pa rticipa nts in the monitoring visit a nd their role (institution ma nage ment, project c oo rd ina tor, other sta ff direc tly

involved , pup ils/ learners d irec tly invo lved ).

Request of documentation for observation regarding one or several finalized activities of the work plan (local activities andage nda of the mob ilities).

Guidance to gather quantifiable data about the level of participation in activities (local, mobilities anddissemination/valorisation).

Request for a written confirmation of the ava ilability of the pa rticipa nts on the da y of the v isit (to e nsure the presenc e o f therelevant pa rticipa nts involved in the projec t ac tivities and to ha ve a n ag reem ent in ad vanc e o n the ag enda and c ond itions

of the visit).


7/35

M-Tool SET

7 / 35

3. QUALITATIVE TECHNIQUES FOR COLLECTING DATATOOL FOR COLLECTION DATA INTERVIEW

Typ e of interview

Fac e-to-fac e verba l interc hang e by group interviewing. Sem i-struc tured (using a ge neral interview guide in a flexib le ap p roa c h):

- Interview que stions are p lanned but no t stand ardized in ad vance b ec ause spe c ificquestions w ill em erge during t he interview;

- There a re no p re-set response c a teg ories. Group interview :

- Seve ra l pe op le simultane ously (manage me nt, projec t co ordinator, p rojec t team,pup ils/ learners, other pa rticipant sta ff);

- Definition o f who will be interviewed , why and how ma ny pe rsons.Purpose

Understanding the project progress. Ga thering c umulative da ta w ith the group situat ion. Stimulat ing peo p le to make their views, mo tives and rea sons exp lic it.

Strategy

One-time interview (variable d uration). Use of t he General Interview Guide :

- Use the p re-set q uestions (Summ ary of the Interview G uide) to know how to a sk andga ther relevant informa tion (related t o the o bjec tives);

- Flexib le use a nd o rde r of q uestions, adapte d t o the mo nitoring o b jectives and projec tlife c yc le;

- Ma ke use o f the Guiding Top ics to m ana ge the a nswe r and avo id d eviations from theobjectives.

The role o f NA sta ff: inte rviewer as a fac ilitato r, who supp lies the questions and top ics foranswe rs and group interac tion.

Managing the interview- In the NA:


8/35

M-Tool SET

8 / 35

TOOL FOR COLLECTION DATAINTERVIEW

prep aring a nd sc hed uling the interview; rea d ing the a pp lica tion form, the c ontrac t, rep orts (if any) or othe r do cuments

related to the p roject.

- In the institution: having the a pp lica tion form a nd the c ontrac t a vailab le d uring the visit; be ginning the interview with their state d ob jectives; giving o ral feed-ba c kduring the visit; c losing the interview w ith a n ove rall view of the strong and we ak p oints,

including rec omm end ations;

writing do wn note s ab out the p a rticipa nts' spe ec h (during and afte r theinterview).

Data from the group interviews Written rec ords of the NA sta ff

TOOL FOR COLLECTION OF DATA OBSERVA TION

Approach Qua litat ive a pp roa ch, not using predete rmined ca teg ories and c lassifica tions. Ob servation in a natural op en-ended wa y.

Purpose

Triangulation b etw een ob servational d at a and the interview ees disc ourse t o e nsuredifferent angles.

Ma king w ider links related t o the projec t impleme ntation.

Scope

Direc t o bservation o f:- Institution premises;- Spa c e used for project ac tivities and d issem inat ion;- Doc ume ntary da ta , like project m ate rials and (fina l) produc ts.


9/35

M-Tool SET

9 / 35

TOOL FOR COLLECTION OF DATAOBSERVA TION

Strategy

Ob serving and listen ing to the institution s env ironm ent . Rea d ing d ifferent types of d oc uments:

- of d ifferent autho rship (te ac hers/ trainers, pup ils/ learners);- and d ifferent availability (c losed , restricted or op enly published ).

Definition of what w ill be ob served a nd w hy, taking into ac count the objec tives of themonitoring visit.

Ca teg ories for desc ribing and analysing the o bservab le da ta (d esc riptive and foc uscategories). Key c ate go ries to a nalyse d oc umentary da ta : credibility, rep resenta tiveness and meaning

(who writes them , for wha t p urpo se, who rea d them , what is om itted , what is

accomplished).

Data from the observation Written rec ords of observab le da ta .


10/35

M-Tool SET

10 / 35

4. SUMMARY OF THE INTERVIEW GUIDECATEGORIES QUESTIONS

How did you know about Comenius/Grundtvig/Leonardo Programmes?

How d id you c om e a c ross the p artners for your projec t?

Was there a projec t tea m to be gin the wo rk?

How did you c ollab orate within the p artnership to c onc eive the co mmo n projec t?

Conception

When and how d id you inform the institution ab out the p rojec t?

How d o you co mmunicate a mong pa rtners?

How do you share the information w ith a ll pa rtners?

What tools do you use to c omm unica te?Which are the c omm unic ation languag es used during the p roject?

Was there any linguistic p rep aration nee de d?

Comm unica tion inthe pa rtnership

How d id you sa tisfy those nee ds?

How is the p rojec t included in the institution s wo rk plan?

Which project activities are included in the curriculum of pupils/learners?

Whic h ac tivities have you a lrea dy ca rried out?

Present ly, in wha t ac tivity a re you working?

What w as the mo st c rowd ed / po pular project a c tivity?

What c hange d in the pa rtnership p lanned ac tivities?

Partnership Local

activities

Will you b e a ble to c omp lete the planned ac tivities?


11/35

M-Tool SET

11 / 35

CATEGORIES QUESTIONS

What kind of c om mon ac tivities have you a lrea dy ca rried o ut with your pa rtners?

Whic h mobilities have you a lrea dy c arried o ut?

What c hange d in your mobility plan?

Ca n you c omp lete the planned mob ilit ies?

What kind o f prepa rato ry ac tivities we re d evelop ed be fore the mob ility?

Could you qua ntify the pa rticipa ting sta ff?

How d id you c hoo se sta ff for mob ility?

Could you q uantify the p a rticipa nt p upils/ learners?

How did you choose pupils/learners for mobility?

How d id you tw in pup ils during their foreign sta y/ when ho sting p artners?

How d id you involve your pup ils/ learners in the impleme ntat ion o f the a c tivities during mob ility and / or when

hosting pa rtners?

Which w as the c ontribution given b y the p arents/ fam ilies to t he m ob ility ac tivities?

Which w as the c ontribution given by the Assoc iated Pa rtners to the mo b ility a c tivities?

Whic h ac tivities we re d eve lope d during m ob ility and / or pa rtners hosting?

How muc h time was spe nt in eac h kind of a c tivity during m ob ility and / or pa rtners hosting?

Mobilities

What kind o f follow -up ac tivities we re d evelop ed afte r mo bility?

How ma ny pe rsons a re p resently involved in the project, including the p rojec t tea m?

How is the p roject tea m formed at the m ome nt?

Institutions

involvement

How o ften does the projec t team m eet?


12/35

M-Tool SET

12 / 35


Whic h c hannels do es the p rojec t tea m use to inform / guide the o ther institution s pa rticipa nts?

How is the institutions ma nage ment involved in the p rojec t?

Which responsibilities were taken by the relevant staff regarding the project?

In w hich ta sks we re pup ils/ learners involved ?

In wh ich ta sks were parents / fam ilies involved in the p rojec t?

Have you involved o ther institution(s)/ orga niza tion(s) from t he loc a l c om munity?

In wh ich ta sks we re the institution(s)/ orga niza tion(s) of the loc a l comm unity invo lved ?

Did they assume the role o f assoc iated p artners?

Community

involvement

Are you planning to involve othe r institution(s)/o rga nization(s) from the loca l com munity?

Whic h fina l prod uc ts have you a lrea dy finalized ?In wha t stage a re you, c onc erning the c om mon fina l prod uc t(s)?Outcomes

What a re the tasks and roles for eac h p artner institution c onc erning the final com mon p rod uc t(s)?

What knowled ge did you ga in through the projec t rega rding its thema tic area?

What know led ge did you a c hieve throug h the p rojec t reg a rding Europ ea n issues?

What c hange d in your langua ge skills due to the p rojec t?

What c ha nged in your ICT skills due to the p rojec t?

What c hanged co ncerning the implementation of p eda gog ica l methods due to the projec t?

What c hange d in the orga nizat ion of the institution due to the p rojec t?

What c hange d c onc erning m otivation in lea rning / teac hing?

Projec t results

What c hang ed in the rela tionships within the institutions partic ipants due to t he p rojec t?


13/35

M-Tool SET

13 / 35


What c hange d in the establishment of links with othe r institutions of the loca l comm unity due to the p rojec t?

What c hange d c onc erning p upils/ learners sc hoo l/training suc cess mo tivated by the p rojec t?

How do you eva luate the p rog ress of the p rojec t?

Who p artic ipate s in the eva luat ion proc ess?

What kind o f feedb ac k rea c hed the p articipa nts?

Which a re the results from your eva luation?

Evaluation

What have you c hang ed as a c onseq uenc e of your eva luation results?

In which events / initiatives did/ will you p a rticipa te to p resent / ma ke known your project ac tivities/ expe rience s

and or results?

What kind o f informat ion wa s prod uc ed to use in the dissem inat ion a c tivities?

What a c tivities did / will you sta rt and imp lement, on your ow n initiative, to p resent / ma ke pub lic the p rojec t?

Have you d eve lop ed any a c tivity in c om mo n with other institutions to p resent/ pub lic ize the p rojec t?

How ma ny pa rticipa nts we re p resent in ea c h d issem inat ion a c tivity?

Dissemination

How do you intend to c ontinue to spread / share informa tion a bo ut your project?

Whic h a c tivities have you d eve loped to p rom ote the a pp licat ion o f your projec t results by o ther institutions /

individuals?

Whic h p rojec t results were app lied by othe r institutions and / or ind ividua ls?

What kind o f institutions / g roup of individua ls have d irec tly benefited from your projec t results?

What p rojec t result(s) turned to be the most signific ant one (s) in terms of b eing ap plica ble in similar ed uc at iona l

contexts?

Valorisation

Do you c onsider that yo ur projec t results a re in ha rmony w ith the LLP Prog ramm e?


14/35


15/35

M-Tool SET

15 / 35

5. GENERAL INTERVIEW GUIDE

CATEGORIES OBJECTIVES SPECIFIC OBJECTIVES QUESTIONS GUIDING TOPICS

Leg itima ting the

interview

To expla in the p rocess of a

mo nitoring v isit.

To expose the a ims of the

visit.To d escribe the

metho do log y used in the

mo nitoring v isit.

To reinforce the

imp ortanc e of the

institution s co llaboration.

To motiva te the

pa rticipa nts in the project

on the importanc e of themonitoring p roc ess.

To inform a bo ut the feed-

ba ck proce ss reg arding the

monitoring results.

Conception To rec og nise ho w thepub lic ha s access to the

Sec toria l Prog ramm e.

To ident ify the channel(s)used to o bta in information

about the Programme

How d id you know ab outComenius/Grundtvig/Leonardo

Programmes?

Internet / NA website

Personnal /

Professiona l co ntac ts

Previous pa rticipa tionin other Europ ea n

Programmes

Participa tion in NA

events


16/35

M-Tool SET

16 / 35


To be fa miliar with the

pa rtner finding p roc ed ure.

To und erstand how the

conta c ts are estab lished to

be gin a pa rtnership.

To c om prehend the c riteria

to selec t the p artners.

How did you com e a c ross the

pa rtners for your project?

Participa tion in a VP

or Contac t Seminar

Use o f an we bsite for

partner finding

Networks

Previous partners in a

different projec t

To rec og nize how the

institution o rganized

interna lly the p roc ess of

project conception.

To und erstand the initial

motivation for the p rojec t.

To know w ho is the sta ff

involved in the p rojec t

team.

Was there a projec t team to b egin

the work?How , whom

To b e a wa re o f the

comm on concep tion of

the partnerships project.

To identify the tasks of each

partner institution during

the co ncep tion proc ess.

To know the measures

taken by the partnership

mem be rs to elab orate the

project.

To identify the a rticulation

between pa rtnerinstitutions.

How did you c ollab orate within

the p artnership to c onc eive the

comm on p roject?

Comm on fill-in of the

joint sections of the

application form


17/35

M-Tool SET

17 / 35


To know the awa reness of

the institution c om munity

ab out the project.

To ide ntify the op portunities

given to the institution

com munity to be involved

in the projec t co ncep tion.

To rec og nise the

involvement of othe r

pe rsons besides the p rojec t

team.

When and how d id you inform the

institution ab out the project?

In teac her/trainer

meetings, through

institutions posters or

newspaper articles,

on a web site, etc

To identify a flow ing

co mmunica tion throughout

the p roject.

To identify a reg ular

co mmunica tion throughout

the p roject.

How d o you co mmunica te among

partners?

When (every da y,

every week, every

month)

Whom (project tea m,

tea chers/ trainers,

management,

pup ils/ learners, o ther

staff)To ident ify the m ea sures

unde rtaken to share

informa tion am ong the

partnership.

How do you share the informa tion

with all partners?

Written confirma tion

of activities and

decisions

To know the too ls used to

co mmunica te with the

partners.

What to ols do you use to

communicate?

Fax, phone , e-ma il,

regular ma il, etc

Comm unication in

the partnership

To be a c qua inted w ith the

communication strategy

implemented among

partners.


lang uag es used toco mmunica te with the

partners.

Which are the c ommunicationlang uag es used during the

project?

Curricular, non-curricular


18/35

M-Tool SET

18 / 35


To rec og nize the need for

linguistic p rep arat ion.

Was there a ny linguistic

preparation needed ?

Why

Who

(teachers/trainers,

management,


sta ff, pa rents/ families)

To iden tify resources used

for linguistic prep ara tion.How d id you sa tisfy those nee ds?

Using a ud iovisua l

ma teria ls, making alang uage c ourse,

hosting a Com enius

Assista nt , etc

To b e a wa re o f the wa ys to

integ rate the p rojec t in the

institutions work plan.

How is the p roject inc lude d in the

institutions work plan?

To rec og nize the

integ ration of the project in

the institution.

To ident ify the m ea sures

taken to integrate theprojec t ac tivities in the

curriculum of

pupils/learners.

Which p rojec t ac tivities areinc luded in the c urriculum o f

pupils/learners?

Which subjects

Which a c tivities have you a lrea dy

carried out?

Partnership Loc al

activities

To ve rify the

imp leme ntation of the

local activities at the

institution and / or in the

loc al c ommunity.

To ide ntify the d eg ree of

accomplishment of the

planned ac tivities. Presently, in w hat a c tivity a re you

working?

Where, when a nd

with whom

(tea chers/ tra iners,

management,

pupils/learners,

parents/families,assoc iated partners,

other participants)


19/35

M-Tool SET

19 / 35


To b e a wa re o f the most

visible projec t ac tivity.

What was the m ost

crowde d/ po pular projec t ac tivity?

How m any

participants of each

kind

(tea chers/ tra iners,

management,

pupils/learners,

parents/families,

assoc iated partners,other participants)

To identify changes in the

partnership s wo rk p lan.

What c hang ed in the p artnership

planned ac tivities?Why


ca pa c ity to ac co mp lish the

partnership s wo rk p lan.

To identify the c ond itions

that influenc e the projec ts

implementation.

Will you be a ble to c omp lete the

planned ac tivities?

Why (enough

resources, time, et c )

To understand the

consistenc y of the

co ope rative w ork done in

the p artnership.

To identify the c omm on

ac tivities in the pa rtnership.

What kind o f commo n ac tivities

have you alrea dy c arried out with

your partners?

When and ho w

To ide ntify the d eg ree ofaccomplishment of the

mob ility plan.

Which mobilities have you already

carried out?

When, where and

who

(teachers/trainers,

management,pup ils/ lea rners,

parents/families,

assoc iated partners,

other participants),

how many

MobilitiesTo ve rify theimp leme ntation of the

mob ility a c tivities.

To identify changes in the

pa rtnership s mo bility p lan.

What chang ed in your mobility

plan?Why


20/35

M-Tool SET

20 / 35



ca pa c ity to ac co mp lish the

mob ility plan.


cond itions that influenc e

the implementation of

mobilities.

Can you co mplete the planned

mobilities?

Why (enough

resources, time, et c )

To b e a wa re o f theplanning process regarding

mob ility a c tivities.

What kind of p rep aratory ac tivitieswere developed before the

mobility?

Who

To know ab out the

comp osition of the

participant staff in

mobilities.

Could you q uantify the

pa rtic ipating staff?

Number of


management,


other participants

To ident ify the c riteria fo rchoosing the staff for

mobility.

How did you c hoose staff formobility?

Sta ff from d ifferentsub jec ts, sta ff w ith

disabilities, etc

To know ab out the

comp osition of the

participant pupils/learners

in m ob ilities.

Could you qua ntify the pa rtic ipa nt

pupils/learners?

Number of

pup ils/ lea rners,

schoo l leve l/ type o f

training, age

To ident ify the c riteria fo r

choosing thepupils/learners for mobility.

How did you c hoose

pupils/learners for mobility?

Pup ils/ lea rners age,

schoo l leve l/ type o f

training,pup ils/ lea rners with

d isab ility, etc

To und erstand the strateg yto impleme nt mobility

activities.


c riteria t o twin p up ils.

How d id you twin pup ils during

their foreign stay/ whe n hosting

partners?

App lica ble to

Comenius Bilateral

Partnerships

Host fa milies and

rec iproc al twining


21/35

M-Tool SET

21 / 35


To know the d irec t

contribution of

pupils/learners to the

imp leme ntation o f mob ility

activities.

How did you involve your

pup ils/ lea rners in the

imp leme ntation of the a c tivities

during mo bility and / or when

hosting partners?


contribution of

parents/ fam ilies to t heimp leme ntation of mob ility

activities.

Which wa s the c ontribution g iven

by the parents/ fam ilies to themobility ac tivities?


contribution of the

Associated Partners to the

imp leme ntation of mob ility

activities.

Which wa s the c ontribution g iven

by the Assoc iated Partners to the

mobility ac tivities?

To know the kind of

ac tivities de velope d during

mobility.

Which a c tivities were d evelope d

during m ob ility and / or partners

hosting?

Who

Visiting other

institutions, time spent

as trainer or trainee,

attending lessons,

wo rking toge ther on

the p rojec t, time

spent for leisure


co herenc e of the workag enda of the mob ility

activities.

How muc h time w as spe nt in each

kind o f ac tivity during mob ilityand / or partners hosting?

To rec og nize the

consistenc y of the mobility

planned ac tivities.

To ident ify the follow -up

ac tivities conseq uently to

the mobility.

What kind of follow-up activities

were developed a fter mob ility?


22/35

M-Tool SET

22 / 35


To ve rify the d eg ree of

involvement in p rojec t

activities.

To spot the volume of

institutions participants.

How ma ny p ersons are p resently

involved in the project, including

the projec t team?

Tea chers/ trainers,

management,


sta ff pa rticipa nts.

To know the c omp osition of

the institution s p rojec t

team.

How is the project team formed at

the moment?

Who

How m any

What subjec tsTo know the wo rk reg ularity

of the project team .

How o ften doe s the project tea m

meet?

To rec ognize the dyna mics

of t he institution s p rojec t

team.To identify the c hannels

used to inform / guide the

institution s pa rtic ipants

ab out the project.

Which c hanne ls do es the p rojec t

tea m use to inform / guide the

othe r institution s pa rtic ipants?

Comenius Corner

E-mail

Meetings


managements support to

the p roject.

To identify measures

regarding management

support.

How is the institution s

mana gem ent involved in the

project?

Visit othe r pa rtner

institutions

Links to other

institutions (loca l

community,

educational

authorities, etc )


sta ffs involvem ent in the

project.

To c a teg orize the m a in

responsibilities of the staff

involved in the p rojec t.

Which responsibilities we re taken

by the relevant staff rega rding the

project?

Tea chers/ trainers and

other institution staff

Institutions

involvement

To b e a wa re o f thepupils/learners

involvement in the p rojec t.

To c lassify the ma in tasks ofthe pup ils/ lea rners involved

in the p roject.

In which tasks we re pup ils/ lea rners

involved?Pupils association

Community

involvement

To rec og nize the

parents/families

involvement in the p rojec t.

To identify synergies

be twee n the institution and

fam ilies, ac c om plished

throug h the projec t.

In which tasks were parents /

fam ilies involved in the p rojec t?Parents Assoc iation


23/35

M-Tool SET

23 / 35


To identify synergies

be twee n the institution and

the loca l com munity,

accomplished through the

project.

Have you involved o ther

institution(s)/ organiza tion(s) of the

loc al c ommunity?

Type o f institut ions/

organizations

To c a teg orize the m a in

tasks of the loca l

comm unitys involvement.

In which tasks were the

institution(s)/ organiza tion(s) of the

loc al community involved?To identify the existenc e o f

an associated partners

network.

Did they a ssume the role o f

assoc iated partners?

Named in the

application form

To rec og nize the officia l

relationships betw een the

institution and the loc alcommunity.

To know ab out the p ossible

enlargement of c ommunity

involvement.

Are you p lanning to involve other

institution(s)/ organiza tion(s) from

the loca l com munity?


accomplishment of theplanned outc omes.

Which final p rod uc ts have you

alrea dy fina lized ?

Final p rod uc ts with

Europe an Logo

To c ollec t evidenc e o f the

existenc e of the comm on

fina l produc t(s).

In wha t stag e a re you, co ncerning

the c omm on final produc t(s)?

What

WhomOutcomes

To ve rify the

imp leme ntation of the

projec t outco mes.

To rec og nize the

comp leme ntary of tasks

within the p artnership.

What a re the tasks and roles for

ea ch pa rtner institution

co ncerning the final co mmon

product(s)?

Projec t results

To und ersta nd the results of

the projec ts

implementation.

To know the imp rovem ents

in knowledg e in the

thematic a rea o f the

project.

What knowledge did you ga in

through the p rojec t reg arding its

thematic area?


pupils/learners,

manag ement, other

institution sta ff,

pa rents/ fam ilies, et c


24/35

M-Tool SET

24 / 35


To rec og nize the

imp rovem ents ma de in the

Europe an Dimension o f

Educ at ion/ Tra ining .

What knowledge did you a chieve

through the p rojec t reg arding

Europ ea n issues?


pup ils/ lea rners,

manag ement, other

institution sta ff,



in langua ge skills achieved

through the projects

implementation.

What c hange d in your langua ge

skills due to the projec t?


pup ils/ lea rners,

manag ement, otherinstitution sta ff,


To identify the

improvements

acc om plished in ICT skills

through the projects

implementation.

What c ha nged in your ICT skills

due to the p roject?


pup ils/ lea rners,

manag ement, other

institution sta ff,



in ped agog ica l methodswith the projec ts

implementation.

To identify the

imp leme ntation of new

ped agog ica l methods due

to the p roject.

What c hange d c onc erning the

implementation of pedagogical

method s due to the p roject?


manag ement, other

institution sta ff

To identify the

improvements in themanagement approach.

To know the ne w

orga niza tion strateg ies

implemented due to the

project.

What cha nged in the orga nization

of the institution d ue to the

project?


manag ement, other

institution sta ff


25/35

M-Tool SET

25 / 35


To identify the

imp rovem ents on

motivation of the projec t

participants.

What cha nged c once rning

motivation in lea rning / tea ching?

Pup ils/ lea rners /

teachers/trainers


in interpersonal

relationships stimulated bythe p roject.

To identify the

reinforcem ent o f the

institution s interna l

cohesion.

What c hang ed in the relationships

within the institution s pa rticipa nts


Between

tea chers/ trainers and

pup ils/ lea rners,

amongpup ils/ lea rners,

among


be twee n staff in

general, betwee n

tea chers/ trainers and

parents/families

To rec og nize the

improvements on linkingthe institution to the loc a l

co mmunity due to the

project.

What c hanged in the

establishment of links with other

institutions of the loc a l community



in pup ils/ learners

school/training

performa nce due to the

project.

What cha nged c once rning

pup ils/ lea rners school/ training

success mo tivate d b y the p rojec t?


26/35


27/35

M-Tool SET

27 / 35


To kno w the institution s

eva luat ion results (self-

evaluation).


strong / wea k po ints of the

projec t ac co rding to the

institution s view.

To know therec om mendations resulting

from the self-eva luation

proc ess.

Which are the results from your

evaluation?

At institution level and

a t the p artnership

levelTo b e a wa re o f the self-

eva luation results.

To identify the ado ption of

rec omme nda tions ma de a t

eva luation repo rting stag e.

What have you c hange d a s a

co nseq uence of your evaluation

results?

At institution level and


level

To ide ntify the d eg ree ofaccomplishment of the

planned dissemination

activities.

In which e vents / initiatives d id/ willyou pa rticipate to p resent / ma ke

known your project activities/

experiences and or results?

Conferences,

sem inars, mee tings,exhibitions

Where, whe n, how, to

whom

Who presented

Dissemination

To rec og nize thedeve lopm ent of the

dissemination strategy.

To know the too ls used to

disseminate the project.


c riteria used to selec t theinformation for

d issem inat ion p urposes.

What kind o f informa tion was

produc ed to use in the

dissemination activities?

Conte nt of: a

webpag e, a

new spa pe r, a

PowerPoint

presenta tion, anexhibition, a

pe rforma nce , etc


28/35

M-Tool SET

28 / 35


To d istinguish the na ture o f

the initiative regarding the

dissemination activities.

To ident ify the m ea sures

taken to d issem inate the

project.

What a c tivities d id/ will you sta rt

and implement, on your ow n

initiative, to present / ma ke pub lic

the p roject?

Auto-initiative

Co -autho rship with

other institutions

(who)

To identify the existenc e o fco ope rative w ork

regarding the

implementation of


Have you deve lope d a ny ac tivity

in comm on w ith other institutions

to p resent/ pub licize the project?

Common

organization a tpartnership leve l

Sha red orga nizat ion

with the associated

partners or other

organizations

To b e a wa re o f the level ofpub lic knowledg e ab out

the p roject.

How ma ny pa rticipa nts we represent in each d issem ination

activity?


management,


sta ff, representa tives

from the ed uca tional

authorities, from the


etc

To identify the c hannels

used to d issem inate

informa tion abo ut the

project.

To know the kind of

institution s pa rtic ipants

taking part in the


How d o you intend to continue to

spread / share information abo utyour projec t?

Sprea d e xperienc es,

ac tivities and project

results

What, when, where,

how, by who and to

whom


29/35

M-Tool SET

29 / 35



accomplishment of the

planned valorisation

activities.

Which activities have you

deve lope d to promote the

application of your project results

by other institutions / individua ls?

Training courses,

seminars,

conferences,

pedagogical

ma teria ls offe rs

To identify the kind of

projec t results mo re

valuab le to be transferredto other educ ational

contexts.

To know the e xtent of the

projec t results a t na tiona l /

interna tiona l sca le.

Which p rojec t results we re a pp lied

by o ther institutions and / or

individuals?

When, where, how

and by whom

At individual, local,

reg ional or nationa l

level.

To understand the transfer

possibilities of the p rojec t

results (apprenticeships

and / or final produc ts).

To ide ntify the ta rge t

group(s) that c ould benefitfrom the project results.

What kind o f institutions / group of

individuals have directly benefitedfrom yo ur projec t results?

Distinction between

the pa rticipants

(internal target

group) and theexternal individua ls

How m any

To rec og nize how the

project results are linked to

the expec ted impact.

What p rojec t result(s) turned to b e

the most significant one(s) in terms

of b eing a pp licable in similar

educational contexts?

Targe t g roup (s) of the

project

Valorisation


contribution of the project

results to achieve Lisbon

ob jectives and / or the

op erational objec tives andpriorities of the LLP

Programme.

To identify the

ac hievement of the projec tresults in fac e o f the

ob jec tives and priorities of

the LLP Programme

Do you c onsider that your projec tresults a re in ha rmony w ith the LLP

Programme?

How

Why

Projec t influenc es


d iffic ulties in p rojec t

development.

To identify spec ific fac tors

that nega tively influenc ed

the projec ts

implementation.

Which p rob lems/ ob stac les did you

enc ounter during the p rojec t?

At the institution and


level


30/35

M-Tool SET

30 / 35


To know the solving

problem p roc edures

imp leme nted in the

partnership.

To spot the effec tiveness of

the comm unica tion

strategy.

To ident ify the level ofco ope ration betw een the

project pa rtic ipa nts.

Did you sha re the p rob lems with a ll

the peop le involved in the

project?

Who (projec t team ,

management,

partnership

c oordinator, all

partners, NA,

authorities, etc )

To identify conc rete

solutions in fac e of t he

projec t s difficulties.

How did you solve the p rob lems

detec ted d uring the projec ts

implementation?

Who, when

To b e a wa re o f the level of

deviation from the initial

projec t p lan.

How did the m entioned problems

chang e, in some wa y, the original

project?

Application form


fac tors in favour of the

projec t development.

To know spec ific fac tors

that positively contribute to

the p roject

implementation.

Which we re the most favo urab le

cond itions to the project

implementation?

At the institution and


level

To spot the strong / weak

po ints in the support given

by the NA to the

bene ficiary institution.

Are you satisfied with the c onta c ts

you had with your NA?Contac ts with the

NA


de gree o f sa tisfac tion o f

the institution c onc erning

the NA. To identify wa ys to improveNA best support and

guidance.

How do you think they could be

improved?


31/35

M-Tool SET

31 / 35

6. GUIDE FOR ANALYSYS OF MONITORING DATAMETHODOLOGICAL

FRAMEWORK TO

QUALITATIVE ANALYSIS

CONTENT ANALYSIS

Purpose

Estab lishing ho w the NA rea c hes the find ings about the m onito ring visit. Organizat ion, ca teg orizat ion a nd interpreta tion of the informat ion c ollec ted (throug h interview and

observation).

Strategy

Cod ing the da ta co llec ted in the interview to d o their lab elling:- The p re-cod ed cat eg ories will be used to validate the interview respo nses, bec ause the se

c ate go ries are b ased on a c lear definition of a ims (inc luded in the Gene ra l Interview Guide ).

- For comp lem enting the use o f the c a teg ories pre-spe c ified (on the G ene ral Interview Guide ),othe r da ta cate go ries (either desc riptive or highe rinference) w ill be develop ed if nece ssa ry.

- The a im of orga nizing the d at a by c a teg ories is to red uc e d ata without significant loss ofinformation, summ arizing the d a ta by pulling tog ethe r them es and identifying pa tterns and

regularities.- The d ata c ollec ted is orga nized by sma ll or large sentences labelled by the c ate go ries and

ob jec tives (units of sense), filled in the c olumn Monitoring Rec ord of the Ana lysis Grid .

Develop ing propo sitions based on the p atte rns and c onnec tions evidenced with the co d ing, req uiringsome d egree of inferenc e be yond the da ta.

- Draw ing the find ings to estab lish a m ea ningful and c ohe rent p icture o f the projec timpleme ntat ion, putting in evide nce the strong a nd wea k po ints and de fining

rec om me nda tions (filled in the c olumn Comm ents for the Rep ort of the Ana lysis Grid

ac c ording to the items of the NA M onitoring Rep ort).- Crossing the da ta c ollec ted in the interview w ith the ob servation da ta to c rea te a

c orrespo ndenc e b etwe en verbal respo nses (what p eop le say) and wha t they do and wha t

they say they do .

- The findings will be supp orted by c rossing the ob servation evide nc e (from direc t o bservationand from the interview) with the spec ific ob ject ives established for ea c h cate go ry in the

General Interview Guide .


32/35

M-Tool SET

32 / 35

EXAMPLE OF THE ANALYSIS GRID FOR THE INTERVIEW

Categories Ob jec tives Monitoring Rec ord Com ments for the Report

To recog nise how the p ublic has

ac c ess to the Sec torial

Programme.

Filled in w ith top ics c onstituted by

units of sense from the notes

c ollec ted by the NA sta ff, during a nd

a fter the mo nitoring visit.

Filled in with inferences (findings)

ob ta ined by c rossing the

ob servation evidenc e with the

spec ific ob jectives defined in the

General Interview Guide .

Conception

To be fam ilia r with the partner

finding proce dure.() ()

Comm unica tion in

the Partnership() () ()

EXAMPLE OF THE ANALYSIS GRID FOR OBSERVATION

Observed Dime nsions Ob jec tives Monitoring Rec ord Com ments for the Rep ort


33/35

M-Tool SET

33 / 35

7. NA MONITORING REPORT Com bination of results from da ta c ollec ted d irec tly (observation) and indirectly (interview). Possib ility g iven to the institution to refute ma tte rs of fac t or inte rp reta tions sta ted in the c onc lusions of the NA Rep ort (existenc e o f

a 1st draft).

Report structure (final version)

Identifica tion o f the institution a nd the projec t

Objec tives of the report phase:

o Good prac tices em pha sis;o Counselling and ad vice .

Monitoring visit:

Introduction (ab out the visit):o Date of visit, identifica tion of the pe rsons interviewed (mana ge ment, coordination,

other staff and pupils/learners), place;

o Context and othe r relevant c ircumstantial information;o Ide ntifica tion of the NA mo nitoring team .

Observed data :o Doc uments, ma teria ls and othe r aspe c ts ob served in situ;o Evidenc e o f projec t ac tivities (artefa c ts, rep orts, boo klets, log b oo ks, multimed ia

products, etc).

Findings:o Results of the content analysis of the interview(s);o Reference to important observation evidence, stressing the strengths and the


34/35

M-Tool SET

34 / 35

Report structure (final version)

we aknesses identified with referenc e to the p re-de fined param ete rs/ c ate go ries;

o Ide ntifying p rob lems and the ir c auses;o Ide ntifying seeds of innovation o r exce llenc e;o Conc lusion (gene ra l app rec iation of the sta te o f project imp lem enta tion; lessons

learned).

Rec omme ndationso What shall be do ne to solve the identified prob lems? To ad just a c tivities and/ or

resources? To improve ac tion? To ma ke the projec t b ette r?

Contribution of the projec t to the LLP Program me (ob jec tives and p riorities).Institution c omm ents ab out NA c onc lusions (in ca se there a re any regarding the 1st draft).

Request for a Follow-up Report:

o Informa tion reg ard ing its minimum req uirem ents;o Establishing a deadline to its submission to the NA.

Date of nex t visit (optiona l).


35/35

M-Tool SET

35 / 35

8. FOLLOW-UP REPORT Aims:

o To ensure that the recom mendations have p rac tica l c onseq uenc es in projec t imp lementa tion.o To ma ke ce rta in that rec om mendations a re impleme nt during the p rojec t lifec ycle.o To g uarante e imp rovem ents in the qua lity of the p rojec t.

Content:o Different from institution fo r institut ion;o Op en forma t, c hosen b y eac h institution.o Minimum requirements:

The institution ha s to prop ose c onc rete follow -up m ea sures foc used on the NA rec om me nda tions; These c onc rete m ea sures have to b e established within a c onc rete t ime fram e d uring p rojec t imp lem enta tion.

m tool set vfinal 2

Documents