format and rationale - doras - dcudoras.dcu.ie/4530/1/esai_2009t[6].pdf · esai 2009t[6].ppt...

4
Justin Rami & Francesca Lorenzi !"#$%& ()*% + ,-)&./#.) 01-/&2% Full time Students (ES204) Large group (75 students) Mostly traditional undergraduate Full-time Background theoretical knowledge No assessment design experience Part time Students (ES222) Small group (28 students) Mature students Part-time Professional experience Limited background theoretical knowledge Little design experience (some administered assessment) BSc in Education and Training Module: Curriculum Assessment 5 ECTS Credits @ 12 week (ES204 Fulltime Students / ES222 Part time Students) !"#$%& ()*% + ,-)&./#.) 01-/&2% Portfolio: format and rationale 3 (/)4 4%5/ #./&)-%1 3 6&7)&./*/&$ 15 "&8/-#$)&8%&9 15 )##/##*/&$ .-%$/-%) 3 :,//8;51-<)-8= 3 >"$7/&$%. )##/##*/&$ 3 ?-%$%.)44@ -/54/.$ 1& 5//8A).B 3 C*D-1E/8 "&8/-#$)&8%&9 15 )##/##*/&$ D-%&.%D4/# $7-1"97 -/54/.$%1& + )DD4%.)$%1& 3 ?-/)$%E%$@ 3 F$-".$"-/8 $7%&B%&9 3 ?1&#$-".$%E/ )4%9&*/&$ 3 >##/##*/&$ D-%&.%D4/# 3 (/)4 0%5/ #./&)-%1 3 >"$7/&$%. )##/##*/&$ 3 C8/&$%5@ #$-/&9$7# )&8 </)B&/##/# 3 (/.19&%#/ D-19-/## 3 (/.19&%#/ 8%55%."4$%/# 3 6E)4")$/ .1"-#/ /55/.$%E/&/## 3 (/54/.$ 1& 4/)-&%&9 /GD/-%/&./ H)#BI (/54/.$%1& 8%)-@ H)#BJ> >##/##*/&$ >.$%E%$@ K/#%9& + !"#$%5%.)$%1& H)#BL M//- *)-B%&9 )&8 5//8A).B H)#BJA (/;8-)5$ >##/##*/&$ ).$%E%$@ + (/#D1&8 $1 ,//8A).B !"#$%& ()*% + ,-)&./#.) 01-/&2% !"#$%& ()*% + ,-)&./#.) 01-/&2% Multiple definitions of Competence? !"#$%& ()*% + ,-)&./#.) 01-/&2% Attitudes Reflection Practical Knowledge (skills) Experience Knowledge (theoretical) Competence

Upload: trinhtram

Post on 04-Apr-2019

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: format and rationale - DORAS - DCUdoras.dcu.ie/4530/1/ESAI_2009t[6].pdf · ESAI 2009t[6].ppt Author: justinrami Created Date: 4/8/2009 12:03:59 PM

Justin Rami & Francesca Lorenzi! !"#$%&'()*%'+',-)&./#.)'01-/&2%'

•! Full time Students (ES204)

•! Large group (75 students) •! Mostly traditional undergraduate

•! Full-time

•! Background theoretical knowledge

•! No assessment design experience

•! Part time Students (ES222)

•! Small group (28 students)

•! Mature students

•! Part-time

•! Professional experience

•! Limited background theoretical knowledge

•! Little design experience (some administered assessment)

BSc in Education and Training

Module: Curriculum Assessment 5 ECTS Credits @ 12 week

(ES204 Fulltime Students / ES222 Part time Students)

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Portfolio: format and rationale

3!(/)4'4%5/'#./&)-%1'

3!6&7)&./*/&$'15'"&8/-#$)&8%&9'15')##/##*/&$'.-%$/-%)'

3!:,//8;51-<)-8='

3!>"$7/&$%.')##/##*/&$'

3!?-%$%.)44@'-/54/.$'1&'5//8A).B'

3!C*D-1E/8'"&8/-#$)&8%&9'15')##/##*/&$'D-%&.%D4/#'$7-1"97'-/54/.$%1&'+')DD4%.)$%1&'

3!?-/)$%E%$@'

3!F$-".$"-/8'$7%&B%&9'

3!?1&#$-".$%E/')4%9&*/&$'

3!>##/##*/&$'D-%&.%D4/#'

3!(/)4'0%5/'#./&)-%1''

3!>"$7/&$%.')##/##*/&$'

3!C8/&$%5@'#$-/&9$7#')&8'</)B&/##/#'

3!(/.19&%#/'D-19-/##'

3!(/.19&%#/'8%55%."4$%/#'

3!6E)4")$/'.1"-#/'/55/.$%E/&/##'

3!(/54/.$'1&'4/)-&%&9'/GD/-%/&./'

H)#BI'

'(/54/.$%1&'8%)-@'

H)#BJ>'

>##/##*/&$'>.$%E%$@'K/#%9&'+'''''!"#$%5%.)$%1&'

H)#BL''

M//-'*)-B%&9')&8'5//8A).B''

H)#BJA'

(/;8-)5$'>##/##*/&$').$%E%$@'+'(/#D1&8'$1',//8A).B'

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Multiple definitions of Competence?

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Attitudes

Reflection Practical

Knowledge

(skills)

Experience

Knowledge

(theoretical)

Competence

Page 2: format and rationale - DORAS - DCUdoras.dcu.ie/4530/1/ESAI_2009t[6].pdf · ESAI 2009t[6].ppt Author: justinrami Created Date: 4/8/2009 12:03:59 PM

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Integration of Ingredients

Pro

cess-o

rien

ted

a

pp

roach

Au

then

tic le

arn

ing

Enviro

nm

en

t

Activ

e S

tud

en

t E

ngagem

en

t

Task

base

d

PA

RT

TIM

E S

TU

DE

NT

S (ES

222)

Fo

sterin

g

Develo

pm

en

t

FU

LL T

IME

ST

UD

EN

TS (

ES204)

Bu

ild

ing p

rofe

ssio

nal

Co

mp

ete

nce

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

learning

Assessment

!"#$%&'()*%'+',-)&./#.)'01-/&2%' !"#$%&'()*%'+',-)&./#.)'01-/&2%'

3!(/)4'4%5/'#./&)-%1'

3!6&7)&./*/&$'15'"&8/-#$)&8%&9'15')##/##*/&$'.-%$/-%)'

3!:,//8;51-<)-8='

3!>"$7/&$%.')##/##*/&$'

3!?-%$%.)44@'-/54/.$'1&'5//8A).B'

3!C*D-1E/8'"&8/-#$)&8%&9'15')##/##*/&$'D-%&.%D4/#'$7-1"97'-/54/.$%1&'+')DD4%.)$%1&'

3!?-/)$%E%$@'

3!F$-".$"-/8'$7%&B%&9'

3!?1&#$-".$%E/')4%9&*/&$'

3!>##/##*/&$'D-%&.%D4/#'

3!(/)4'0%5/'#./&)-%1''

3!>"$7/&$%.')##/##*/&$'

3!C8/&$%5@'#$-/&9$7#')&8'</)B&/##/#'

3!(/.19&%#/'D-19-/##'

3!(/.19&%#/'8%55%."4$%/#'

3!6E)4")$/'.1"-#/'/55/.$%E/&/##'

3!(/54/.$'1&'4/)-&%&9'/GD/-%/&./'

H)#BI'

'(/54/.$%1&'8%)-@'

H)#BJ>'

>##/##*/&$'>.$%E%$@'K/#%9&'+'''''!"#$%5%.)$%1&'

H)#BL''

M//-'*)-B%&9')&8'5//8A).B''

H)#BJA'

(/;8-)5$'>##/##*/&$').$%E%$@'+'(/#D1&8'$1',//8A).B'

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Research results: stage 1

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Little or no experience of task-based portfolios

Making the unfamiliar familiar = transforming tasks into essays

Under-estimating

preparation time

What & How? Need for guidance and reassurance

Initial unease with being allowed to be creative

Little or no experience of task-based portfolios

Under-estimating preparation time

What & How? Need for guidance and reassurance

Initial unease with being allowed to be creative

Page 3: format and rationale - DORAS - DCUdoras.dcu.ie/4530/1/ESAI_2009t[6].pdf · ESAI 2009t[6].ppt Author: justinrami Created Date: 4/8/2009 12:03:59 PM

!"#$%&'()*%'+',-)&./#.)'01-/&2%' !"#$%&'()*%'+',-)&./#.)'01-/&2%'

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

71 out of 75 students successfully completed the portfolio (94.7% completion

rate)

60% of the students improved the mark on their Activity design

(Task1a & Task1b)

Bell Curve overall mark distribution

Low peer marking reliability (Task 2)

Low reflectivity (Task3)

25 out 28 students successfully completed the portfolio (89.2%

completion rate)

89% of the students improved the mark on their Activity design

(Task1a & Task1b)

Narrow/ high overall marks range

High peer marking reliability (Task2)

High reflectivity (Task3)

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

I learned how to create an assessment

I have learned about how much time goes into designing assessment

I learned to apply other elements of my learning from other modules into this assignment

I learned how to give clearer instructions in assessment design

I have learned how to take feedback (good or bad). It gives an insight into how others see your work.

My understanding of assessment and feedback are greatly improved.

I have learned to link theory to practice.

have found this module very relevant to my work

I have gained practical experience in designing assessment

I had the opportunity to apply what I had learnt from lectures

I have experienced the whole Kolb's cycle

With this module I have experienced Bloom’s higher levels

This module was a case of experiential learning

The learning outcomes for this module were fully met

+

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Deciding on a task was hard

I found it difficult to be both the teacher and the student.

Matching learning activities to the assessment was difficult

Linking theory to practice is difficult Finding the time (and energy) to correct was hard

Find the right level (too strict /too generous) to mark at was hard

I felt I was not qualified to mark fellow classmates work

Taking feedback (even if constructive) was (is) difficult

I would have preferred the lecturer to mark instead of peer marking

Initially very daunting

Information overload Task1a too early in the module

Uneasy with marking fellow student

Too much jargon/language initially difficult for first-timer

Very time consuming/underestimated the preparation

tim

I would have preferred feedback from the lecturer on Task1a

I would have liked more guidance on marking

I would have liked more guidance on the reflection component

-

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Page 4: format and rationale - DORAS - DCUdoras.dcu.ie/4530/1/ESAI_2009t[6].pdf · ESAI 2009t[6].ppt Author: justinrami Created Date: 4/8/2009 12:03:59 PM

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

Teacher Competence

The lecturer facilitated the transition

From student to teacher

Empathise with assessors

Appreciation of

complexity of teacher’s role in assessment

Appreciation of complexity of assessment

design

Fostering openness to new

assessment forms

Fu

ll-t

ime P

art-tim

e

!"#$%&'()*%'+',-)&./#.)'01-/&2%'

!"#$%&'()*%'+',-)&./#.)'01-/&2%' !"#$%&'()*%'+',-)&./#.)'01-/&2%'