national launch conference quality enhancement in: - assessment - responding to student needs
TRANSCRIPT
![Page 1: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/1.jpg)
National Launch Conference
Quality Enhancement in: - Assessment - Responding to Student Needs
![Page 2: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/2.jpg)
At the end of a full day……….
…….what can I add or contribute?
1. A voice from the grass roots2. A practitioner's perspective on the basis for
the themes3. Practicable and proven suggestions about
what serving teachers can do next
![Page 3: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/3.jpg)
For teachers like me….
Student numbers
Increased, with poorer students
Resources- decreased
Each year, it seems…..
![Page 4: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/4.jpg)
So if I achieve enhancement..
The first part of the return from improvement will be taken up in simply holding quality and standards where they were last year, in a more demanding situation
Only anything above and beyond that will go into acknowledged enhancement
![Page 5: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/5.jpg)
Significant enhancement?
In my experience, it occursNOT by doing something better then before, butBy doing something in a better – and hence different – waySo I am seeking changes in my practice which will be cost-effective, and effective
![Page 6: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/6.jpg)
As a foot soldier, I see the present scheme in these terms:
Foundation built since audit began
Well-founded new developments
![Page 7: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/7.jpg)
As a foot soldier, I see stage 1 of the scheme in these terms:
Foundation built since audit began
Enhancement of
AssessmentResponding to
student needs
![Page 8: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/8.jpg)
So? We should:
1. Identify what we are building on
2. Work on the developments of that
which have most potential
![Page 9: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/9.jpg)
Enhancing ASSESSMENT?
What are we building upon?
Alignment of Assessment and OutcomesReal attention being given to key skills and higher level learning outcomes 25 years experience of self-assessment
![Page 10: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/10.jpg)
Outcomes
Assessment T & Learning
Ideal Alignment
![Page 11: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/11.jpg)
Outcomes
Assessment T & Learning
10 years ago, there was much lack of fit
![Page 12: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/12.jpg)
Every audit found examples of:
Outcomes claimed but not assessed
Assessment in place, but satisfied by performance we don’t really value
Outcomes for which there was no purposeful development activity in place
![Page 13: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/13.jpg)
Biggest problems were with:
“Educating the Reflective Practitioner”
for
Higher level cognitive and interpersonal capabilities
![Page 14: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/14.jpg)
Outcomes
?Assessment
?
?T & Learning
?
Alignment for Capability
![Page 15: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/15.jpg)
Change and development
- but this has taken time!
![Page 16: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/16.jpg)
Ex: Aalborg pilot (1993)Project-oriented course; end of semester 1Previous assessment based on project report with minimal “process analysis”Pilot for 25 studentsWhat did you have to do? How did you do it?How well did you do it? How can you do better next time?How useful has this been to you? Immediately, enthusiasm. Six months later: “You must never do that again, because…………”
![Page 17: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/17.jpg)
“You must never do that again, because….………….. we had such an advantage over the other 375 students”. You must do it for everyone.
Yet only in 2002 were outcomes and learning and teaching eventually alignedAnd assessment still needs attention
Change and development do take time!
![Page 18: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/18.jpg)
Generally, in Scotland, things have changed:
Best practice is built upon programme specifications, in which outcomes and assessment are usually well aligned
![Page 19: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/19.jpg)
The result is that
Outcomes and assessment convey much the same message; in addition, assessment is usually transparent
![Page 20: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/20.jpg)
Outcomes
Assessment T & Learning
Modern Alignment
![Page 21: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/21.jpg)
Outcomes
Assessment T & Learning
Modern Alignment
![Page 22: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/22.jpg)
Outcomes and
AssessmentT & Learning
Modern Alignment
![Page 23: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/23.jpg)
The next logical step is……….
……..to integrate these two remaining aspects more and more
![Page 24: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/24.jpg)
Outcomes and
Assessmentand
Learning and Teaching
Future Integration
![Page 25: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/25.jpg)
And that is happening already:
Last week I listened to a Salford Computer Scientist, describing his work on their PGCHECreating a “Virtual Assessment Environment”Driven from radically changed and outcome-sensitive assessmentQuantum leap in outcomes and performanceYesterday, an e_mail describing introduction of formative peer assessment in Chem Eng at Heriot-Watt. BIG SUCCESS!
![Page 26: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/26.jpg)
Integration should entail:
Self-assessing learners who direct their own learningSelf-assessing learners who monitor their own learningSelf-assessments presented, portfolio-style, for “auditing”Peer-assessing in learning groups where structured interaction is cost-effectively harnessed for feedforward Rigorous making of judgements, in all of this
![Page 27: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/27.jpg)
Heading
Performance
Making the judgement – transparently and objectively
S_
C_
A_
L_
E_
![Page 28: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/28.jpg)
The result? Alverno CollegeLiberal Arts College; self-assessment integralAccess or dropout entrants commonGroup overheard at breakfast with domestic concerns……….……. and then planning what they each wanted to take from the morning's lesson, and how they would arrange thatAnother group overheard on departure……….Would it be like that in your university?Moral: self-monitoring and self-directing pays off
![Page 29: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/29.jpg)
Soft words butter no parsnips!
Specifically, what should integration entail for the average, hard-pressed lecturer?
![Page 30: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/30.jpg)
Enhancing ASSESSMENT?
What should we be doing next?I know what I’ll be doing! [Cost-effectively]
[Completing aligning Assessment and Outcomes] [Continuing aligning both, with Learning]Developing self-assessment, especially for higher level abilitiesHence developing formative peer assessment Making all assessing transparent – and objective
![Page 31: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/31.jpg)
Enhancing ASSESSMENT?
What should we be doing next?I’ve told you what I’ll be doing!
What will you be doing?1 + 1 minute to tell your neighbour, and hear what they have to say
![Page 32: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/32.jpg)
So much for:
Foundation built since audit began
Enhancement of
Assessment
![Page 33: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/33.jpg)
Now what about:
Foundation built since audit began
Enhancement of
Responding to
student needs
![Page 34: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/34.jpg)
RESPONDING TO STUDENT NEEDS?
What are we building upon here? 25 years of campaigning for data that informs!
The demand for informed self-evaluation………. has led to the ingathering of data……. using effective tools of enquiry…. informing teachers about student learning and the learning experience………. in forms which can be used to enhance……….and prompt us to discover and meet needs
![Page 35: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/35.jpg)
BUT…………
The pedagogy and practice are still not very well developedWe are not yet very good at dealing cost-effectively with varied individual needsAnd we are only tentatively grappling with different types of need - especially the affective needs
![Page 36: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/36.jpg)
We must still develop
Methodology, and proven good practice - for varied needs
![Page 37: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/37.jpg)
Learning Needs…...
Are held in different ways
And so have to be dealt with in different ways
[And may come up as fish swimming the wrong way, if your version of ppt is not the same as mine]
![Page 38: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/38.jpg)
Learning needs can be like ...
Fish, in a fish-ladder
![Page 39: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/39.jpg)
Need = declared
Desired outcome known: let’s get on with it
Just listen to me
![Page 40: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/40.jpg)
Need = known
Safety!
Outcome known, but private!
![Page 41: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/41.jpg)
Need = undefined
Exploring possibiliti
es
I don’t know what my need is!
![Page 42: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/42.jpg)
Need = unperceived
Challenge!
I don’t recognise that I have a need
![Page 43: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/43.jpg)
Learning needs can be like ...
Fish, in a fish-ladderlisten
Give me safety
Can I explore?
I’m fine
![Page 44: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/44.jpg)
It’s obvious, but neglected that
We can’t respond to needs until we find out what they are!
![Page 45: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/45.jpg)
It’s obvious, but neglected that
We won’t find out what the real needs are, unless we ask – and listen – and are seen as likely to first listen and then act upon what we hear
![Page 46: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/46.jpg)
WHAT NEXT?
What should we be doing next?I know what I will be doing next
![Page 47: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/47.jpg)
I’m developing appropriate e_tivities:
NEED
Declared
Known
Undefined
Unperceived
ACTIVITY
Mager’s answering
Anonymous negotiation
Action learning sets
Claim – and checking
![Page 48: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/48.jpg)
At course team level, I’ll
First establish a partnership approach, involving students and teachersPromote “tools of enquiry”, far beyond questionnairesUse these to help teachers and students to analyse the learning experience and identity the real needs Pilot enhancement for current cohortsHOW?
![Page 49: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/49.jpg)
As an example, from UHI:
A new module, with new goals and methodsSix weeks into semester, a morning for evaluation workshopsStudents and staff analyse experiences so farCompare notesDecide immediate priorities and changes in plan for rest of semesterEstablish that teachers wish detailed rather than general feedback: not “This is (in)effective” but “This is (in)effective, because ………….”
![Page 50: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/50.jpg)
The activities were planned to:
1. Identify worthwhile learning and development to date
2. Advise Stop/Start/Continue on learning activities
3. Identify immediate priorities, for learners and teachers
4. Anticipate difficulties
![Page 51: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/51.jpg)
Joint forward planning, for the current cohort, meant
Real point in identifying needs
Shared responsibility, and monitoring of decisions for enhancement
Learning and teaching activities could become just that
![Page 52: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/52.jpg)
Best practice is:Formative, not summative, for allSet up at the grass roots, in particular contexts Suitably timed Based on safety to declare or expose needsEmpathic, especially to affective needsResponsive – and thus obviously worthwhileCost-effectiveA joint activity Intrinsic to the learner-teacher relationship
![Page 53: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/53.jpg)
The consequences?
Once students have engaged in a meaningful exercise to identify their needs, and take them on board, then …
They know that we want to knowThey tell us, unprompted, in helpful detail, about joys as well as worries
![Page 54: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/54.jpg)
BUT, institutionally
The methodology is less well developed – and appreciatedThe progression has been far from sector-wideSome institutions need to catch up with best practice elsewhereThey risk being left badly behindSo the case for institutional collaboration, for “working together”, is strong in this case
![Page 55: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/55.jpg)
INSTITUTIONALLY, I WOULD…….
First establish a partnership approach, at course levelPromote “tools of enquiry”, far beyond questionnairesUse these to help teachers and students to analyse the learning experience, and enhance it Pilot enhancement which benefits current cohortsPillage effective practice
![Page 56: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/56.jpg)
WHAT NEXT - INSTITUTIONALLY?
I’m just a grass roots teacher nowadaysYOU are here today as the institutional policy makers. So ……….
What should your institution be doing next to enhance in this area?1 + 1 minute to tell your neighbour, and listen to what they have to say
![Page 57: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/57.jpg)
Scotland will concentrate on:
Foundation built since audit began
Enhancement of
AssessmentResponding to
student needs
![Page 58: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/58.jpg)
It will be exciting, and worthwhile:
We shall be striving to optimise the effectiveness of whatever resource is available to each of us, for the benefit of student learningThe evaluative innovators, who have so often been regarded as the lunatic fringe, could emerge as those whose work and advice is sought, and built upon
![Page 59: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/59.jpg)
SO? What is teaching?
“Teaching is an activity which brings together two people, one of whom is rather more of a learner, the other of whom is rather more of a teacher – an activity within which learning and teaching take place”
![Page 60: National Launch Conference Quality Enhancement in: - Assessment - Responding to Student Needs](https://reader035.vdocuments.mx/reader035/viewer/2022062314/56649c995503460f94956142/html5/thumbnails/60.jpg)
Let’s set out to establish that:
“Enhancement is an activity which brings together two groups of people, one of which consists of those who are rather more learners, the other of which includes those who are rather more teachers – an activity within which the enhancement of learning and teaching takes place”