testa at unsw, sean brawley, testa summit 16 sept 2013
DESCRIPTION
TESTA is Faculty of Arts and Social Sciences. Efficiency in Assessment and Feedback. Data-driven approach to fast-tracking quality assurance to make responsive changes to assessment.TRANSCRIPT
![Page 1: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/1.jpg)
The UNSW experiencewith TESTA
Faculty of Arts and Social Sciences
Professor Sean BrawleyAssociate Dean
(Education)
![Page 2: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/2.jpg)
![Page 3: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/3.jpg)
UNSW Assessment Project Goals
1. Improve efficiency in the conduct of assessment in order to reduce academic workloads and ensure that student’s time on tasks is not spent on unnecessary activities, which have the sole purpose of generating a grade.
2. Improve the educational effectiveness of assessment tasks to ensure that they engage and motivate students in their learning efforts.
![Page 4: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/4.jpg)
3. Increase the alignment of assessment tasks with the disciplinary goals and the learning outcomes of individual courses such that student efforts are directed towards achieving the key learning objectives. 4. Improve the alignment of assessment activity and processes across the faculty.
5. Increase the congruence between Faculty assessment processes and practices and the University’s assessment policies, procedures and aspirations.
![Page 5: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/5.jpg)
Assessment Tasks in H&PTut Particip/Prep
11%
Individual Present3%
Group Work3%
Tut Writing18%
Extended Writing36%
Short writing11%
Tests/Quizzes8%
Final Exam10%
![Page 6: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/6.jpg)
Assessment Tasks in EMPA
![Page 7: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/7.jpg)
UNSW HP assessments tasks against those of the University of Sydney, University of Melbourne, University of Nottingham, George Mason University and UCLA combined.
Extended Writing Short Writing Exams Tut particip Indiv Present Group Work Tests/Quizzes0
5
10
15
20
25
30
35
40
45
50
UNSWOthers
![Page 8: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/8.jpg)
No. Assessment Tasks per Course
UNSW USYD MELB NOTT UCLA GM0
1
2
3
4
5
6
7
8
![Page 9: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/9.jpg)
Amount of words per level
USYD MELB GM NOTT0
1000
2000
3000
4000
5000
6000
Level 1Level 2Level 3
![Page 10: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/10.jpg)
Faculty Assessment Tool
FASS Assessment Project
Efficiency /Quality
Assurance
Innovation / Quality
Improvement
Faculty Working
Party
TESTA
Asses. Tool
Prototype
StudentTime on
TaskTrial
60 Students
FocusGroups
1700Students Complete
AEQ
Reduce average student time on task from 114 to 85 hoursEstablish staff marking expectations (time/words per student)
Trial S1, 201215 courses
1000+ students53 staff diaries
170 student diaries
• Incorporates GA Tool• Operational S2, 2012
• Aids governance, • Mainstreams innovation• Self-pop course guides
![Page 11: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/11.jpg)
![Page 12: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/12.jpg)
Workshop Feedback
• “Interesting project that will enable innovation in both efficiency and pedagogy”
• “The work shop was much more useful than I thought it was going to be …the information about TESTA has reassured me that there will be a quality/pedagogy component to the exercise, rather than only a resources/efficiency drive. I now have a better idea how TESTA brings the student voice to the fore, and think this is a valuable undertaking”
![Page 13: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/13.jpg)
Workshop Feedback
• “Thanks for the opportunity to do this workshop. Ive learned much and realise how I can improive my own practice and help steer colleagues in productive directions”
• “The challenge is how to service implementation with very limited resources and competing demands and performance expectations … Positive education frame of reference is a good place to start … with a proven model of change. Thanks for a good experience in collective problem solving”
![Page 14: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/14.jpg)
Workshop Feedback
• “I fear that everyone knows that ultimately what we decide will have very little impact on decisions that are made higher up, and that [these decisions] are not based on pedagogical considerations. On that basis, its very frustrating … The 2 days were really interesting for me. I do think, however, that the major purpose for which it ran, is unlikely to be achieved. It is difficult not to be cynical about the pressures coming from above — and they are not pedagogical”
![Page 15: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/15.jpg)
Workshop Feedback
“Learnt heaps — so good to get an opportunity to discuss assessment”
“TESTA sessions did not inspire enthusiasns when I said I would attend but I have been pleasantly surprised by how useful learning about the system and process has been. I now want to revisit the program I convene — this would be so useful for anyone who developing a course or program”
![Page 16: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/16.jpg)
Workshop Feedback
• “I thought the TESTA methodology was very good and thorough but not realistic for the time and resource constraints that UNSW operates under”
![Page 17: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/17.jpg)
Assessment Experience Questionnaire
• Slight changes to some of the 28 AEQ questions
![Page 18: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/18.jpg)
“The teachers made it clear from the start what they expected from students”
Became
“My lecturers/tutors made it clear from the start what they expected from students”
![Page 19: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/19.jpg)
“It was often hard to discover what was expected of me in this course”
Became
“It was often hard to discover what was expected of me in my major/program”
![Page 20: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/20.jpg)
“I learnt new things while preparing for the exams”
Became
“I learnt new things while preparing for the exams/class tests”
![Page 21: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/21.jpg)
Assessment Experience Questionnaire
• Slight changes to some of the 28 AEQ questions
• Online instrument
![Page 22: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/22.jpg)
Assessment Experience Questionnaire
• Slight changes to some of the 28 AEQ questions
• Online instrument• Explode email to nearly five thousand
undergraduate students
![Page 23: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/23.jpg)
![Page 24: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/24.jpg)
![Page 25: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/25.jpg)
Assessment Experience Questionnaire
• Slight changes to some of the 28 AEQ questions
• Online instrument• Explode email to nearly five thousand
undergraduate students• 1820 responded (37%)
![Page 26: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/26.jpg)
AEQ responses by Program
![Page 27: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/27.jpg)
Demographics• 85% of students domestic, 15% international – would rep the average
• Age17-21 — 55% 22-30 — 37%31 and over 6%
• Gender72% were female (higher than Faculty average)
• Level 100 level — 28% 200 level — 22% 300 level — 27% 400 level above — 21% (greater than average)
• GPApass average 16%credit average 48% a distinction average 31% 4% high distinction average 1% failing average
![Page 28: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/28.jpg)
![Page 29: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/29.jpg)
![Page 30: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/30.jpg)
![Page 31: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/31.jpg)
![Page 32: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/32.jpg)
![Page 33: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/33.jpg)
![Page 34: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/34.jpg)
![Page 35: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/35.jpg)
![Page 36: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/36.jpg)
![Page 37: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/37.jpg)
![Page 38: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/38.jpg)
![Page 39: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/39.jpg)
![Page 40: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/40.jpg)
Feedback
![Page 41: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/41.jpg)
![Page 42: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/42.jpg)
![Page 43: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/43.jpg)
![Page 44: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/44.jpg)
![Page 45: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/45.jpg)
![Page 46: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/46.jpg)
![Page 47: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/47.jpg)
![Page 48: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/48.jpg)
![Page 49: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/49.jpg)
![Page 50: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/50.jpg)
![Page 51: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/51.jpg)
![Page 52: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/52.jpg)
![Page 53: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/53.jpg)
![Page 54: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/54.jpg)
![Page 55: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/55.jpg)
![Page 56: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/56.jpg)
![Page 57: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/57.jpg)
![Page 58: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/58.jpg)
![Page 59: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/59.jpg)
![Page 60: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/60.jpg)
![Page 61: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/61.jpg)
![Page 62: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/62.jpg)
![Page 63: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/63.jpg)
![Page 64: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/64.jpg)
![Page 66: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/66.jpg)
![Page 67: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/67.jpg)
![Page 68: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/68.jpg)
![Page 69: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/69.jpg)
![Page 70: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/70.jpg)
![Page 71: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/71.jpg)
![Page 72: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/72.jpg)
![Page 73: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/73.jpg)
![Page 74: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/74.jpg)
![Page 75: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/75.jpg)
![Page 76: TESTA at UNSW, Sean Brawley, TESTA Summit 16 Sept 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062511/54c164d34a795972578b464e/html5/thumbnails/76.jpg)