waier 2012
DESCRIPTION
This is my presentation at the 2012 Western Australian Institute of Educational Research held at Notre Dame University, Fremantle. It uses survey responses from teachers to evaluate just how 'high-stakes' NAPLAN is.TRANSCRIPT
![Page 2: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/2.jpg)
NAPLAN: A Global Machine?
![Page 3: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/3.jpg)
AERA Definition
“Certain uses of achievement test results are termed "high stakes" if they carry serious consequences for students or for educators. Schools may be judged according to the school-wide average scores of their students. High school-wide scores may bring public praise or financial rewards; low scores may bring public embarrassment or heavy sanctions.”
http://www.aera.net/AboutAERA/AERARulesPolicies/AERAPolicyStatements/PositionStatementonHighStakesTesting/tabid/11083/Default.aspx
![Page 4: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/4.jpg)
What makes NAPLAN high-stakes?
![Page 5: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/5.jpg)
What do teachers perceive?
![Page 6: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/6.jpg)
Impact on Curriculum and Pedagogy
![Page 7: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/7.jpg)
Table of responses
![Page 8: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/8.jpg)
Survey Item
Frequencies (Percent of responding)
M (SD)SD = 0 D = 1 N = 2 A = 3 SA = 4
(1) NAPLAN has resulted in me giving lessons that improve
higher-order thinking and critical analysis by my students.
140
(18.3%)
265
(34.6%)
201
(26.2%)
149
(19.4%)
12
(1.6%)1.5 (1.0)
(2) NAPLAN has encouraged me to
give lessons that prepare students for
the tests.
23
(3.0%)
42
(5.5%)
63
(8.2%)
443
(57.8%)
196
(25.6%)3.0 (0.9)
(3) NAPLAN promotes classroom conversations that lead
to sustained dialogue between students and between
teachers and students.
163
(21.3%)
300
(39.1%)
195
(25.4%)
99
(12.9%)
10
(1.3%)1.3 (1.0)
(4) I feel that student learning in language, grammar and
technical vocabulary have improved since the introduction
of NAPLAN.
108
(14.1%)
267
(34.8%)
214
(27.9%)
172
(21.1%)
16
(2.1%)1.6 (1.0)
(5) I feel that student learning in
numeracy has improved since the
introduction of NAPLAN.
115
(15.0%)
284
(37.0%)
261
(34.0%)
100
(13.0%)
7
(0.9%)1.5 (0.9)
(6) The need to focus on NAPLAN has forced me to take
class time away from other curriculum areas.
22
(2.8%)
69
(9.0%)
84
(11.0%)
315
(41.1%)
277
(36.1%)3.0 (1.0)
(7) The need to focus on NAPLAN has resulted in less
emphasis and teaching time devoted to some curriculum
areas in all classes at my school.
15
(2.0%)
79
(10.3%)
128
(16.7%)
313
(40.8%)
232
(30.2%)2.9 (1.0)
![Page 9: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/9.jpg)
Survey Item
Frequencies (Percent of responding)
M (SD)SD = 0 D = 1 N = 2 A = 3 SA = 4
(8) NAPLAN facilitates students making connections from
what the tests assess to their real-life contexts.
272
(35.5%)
304
(39.6%)
146
(19.0%)
34
(4.4%)
11
(1.6%)1.0 (0.9)
(9) NAPLAN does not enable students to focus on identifying
and solving intellectual and/or real-world problems.
16
(2.1%)
61
(8.0%)
187
(24.4%)
331
(43.2%)
172
(22.4%)2.8 (1.0)
(10) NAPLAN has meant that students have control over the
pace, directions and outcomes of lessons in my class.
302
(39.4%)
339
(44.2%)
103w
(13.4%)
18
(2.3%)
5
(0.7%)0.8 (0.8)
(11) NAPLAN promotes a socially
supportive and positive classroom
environment.
310
(40.4%)
306
(39.9%)
125
(16.3%)
22
(2.9%)
4
(0.5%)0.8 (0.8)
(12) The criteria for judging student
performance in NAPLAN are clear
and explicit.
94
(12.3%)
216
(28.2%)
187
(24.4%)
246
(32.1%)
24
(3.1%)1.9 (1.1)
(13) NAPLAN promotes classes
where students are engaged and
on task.
238
(31.0%)
280
(36.5%)
177
(23.1%)
66
(8.6%)
6
(0.8%)1.1 (1.0)
(14) NAPLAN facilitates classes where the participation of
students of different backgrounds is encouraged.
291
(37.9%)
277
(36.1%)
170
(22.2%)
27
(3.5%)
2
(0.3%)0.9 (0.9)
![Page 10: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/10.jpg)
Mediated by SES
![Page 11: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/11.jpg)
Mediated by SES
0 1 2 3 4
(6) The need to focus on NAPLAN has
forced me to take class time away
from other curriculum areas.
(7) The need to focus on NAPLAN has resulted
in less emphasis and teaching time devoted to
some curriculum areas in all classes at my
school.
(9) NAPLAN does not enable students to focus
on identifying and solving intellectual
and/or real-world problems.
Low Average High
![Page 12: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/12.jpg)
Mediated by System
![Page 13: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/13.jpg)
Mediated by System
0 1 2 3 4
(2) NAPLAN has encouraged me
to give lessons that prepare
students for the tests.
(6) The need to focus on NAPLAN has
forced me to take class time away
from other curriculum areas.
(7) The need to focus on NAPLAN has resulted
in less emphasis and teaching time devoted to
some curriculum areas in all classes at my
school.
(9) NAPLAN does not enable students to focus
on identifying and solving intellectual
and/or real-world problems.
Government Independent Catholic
![Page 14: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/14.jpg)
Mediated by State
![Page 15: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/15.jpg)
Mediated by State
0 1 2 3 4
(2) NAPLAN has encouraged me
to give lessons that prepare
students for the tests.
(6) The need to focus on NAPLAN has
forced me to take class time away
from other curriculum areas.
(7) The need to focus on NAPLAN has resulted
in less emphasis and teaching time devoted to
some curriculum areas in all classes at my
school.
Western Australia Southern Australia
![Page 16: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/16.jpg)
Positives?
What, if any, are the positive impacts you have seen in your school/class as a result of NAPLAN?
![Page 17: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/17.jpg)
Positives?
• None or Minimal 37%
• Whole School Focus on Literacy and Numeracy 22%
• Better tracking of students 11%
• Students Get Better at Tests 10%
Can't think of any.
We can track if new teaching systems or strategies have an impact on the children's
understanding.
It helps to identify students with problems in numeracy or literacy. It also helps to identify students who are particularly strong in these areas but may have been underachieving in
school assessments.
Minimal, apart from students having a go at a structured test.
![Page 18: WAIER 2012](https://reader033.vdocuments.mx/reader033/viewer/2022060200/5598b5bb1a28aba76c8b4668/html5/thumbnails/18.jpg)
So, how high-stakes is NAPLAN?