interpreting feedback from baseline tests - whole school & individual student data

Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data

Course: CEM Information Systems for Beginners and New Users

Day 1 Session 2

Wednesday 17th October 2012

Peter Hendry: CEM Consultant

[email protected]

•To inform professional judgement

•To start a conversation

USING BASELINE DATA FOR TEACHING AND LEARNING

IF FEEDBACK DATA IS TO BE TRUSTED THEN PROBABLY:

• The students understood the purpose of the assessments

• And each student did their best at the time…….

• As a year group, how able are they?

• What strengths and weaknesses does the group have?

• How did each student perform?

Bands, percentiles, standardised scores…

0

50 60 70 80 90 100 110 120 130 140 150

Standardised scores

DC B

A

105 20 301 40 90 958070 996050Percentiles:

25 75

National Quartile Ability Bands

BASELINE D C B A

ALIS: AV GCSE <5.0 5.0-5.7 5.7-6.55 >6.55

Yellis % >43 43-52 52-61 >61

STANDARDISED CABT MidYIS, Yellis and Alis <90 90-100 100-110 >110

IN ANY COHORT, 25% OF THE POPULATION WILL BE IN EACH BAND.

THE VALUES MAY VARY SLIGHTLY FROM YEAR TO YEAR

BANDS

Alis: year 12 students, two baseline profiles for the same school

Nationally, 25% in each band

Comments and potential implications?

Band Profile Graph: all MidYIS cohort

Checking this graph each year will give you an immediate overview of your intake.

A school with a ‘completely average’ intake would have 25% of pupils within each band.

Band D Band A

35

2621

17

0

10

20

30

40

50

60

70

80

90

100

D C B A

Per

cen

t

Maths: Percent in each BandYear 7 MidYIS Test 2011/2012

17

37

2025

0

10

20

30

40

50

60

70

80

90

100

D C B A

Per

cent

Vocabulary: Percent in each BandYear 7 MidYIS Test 2011/2012

Band A Band ABand D Band D

Comments?

11

21

33 35

0

10

20

30

40

50

60

70

80

90

100

D C B A

Per

cent

Non-Verbal: Percent in each BandYear 7 MidYIS Test 2011/2012

2924 26

21

0

10

20

30

40

50

60

70

80

90

100

D C B A

Per

cen

t

Skills: Percent in each BandYear 7 MidYIS Test 2011/2012

2924 26

21

0

10

20

30

40

50

60

70

80

90

100

D C B A

Per

cen

t

Skills: Percent in each BandYear 7 MidYIS Test 2011/2012

38

2619 17

0

10

20

30

40

50

60

70

80

90

100

D C B A

Per

cen

t

Proof Reading: Percent in each BandYear 7 MidYIS Test 2011/2012

24 23 2330

0

10

20

30

40

50

60

70

80

90

100

D C B A

Per

cent

Perceptual Speed & Accuracy: Percent in each BandYear 7 MidYIS Test 2011/2012

Vocabulary Maths Non Verbal Skills MidYIS Score

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

Average 100.6 95.9 105.3 99.2 98.1

St. error 1.1 1.1 1.1 1.1 1.1

On another day, with 95% certainty, the score of 100.6 (+/- 1.1 x 2)

• would not be higher than 100.6 + 2.2 = 102.8

• would not be lower than 100.6 – 2.2 = 98.4

Standardised Scores Sort Data By...

Mean Score: 100

Standard Deviation: 15

How might this information be useful?

Scores Standardised On A Nationally Representative Sample of Schools

Vocabulary Maths Non Verbal Skills MidYIS ScoreS

t. S

core

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

100.6 95.9 105.3 99.2 98.1

1.1 1.1 1.1 1.1 1.1

134 A 119 A 116 A 87 D 130 A

95 C 97 C 88 D 85 D 95 C

99 C 104 B 112 A 110 B 101 B

93 C 94 C 120 A 91 C 93 C

116 A 99 C 118 A 84 D 109 B

93 C 95 C 120 A 113 A 93 C

92 C 83 D 112 A 94 C 87 D

102 B 102 B 112 A 108 B 102 B

Proof Reading PSA

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

93.7 102.2

1.1 1.1

101 B 83 D

76 D 93 C

97 C 114 A

80 D 99 C

102 B 78 D

119 A 107 B

80 D 102 B

106 B 107 B

Scores over 130 – top 2% nationally




Using national baseline test scores to Identify Gifted Pupils

Year 7: the ‘top’ students

Vocabulary Maths Non Verbal Skills MidYIS Score

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

St.

Sco

re

Ban

d

100.6 95.9 105.3 99.2 98.1

1.1 1.1 1.1 1.1 1.1

150 A 150 A 142 A 150 A 150 A

122 A 132 A 130 A 150 A 130 A

134 A 119 A 116 A 87 D 130 A

120 A 123 A 110 B 132 A 123 A

127 A 113 A 122 A 95 C 123 A

117 A 121 A 116 A 109 B 121 A

117 A 120 A 120 A 128 A 120 A

125 A 111 A 114 A 100 B 120 A

146 146145 146101 83124 129109 89

Pro

of

read

ing

Per

cep

tual

sp

eed

an

d a

ccu

racy

50 60 70 80 90 100 110 120 130 140 150

Standardised Test Score

Stanine 1

2 3 4 5 6 7 8 9

4% 4 % 7% 7% 12% 12% 17% 17% 20%

Individual Pupil Record 75Date Of Birth: 24/12/97 Student Number:Sex: F Form:

Band Stanine PercentileStandard

ScoreVocabulary B 5 53 101

Maths B 5 52 101

Non-Verbal C 5 46 98

Skills C 5 46 99

MidYIS Score B 5 52 101

50

60

70

80

90

100

110

120

130

140

150

Vocabulary Maths Non-Verbal Skills MidYIS Score

Na

tio

na

lly

Sta

nd

ard

ise

d S

core

s

Nationally Standardised Scores with 95% Confidence Band

106 B 96 C

Proof Reading PSA

A relatively lower vocabulary score might indicate a difficulty which:

• could contribute to under-performance in most, if not all subjects

• might lead to ‘stressful situations’

• may lead to further investigation and subsequent pupil support

Individual Pupil Record ZUHA OKARVIDate Of Birth: 15/10/98 Student Number:Sex: F Form: 8C


ScoreVocabulary C 4 35 94

Maths B 6 75 110

Non-Verbal B 6 63 105

Skills A 7 84 115


50

60

70

80

90

100

110

120

130

140

150


Nat

iona

lly S

tand

ardi

sed

Sco

res


Individual Pupil Record RAWAD OKBIDate Of Birth: 29/08/99 Student Number:Sex: M Form: 8E


ScoreVocabulary D 3 20 87

Maths B 5 58 103


Skills B 6 71 108

MidYIS Score C 4 34 94

50

60

70

80

90

100

110

120

130

140

150


Na

tio

nall

y S

tan

da

rdis

ed

Sco

res


Proof Reading PSA Proof Reading PSA

121 A 108 B 88 D 118 A

A relatively low maths score might indicate potential weaknesses in subject areas which require:

• numerical skills

• logical thinking

• skills such as sequencing

CONVERSELY: a high maths score but a low vocab/reading score…….

Individual Pupil Record RACHEL STRONACHDate Of Birth: 13/1/99 Student Number:Sex: F Form: 8E


ScoreVocabulary B 6 63 105

Maths D 3 15 84

Non-Verbal A 6 76 111

Skills B 6 67 107


50

60

70

80

90

100

110

120

130

140

150


Na

tio

na

lly

Sta

nd

ard

ise

d S

core

s


Individual Pupil Record CAMERON BALLDate Of Birth: 29/10/98 Student Number:Sex: M Form: 8E



Maths A 9 99 135

Non-Verbal C 4 39 96

Skills B 6 74 110

MidYIS Score A 7 87 117

50

60

70

80

90

100

110

120

130

140

150


Nat

iona

lly S

tand

ardi

sed

Sco

res


A relatively high non-verbal score might indicate potential strengths in subject areas which require:

• 3d, and 3d into 2d, visualisation

• Spatial awareness

• Understanding images in 2d representing 3d

• Extracting information from visual images

• Science, D and T, Art, Geography……

and vice versa

Individual Pupil Record SULAIMAN BAHELMIDate Of Birth: 23/2/99 Student Number:Sex: M Form:


ScoreVocabulary A 7 81 113

Maths B 6 66 106

Non-Verbal D 3 18 86

Skills B 6 68 107


50

60

70

80

90

100

110

120

130

140

150


Nat

iona

lly S

tand

ardi

sed

Sco

res


Date Of Birth: Student Number:Sex: M Form: 7E



Maths C 4 34 94


Skills C 4 28 91


50

60

70

80

90

100

110

120

130

140

150


Nat

ion

ally

Sta

nda

rdis

ed S

core

s


A relatively low skills score might indicate potential weaknesses such as:

• Speed of processing/working

• Potential underperformance in test/examination conditions

• Poor written work (SPG etc.)

and vice versa

Skills: Proof Reading

Skills: Perceptual Speed and Accuracy

Date Of Birth: Student Number:Sex: M Form: 7Y


ScoreVocabulary A 9 99 134

Maths A 8 90 119


Skills D 3 20 87


50

60

70

80

90

100

110

120

130

140

150


Nat

iona

lly S

tand

ardi

sed

Sco

res


Proof Reading PSA

Sex: M Form:



Maths A 8 89 119


Skills B 6 61 104


50

60

70

80

90

100

110

120

130

140

150


Nat

iona

lly S

tand

ardi

sed

Sco

res


Proof Reading PSA

101 B 83 D 83 D 114 A

SEN use of MIDYIS test results

Analysis of baseline test individual skill profiles to indicate potential areas of learning difficulties

e.g. If the two lowest scores are the vocabulary and skills section and are, or close to being, statistically significant (see IPR)

• Then the student might be dyslexic.......

• Follow-up with appropriate diagnostic tests…..

Individual Pupil Record LAUREN BAKERDate Of Birth: 28/11/99 Student Number: J870396003050

Sex: F Form: 7C



Maths B 6 68 107


Skills D 2 10 81


50

60

70

80

90

100

110

120

130

140

150


Nat

ion

ally

Sta

nd

ard

ised

Sco

res


07S1 - 117

07Q1 + + 117

07H1 + 126

07M2 - 106

07Q2 + 127

07H1 - + 120

07Y1 111

07Y1 + + 113

07S2 98

07S2 - - 137

07T2 + 116

07Q1 + 101

07S1 + 113

07H2 - 126

07H1 + 88

07H2 104

07M1 123

07M2 - 128

07S1 - 111

07Q1 + 114

07Q2 + 109

7Y2 - + 132

Last Name First Name Tutor Group Vocab Maths Non Verbal Skills Overall MidYIS

Sharing data with colleagues: e.g. baseline test data

INSIGHT Pupil IPR


ScoreKS3

Equivalent

Speed Reading B 6 69 107 6c

Text Comprehension B 5 60 104 5a

Passage Comprehension C 5 45 98 5b

Overall Reading B 5 59 103 5a

Number & Algebra D 3 19 87 4a

Handling Data B 6 61 104 6a

Space, Shape & Measures D 4 23 89 5c

Overall Mathematics C 4 31 93 5b

Biology A 7 82 114 6a

Chemistry A 9 96 127 7a

Physics A 8 89 118 7c

Overall Science A 8 93 122 7b

Vocabulary B 6 65 106

Non Verbal B 6 70 108

Skills A 8 92 121

Overall Ability C 4 36 94

40

60

80

100

120

140

160

Sp

eed

Rea

din

g

Tex

t Co

mp

rehe

nsio

n

Pas

sag

e C

om

preh

ensi

on

Ove

rall

Rea

ding

Num

ber &

Alg

ebra

Han

dlin

g D

ata

Sp

ace,

Sh

ape

& M

easu

res

Ove

rall

Mat

hem

atic

s

Bio

logy

Ch

emis

try

Ph

ysic

s

Ove

rall

Sci

ence

Vo

cabu

lary

No

n V

erba

l

Ski

lls

Ove

rall

Abi

lity

Sta

nd

ard

ised

Sco

res

Standardised Scores With 95% Confidence Band

Mat

hs

N

2a

c

3b

a

c

4b

a

c

5b

a

c

6b

a

c

7b

a

c

8b

a

Sp

eed

Rea

din

g

Tex

t Co

mp

rehe

nsio

n

Pas

sag

e C

om

preh

ensi

on

Ove

rall

Rea

ding

Num

ber &

Alg

ebra

Han

dlin

g D

ata

Sp

ace,

Sh

ape

& M

easu

res

Ove

rall

Mat

hem

atic

s

Bio

logy

Ch

emis

try

Ph

ysic

s

Ove

rall

Sci

ence

KS

3 L

evel

KS3 Equivalent Levels with 95% Confidence Band

IPRs in KS3 Levels

NATIONAL AVERAGE

The code:

j: reduces size

k: infills

m: inverts