multiple assessment methods

Multiple Assessment

Methods

Jeremiah Connell

Stiggins, R. (2007). An introduction to student-involved assessment for learning. Upper Saddle River, New Jersey:

Pearson Prentice Hall.

Stiggins’s four categories of

assessment methods:

•Selected response

•Essay

•Performance assessment

•Personal communication

Let’s imagine an example of each:

Selected response•Of the following choices, pick the item that is not a result the Industrial Revolution:

•a) increased urbanization b) Marxism c) Romanticism d) the likelihood of finding a piano in a middle-class family’s home e) the Age of Enlightenment

Let’s imagine an example of each:

Essay

•Do you think that student protests against the Vietnam War were effective? Why or why not?

Essays • If you care about the quality of your writing, it’s easy to

go overboard and spend much more time on an assignment than an instructor expects. Conversely, if you don’t care about the quality of your writing, or never developed strong writing skills, it’s possible for your writing to get in the way of demonstrating how much of the content you have understood.

• Writing rubrics can help to ameliorate this. (Perhaps cover rubrics on another staff development day?)

Let’s imagine an example of each: Performance

Assessment•Two students are asked to

act out a short skit from their Spanish textbook (or better yet, speak and listen to each other without relying on a script from the textbook).

Let’s imagine an example of each: Personal communication:

•A teacher asks a student to clarify a point that he or she made in a paper. The student re-states his or her opinion in the conversation and uses information from the coursework to back it up. The paper may need more work, but in his or her conversation with the teacher, the student reveals a decent grasp of the material.

Personal communication

•Being able to assess reasoning is “the real strength of personal communication as a means of assessment” (p. 203). You can ask a student how he/she arrived at a conclusion. You can ask him/her reasons for an opinion. You can follow along with his/ her train of thought, and unlike evaluating written responses, you get your information right away. Stiggins calls the “assessment of oral communication skills” personal communication’s “great strength” (p. 204). Facility with language is something I want to encourage wherever possible, but I think that a student’s deficit in oral communication skills must be considered when using personal communication to assess learning. This is just another reason to make sure that you use a variety of assessment methods and are clear about matching assessment methods to what you really want to measure.

How do we choose which of these classroom assessment

methods is the most appropriate? • This depends on a lot of different things. What age group are you

working with? Stiggins states that “in the primary grades, before students have become confident readers and writers, selected response or essay methods cannot be used, as they require competence in those modes of communication” (p. 76). What kind of knowledge or reasoning are you assessing? “Evaluative reasoning … cannot be tested using multiple-choice or true/ false items because this kind of reasoning requires a presentation of a defense. Answers are not merely right or wrong –they vary in quality” (p. 76). Other methods of assessment may be the best choice insofar as testing fidelity goes, but, “sometimes limited resources make it impossible to assess the actual skill” (p. 87). For example, a teacher may wish to have all students perform a piece of music or a soliloquy from a play to show an understanding of the material as well as to demonstrate their performance ability, but time constraints or other factors may make doing this impossible.

Assessing student affect

•We want to assess student disposition because it has such a strong effect upon learning. Way back in chapter one, Stiggins writes about students’ “expectations of themselves” (p.19) and tells us that “students decide how high to aim based on their sense of the probability that they will succeed. … “No single decision … exerts such influence on student success” (p.19).

• Stiggins re-states this idea in chapter nine when he writes about academic self-efficacy. He tells us “it is the evaluative judgment one makes about one’s possibility of success and/or productivity in an academic context” (p. 225). Student attitudes towards school will influence how hard they will try and how much risk they will take in ‘putting themselves out there.’ The link between effort and success when it comes to learning is not always clear for many young people. (It’s not always clear for more mature people, either.) It is something that teachers need to help develop.


• When it comes to addressing student disposition, it is important to keep it professional, keep it related to school, and know when to involve the school psychologist, counselor, principal, or other professional. Stiggins tells us--and it should be considered common sense--that “you can do great harm if you fail to respond appropriately” (p. 223). Empathy, sympathy, and a desire to help are not appropriate substitutes for the specialized knowledge of a trained, certified, social-worker or psychologist.


• Richardson, Morgan, & Fleener’s “Reading to Learn in the Content Areas” tells us that “negative emotions can impede learning” and that “the brain does not function at its best or at its highest level in a threatening environment” (p. 448). We may have no problem calling to mind plenty of anecdotal evidence to support those statements, but if we examine the literature we find research and hard evidence about how positivity, negativity, stress, and comfort can influence learning. Research tells us that non-threatening and emotionally supportive classrooms are they way to go, but even still, they may not be the norm in some districts.


• How can a teacher assess student disposition/affect? Beyond personal communication and a thoughtful examination of the more subtle cues that a student gives off, there are the options of group interviews or questionnaires. Stiggins suggests Likert scale type questionnaires to assess feelings about specific academic subjects and school related issues.

• Just like with other assessments, sample size, fidelity, and the collection of only useful information must be considered when assessing student disposition.

11/14/2012 Weds.

11/16/2012 Fri.

11/19/2012 Mon.

11/26/2012 Mon.

11/30/2012 Fri.

12/03/2012 Mon.

12/04/2012 Tues.

12/05/2012 Weds.

12/06/2012 Thurs. Averages

Pre-intervention Average

Post-intervention Average

AJSelf-reported stress level 4 5 1 3 5 3 3 3.429Behavior points 2 1.5 OSS 0.75 1.25 1.5 1.5 1.25 1 1.344Correlation 3 2.75 -1.875 0.75 2.75 0.125 -0.5Distance between reported stress and behavior score 12 12 6 4 12 2 0 6.857 10 4.5

Weak Weak Fair Strong Strong

Source Peers Home NASchool & Peers School School

BJSelf-reported stress level 2 4 2 3 3 2.8Behavior points 2 1.25 2 1 1.5 1.55Correlation 1 1.125 1 -0.5 0.75Distance between reported stress and behavior score 4 6 4 0 4 3.6 4 3.5

StrongSource New Student all, nil low all, 4 of 5 all, nil low all, nil low all, nil, low

BMSelf-reported stress level 5 3 2 2 2 1 2 2.429Behavior points 2 2 2 2 1.5 1.25 0.5 1.607Correlation 4 2 1 1 -0.25 -1.875 -2.75Distance between reported stress and behavior score 16 8 4 4 0 6 8 6.571 9.333 4.5

Weakest StrongSource Home Home Home Home Home Home, OK nil, all ok

CJSelf-reported stress level 5 3 3 2 3.25Behavior points 0 0.5 0.25 0.25 0.25Correlation -1 -1.75 -1.75 -2.75Distance between reported stress and behavior score 0 4 6 10 5 2 8

StrongSource School School School School

DJSelf-reported stress level 5 1 3Behavior points 0 OSS 0 0Correlation -1 -5Distance between reported stress and behavior score 0 16 8 0 16

Strong Weakest

Source SchoolAll Satisfactory

HDSelf-reported stress level 3 2 4 3 Refused Refused 3Behavior points ISS 1.75 1.5 1.75 1 1.5Correlation 1.375 -0.25 2.375 -0.5Distance between reported stress and behavior score 6 0 10 0 4 3 5

Strong StrongSource School School School School

IASelf-reported stress level 5 5 2 3 3 3 3.5Behavior points 2 0 2 2 1 1 1 1.286Correlation 4 -1 1 -2.5 -2.5 -2.5Distance between reported stress and behavior score 16 0 4 0 0 0 3.333 8 1

Weakest Strong Strong Strong Strong

Source

School & Home. Max Neg. All

Home & Sch. Neg.

Home & Sch. Neg.

Satisfactory, All

Satisfactory, All

JPSelf-reported stress level New Student 2 2 3 3 2.5Behavior points 1.5 1.5 1.5 1 1.375Correlation -0.25 -0.25 0.75 -0.5Distance between reported stress and behavior score 0 0 4 0 1 n/a 1

Strong Strong StrongSource School School Peers School

KBSelf-reported stress level 5 3 4 3 3.75Behavior points 0 1.25 1.5 1.25 0.75 1 0.958Correlation -1 0.125 1.125 -0.5Distance between reported stress and behavior score 0 2 6 0 2 2.666 0

Strong Strong

Source Peers (ISS) SchoolHome & School None, all flat

RDSelf-reported stress level 2 4 2 2 3 3 2 2 2.5Behavior points 1 1.25 1.25 0.75 0.75 1.25 1 1 1.031Correlation -1.5 1.125 -0.875 -2.125 -1.125 0.125 -1.5 -1.5Distance between reported stress and behavior score 4 6 2 6 2 2 4 4 3.75 4.5 3

Strong Strong Strong

Source School All None PeersSchool & Peers Ok All Ok all School

ZKSelf-reported stress level 5 4 4 4 4 3 3 3.857Behavior points 2 1.5 0 1.75 1.5 1.75 1.25 0.75 1.313Correlation 4 1.75 2.25 1.75 2.25 0.125 -1.125Distance between reported stress and behavior score 16 8 10 8 10 2 2 8 10.5 4.666

Strong Strong

Source

Home & Friends, bereivement All All All School School School

Managing assessment data•How and where we store information, if we should summarize or

keep detailed notes, as well as method of communication about

our assessments, all depend on the kind of assessment and the

target audience (i.e. parents with a specific questions about their

child’s progress vs. academic policy makers).

•Stiggins tells us that our four main “communication options” are:

“report cards, portfolios, conferences, and test scores.”

Managing assessment data

•There comes a point when we start to see diminishing returns on time spent testing and managing assessment data.

Why should we use multiple assessment

strategies?

•No, really, I’m asking all of you: why should we?


strategies?•There is assessment for learning

(formative), and there is assessment of learning (summative).

•Diagnostic assessment or pre-assessment (McTighe & O’Connor), formative assessments, and summative assessments (Stiggins), all have their place.


strategies?• Selected response quizzes or tests, essays,

performance assessments, and personal communication (Stiggins), as well as culminating projects and work portfolios (McTighe & O’Connor) can all be used at different times; a teacher should pick whatever method is most congruent with the learning styles of the kids he or she is working with, the lesson or unit’s learning goals, and what’s going to be done with the assessment information.

References

McTighe, J. & O’Connor, K. (2005). Seven practices for effective learning. Educational Leadership. 63(3), 10-17.

Richardson, J., Morgan, R., & Fleener, C. (2006). Reading to Learn in the ContentAreas. Belmont, CA: Wadsworth Cengage Learning.

Stiggins, R. (2007). An introduction to student-involved assessment for learning. Upper Saddle River, New Jersey: Pearson Prentice Hall.

multiple assessment methods

Documents