alternatives in assessment
DESCRIPTION
Alternatives in Assessment. Assessment Options. Popham, W. J. (1995). Classroom assessment : what teachers need to know . Boston: Allyn and Bacon. Item Types. Selected-response Constructed-response Personal response. Selected-response formats. Conventional multiple-choice Matching - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/1.jpg)
Alternatives in Assessment
![Page 2: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/2.jpg)
Assessment Options
Popham, W. J. (1995). Classroom assessment : what teachers need to know. Boston: Allyn and Bacon.
![Page 3: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/3.jpg)
Item Types
• Selected-response
• Constructed-response
• Personal response
![Page 4: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/4.jpg)
Selected-response formats
• Conventional multiple-choice• Matching• Alternate choice• True-False• Complex multiple-choice• Multiple True – False• Context-dependent item sets (reading
comprehension)
![Page 5: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/5.jpg)
Conventional MC item
“I’d like to buy some more coffee, please.”
“I’m sorry, but there doesn’t seem to be ____.”
A.any left
B. left any
C.leaving any
D.some left
StemAnswer (*key)
distractors
(C.E.L.T. Test of English Structure)
![Page 6: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/6.jpg)
Matching
• Keep items similar• Unequal number of
choices• +Efficient• -Can lead to trivial
lists
original
private
royal complete
slow first
sorry not public
total
Nation, I. S. P. (1990). Teaching and learning vocabulary. Boston: Heinle & Heinle.
![Page 7: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/7.jpg)
Alternate choice
Comparison between choices – not true/false
Many tests have only two plausible distractors anyway
+ Efficient Score range 50% - 100%
The team needs new (shirts / shorts).(Oxford Placement Test – Listening)
![Page 8: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/8.jpg)
True - False
• Popular in many textbook exercises
• + Efficient
• + realistic judgment
• - guessing affected by test-takers’ personality
• Score range 50% - 100%
A person who lethargic is full of energy. TRUE / FALSE
![Page 9: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/9.jpg)
Complex multiple choice
• More difficult to process than regular MCQ• Does not discriminate well
The fluid imbalance known as edema is commonly associated with:1. Allergic reactions.2. Congestive heart failure.3. Extensive burns.4. Protein deficiency.The correct answer is:a. 1, 2, and 3.b. 1 and 3.c. 2 and 4.d. 4 only.*e. 1, 2, 3, and 4.
BYU Guidebook for Developing Multiple-Choice Tests
![Page 10: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/10.jpg)
Multiple True-False
• Also often used in textbooks
• Fewer problems than complex multiple-choice
The fluid imbalance known as edema is commonly associated with:1. Allergic reactions. (T/F)2. Congestive heart failure. (T/F)3. Extensive burns. (T/F)4. Protein deficiency. (T/F)
![Page 11: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/11.jpg)
Context dependent item sets
• Sometimes known as ‘testlets’, ‘item bundles’, ‘scenarios’
• Reading comprehension passage with multiple questions
• Listening comprehension passage with multiple questions
• Items are usually not independent
• Should ideally be treated as a group
![Page 12: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/12.jpg)
Interlinear items
Rathmell, G. (1985). Test of English proficiency level. California: Hayward: The Alemany Press.
![Page 13: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/13.jpg)
Items using visual support
Reading proficiency test by Siwon Park, piloted in HELP program
![Page 14: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/14.jpg)
Advantages of selected response
• easy to administer
• easy to score
• scoring is “objective”
![Page 15: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/15.jpg)
Disadvantages of selected-response
• relatively difficult to create
• requires no language production
• tend to measure knowledge rather than skill
![Page 16: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/16.jpg)
Constructed-response formats
• Fill-in
• cloze
• C-test
• short answer
• essay
• interview
• performance (weak / strong)
![Page 17: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/17.jpg)
Fill-in item
• Requires production but is constrained
• Can target specific knowledge
• Potential for ambiguity
Tom loves coffee. He drinks it ______ day.
![Page 18: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/18.jpg)
Cloze
• Rational versus mechanical deletion
+(Relatively) easy to create and score
-What does cloze measure?
The science of automatic control depends on certain common principles by which an organism, machine, or system regulates itself. Many historical developments up to the present day have helped to identify these principles. For hundreds of years there ___(1)____ many examples of automatic control systems, but no connections were recognized among ___(2)____. A very early example was a device on windmills designed ___(3)___ keep their sails facing into the wind …. (Heisei University)
![Page 19: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/19.jpg)
C-Test
+Objective scoring possible
+Easy to create
-Format may confuse test takers
An American friend of ours hired a car in London although he was inexperienced in driving on the left-hand side of the road. Soon h_(1)_ found him__(2)_ going i__(3)_ the wr__(4)_ direction ro__(5)_ a roundabout. H__(6)_ braked sha__(7)_, slid side__(8)_, and en__(9)_ up wi__(10)_ both fr__(11)_ wheels o__(12)_ the pave__(13)_. …
http://www.uni-duisburg.de/FB3/ANGLING/FORSCHUNG/CTENGS.htm
![Page 20: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/20.jpg)
Short answer / Essay
+Easy to create
+Extended sample of language
-Scoring can be subjective
-Interaction between language and other abilities
ESSAY: Recently, incidents depicting violence have been increasingly common in primetime TV programs. Some people argue that watching violent acts encourages people to become more violent. Other people claim that watching violence fulfills a natural desire for aggression and actually reduces violent behavior. Which position do you agree with? Write an essay defending your position. Be sure to support your ideas.
![Page 21: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/21.jpg)
Interview
• Very popular format for assessing oral language
+direct assessment of speaking ability
-scoring can be subjective
-influence of interviewer
![Page 22: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/22.jpg)
Strengths of performance assessments
• Positive washback for programs
• Focus on real world ability rather than trivial knowledge
• Closer match to course objectives
• Can document creativity, critical thinking skills
• Provide useful diagnostic information about students’ abilities
![Page 23: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/23.jpg)
Weaknesses of performance assessments
• Logistically difficult to create and administer on a large scale
• Use of rater judgments may lead to low reliability
• Construct underrepresentation
• Construct irrelevant variance
• Generalizability
![Page 24: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/24.jpg)
Advantages of constructed-response
• no effect for guessing
• productive language use
• interaction of receptive and productive skills
![Page 25: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/25.jpg)
Disadvantages of constructed-response
• difficult and time consuming to score
• scoring is subjective
• “bluffing” is possible
![Page 26: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/26.jpg)
Personal response
• conferences
• portfolios
• student profiles
• self-assessment
![Page 27: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/27.jpg)
Advantages of personal response
• student-centered
• appropriate for assessing learning processes
• useful for learners with unique profiles
![Page 28: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/28.jpg)
Disadvantages of personal response
• difficult to create and structure
• scoring is subjective
![Page 29: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/29.jpg)
Test delivery formats
• paper and pencil
• telephone
• computer– computer-delivered– web delivered– computer adaptive
![Page 30: Alternatives in Assessment](https://reader036.vdocuments.mx/reader036/viewer/2022062722/56813b16550346895da3c40b/html5/thumbnails/30.jpg)
Adaptive testing
Sands, W. A., & Waters, B. K. (1997). Introduction to ASVAB and CAT. In W. A. Sands & B. K. Waters & J. R. McBride (Eds.), Computerized adaptive testing (pp. 3-10). Washington: American Psychological Association.