assessment literacy kansas state department of education assessment literacy project1...
TRANSCRIPT
Assessment Literacy
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 1
Selected-response Tests
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT
Selected Response
2
Test-designer creates correct responses
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 3
• Test-taker selects correct response
• Test-taker does not generate and answer
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT
Selected Response
4
Stand-alone items
Item stem is linked to a stimulus such as:• Reading passage• Graph, table• Photo, video
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT
Selected Response
5
Appropriate for either:
Lower-order• Knowledge• Comprehension
Higher-order• Application• Analysis• Synthesis• Evaluation
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT
Selected Response
6
Easier to write acceptable items(valid, reliable, unbiased) for…
• Lower-order• Than• Higher-order
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 7
Selected-response Types
• True-false
• Matching
• Multiple-choice
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 8
Challenging True-False
Stem:
• Choice A: True or False• Choice B: True or False• Choice C: True or False• Choice D: True or False
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 9
Advantages
Selected-response items are
Efficient • Cover content breadth or depth more quickly• Easier to score and analyze• Easier to interpret and report
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 10
Disadvantages
Difficult
• to write good higher-order items
• to distinguish between knowing and guessing
• to measure performance directlye.g., writing a persuasive essay
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 11
Disadvantages
Selected-response format encouragesDrill-and-kill
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 12
Use textbook end-of-chapter and end-of-unit SR items with extreme caution
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 13
Design and Development Steps
1. Know the material and learning progression2. Create test blueprint3. Write items4. Develop answer key5. Field-test items6. Perform analysis of test, items, distractors7. Revise/edit accordingly
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 14
How-to Write Good Selected-response Test Items
Is This a Trick Question?
A Short Guide to Writing Effective Test Questions
ASSESSMENT L ITERACY PROJECT
Kansas State Department of Education
ASSESSMENT L ITERACY PROJECT 15
Persistence Pays Off
Persistence is to item-writing
As ____ is to piano virtuosity.
A. PracticeB. PracticeC. PracticeD. PracticeE. All of the above