coherent assessment systems supporting college and career...
TRANSCRIPT
![Page 1: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/1.jpg)
1
Coherent Assessment Systems Supporting College and Career
Ready Success
CSAI Professional Development
Central & South Central Comprehensive Centers
Oklahoma City, OK January 14, 2016
Joan Herman
![Page 2: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/2.jpg)
2
OVERVIEW
Contextual challenges Coherent systems that can support learning Critical ingredient: quality assessment, smart
use Getting there
![Page 3: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/3.jpg)
3
Contextual Conundrum
Enduring Belief: Assessment/accountability can benefit learning
But:
Assessment historically has narrowed learning
Too little assessment literacy
Too much time in testing
Calls for testing audits/action plans
![Page 4: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/4.jpg)
4
The time is now:
From too much of the wrong kinds of testing
To coherent systems of assessment that support CCRS
![Page 5: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/5.jpg)
5
One Size Does Not Fit All
![Page 6: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/6.jpg)
6
Different Levels of Detail
Quarterly
Annual
Minute-by-minute, Daily, Weekly
End-of-Unit
![Page 7: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/7.jpg)
7
Guiding Premise: Coherent Focus, Variation in Grain Size to Support Use
![Page 8: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/8.jpg)
8
• Lays out common vision of how various types/levels of assessment are supposed to work
• Conflicting definitions hamper effective communication and action
• Help districts and schools assess their needs and move to better, more efficient systems
• Too much testing? Get rid of duplicates or what’s not working; devise more effective/efficient alternatives
• Associated PD modules
How Framework Helps
![Page 9: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/9.jpg)
9
Coherent Assessment Systems: On-going Data for Improvement
![Page 10: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/10.jpg)
10
Coherent Assessment Systems: On-going Data for Improvement
![Page 11: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/11.jpg)
11
Coherent Assessment Systems: On-going Data for Improvement
![Page 12: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/12.jpg)
12
Coherent Assessment Systems: On-going Data for Improvement
![Page 13: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/13.jpg)
13
Coherent Assessment Systems: On-going Data for Improvement
![Page 14: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/14.jpg)
14
Coherent Assessment Systems: On-going Data for Improvement
![Page 15: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/15.jpg)
15
Coherent Assessment Systems: On-going Data for Improvement
![Page 16: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/16.jpg)
16
Description of Each Assessment Type
![Page 17: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/17.jpg)
17
A Common Process of Assessment for Improvement: Key Attributes Clear, significant learning goals and success criteria/
performance standards relative to an expected learning progression
Appropriate Methods/Strategies for eliciting evidence student learning relative to significant goals
Appropriate ethods/strategies for interpreting/reporting student learning/results
Use results to take action to improve
Stakeholders involved in the process
![Page 18: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/18.jpg)
18
A Feedback Loop
![Page 19: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/19.jpg)
19
ASSESSMENT QUALITY: VALIDITY
the extent to which an assessment provides accurate inferences and well serves intended purpose(s)
![Page 20: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/20.jpg)
20
General Guidance on Quality Criteria ■ Alignment
■ Reliability
■ Fairness
■ Evidence of relationship to purpose
■ Utility/usability
■ Feasibility
■ Coherence
![Page 21: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/21.jpg)
21
Getting Alignment Right in ELA
■ Reading and writing
■ Appropriate text complexity
■ Balance of literary and information texts
■ Require close reading and analysis of texts, consistent with standards
■ Range of cognitive demand, item/task types
■ Emphasize vocabulary and language use
■ Research and inquiry, speaking and listening
![Page 22: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/22.jpg)
22
Getting Alignment Right in Math
■ Emphasize content most needed for later success
■ Balance of concepts, procedures and application
■ Connect content to practice
■ Require a range of cognitive demand
■ Range of item and task types
![Page 23: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/23.jpg)
23
Traditional Alignment Study: Webb
■ Item by item review by content experts
■ Each item rated for content (standard/target) and depth of knowledge (DOK)
■ Results summarized to yield content concurrence, range, balance, depth of knowledge consistency, etc.
■ Assuring higher levels of DOK key to deeper learning goals
![Page 24: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/24.jpg)
24
Alignment:
Good match in content and cognitive demand
![Page 25: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/25.jpg)
25
Getting to coherent systems that actually benefit learning
![Page 26: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/26.jpg)
26
Bringing the Vision to Reality
• System of quality assessments, seriously aligned with meaningful learning goals
• Assessment literacy supporting evidence-based practice: intelligent selection/creation, analysis and use; reflective practice
• Which comes first? How to get there?
![Page 27: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/27.jpg)
27
IN THE FINAL ANALYSIS
Data don’t solve teaching and learning problems, educators
do
![Page 28: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/28.jpg)
28
Coherence and Accountability:
![Page 30: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/30.jpg)
30
DOK4: PARCC ELA Example, Grade 7
You’ve read 3 texts describing Amelia Earhart. All three include the claim that she was a brave, courageous person. The three texts are…...
Consider the argument each author uses to demonstrate Earhart’s bravery.
Write an essay that analyzes the strength of the arguments about Earhart’s bravery in at least two of the texts. Remember to use textual evidence to support your ideas.
![Page 31: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/31.jpg)
31
DOK 3: Smarter Balanced ELA Example, Grade 11
Read this sentence from the passage (after reading a passage on space diamonds).
“Besides being beautiful to contemplate, space diamonds teach us important lessons about natural processes going on in the universe, and suggest new ways that diamonds can be created here on Earth.”
Explain how information learned from space diamonds can help scientists make diamonds on Earth. Use evidence from the passage to support your answer.
Type your answer in the space provided.
![Page 32: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/32.jpg)
32
Recent Views on Assessment Quality
■ Criteria for High Quality Assessment (Darling Hammond et al, 2013)
http://www.hewlett.org/uploads/documents/Criteria_for_High_Quality_Assessment_June_2013.pdf
■ CCSSO Criteria for Procuring and Evaluating High-Quality Assessments http://www.ccsso.org/Documents/2014/CCSSO%20Criteria%20for%20High%20Quality%20Assessments%2003242014.pdf)
■ Standards for Psychological and Educational Testing (AERA, APA, NCME, 2014)
![Page 33: Coherent Assessment Systems Supporting College and Career ...c3ta.org/plugins/workplans/documents/1269/Day2... · Coherence . 21 Getting Alignment Right in ELA Reading and writing](https://reader033.vdocuments.mx/reader033/viewer/2022050415/5f8bca791fe6c8264c10563b/html5/thumbnails/33.jpg)
33
Webb’s DOK Framework
■ DOK 1: Basic knowledge/procedures, recall
■ DOK 2: Simple application (some mental processing)
■ DOK 3: analysis, reasoning, inference, abstract thinking
■ DOK 4: Extended planning, synthesis/investigation of multiple sources, non-routine problem