tools for aligning instruction, standards, & assessments st. paul, mn august 5, 2009 rolf k....
TRANSCRIPT
![Page 1: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/1.jpg)
Tools for Aligning Instruction, Standards, Tools for Aligning Instruction, Standards,
& Assessments& Assessments St. Paul, MN
August 5, 2009
Rolf K. Blank
Surveys of Enacted Curriculum
![Page 3: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/3.jpg)
What is/are the SEC?
• Practical, reliable set of data collection and analysis tools – combining teacher data with content analysis by experts
• Online web-based surveys in Mathematics, English Language Arts, Science, Soc Studies
• Reporting instructional data and alignment in user-friendly charts
• Assist in Facilitating group discussions for observed differences across classrooms, schools, and districts
![Page 4: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/4.jpg)
Session topics
• What is SEC?
• Why this approach to data?
• How SEC data address School Improvement?
• How are data collected/ reported / used?
![Page 5: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/5.jpg)
What problem are we addressing?
• Teaching: What produces change in instruction esp. to improve achievement? What is the role of data? How can we have teachers work together –from data--on improvement?
• Research: How do we measure classroom practices/teaching? How to compare differences among classes and teachers?
• Policy: What is the effect of common standards and state accountability/assessments? What do we mean by evidence-based tools for improvement?
![Page 6: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/6.jpg)
Data-informed School Improvement What is the usual process?
• Large District “Data cycle” in Schools Annual Assessment data -- baseline Analysis discussion –teachers, admin. Set targets from test results; Identify possible
explanations; Sch improve plan Teachers responsible to make changes Benchmark assessments –measure progress Review data – provide TA Assessment data – 1 yr, 2 yrs-- Gains ?
![Page 7: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/7.jpg)
Key Question leading to SECResearch into Practice
• How can Educators obtain reliable, valid data to determine Alignment of instruction with required standards and assessments?
• Then …
![Page 8: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/8.jpg)
Next Question -- SEC DataResearch into Practice
• How are the curriculum data useful?
OR• (What is the importance of
“Alignment?”)
![Page 9: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/9.jpg)
Intended (3-4 State Math Stands.) Assessment (3rd Grade Math Test)
![Page 10: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/10.jpg)
Math Enacted (3rd Grade Teachers) Intended (3rd Grade Math Standards)
![Page 11: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/11.jpg)
Math/ Statistics (3rd Grade Teachers) Intended (3rd Grade Stands Math)
![Page 12: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/12.jpg)
ELA Enacted (9th Grade Teachers) State ELA Intended (9th Grade Standards)
![Page 13: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/13.jpg)
Reading First: 3rd Grade Teachers ELA State Sample: 3rd Grade Teachers
![Page 14: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/14.jpg)
14
2005 to 2008 Change–Geo Concepts–Gr 8 Instruction
![Page 15: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/15.jpg)
![Page 16: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/16.jpg)
Alignment as a Systemic Tool
Classroom
Content
![Page 17: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/17.jpg)
— Carl Glickman, 2002
Research has found that faculty in successful schools always question existing instructional practice and do not blame lack of student achievement on external causes.
![Page 18: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/18.jpg)
Surveys of Enacted Surveys of Enacted CurriculumCurriculum
A neutral content grid
with cognitive demand
The intended curriculum: State content standards—What students should learn
The enacted curriculum: What teachers teach
The learned curriculum: Student outcomes based on school learning
The assessed curriculum: State (and other) assessments—tested learning
![Page 19: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/19.jpg)
Education Improvement Questions
Collecting Data: How can in-depth subject content data be collected -not simple topic checklists- to analyze teaching content in relation to curriculum goals, standards, or assessments?
Analyzing Data: How can methods of teaching/ practices be compared across classrooms, schools, districts, and states?
Using Data: And, how can the data then be used to improve instruction toward standards?
Source: Maine SEC Project
![Page 20: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/20.jpg)
SEC Development
• The Surveys of Enacted Curriculum (SEC) Collaborative Project was initiated in 1998, to test a curriculum research tool for broader use in education to improve instruction.
• Over the past ten years the Council of Chief State School Officers (CCSSO), has worked with states and other partners thru the SEC Collaborative to develop the survey instruments, implement an Online System for data collection, analysis/reporting, and use with teachers.
![Page 21: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/21.jpg)
Development (cont.)
• In 2003, CCSSO and UW-Madison/WCER developed an Online, Web-based system for data collection, reporting, and alignment analysis.
• Surveys are available K-12 for English Language Arts/Reading, Math, Science, Social Studies, and (new) ELD teachers.
• Key to effective use of SEC data is training and professional development.
![Page 22: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/22.jpg)
States /Districts Active with SEC Tools and Data : 2001 - present
• Alabama• Delaware• Idaho• Illinois• Indiana• Iowa• Kansas• Maine
• Michigan • Minnesota (Standards coded)• Mississippi• Montana• New Hampshire• New York• North Carolina• Ohio
![Page 23: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/23.jpg)
(2) States /Districts Active with SEC Tools and Data : 2001 - present
• Oklahoma• Oregon• Pennsylvania• Tennessee• Utah• Vermont• Virginia• Wisconsin
![Page 24: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/24.jpg)
SEC by the Numbers: annual
12,100 SEC Teacher Surveys (30 states) Math
Science ELAR
Soc Stud ELD (SEC ELL Consortium) 140 Standards or Assessment
documents Alignment analysis
![Page 25: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/25.jpg)
SEC Collaborating Organizations
•Council of Chief State School Officers www.SECsurvey.org
•Wisconsin Center for Education Research www.SEConline.org
•Learning Point Associates www.SECsupport.org
•TERC Using Data Project www.ra.terc.edu/DEC
![Page 26: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/26.jpg)
SEC Collaborating Organizations
•Measured Progress www.measuredprogress.org
•The College Board www.collegeboard.com
![Page 27: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/27.jpg)
English LanguageArts & Reading
The SEC Data-set
SUMMARY MEASURES
Content Practice Climate Prof. Dev./ / /
Science
InstructionalContent
Instr.Activities
Tchr.Char./Opinions/Beliefs
Professional DevelopmentMathematics
Social Studies
![Page 28: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/28.jpg)
• School & Class Description• Instructional Activities
• General• Problem Solving Activities
• Pairs & Small Group Work• Use of Hands-on Materials• Use of Calculators/Computers & other Ed. Tech.
• Assessment Use• Instructional Influences
• Instructional Readiness• Teacher Opinions• Professional Development
• Types, Frequency• Content , Active,• Collegial, Coherence
• Instructional Content•Topic x Cog. Demand
Survey Sections
![Page 30: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/30.jpg)
![Page 31: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/31.jpg)
Registration
![Page 32: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/32.jpg)
Username and Password = Confidentiality
![Page 33: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/33.jpg)
SEC Survey Selection
![Page 34: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/34.jpg)
Survey Menu
![Page 35: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/35.jpg)
Multi-State Collaborative
Build Knowledge of leaders Share Strategies Produce joint products, tools
![Page 36: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/36.jpg)
SEC Collaborative offers
• Core Components of SEC tools/services1) Surveys with teachers – report instruction
2) Alignment analysis – content code standards and assessments
3) How to use Data – knowledge, skills
4) Leader development – 2-3 meetings/yr
4) In-state workshops: a) orientation
b) use of data
![Page 37: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/37.jpg)
![Page 38: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/38.jpg)
Your progress will be noted on survey menu when you return.
![Page 39: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/39.jpg)
Taking the Online Survey
• Approximately 60-90 minutes to complete
• May be completed in multiple sittings
• Data is saved as each section is submitted
• Data reported online in pre-designed charts and content maps
![Page 40: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/40.jpg)
Uses a multi-dimensional language fordescribing instructional content
SEC Instructional Content
Topics
byCognitive Demand
(Expectations for Student Learning)
![Page 41: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/41.jpg)
Categories of Cognitive Demand
Topics Algebra
Memorize Peform Procedures
Communicate Understanding
Sovle non-routine
problems
Conjecture/ Generalize/
Prove Multiple
Step Equations
Inequalities
Literal Equations
Lines / Slope and Intercept
Operations on
Polynomials
Quadratic Equations
Content Matrix--Math
![Page 42: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/42.jpg)
… adding levels of relative emphasis yields a 3-D construct
Coarse Categories of Cognitive Demand
Content Areas
Memorize Perform Procedures
Demonstrate Understanding
Conjecture, Hypothesize
Non-routine problems
Number Sense
Operations
Measure-ment
Basic Algebra
Advanced Algebra
Geometric Concepts
![Page 43: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/43.jpg)
![Page 44: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/44.jpg)
![Page 45: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/45.jpg)
MemorizePerform
CommunicateConjecture
Connect0
0.020.040.060.08
0.1
Operations
Number Sense
Measurement
Geometric Concepts
Algebraic Concepts
Data Analysis
Instructional Technology
MemorizePerform
CommunicateConjecture
Connect
State J Grade 8Mathematics Instruction
Content Maps
![Page 46: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/46.jpg)
![Page 47: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/47.jpg)
Conjecture/ Generalize/ ProveRecite basic mathematics facts
Recall mathematics terms & definitions
Write formal or informal proofs
Recognize, generate or create patternsPerform Procedures
Use numbers to count, order, denote
Follow procedures/instructions
Reason inductively or deductively
Organize or display data
Read or produce graphs and tablesExecute geometric constructions
Demonstrate Understanding Solve Non-routine Problems/ of Mathematical Ideas Make Connections
Communicate mathematical ideas
Analyze data, recognize patterns
Explain findings and results from data analysis strategies
Show or explain relationships between models, diagrams, and/or other representations
Apply mathematics in contexts outside of mathematics
Use representations to model mathematical ideas
Synthesize content and ideas from several sources
Develop/explain relationships between concepts
Expectations for Students in Mathematics
Determine the truth of a mathematical pattern or proposition
Apply and adapt a variety of appropriate strategies to solve non-routine problems
Find a mathematical rule to generate a pattern or number sequence
Recall formulas and computational procedures
Solve equations/formulas/routine word problems
Memorize Facts/ Definitions/ Formulas
Do computational procedures or algorithms
Make and investigate mathematical conjectures
Identify faulty arguments or misrepresentations of data
![Page 48: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/48.jpg)
Applications
• Alignment analysis --instruction, standards, assessments
• Instructional improvement in schools• Needs assessment/ Evaluation• Indicators – for comparison, analysis,
monitoring change over time
![Page 49: Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank RolfB@ccsso.org Surveys of Enacted Curriculum](https://reader036.vdocuments.mx/reader036/viewer/2022070409/56649e9d5503460f94b9e829/html5/thumbnails/49.jpg)