technology and the smarter balanced assessment system one state’s perspective tj bliss, ph.d
TRANSCRIPT
![Page 1: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/1.jpg)
Technology and The Smarter Balanced Assessment System
One State’s Perspective
TJ Bliss, Ph.D.
![Page 2: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/2.jpg)
The Smarter Balanced Assessment System
Idaho Core State Standards
specify K-12 expectations for college and career readiness
All students leave
high school college
and career ready
Teachers and schools have
information and tools they need
to improve teaching and
learning
Interim assessmentsFlexible, open, used for
action feedback
Digital LibraryTeacher resources in formative assessmentto improve instruction
Summative assessments
Benchmarked to college and career readiness
![Page 3: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/3.jpg)
The Smarter Balanced Governance Structure
![Page 4: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/4.jpg)
![Page 5: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/5.jpg)
Idaho Involvement in the Smarter Balanced Assessment Consortium
• Governing Board Member (Supt. Tom Luna)• Former Executive Committee Co-Chair (Carissa Miller)• Executive Committee Member (Luci Willits)• K-12 State Lead (TJ Bliss)• Higher Ed State Lead (Chris Mathias/Roger Stewart)
Teachers/Administrators
Higher Education
Faculty
State Department and
State Board Staff
100+ 20 15
![Page 6: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/6.jpg)
Common Core Math Standards• Balance conceptual understanding and procedural
fluency• Connect these two types of knowledge• Maintain high cognitive demand • Communicate reasoning about concepts• Engage students in mathematical practices:
oReason abstractly and quantitativelyoConstruct viable arguments and critique the
reasoning of others (Moschkovitch, 2012)
![Page 7: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/7.jpg)
Common Core ELA Standards
• Reading: Engage with complex texts to build knowledge across the curriculum
• Writing: Use evidence to inform, argue and analyze
• Speaking and Listening: Work collaboratively, understand multiple perspectives, and present ideas
• Language: Develop and use the linguistic resources to do all of the above
(Bunch, Kibler & Pimental, 2012)
![Page 8: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/8.jpg)
Assessing Deeper Knowledge
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
Multiple Choice Matching
Short AnswerPerformance Tasks
(Essay)
![Page 9: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/9.jpg)
Assessing Deeper Knowledge
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
ISAT
90%
10%
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
Smarter Balanced
30%
70%
![Page 10: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/10.jpg)
Summative assessments
Benchmarked to college and career readiness
A Balanced Assessment System
All students leave
high school college
and career ready
Idaho Core State Standards
specify K-12 expectations for college and career readiness
Teachers and schools have
information and tools they need
to improve teaching and
learning
Interim assessmentsFlexible, open, used for
action feedback
Teacher resources for formative assessment
practicesTo improve instruction
![Page 11: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/11.jpg)
Formative Assessment
• Assessment FOR learning• Daily/weekly at classroom level• Answers questions like:
– Where are my students in relation to learning goals (for this lesson)?
– What is the gap between students’ current learning and the goal (for this lesson)?
(Heritage, 2013)
![Page 12: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/12.jpg)
Smarter Balanced Formative Digital Library
• State Networks of Educators (SNE): – 2000+ educators contributing, reviewing, and
approving materials for the library using a Quality Criteria Checklist / System
– Educators will review and pilot materials in their classrooms and schools to provide feedback.
• Library will be available for use in beta in April 2014• States may purchase access after August 2014
![Page 13: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/13.jpg)
![Page 14: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/14.jpg)
![Page 15: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/15.jpg)
![Page 16: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/16.jpg)
![Page 17: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/17.jpg)
Summative assessments
Benchmarked to college and career readiness
Teacher resources for formative assessment
practicesTo improve instruction
A Balanced Assessment System
All students leave
high school college
and career ready
IdahoCore State Standards
specify K-12 expectations for college and career readiness
Teachers and schools have
information and tools they need
to improve teaching and
learning
Interim assessmentsFlexible, open, used for
action feedback
![Page 18: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/18.jpg)
Interim Assessment
• Assessment OF learning• Periodically at classroom, school or district level• Optional • Answers questions like:
– What have my students learned?– Is there evidence improvement strategies are
working?– How should we allocate resources at the district
and school levels?
(Heritage, 2013)
![Page 19: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/19.jpg)
Smarter Balanced Interim Assessments
• Non-secure interim item bank is flexible; can be used at district, school, classroom levels.
• Ready for use in Fall 2014• States may purchase access going forward
![Page 20: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/20.jpg)
Teacher resources for formative assessment
practicesTo improve instruction
A Balanced Assessment System
All students leave
high school college
and career ready
IdahoCore State Standards
specify K-12 expectations for college and career readiness
Teachers and schools have
information and tools they need
to improve teaching and
learning
Interim assessmentsFlexible, open, used for
action feedback
Summative assessments
Benchmarked to college and career readiness
![Page 21: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/21.jpg)
Summative Assessment
• Assessment OF learning• Annual at state level• Answers questions like:
– Have students met the standards?– How are subgroups performing over time?– Is there evidence improvement strategies are
working?– How should state and districts allocate resources?
(Heritage, 2013)
![Page 22: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/22.jpg)
Smarter BalancedSummative Assessment
• Developed with broad input from stakeholders in every consortium state
• Computer Adaptive Test – Multiple choice– Short answer
• Performance Tasks– Theme and scenario-based sets of materials– Measure higher-order thinking skills
![Page 23: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/23.jpg)
Smarter BalancedSummative Assessment
• Students who pass 11th grade test will receive exemption from remediation in first year of college
![Page 24: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/24.jpg)
Smarter Balanced Summative Assessment
MATHMultiple
Choice/Short Answer
MATHPerformance
Task
ELAMultiple
Choice/Short Answer
ELAPerformance
Task
![Page 25: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/25.jpg)
Smarter Balanced Item Types
Selected Response
Constructed Response
Extended Response
Performance Task
Technology Enhanced
ER
CR
PT
TE
SR
![Page 26: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/26.jpg)
Assessing Deeper Knowledge
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
ISAT
90%
10%
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
Smarter Balanced
30%
70%
![Page 27: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/27.jpg)
DOK 1: Selected Response
ER
CR
PT
TE
SR
Grade 6 Math – Selected Response
![Page 28: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/28.jpg)
Assessing Deeper Knowledge
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
ISAT
90%
10%
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
Smarter Balanced
30%
70%
![Page 29: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/29.jpg)
DOK 2: Drag and Drop (Matching)
ER
CR
PT
TE
SR
![Page 30: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/30.jpg)
Assessing Deeper Knowledge
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
ISAT
90%
10%
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
Smarter Balanced
30%
70%
![Page 31: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/31.jpg)
DOK 3: Constructed Response
ER
CR
PT
TE
SR
![Page 32: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/32.jpg)
Assessing Deeper Knowledge
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
ISAT
90%
10%
IdentifyDefine
Memorize
OrganizeClassify
Compare
CritiqueRevise
Investigate
CreateEvaluateDesign
Smarter Balanced
30%
70%
![Page 33: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/33.jpg)
DOK 3-4: Performance Tasks
ER
PT
TE
SR
![Page 34: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/34.jpg)
Other Item Types: Manipulatives
![Page 35: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/35.jpg)
Other Item Types: Embedded Video
![Page 36: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/36.jpg)
Essential Elements for a Quality Next-Gen Assessment System
• Full alignment to Common Core Standards• Computer-based summative assessments in grades 3-8/HS• Computer-based interim assessments• Formative assessment tools for teacher development• Assessment of lower & higher-order thinking skills• State involvement in development and quality assurance• Sole ownership of student data• Data availability to states for further analysis• Cost neutrality or savings• Extensive accommodations and accessibility options
![Page 37: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/37.jpg)
Michigan Study on CCSS Assessments
![Page 38: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/38.jpg)
ESSENTIAL ELEMENTS FOR A HIGH QUALITY ASSESSMENT IN IDAHO
SBAC ACT SAT
Full alignment to Common Core Standards X
Computer-based summative assessments in grades 3-8 & HS X
Computer-based interim assessments X
Formative assessment tools for teacher development X
Balanced assessment of lower & higher-order thinking skills X ~ ~
State involvement in development & quality assurance X
Sole ownership of student data X
Data availability to states for further analysis X
Cost neutrality or savings X ? ?
Extensive accommodations & accessibility options X
![Page 39: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/39.jpg)
• Devices• Software• Other Hardware• Network• BYOD
Smarter Balanced Technology Specifications
![Page 40: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/40.jpg)
Device Compatibility
PC: http://farm3.staticflickr.com/2838/9527140126_6b8d88348c_o.jpgMAC: http://upload.wikimedia.org/wikipedia/commons/7/74/Mac_mini_2012.jpgLaptop: http://pixabay.com/p-41070/?no_redirectTablet: http://upload.wikimedia.org/wikipedia/commons/a/a4/IPad_3.png
![Page 41: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/41.jpg)
Software Specifications
![Page 42: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/42.jpg)
Future Software Considerations
![Page 43: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/43.jpg)
Other Hardware Requirements
• 10” Screen size• Headphones• External keyboards• Pointing device (finger)• Printers (for accommodations)
![Page 44: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/44.jpg)
Network Requirements
• 10–20 Kbps per student or less
• Bandwidth Test: https://air.tds.airast.org/student/Pages/LoginShell.aspx?section=sectionDiagnostics&c=SBAC_PT
• Bandwidth test can be accessed using most browsers, except Internet Explorer
![Page 45: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/45.jpg)
http://farm8.staticflickr.com/7206/6776952988_8a7273ab29_o.jpg
![Page 46: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/46.jpg)
Idaho Tech Readiness
• Meeting Minimum Operating System: 98.5%• Meeting Minimum Display Size: 96.6%• Meeting Minimum Screen Resolution: 96%
![Page 47: Technology and The Smarter Balanced Assessment System One State’s Perspective TJ Bliss, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649e265503460f94b155ef/html5/thumbnails/47.jpg)
Questions?
Dr. TJ BlissDirector of Assessment and Accountability, SDE
SBAC State Lead for [email protected]
(208) 332-6842