transitional the assessment

Celebrating 25 Years! 1

Transitional THE Assessment

Is Your District Ready?

1988 - 2013


Objectives for the day

• Participants will– Understand who and what will be tested– Understand differences in KSDE and CETE

resources– Find KITE, log in, and create tests– Download KITE Client software– Understand and use new technology Enhanced

Resources

1988 - 2013


Norms for the day

• Cell Phones on vibrate• Consideration of each other’s needs and level

of understanding• Keep the conversation positive• Post all unanswered questions in the Parking

Lot

1988 - 2013


What Color is your Car?

Get into groups of like car colored people

Introduce your selves

What common characteristics do you find in your group? Why do you drive the color car you do?

1988 - 2013


What your car color says about you

Dealing with the “cars” in the lot…

1988 - 2013


First the Basics

• Math and Reading 3-8 grades and 11th graders who do not have a banked score.

• CETE would appreciate all 10,11,and 12 grades to test for data quality reasons.– Only banked scores will be used for accountability

• Science Grades 4, 7 and OTL with both sections by their 11th grade year

• History / Government – No Test• Writing, local recommended but not required

1988 - 2013


Resources

• KSDE– http://

ksde.org/Agency/DivisionofLearningServices/CareerStandardsandAssessmentServices/CSASHome/Assessments.aspx

• CETE– www.ksassessments.org

• SWPRSC– Presentation Handouts

1988 - 2013

http://ksde.org/Agency/DivisionofLearningServices/CareerStandardsandAssessmentServices/CSASHome/Assessments.aspx




http://www.ksassessments.org/


The New CETE Summative• College Ready Standards;• deliver the test via computer, both desktop/laptop and iPads;• include technology- enhanced items, built using templates similar to those used for SBAC;• include only machine- scorable items;• map every item to an SBAC assessment “claim,” which will be the unit for reporting

subscores;• contain items that have all been written to the SBAC “targets,” which represent the ways

in which students may be expected to learn and demonstrate their knowledge—by integrating skills and concepts across standards, rather than by tapping only isolated skills within one standard;

• use the SBAC blueprint as a guideline for determining which standards to emphasize;• include multiple forms;• match the SBAC style guide with few exceptions; and• merge SBAC allowable accommodations with the Kansas accommodations policy to

provide further computer based accommodations to students.‐

1988 - 2013


Technology Enhanced Items

• CETE has developed about 40 technology enhanced templates

• They are used to assess a concept not easily assessed through multiple choice.– Interactive and engaging– Provide a better measure of a construct– Assess existing construct more efficiently

• Practice TEI assessment can be assessed now for formative use

1988 - 2013



1988 - 2013


Reporting

• Not immediate this year because of cut scores will need to be set after all tests are completed.

• Students will only receive proficiency category.• Scores will be reported on the claims at the

school level.

1988 - 2013


English Language Arts

• Between 52 and 60 items total• Two sessions– Reading and writing on each section

• Item types include:– Selected response– Multiple selected response– Technology response

1988 - 2013



• Claim 1– Literacy and informational texts– Items are related to texts– All claim 1 targets are included• Targets 1-7 Literacy• Targets 8-14 Informational

1988 - 2013



• Claim 2 – Writing– Stand alone (not text – based)– Only some targets are included• Targets 1/3/6: Write/Revise Brief Texts• Target 8: Language and Vocabulary Use• Target 9: Edit/Clarify

1988 - 2013



• Not Included on 2013/2014 assessment:– Claim 3 – Speaking / Listening– Claim 4 – Research– Constructed response tasks– Performance tasks

• Additional coverage of the KCCRS will be included in future assessments

1988 - 2013

Math Transitional Assessment

• Around 60 items total• Two sections• Item types include:– Selected response– Multiple select response– Technology enhanced– Numeric entry


• Smarter Balanced Claims– Claim 1: Concepts and Procedures– Does the student know how to DO the math?– Focus: Mathematical Content Standards


• Grades 3-8– Targets for claim 1 are the clusters– “Major” or “additional supporting”– Greater focus on ‘major” and less on “additional /

supporting”– Students will see at least 1 item from every

cluster in their grade level


• High School– Targets only 16 clusters for Claim 1– “Major” or “additional / supporting”– Greater focus on ‘major” and less on “additional /

supporting”– Students will see at least 1 item from every

cluster in their grade level


• All Grade Levels– All claim 1 targets– Claim 1 targets from previous grades

• Special note for HS: SBAC specifies any standard can be assessed in these claims. However CETE has only used the targeted Claim 1 standards or those from the lower grades.


• Calculator Use– 3-5 no calculator– 6-HS Calculator active and inactive subsections• On the calculator active subsection, special

mathematical tools (e.g., abacus or large button calculators) are permitted for students in their IEP.

• Not included on 2013-2014 assessment:– Constructed response tasks– Performance tasks

Accessibility

• Tools are available to all students all of the time. Tools include:– Highlighter– Striker– Eraser– Calculator on calculator portions of math tests– Periodic table on high school physical science test– Screen magnification

• Tools do not change how the content is delivered or how the student responds

Personal Needs and Preferences

• The PNP allows teachers to identify students special needs and drives the delivery of accommodations

• The PNP is accessed in the Student Record in Educational Portal

• The PNP includes:– Display enhancements: how resources are to be presented

and structured.– Language Brail: how content is communicated to the learner– Audio Environment Supports: how content is audibly

delivered and testing environment adapted to fit the learner’s needs

Available Accommodations

• Text to speech will be available for students requiring audio presentation of items and directions

• Braille, large print, and print booklets will be available in electronic files– Brail booklets will be delivered as braille-ready

files (BRFs) for download to an embosser; graphics will be delivered as PDFs

– Print booklets will be available as PDFs


KITEKansas Interactive Testing Engine

• Access at www.ksassessments.org• Access to the state summative• Access to Kwiet (writing test)• Access to Career Pathways (CTE)• Access to Dynamic Learning Maps (The old

Alternative)• Access to Formative Tools• Access to old NCLB data1988 - 2013

http://www.ksassessments.org/


Things that have to happen before you can use KITE

• First – Superintendent must complete his/her EDCS Report in the authenticated applications at KSDE

• Second – the district data steward must complete a STCO submission to KIDS

• Third – KSDE sends the data to CETE every night

• Assign Roles

1988 - 2013


Hardwar Issues

• Works on PC, Mac, and IPad devices.– Download the KITE Client

• May have it up for Chrome• IPad– Go to Safari– Type in tde.cete.us/TDE/login.html

1988 - 2013


Formative Assessments

• www.ksasessments.org• Hover over “For Educators”• Click on Formative Assessment Tools• Explore the Language Arts and Mathematics offerings– At your table, ½ commit to ELA research and ½ commit to

Math research– Read material– Report to shoulder partner high lights– Share reports with the rest of the table

1988 - 2013

http://www.ksasessments.org/


The Portal

• Educator.cete.us• Sign in using your school e-mail address as

username.• (First Time)Click on forgot password.• Check you school e-mail account for instructions to reset your account.1988 - 2013


Navigating KITE

1988 - 2013


Navigating KITETest Management

1988 - 2013


Navigating KITEAdding a new test

1988 - 2013


Navigating KITE

1988 - 2013


Navigating KITE

1988 - 2013

• Select the test you want and then click “Next”


Adding Students

• Click on the Students Tab

1988 - 2013


Adding Students


1988 - 2013


Naming the test

1988 - 2013


Print your tickets

1988 - 2013

Celebrating 25 Years! 451988 - 2013


KITE Client

• This is needed for students to access their KITE Portal

• Go to www.ksassessments .org• Hover over “For Educators” and click on KITE• Down load the client onto your computer

1988 - 2013

http://www.ksassessments/


Warning

• Tickets– Same ticket information for all tests– Students could take the test at home– Students could take some else’s test– IPad users could pop out of the test to look up

information• If this should happen there is an SC code for

this

1988 - 2013


Lets Practice

• Open a web browser• Go to educator.cete.us and log in• Click on Test management• Search for “Practice for Technology-Enhanced

Items”• Click the radio button and then click next• Select some 3 or 4 random students• Print your tickets1988 - 2013


Lets Practice

• Launch your KITE Client• Log in with the ticket information as a student• Experience the joys of Technology Enhanced

Items

1988 - 2013

Celebrating 25 Years! 501988 - 2013


Next Generation Assessments in Kansas

Marianne PerieCETE

January 22, 2014Presented at KAAC in Topeka

And USA in Wichita

1988 - 2013


Everything is changingSmarter Balanced Assessment Consortium (SBAC)Wiser Harmonious Assessment of Kansas (WHAK)(We (CETE)are taking suggestions on naming this new assessment!)

1988 - 2013


But how much is changing, really?

• Transition assessment in Spring 2014 is the same as we have always planned.

• Spring of 2015, when we would have had SBAC for the first time, we will have an enhanced Kansas assessment.

• By Spring of 2016, we will be very close to where we would have been with SBAC with difference due to choices made in Kansas.

1988 - 2013


Spring 2014

• Transition Assessment– Delivered on KITE– Aligned with Kansas College and Career Ready

Standards for math, reading, and writing conversations– Follows similar blueprint to SBAC– Machine-scorable items only– No performance task

- No writing prompt - No listening items

1988 - 2013


New Development in 2014-2015

• The transitional test will serve as the backbone for the new Kansas College and Career Ready Assessment

• Enhancements– Listening section– Writing prompt– Math performance tasks

1988 - 2013


Spring 2015

• The core machine-scorable part of the test will be parallel to what was administered in 2014, but we will refresh the item pool.

• We will field test the enhancements.• Accountability for 2015 will be based on the core

portion of the test.• Schools and districts will receive feedback on the field-

test portions to help gauge students readiness on the full set of standards.

1988 - 2013


Summer 2015

• After analyzing the field-test items, we will create the best form possible that includes all features of our future assessment.

• We will set new achievement standards (cut scores and performances level descriptors) based on that form.

• Using those new cute scores, we will set new AMOs and communicate the new targets to schools and districts.

1988 - 2013


Spring 2016

• Now we have a fully enhanced test that covers all of the Kansas College and Career Ready Standards.

• We should also have sufficient numbers of items to make the test adaptive this year as well.

1988 - 2013


Adaptivity

• The test will be adaptive to allow students to be measured on items close to their ability level.

• We are considering stage adaptivity rather than item adaptivity that SBAC uses.

• Benefits– More reliable estimates– Targets assessment to student level

1988 - 2013


Special Education

• Adaptivity should help students who used to take the KAMM. They will be assessed on grade-level, but with easy items.

• Many tools are available to all students (e.g., highlighter, notes, calculator)

• Accomodations are available electronically (striker, contrast, auto font)

• TTS is available in a new and improved voice this year.

1988 - 2013


Kansas Fingerprints

• We want Kansas educator and stakeholder fingerprints all over these new assessments– Teachers

- Design decisions- Item writing- Item reviewing- Rangefinding- Scoring

1988 - 2013


Kansas Stakeholders

• Administrators – Support teacher involvement– Voice in report decisions– Cross-content development

• Kansas Board of Regents– High school-we want to ensure that test truly

predict college readiness– Will be involved in design and review of

assessments and setting cut scores

1988 - 2013


Full Kansas Assessment Program

• Summative assessment• O ELA (complete in 2016)

– Math (complete in 2016)– History/ government (complete in 2017)– Science (complete in 2017)

• Formative Tools– Really more like sample items now– Developing capacity for teachers to build test forms using items

pool– In 2016, we can start building true formative, instructionally-

embedded test. • Will include science and H/G

1988 - 2013


Things to Consider

• Essay– Covers both ELA and Science or

History/Government standards– Students in grades 4,7, and 11 would only need to

write one essay aligned to both History/government and literacy standards

– Two rubrics provide two scores- one for each test– Same idea for science

1988 - 2013


HS Example

Students watch “I have a dream” and read an essay by Malcolm X. They are then asked to write an essay comparing and contrasting the two approaches to the civil rights movement. They may be asked to define and give examples of civil disobedience and discuss its efficacy.

1988 - 2013


Writing Standards (G11)

• Write information/explanatory texts, including the narration of historical events, scientific procedures/ experiments, or technical processes.a. Introduce a topic clearly, previewing what is to follow; organize ideas, concepts, and information, using strategies such as definition, classification, comparison/ contrast, and cause/effect; including formatting (e.g., headings), graphics (e.g., charts, tables), and multimedia when useful to aiding comprehension.b. Develop the topic with relevant facts, definitions, concrete details, quotations, or other information and examples.c. Use appropriate transitions to create cohesion and clarify the relationships among ideas and concepts. d. Use precise language and domain-specific vocabulary to inform about or explain the topic.e. Establish and maintain a formal style and objective tone.f. Provide a concluding statement or section that follows from and supports the information and explanation presented.

1988 - 2013


Kansas History/Government Standards

• High school: Civil rights, social change• Standard #3: Societies are shaped by beliefs, ideas,

and diversity.– 3.1 The student will recognize and evaluate significant

beliefs, contributions, and ideas of the many diverse peoples and groups and their impact on individuals, communities, states, and nations.

– 3.2 The student will draw conclusions about significant beliefs, contributions, and ideas, analyzing the origins and context under which these competing ideals were reached and the multiple perspectives from which they came.

1988 - 2013


Things to consider (1)

• Adaptivity in writing prompt and performance task.– SBAC planned to have writing prompts and

performance tasks written to three different levels of difficulty. The first part of the test would determine which writing prompt/performance task the student received.

– Should we do the same? Would two levels be sufficient?

1988 - 2013



• Scoring– With a writing prompt and math performance

task, we will have student responses that need to be scored by hand.

– We would like teachers to be involved in scoring.– What is the best model?

1988 - 2013


Scoring Models

• Fully distributed scoring– Teachers score on the computer using KITE. An

independent activity.• School or regional based scoring – Teachers score as a group and enter scores later.

• Scoring center– Only a few teachers come to Lawrence for several

days to score all student papers.

1988 - 2013



• Weighting the essay and performance task– What are your thoughts as to how much weight the

essay should have on the ELA score or the math performance task should have on the math test?

• MC items are worth one point each. TE items can be worth up to 3 points each.– Math core is worth 60 points. – ELA core is worth 57-71 points, depending on the

grade.

1988 - 2013



• Listening requires headphones and additional caching • Districts and schools will need to purchase

headphones for every student or ask students to bring in their own (think ear buds)

• Streaming audio will put a huge load on the system, so you will need to work with IT to prepare for that in 2014-2015.

• How can KSDE and CETE help you prepare for this load?

1988 - 2013



• USED required three: Proficient, one above and one below

• SBAC has four; PARCC has five• Kansas had traditionally used five• Considering four:– Academic warning– Approaching standard– Meeting Standard– Exceeding standard

• Would other levels be useful? Where and Why?

1988 - 2013


Discussion topics

• Double counting essays• Scoring• Weighting the essay and math performance

task• Streaming audio-bandwidth and caching

issues• Number of performance levels

1988 - 2013

transitional the assessment

Documents

new technology

color car

sbac blueprint

sbac targets

sbac assessment claim

banked scores

sbac style guide

computerbased accommodations