assessment development: an interactive journey...assessment development: an interactive journey...

20
Assessment Development: An Interactive Journey Dr. Kristine David Asst. Director of Assessment

Upload: others

Post on 09-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Assessment Development: An Interactive Journey

Dr. Kristine David

Asst. Director of Assessment

Page 2: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Assessment occurs every day as part of quality instruction.

Page 3: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

What is Assessment?

A process of collecting evidence to make informed decisions.

“Assessment is crucial to move from opinions to informed action.” (National Research Council, 2001)

Page 4: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Why use tests?

(From “Assessment Literacy” by Forte, E., 2018)

Page 5: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Why use tests?

• Every test must have a purpose: what are the scores to be used for?

• Each use is associated with stakes.

• All tests should have some validity evidence to support score meaning.

• The higher the stakes, the more critical validity evidence becomes.

(From “Assessment Literacy” by Forte, E., 2018)

Page 6: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Purposes and Uses of Assessment

• What do you want to know?

• Why do you want to know this and what will you do with this information?

(From “Assessment Literacy” by Forte, E., 2018)

Page 7: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Purposes and Uses of Assessment

• What do you want to know?

• Why do you want to know this and what will you do with this information?

(From “Assessment Literacy” by Forte, E., 2018)

• What do students already know about

what I’m about to teach?

• How well are students understanding

this lesson so far?

• How well did students learn the

concepts from the unit I just taught?

• How well are students achieving in

relation to the standards for science in

their grade?

• How well are students achieving in

science this year as compared with

students in this grade last year?

Page 8: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Purposes and Uses of Assessment

• What do you want to know?

• Why do you want to know this and what will you do with this information?

(From “Assessment Literacy” by Forte, E., 2018)

• I need to tailor my upcoming lesson to better match

students’ needs.

• I need to know whether and how to reteach or if it’s

time to move on.

• I need information to give as feedback to students or

to use in grading.

• We need to determine whether and how to adjust our

science curricula for next semester or next year.

• We need to evaluate our science programs and

resources.

• We need to evaluate how we distribute resources to

districts or schools to support improvements in

science instruction.

Page 9: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Why use tests?

• Guide next steps in

instruction

• Evaluate learning for

calculating grades

• Evaluate teachers

• Evaluate instruction • Determine eligibility for

program entry or exit

• Evaluate schools or districts

• Evaluate curriculum • Diagnose learning difficulties • Evaluate programs or

services

• Predict performance in a

later setting

(From “Assessment Literacy” by Forte, E., 2018)

Page 10: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Why use tests?• Guide next steps in

instruction

• Evaluate learning for

calculating grades

• Evaluate teachers

• Evaluate instruction • Determine eligibility for

program entry or exit

• Evaluate schools or districts

• Evaluate curriculum • Diagnose learning difficulties • Evaluate programs or

services

• Predict performance in a

later setting

These uses are more formative.

They have relatively low stakes for

students and educators, as long

as scores are considered in

combination with other information

and decisions allow for flexibility in

implementation.

These uses have high stakes for

individual students and scores

must always be considered in

combination with other information.

These uses have high stakes for

educators and some

administrators and scores must

always be considered in

combination with other information.

(From “Assessment Literacy” by Forte, E., 2018)

Page 11: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Standardized Assessments

Page 12: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Steps In Constructing Standardized Assessments• Blueprints and Item Specifications

• Feedback to Students

• Passages and Items Written

• Review Items for Bias and Fairness Concerns

• Scoring and Data Review of Items

• Score Reports

• Scoring the Items

• Standard Setting

• Test Construction

Page 13: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Classroom Assessments

Page 14: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Classroom Assessments

Page 15: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Standardized Assessments

Blueprints and Item

Specifications

Passages and Items Written

Review Items for Bias or Fairness

Concerns

Test Construction

Scoring of the Items

Scoring and Data Review of

Items

Setting Standards

Score ReportsFeedback to

Students

Page 16: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Assessment Items

Page 17: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Assessment Items

Page 18: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Assessment Items

Page 19: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Creating Assessment Items

Page 20: Assessment Development: An Interactive Journey...Assessment Development: An Interactive Journey Author: Pitt, Adam L Created Date: 3/24/2020 9:34:03 AM

Questions?

[email protected]