getting started. decide which type of assessment –input assessment –process assessment...

33
Getting Started

Upload: brenda-watson

Post on 22-Dec-2015

221 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Getting Started

Page 2: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Getting Started

• Decide which type of assessment– Input assessment – Process assessment – Outcomes assessment– Impact assessment

Page 3: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Input Assessment Questions

• Who are our students?– Demographics– Attitudes– Skills– Knowledge

• What do they need in the way of programs and services?

Page 4: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Process Assessment Questions

• Visibility: Do students know about us?

• Importance/Need: Do students want/need our services?

• Use: Do students use our services?

• Satisfaction/Reaction: What do students think of the services and programs we provide?

Page 5: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

D

Program/Service Are you aware of this service?

How important is this service to you?

Have you used this service?

How satisfied are you with this program?

Yes No Not at all

Some-what

Very Important

Yes No Dissatisfied Neutral Satisfied

Academic Advising

Counseling Services

Health Education

Financial Aid Services

Recreational Sports

Learning Support Center

Dean of Students

Residential Life

Process Assessment Template

Page 6: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Outcomes Assessment Questions

• What have students learned?

• Who have they become?

Page 7: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Impact Assessment

• Did our program or service make a difference in what students learned or who they became?

• How will we know?

Page 8: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Moving from Strategic Vision

to Measurable Outcomes

Page 9: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Mission Review

• What business are we in?

• What business should we be in?

Page 10: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Why Mission Review?

• To determine purpose

• To respond to changed assumptions

• To clarify values

• To respond to changed capabilities

• To strengthen decision-making

• To conform actuality with aspirations

• To foster institutional change and renewal

Page 11: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Goals

• Goals state what the institution desires to have (inputs), to be (processes) and to become (outcomes).

Page 12: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Goals

• What do we want the result – outcome, process, or input – to be?

• How will we recognize the result when we have it? What are the concrete behaviors?

• What specific evidence are we willing to accept that these concrete behaviors have actually occurred?

Page 13: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Objectives Consist of:

• Desired outcome

• Criteria

• Indicators

• Standards of attainment

Page 14: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Outcome IndicatorsCriteria

To engage insystematicthinking

Develop scientifichypotheses

Write short stories

Invent shortcut fortransmission repair

Written test:Given data

Writes story:Given theme

Hands on performance

Page 15: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Goal Statement

Objective 1 Objective 2 Objective 3

Criterion 1

Indicator 1

Criterion 2

Indicator

Indicator 2

Criterion 1

Indicator

Criterion 2

Indicator 1

Indicator 2

Criterion 1

Indicator

Page 16: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Linking Goals and Objectives to Assessment and Evaluation

Assessment Results Evaluative Judgment Action to be Taken

Information usefulfor decision making.

Actual outcome compared with apre-specified standardfor an intended outcome.

Changes, if any, tobe made in inputs and processes on basis of evaluation.

Page 17: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Effective Goal Statements

• Begin with the word “To”

• Use verbs that imply action or accomplishment – To construct, To develop

• Use language appropriate to audience

• Include what you want the result to be

Page 18: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Example Goal

• To draw reasonable inferences from observations and logical premises

Page 19: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Effective Objectives

• Begin with the word “To” followed by a verb specifying an action or accomplishment

• Has associated with it one or more observable and therefore assessable results (concrete behavioral criteria)

Page 20: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Effective Objectives

• Identifies a target population

• Specifies or implies a target date for completion

• Identifies one or more indicators (methods of assessment) for its outcome

Page 21: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Effective Objectives

• Has associated with it conditions under which assessment will take place

• Has associated with it one or more standards of attainment for purposes of evaluation

Page 22: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Effective Objectives

• Relates to a specific goal

• Specifies WHAT will be done and WHEN, but not why or how or where

• Relates to a relatively short period of time, typically one year

Page 23: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Effective Objectives

• Is realistic and obtainable

• Specifies the maximum cost allowable

Page 24: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

A Process for Writing Goals and Objectives

• Get the main idea down on paper

• be liberally educated• think critically• have a high standard of ethics• be concerned about important social issues• have good communications skills

Page 25: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

A Process for Writing Goals and Objectives

• Identify concrete behavioral expressions of the outcome

1. What evidence would you be willing to accept?

2. What distinguishes people who have the characteristic from those who do not?

3. What instructions would you give to someone else who had to recognize the outcome?

Page 26: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Example

Outcome: be liberally educated

Concrete behaviors:knows a lotenjoys good booksis articulatetakes leadership roles in the communityunderstands sciencewrites well

Page 27: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

A Process for Writing Goals and Objectives

• Clean up the language used in Step 2• Delete duplications and choose the one statement that best

represents your intent

• Cross out behaviors that do not represent behaviors or conditions

• Eliminate statements that are not behaviors

Page 28: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Example

Outcome: be liberally educated

Concrete behaviors:uses the libraryreads the Great Booksowns a public library cardwrites book reviews for the campus newspaperreads few mass market gothic novels

Page 29: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

A Process for Writing Goals and Objectives

• Write complete sentences to describe each outcome

Concrete behaviors:uses the library = borrows each semester at least ten books from the college library

writes book reviews for the campus newspaper =has had accepted for publication by the campus newspaper during the last year one or more book reviews.

Page 30: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

A Process for Writing Goals and Objectives

• Check for completeness of goal description

• Does this series of concrete behaviors adequately describe the goal?

• If these behaviors or conditions are present, are you willing to accept that the goal has been achieved?

Page 31: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

ExamplesGoal: To graduate seniors who are all prepared for productive roles in society, both as effective participantsleaders.

Objective 1: To graduate students who have well developedhigher-order cognitive skills.

Objective 2: To graduate students who developed an activeawareness of their natural environment

Objective 3: To graduate students who have developed an awareness of themselves

Page 32: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Examples

• See Goal Objective Example

Page 33: Getting Started. Decide which type of assessment –Input assessment –Process assessment –Outcomes assessment –Impact assessment

Small Group Exercise

Use Goal Objective Template