dr. jeff m. allendepartment of technology and cognition assessment of courses an open forum through...

Dr. Jeff M. AllenDepartment of Technology and Cognition

Assessment of Assessment of CoursesCourses

An Open Forum through the University Forum on Teaching,

Learning and AssessmentSponsored by the Office of the Vice-President of Academic Affairs

Can be Downloaded at:www.coe.unt.edu/Allen/download.htm


Session ObjectivesSession Objectives

Discuss General Classroom Assessment.

Discuss Outcome Oriented Evaluation.

Facilitate an Open Discussion about Assessment.


Needs AssessmentNeeds Assessment

What do you know about assessment or evaluation?

What are your expectations of this session?


What is the Difference What is the Difference betweenbetween

Education & Education & Training?Training?


Consider your reaction if Consider your reaction if your child came home and your child came home and told you:told you:We attended sex education today!

or We attended sex training today!


Evaluation MythEvaluation Myth

I can’t Measure the I can’t Measure the ResultsResults of my of my

Program.Program.


Using different “Levels” of Evaluation:

Comfort (Environment)

Consider . . .Consider . . .




Formative (Progress)






Summative (Learning Outcomes)






Summative (Learning Outcomes)

Transfer (Application of Learning)



Contextual Learning Why do I have to learn this? Where am I going to use it? How does this

relate to where I’m going in life?



Evaluation MythsEvaluation Myths

I Don’t Need To I Don’t Need To Justify My Justify My Existence, I Have a Existence, I Have a Proven Proven Track RecordTrack Record


Evaluation MythEvaluation Myth

My My Doesn’t Doesn’t Require Evaluation,Require Evaluation,

So Why ShouldSo Why Should

I Do It?I Do It?


What if is no longer in that position?

What about tough economic times?

Budget Cuts? What if someone doesn’t have

the same amount of faith?



Why Evaluate?Why Evaluate?


Goals of AssessmentGoals of Assessment(Classroom)(Classroom) Basis for Planning & Directing Determine if Training /

Education makes a Difference Assess Progress &

Achievement Continuous ImprovementContinuous Improvement


Goals of AssessmentGoals of Assessment(Programs)(Programs) Basis for Planning & Directing Assess Progress &

Achievement Evaluate Curriculum /

Programs / Staff / Facilities Certify / Rate / Accredit

(for example: SACS & THECB) Monitor Expenditures of $$$


Goals of AssessmentGoals of Assessment(Programs)(Programs) Justify Existence Accountability Pressure from Other

Organizations Marketing Continuous ImprovementContinuous Improvement


Please Remember . . Please Remember . . .. Not everything is

quantifiable. Consider evaluation

EARLY. Some benefits cannot be

measured immediately.


A Complete A Complete Results Results

Oriented ModelOriented ModelSource:

Phillip, J. (1991). Handbook of Training Evaluation and Measurement Methods (2nd Ed.). Houston, TX: Gulf.

Latest Edition:

Phillips, J. (1997) – 3rd Ed. ISBN #0-88415387-8

1. Conduct a Needs Analysis 2. Develop Tentative Objectives

3. Establish Baseline Data4. Select Evaluation Methods/Designs5. Finalize Program Objectives7. Estimate Program Cost/Benefits8. Prepare and Present Proposal9. Design Evaluation Instruments10. Determine & Develop Content11. Design or Select Training and Development Methods12. Test Program and Make Revisions

BEFORE

13. Implement and Conduct Program

14. Evaluate/Collect Data at Proper Stages

15. Analyze and Interpret Data

DURING

16. Make Adjustments

17. Calculate Return-on-Investment

18. Communicate Results

AFTER

Results-Oriented ModelResults-Oriented Model



BEFORE



15. Analyze and Interpret Data




DURING

AFTER




15. Analyze and Interpret Data (Improvement Notes)

DURING



BEFORE










BEFORE DURING

AFTER




BEFORE




DURING




AFTER


Continuous

Improvem

ent


Limitations of Limitations of Evaluation & Evaluation & AssessmentAssessment Evaluation/Assessment

(generally) Does Not Solve Problems,

It Serves to Identify Them.

Improvement is Next!Improvement is Next!

Dr. Jeff M. Allen

University of North TexasUniversity of North Texas

Department of Technologyand Cognition

P.O. Box 311337Denton, Texas 76203-1337

Email: [email protected]: (940)565-4918

To Download Presentation: http://www.coe.unt.edu/Allen/download.htm

(Available until February 2000)

dr. jeff m. allendepartment of technology and cognition assessment of courses an open forum through...

Documents