zen and the art of assessment: a framework for effective practice based on: assessment in context:

Austin Community College Achieving Excellence Committee November 30, 2007

Zen and the Art of Assessment:Zen and the Art of Assessment:A Framework for Effective PracticeA Framework for Effective Practice

Based on:Assessment in Context:

A Systems Approach to Educational Effectiveness

Ronald L. BakerRonald L. Baker


Educational PracticeEducational Practice

Teac

hing

Teac

hing

Learning

Learning

AssessingAssessing

KnowledgeKnowledge


Historical ParadigmHistorical Paradigm

KnowledgeMaze of disparate often isolated information

TeachingDispensing discipline-specific information

LearningRecording and assembling information

AssessingTesting retention of information

AppearanceAppearance

Most of us do not look as handsome to others as we do to ourselves.

Assiniboine Tribal Proverb


ChangeChange

OutcomesImplied Explicit

What does that mean?

AchievementsAssumed Assessed

How do you know?

EvidenceAnecdotal Verifiable

Show me the data!


Strategic PlanStrategic Plan

We need elucidation of the obvious more than investigation of the obscure.

Oliver Wendell Holmes


PerspectivePerspective

The challenge is for us to see beyond the innumerable fragments to the

whole, stepping back far enough to appreciate how things move and

change as a coherent entity.Margaret Wheatley


ApproachApproach

Method consists of two processes, correlative and complementary to each

other: AnalysisAnalysis of complex totalities into their parts; and SynthesisSynthesis of parts into

their totality.Joseph L. Esposito


AmplificationAmplification

AnalysisAnalysis - Reductionistic examination of parts to acquire knowledgeknowledge of their properties and functions.

SynthesisSynthesis - Holistic study of relationships among parts to gain understandingunderstanding of their roles and the purpose of the whole in which they exist.


CharacteristicsCharacteristics

AnalysisAnalysis

Reductionistic

Take Apart

Isolate

Answer Questions

SynthesisSynthesis

Holistic

Put Together

Correlate

Ask Questions

Isolated PracticesIsolated Practices

Interlocking PracticesInterlocking Practices

Analysis FitAnalysis Fit

Synthesis FitSynthesis Fit


NuancesNuances

Improvement (Achieve Outcomes)Student LearningCurriculumPedagogy

Performance (Evaluate Outcomes)Student AchievementTeaching EffectivenessProgram Success

Accountability (Defend Outcomes)CostEfficiencyViability


DefinitionDefinition

Assessment is a system of analysis and synthesis to appraise and document quality, achievements, and effectiveness consisting of:

CollectionAnalysisEvaluationEvidenceAssimilation


ElementsElements

Collection - systematic acquisition of data linked to indicators of achievement.

Analysis - critical examination of data.

Evaluation - meaning derived from analysis.

Evidence - documentation to support judgments, conclusions, and actions.

Assimilation - use of evidence-based findings to inform and improve practice.


InterestsInterests

Student Learning

Teaching Effectiveness

Program Effectiveness

Support Unit Effectiveness

Institutional Effectiveness

Personal Fulfillment


FrameworksFrameworks

Student LearningFocus: Learning Outcomes

Assess: Progress/Achievements

Teaching EffectivenessFocus: Promotion of Learning

Assess: Student Engagement

Program EffectivenessFocus: Stakeholder Expectations

Assess: Post-completion Success


FrameworksFrameworks

Unit EffectivenessFocus: Role and Objectives

Assess: Processes and Practices

Institutional EffectivenessFocus: Mission and Goals

Assess: Fulfillment of Intentions

Personal FulfillmentFocus: Individual Expectations

Assess: Satisfaction and “Fit”


FormsForms

Formative - ongoing formal and informal evaluations that provide feedback on progress to date and gives direction to achievement of intended outcomes.

Summative - formal evaluations at specific points in time to judge performance in relation to the intended outcomes of the course or unit.


FulcrumFulcrum

How much assessment is formative?

How much assessment is summative?

How commensurate is that distribution with your mission and values?


Student Learning AssessmentStudent Learning Assessment

Primary Purposes:

Assessment of Student LearningEvaluate/certify student achievements

Assessment for Student LearningAssist students in fulfilling their fullest potential as learners


DifferentiationDifferentiation

Assessment of learning is the process of measuring, evaluating,

and documenting students’ knowledge, skills, and abilities.


DifferentiationDifferentiation

Assessment for learning is the process of seeking and interpreting

evidence for use by learners and their teachers to decide where the learners are in their learning, where they need

to go, and how best to get there.Assessment for Learning: 10 Principles

Assessment Reform Group (ARG)


CharacteristicsCharacteristics

Assessment Assessment ofof Learning Learning

Measures Past Learning

Reports Results

Accountability

Yields Feedback

Summative

Evaluative

Formal

Assessment Assessment forfor Learning Learning

Fosters Future Learning

Influences Results

Improvement

Yields Feedforward

Formative

Diagnostic

Informal


BalanceBalance

Assessment of learning, balanced with assessment for learning, interconnects

assessments with assignments in a recursive cycle so that summative feedback on one outcome yields

formative feedforward that enhances achievement of a subsequent outcome.

Integrative Assessment (Quality Assurance Agency for Higher Education)


A Excellent

C- Fine

C/C- Interesting

C Opening terrible - main part OK - give references next time

C- Your writing is appalling

D Terrible! Didn’t you learn anything at school about writing essays?!

AmbiguityAmbiguity

Purposeful PracticePurposeful Practice


Purposeful Practice MatrixPurposeful Practice Matrix

TeachingMethods

Intended Outcomes

1)

2)

3)

4)

5)

StudentEngagement

StudentDemonstration

AssessmentConsiderations

Assessment of Learning

Assessment for Learning

Corroborating Evidence

Learning Theory

AchievementIndicators


Questions and DiscussionQuestions and Discussion


ValuesValues

What is your foremost institutional value?


ApplicationApplication

Does assessment practice reflect that value?


AuthenticityAuthenticity

How well do assessments promote outcomes achievement or enable judgments of authentic achievement of your outcomes?


AssimilationAssimilation

How are assessment results used to enhance achievements/improve

effectiveness of practice?


Good Luck!Good Luck!

Ron BakerRon [email protected]@nwccu.org

zen and the art of assessment: a framework for effective practice based on: assessment in context:

Documents