clackamas cc assessment presentation 2010
TRANSCRIPT
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 1/47
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 2/47
Assessment and Students Learning
The purpose of
assessment is to guide
practice.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 3/47
Definition of Assessment
Assessment is an ongoingprocess aimed atunderstanding and
improving student learning.
It involves making ourexpectations explicit andpublic;
setting appropriate criteria
and high standards forlearning quality;
systematically gathering,
analyzing, and interpreting
evidence
to determine how well
performance matches those
expectations and standards;
and using the resulting
information to document,
explain, and improve
performance.
(Angelo, AAHE Bulletin, November, 1995
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 4/47
Definition of Assessment
When it is
embedded
effectively within largerinstitutional systems,
assessment can help us
focus our collective
attention,
examine our
assumptions, and
create a shared
academic culturededicated to assuring
and improving the
quality of higher
education (Angelo, AAHE
Bulletin, November, 1995
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 5/47
Definition of Assessment
"Assessment is defined as the systematic basis
for making inferences about the learning and
development of students.
More specifically, assessment is the process of
defining, selecting, designing, collecting,
analyzing, interpreting, and using information to
increase students' learning and development"(T. Dary Erwin, Assessing Student Learning and Development , Jossey-Bass, 1991, see pp.14-19).
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 6/47
Using Assessment to Drive Learning
Assessment is
conducted toinform practiceleading to
improveperformance.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 7/47
Learning is when Neurons Wire
Learning is a change
in the neuron-patterns of the
brain.(Ratey, 2002)
www.virtualgalen.com/.../ neurons-small.jpg
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 8/47
Use it or Lose it
When new material is
not practiced the new
dendrite tissue is
reabsorbed by the brainto conserve resources.
(Dr. Janet Zadina)
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 9/47
Teachers Definition of Learning?
Learning is the ability to use information aftersignificant periods of disuse
and
it is the ability to use the information to solveproblems that arise in a context different (if onlyslightly) from the context in which the information
was originally taught.
(Robert Bjork, Memories and Metamemories, 1994)
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 10/47
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 11/47
Assessment can be used to Drive
Students 'Learning
1. Establishing clear,measurable expectedoutcomes of students
learning.
Example-- competencylevels in math or readingor departmental examsin content subjects.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 12/47
What do we want our students to learn?
What would make us happy (from all that we
taughtthe skills, content and behaviors) that our
students remembered and could use one year after
they finished our class?
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 13/47
Using Assessment to Drive Learning
2. Ensuring that studentshave sufficientopportunities to achievethose outcomes.
Rewriting
Retesting
Revising
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 14/47
Time
Does the course time fit
the amount of content
or number of skills
students are beingasked to learn?
A 3 credit course that
meets for 15 weeks3
hours per week
Gets 1.7% of the
students time each
week to deliver the
learning.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 15/47
Using Assessment to Drive Learning
3. Systematicallygathering, analyzing,
and interpretingevidence to determinehow well studentlearning matches ouroutcomes/expectations
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 16/47
Examples of Gathering Information
Summative Forms
Pre-test --Post test
Initial writing sample
final writing sample
Portfolio of progress
Weekly quizzes
Cumulative exams
Written explanations of
understandings
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 17/47
Examples of Gathering Information
Formative Forms
Classroom discussions
Individual students
questioning Self ( student)
evaluation
Recoding of course
information Classroom assessment
techniques (CAT)
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 18/47
Using Assessment to Drive Learning
4.Using the resulting
information to
understand and
improve studentlearning.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 19/47
Examples
Making changes in testquestions based on post-test analysis.
Revising assignments tobetter match learningoutcomes.
Rethinking the best use of your time in theclassroom.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 20/47
Benefits of Assessment to Students
Clearly defined learning
outcomes helpstudents focus theirtime and energy.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 21/47
Benefits of Assessment to Students
Grades are a motivator
Regular feedback helpsstudents to know their
strengths and
weaknesses.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 22/47
Feedback of Progress is Vital
Feedback allows for afeeling of makingprogress.
A feeling of makingprogress is what allowsstudents to deal withtasks, especially tasksthey dont necessarily like
to do.
(James Zull, The Art of Changing the Brain, 2002)
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 23/47
Benefits of Assessment to Students
Assessment
information can
document what
students have learnedfor use in job
applications, grad
school etc.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 24/47
Do grades have a place in
assessment?
YesThey can be useful evidence of
students learning if they are based on directevidence of students learning (tests, papers,projects etc.) that are truly linked to majorlearning goals and clearly delineated,
consistent standards through test blueprintsor rubrics (Suskie, 2004) nfo.umuc.edu/.../ image005.gif )
i
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 25/47
However, grade have limitations
Grades fail to clearly tell usabout large learning
Critical thinking skills
Problem solving abilitiesCommunicationskills/oral/written/listening
Social skills
Emotional Management skills
www.thrall.org/ criticalthinking/title.gif
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 26/47
Grades struggle to tells us about
Students Strengths and Weaknesses
A grade of B in organic
chemistry says the
student has probablylearned a great deal of
the information but we
dont know what she has
or has not mastered.
members.aol.com/ profchm/chmjugl2.gif
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 27/47
Grading Standards Across Courses
How precise are the
grading standards ?
Do standards differ
from teacher to
teacher?
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 28/47
Grading Standards Across Courses
Grading holistically
Grading using a rubric?
Grading giving points
Grading giving percentages
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 29/47
Example of Using Grades
If in class A
All scores below 60 are
considered an F and
4 test of equal value are
givenpotentially a
student could earn two
grades of F and two
grades of A to = C in the
course.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 30/47
Example of Using Points
In class B
If four 100 point tests aregiven and a student earnsthe following grades
Test 1 = 39 points
Test 2 = 93 points
Test 3 = 57 points
Test 4 = 95 points
AVG = 71 or a D grade
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 31/47
Testing Standards are often
Inconsistent
Does the tests clearly
match the content
taught, the level of thinking taught and the
skills taught in the
class?
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 32/47
Role of Grading in Assessment
Grades are often based
on more than just whatthe students have
learned as measured
by tests, papers,
projects, presentationsetc.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 33/47
Other Issues that Impact Grades
Grades may be
impacted by students
effort, attitude,
behavior orparticipation.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 34/47
Other Issues that Impact Grades
Grades may also be
impacted by course
rules that lower grades
for being late or absentfrom class or turning in
late work.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 35/47
Grades
These may all be
appropriate classroom
management tools but
they illustrate howgrades may not reflect
what a student has
learned as defined in
the courses learningoutcomes.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 36/47
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 37/47
Limits of Tests
Are the test questions
precise enough and
consistent enough with
what we taught to bean accurate measure of
the learning?
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 38/47
50 Minutes
How many questions
covering how many
parts of what was
taught can be answeredby students in 50
minutes?
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 39/47
Formative Assessment
Black and Wiliam [3]
consider an assessment
formative when the
feedback from learningactivities is actually
used to adapt the
teaching to meet the
learner's needs.
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 40/47
Formative Assessment Tools
Classroom Assessment Techniquesthese are avariety of informal short activities to assess howstudents learning is progressing. They can bedone daily, weekly, monthly etc.( Angelo and Cross, 1993)
± One minute paper
± Muddiest point
± One sentence summary
± Background Questionnaire
± Content Inquiry
TOOLS
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 41/47
Formative Tools
Written Feedback
Oral Feedback/ individual student meetings
Peer feedback
Small Group Instructional Diagnosis (SGID)
Recitation/ Questioning/Recoding
Discussion
Observations
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 42/47
Self Assessment
Self assessment of
work- builds
metacognition skills.
It is students judging
their own work based
on explicit criteria in
order to do better in
the future( Rolheiser & Ross, 2000).
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 43/47
Summative Tools
Essay tests
Objective tests, true-false, multiplechoice, fill-in-the blanks, matching
Cases
Open book tests
Take home tests
Group tests
Retesting
Daily/weekly quizzes
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 44/47
Summative Tools
Pop quizzes
Oral presentations-powerpoint, web pages or sites
Written reports Written term papers
Written essays
Group presentations
Speeches Role plays
Performances
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 45/47
Summative Tools
Simulations
Games, like College Bowl, Jeopardy
Debates Trials
Point-Counter Point
Town Meeting
Create video or DVD Interviews
Teach a lesson
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 46/47
Summative Tools
Annotating reading
Writing case studies
Solving problems
Creating mind maps-contentmaps
Create images or drawings Reflective Journals
Discussion/participation
Problemsets/math/chemistry/physics/accounting
Answer questions from readings Write summary or notes of
reading
Puppet Show
8/8/2019 Clackamas CC Assessment Presentation 2010
http://slidepdf.com/reader/full/clackamas-cc-assessment-presentation-2010 47/47
References
Bers, T., Davis, B. D., & Mittler, M. (2001). Assessing the Achievement of General Education Objectives in the Community College: A Project Acrossthe Disciplines [Electronic Version]. Assessment Update, 13, 6-13. See http://www3.interscience.wiley.com/cgi-bin/jissue/86511668.
Biggs, J. (2006). OBTL (Outcomes-based Teaching and Learning) at CityU in the Hong Kong context. Seehttp://celt.ust.hk/obe/links/references/OBTL%20at%20CityU%20in%20the%20Hong%20Kong%20Context(PP03).ppt Boud, D., & Falchikov,N. (2006).Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education, 31(4), 399-413. Brown, G., Bull, J., & Pendlebury,M.(1997). Assessing student learning in higher education. London ; New York: Routledge. Coates, H. (2007). Excellent measures precede measures of excellence. Journal of Higher Education, 29(1), 87-94.
Cross, P., & Angelo, T. (1988). Classroom Assessment Techniques. A Handbook for Faculty. Seehttp://eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/20/15/f 6.pdf
Gan Che, N., Heskin, K., & Sharma, R. (1993). Quality of Student Outcomes: Concepts and Issues of Measurement. Seehttp://www.aair.org.au/jir/Nov93/Ng2.pdf Hernon, P. (2004). Selecting from the Assessment Tool Chest. In P. Hernon & R. E. Dugan (Eds.), Outcomes
Assessment in Higher Education Westport: Libraries Unlimited. Hernon, P. & Dugan, R. (Eds.). (2004).O
utcomes Assessment in Higher Education:Views and Perspectives. Westport: Libraries unlimited. Hinett, K., & Knight, P. (1996). Quality and assessment. Quality Assurance in Educat ion, 4(3), 3-10. (Also relevant for Quality Assurance, Implementation)
Hunt, S. (2000). Community College Strategies: Using a Capstone Course to Assess General Education Outcomes. Assessment Update, 12, 8-9. Seehttp://www3.interscience.wiley.com/cgi-bin/fulltext/101521998/PDFSTART
Kift, S. (2002). Harnessing Assessment and Feedback to Assure QualityOutcomes for Graduate Capability Development: A Legal Education CaseStudy. See http://www.aare.edu.au/02pap/kif02151.htm
Murphy, R. (2001). A Briefing on Key Skills in Higher Education, Assessment Series No 6, Learning and Teaching Support Network (LTSN) GenericCentre. See http://www.palatine.ac.uk/files/967.pdf
Rolheiser, C., & Ross, J. A. (2000). Student self-evaluation - what do we know? Orbit, 30(4), 33-36.
Seybert, J. (1994). Community College Strategies: Assessing Student Learning [Electronic Version]. Assessment Update, 6, 8-9. Seehttp://www3.interscience.wiley.com/cgi-bin/fulltext/114134718/PDFSTART. Seybert, J. (2002). Assessing Student LearningOutcomes. New Directions
for Community Colleges(117), 55-65.
T. Dary Erwin, Assessing Student Learning and Development , Jossey-Bass, 1991, see pp.14-19). Yeo, S. (2004). Embedding Graduate Attributes in Assessment Tasks. See http://www.cdtl.nus.edu.sg/link/pdf/Jul2004.pdf (Also relevant for Staff
Development, Conceptualisation
http://www.aacu.org/resources/assessment/index.cfm
http://www.glencoe.com/ps/teachingtoday/educationupclose.phtml/9
http://www.stanford.edu/group/ncpi/unspecified/assessment_states/instruments.html
http://www.eric.ed.gov/ERICWebPortal/search/detailmini.jsp?_nfpb=true&_&ERICExtSearch_SearchValue_0=ED399925&ERICExtSearch_SearchType_0=no&accno=ED399925 ( AAHE Reference to Definition of Assessment)