fall 2013 semlol presentation -- towards authentic assessment

37
TOWARDS AUTHENTIC ASSESSMENT IN ONLINE TUTORIALS SEMLOL Fall Meeting 2013 - November 8, 2013 Bill Marino Online Learning Librarian - Eastern Michigan University Image source: cobalt123 (2007) Test Well. Retrieved from http://www.flickr.com/photos/cobalt/409924867/

Upload: bill-marino

Post on 11-Nov-2014

340 views

Category:

Education


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

TOWARDS AUTHENTIC ASSESSMENT IN ONLINE

TUTORIALSSEMLOL Fall Meeting 2013 - November 8, 2013

Bill MarinoOnline Learning Librarian - Eastern Michigan University

Image source: cobalt123 (2007) Test Well. Retrieved from http://www.flickr.com/photos/cobalt/409924867/

Page 2: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

This presentation begins a conversation on:

• What do we assess?

• How do we assess?

Image source: wecometolearn (2012). Long before the Third Grade Test. Retrieved from http://www.flickr.com/photos/wecometolearn/6831018124/

Page 3: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Do we assess student learning in our online media?

Page 4: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

What do we assess?

Page 5: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

What do we assess?

Benjamin Bloom

Image retrieved from https://bloomstheory.wikispaces.com/Introduction

Page 6: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

The foundation:

Image source: [email protected] (2011). New Bloom's Taxonomy. Retrieved from http://www.flickr.com/photos/fishbraintexas/5493450400/

Page 7: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Learning Objectives

Source: Research 101 @ EMU. Adaptation of University of Washington Information Literacy Learning's Research 101.

• Give focus to a lesson's content• Express expectations• Provide a framework for assessment/learning

activities

Page 8: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Effective Assessment is…

• “Knowing what you are doing”

• “Knowing why you are doing it”

• “Knowing what students are learning as a result”

• “Changing because of the information”

(Gilchrist, 2009)

Page 9: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

The foundation:

Image source: [email protected] (2011). New Bloom's Taxonomy. Retrieved from http://www.flickr.com/photos/fishbraintexas/5493450400/

Page 10: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Remember:

•shallow processing

•recall/recognition of facts

•memorization

•the 5 Ws

(IUPUI Center for Teaching and Learning, 2002)

Page 11: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Understand:

•summarization

•interpretation

•focus on connections

(IUPUI Center for Teaching and Learning, 2002)

Page 12: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Apply:

•knowing when and why to apply

•recognition/transfer of patterns

•judging effects

(IUPUI Center for Teaching and Learning, 2002)

Page 13: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Analyze:

•breaking down into respective parts to create a model of thinking

•identifying relationships

(IUPUI Center for Teaching and Learning, 2002)

Page 14: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Evaluate:

•apply a set of criteria to evaluate

(IUPUI Center for Teaching and Learning, 2002)

Page 15: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Create:

•"combining elements into a pattern not clearly there before."

(IUPUI Center for Teaching and Learning, 2002)

Page 16: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Learning Objectives

Source: Research 101 @ EMU. Adaptation of University of Washington Information Literacy Learning's Research 101.

Page 17: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

• Select an appropriate topic for research

• Generate questions from a topic

• Broaden and narrow a question

• Identify key concepts and vocabularies related to a topic

• Broaden and narrow concepts and vocabularies related to a topic.

Page 18: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

• Select an appropriate topic for research

• Generate questions from a topic

• Broaden and narrow a question

• Identify key concepts and vocabularies related to a topic

• Broaden and narrow concepts and vocabularies related to a topic.

understand

analyze, create

apply, analyze, evaluate, create

understand

apply, analyze, evaluate, create

Page 19: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

However, when it comes to assessment...

• Broaden and narrow concepts and vocabularies related to a topic.

apply, analyze, evaluate, create

Page 20: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

However, when it comes to assessment...

• Broaden and narrow concepts and vocabularies related to a topic.

apply, analyze, evaluate, create

understand, apply

Page 21: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment
Page 22: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment
Page 23: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Enter Authentic Learning

"Authentic assessment requires the respondent to construct, rather than select, a response to academic stimuli" (Powers, 2005).

Page 24: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

How can this be incorporated into online

tutorials?1. Not necessarily "tool-dependent”

2. Can still capture relevant data

3. Requires a shift in how we think of assessment--from an add-on to the instructional object itself.

Page 25: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

What does authentic assessment look like?

• simulation

• case studies/situational learning models

• reflection/self-assessment

• collaboration/social elements included

Image source: Horse Simulator WWI. Retrieved from http://en.wikipedia.org/wiki/File:Horse_simulator_WWI.jpg

Page 26: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Simulation

Image source: SuperJet International (2011). Full Flight Simulator. Retrieved from http://www.flickr.com/photos/superjetinternational/5573438825/

Page 27: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Simulation

Image source: University of Arizona Libraries (2013). Guide on the Side. Retrieved from http://www.library.arizona.edu/applications/quickHelp/tutorial/searching-the-ua-library-

catalog

Guide on the Side - http://code.library.arizona.edu/gots/

Page 28: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Case studies/situational learning models

Image source: VU e-Innovations (n.d.) The Adventures of Jasper Woodbury. Retrieved from http://jasper.vueinnovations.com/

Page 29: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Case studies/situational learning models

Page 30: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Reflection/Self-assessment

Page 31: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

The social element• Provide opportunities for further

discussion

Page 32: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

So...

can become...

Page 33: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Image source: Jobling, C. (2010). My first concept map. Retrieved from http://www.flickr.com/photos/cpjobling/5011621421/

A concept mapping exercise…

Page 34: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

A troubleshooting exercise…

Mike is researching customer service in college dining services, but cannot find relevant sources. His search is below. Help him refine his keywords by suggesting broader, narrower, or related terms that he can search.

Enter your words here.

Page 35: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

So much more.

Page 36: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

THANK YOU!References:

Conrad, R., & Donaldson, J. (2004). Engaging the Online Learner. San Francisco: Jossey-Bass.

Ellis, R.K. (2012). Backchannel Best Practices. Retrieved from

http://www.astd.org/Publications/Newsletters/Learning-Circuits/Learning-Circuits-Archives/2012/02/

Backchannel-Best-Practices

Gilchrist, D. (2009). A Twenty Year Path: Learning about Assessment; Learning from Assessment.

Communications in Information Literacy, 3(2), 70-79.

Holder, L. (2012). How to design assessments that promote the learning process. Retrieved from

http://elearningindustry.com/authentic-assessments.

IUPUI Center for Teaching and Learning. (2002). Bloom's Taxonomy "Revised" Key Words, Model

Questions, & Instructional Strategies. Retrieved from

https://keyarts.wikispaces.com/file/view/bloom_revised.pdf.

Powers, K. (2005). Authentic Assessment. In (S. W. Lee, Ed.) Encyclopedia of school psychology.

Thousand Oaks, Calif.: Sage Publications. Retrieved from http://galenet.galegroup.com/servlet/eBooks?

ste=22&docNum=CX3453099999.

Silvers, A. (2011). Authentic Assessment in Learning Experiences - ADL Future Learning Experience

Project. Retrieved from https://sites.google.com/a/adlnet.gov/future-learning-experience-project/project-

updates/authenticassessmentinlearningexperiences

Page 37: Fall 2013 SEMLOL Presentation -- Towards Authentic Assessment

Bill MarinoAssistant Professor – Online Learning

LibrarianEastern Michigan University

[email protected]

Twitter: @wmarino