My Thoughts on My Thoughts on

How You Can Have a Successful How You Can Have a Successful Experience Experience

with Calibrated Peer Reviewwith Calibrated Peer Review

by Dr. Wendy Keeney-Kennicutt,by Dr. Wendy Keeney-Kennicutt,

CPR Administrator, TAMUCPR Administrator, TAMU

WHAT IS CPRWHAT IS CPR™™??

A Web-based instructional writing A Web-based instructional writing and peer assessing tooland peer assessing tool

Originated in the Molecular Science Originated in the Molecular Science Project, an NSF-sponsored chemistry Project, an NSF-sponsored chemistry reform project (DUE 95-55605) at UCLAreform project (DUE 95-55605) at UCLA

Enables you to learn by writing about Enables you to learn by writing about significant topics in a course, then going significant topics in a course, then going through a critiquing process 7 timesthrough a critiquing process 7 times

FREEFREE

HISTORY AT TAMUHISTORY AT TAMUcpr.tamu.educpr.tamu.edu

20022002 - CPR - CPRTMTM was introduced to TAMU by was introduced to TAMU by me, Dr. Wendy Keeney-Kennicutt after me, Dr. Wendy Keeney-Kennicutt after a Chemical Education workshop demo.a Chemical Education workshop demo.

20032003 - To avoid FERPA issues & because - To avoid FERPA issues & because of WALS NSF grant thru CTE, CPRof WALS NSF grant thru CTE, CPRTMTM was housed on a secure TAMU server.was housed on a secure TAMU server.

20032003 - I volunteered to be the CPR - I volunteered to be the CPRTM TM administrator because of experience.administrator because of experience.

WALS = Writing for Assessment and Learning in the Natural and Mathematical Sciences

USE OF CPR AT TAMUUSE OF CPR AT TAMU

In the last 3 years, CPR at TAMU has been In the last 3 years, CPR at TAMU has been used by approximately used by approximately 19,00019,000 undergraduate and graduate undergraduate and graduate

students doing students doing 492492 new assignments by new assignments by 384384 instructors in instructors in 400400 courses spread over courses spread over 30+30+ majors in majors in 99 colleges.  colleges. 

MAJORS USING CPRMAJORS USING CPRTMTM

AccountingAccounting Ag. EconomicsAg. Economics Animal ScienceAnimal Science AnthropologyAnthropology ArcheologyArcheology BiochemistryBiochemistry BiologyBiology BotanyBotany Bus. Admin.Bus. Admin. Ctr. Acad. Enh.Ctr. Acad. Enh. ChemistryChemistry

EnglishEnglish Ed. CurriculumEd. Curriculum Ed. PsychologyEd. Psychology EngineeringEngineering FilmFilm FrenchFrench GermanGerman GeographyGeography KinesiologyKinesiology Learn. Comm.Learn. Comm. MathMath

MicrobiologyMicrobiologyNutritionNutritionPhysicsPhysicsPoultry SciencePoultry Science

PsychologyPsychologyReadingReading Secondary Ed.Secondary Ed. Vet Integr. Bio. Sci.Vet Integr. Bio. Sci. Wildlife & Fish. Sci.Wildlife & Fish. Sci. ZoologyZoology

Why are you doing CPR?Why are you doing CPR?

Giving you more practice writing in your Giving you more practice writing in your classes – not just English papersclasses – not just English papers

You will have to write after university in the real You will have to write after university in the real worldworld

Ramifications of Bloom’s Taxonomy pyramid Ramifications of Bloom’s Taxonomy pyramid (next slide)(next slide) What level will pay you the “Big Bucks”?What level will pay you the “Big Bucks”? How will you get experience at working at higher How will you get experience at working at higher

levels of understanding (analysis, synthesis and levels of understanding (analysis, synthesis and evaluation)? evaluation)?

Why is writing Why is writing important?important?

Synthesis

Analysis

Application

Use of information Use of information to solve problems; to solve problems; transfer of abstract transfer of abstract or theoretical ideas or theoretical ideas

to practical to practical situations.situations.

Interpretation Identification of Identification of connections and connections and

relationshipsrelationshipsTranslation

Restatement in your Restatement in your own words; own words;

paraphrase; summaryparaphrase; summary

RecallVerbatim information; Verbatim information; memorization with no memorization with no

evidence of evidence of understandingunderstanding

EvaluationCombination of Combination of

information to form a information to form a uniqueunique

product; requires product; requires creativity and originalitycreativity and originality

Judgment: the ability toJudgment: the ability tomake decisions and make decisions and supportsupportviews; requires views; requires understanding of valuesunderstanding of values

Identification of Identification of component parts; component parts; determination ofdetermination ofarrangement, arrangement, logic, semanticslogic, semantics

Bloom’s Taxonomy – categorizingBloom’s Taxonomy – categorizing level of abstraction of questionslevel of abstraction of questions

HOW DOES IT WORK?HOW DOES IT WORK?

You write an assignment as per instructions.You write an assignment as per instructions.

You pass a calibration step, where you learn to You pass a calibration step, where you learn to recognize and rank 3 essays of different quality recognize and rank 3 essays of different quality on the same topic.on the same topic.

You, NOT the instructor, critique 3 of your peers You, NOT the instructor, critique 3 of your peers and your own work on-line. and your own work on-line.

Your instructor can change grade afterwards.Your instructor can change grade afterwards.

INTROINTRO

A CPR assignment consists of three stages: A CPR assignment consists of three stages:       

Stage 1:Stage 1: Text Entry Stage Text Entry Stage       Stage 2:Stage 2: Calibration and Review Stage Calibration and Review Stage       Stage 3:Stage 3: Results Stage Results Stage

Only one stage can be accessed at any time. Only one stage can be accessed at any time. If you don’t do the text entry, you cannot do If you don’t do the text entry, you cannot do

the rest of the assignment.the rest of the assignment.

STAGE 1: TEXT ENTRYSTAGE 1: TEXT ENTRY

You will explore the assignment source You will explore the assignment source material. material.

The source material provides the The source material provides the information about the assignment topic. information about the assignment topic. Source material can include: web sites, Source material can include: web sites, articles, text books, pictures, movies, articles, text books, pictures, movies, animations, etc. animations, etc.

STAGE 1: TEXT ENTRYSTAGE 1: TEXT ENTRY(continued)(continued)

You then submit a text based on the material and You then submit a text based on the material and guiding questions. Use HTML (see Student FAQs and guiding questions. Use HTML (see Student FAQs and instructor notes).instructor notes).

Make sure you answer all the guiding questions in your Make sure you answer all the guiding questions in your essay. Read the Writing Prompt carefully – it sets the essay. Read the Writing Prompt carefully – it sets the scene. scene.

Write in MSWord, then copy/paste into text box. CPR Write in MSWord, then copy/paste into text box. CPR will time you out after about 10 minutes and you can will time you out after about 10 minutes and you can lose all your work. You can also check your lose all your work. You can also check your grammar/spelling.grammar/spelling.

STAGE 2:STAGE 2: Calibration and Calibration and Review StageReview Stage

You will:You will:

evaluate three example texts, called calibration evaluate three example texts, called calibration essays using a grading rubric. These calibrations essays using a grading rubric. These calibrations will develop your ability to effectively review the will develop your ability to effectively review the work of your peers. You have 2 chances to pass work of your peers. You have 2 chances to pass each calibration. each calibration.

evaluate the work of three peers anonymously. evaluate the work of three peers anonymously. Take some time & be fair in your written comments.Take some time & be fair in your written comments.

evaluate your own work. evaluate your own work.

Stage 3: Results StageStage 3: Results Stage

You will view your assignment results.You will view your assignment results.

For Your Instructor:For Your Instructor: A problems list is generatedA problems list is generated All data can be downloaded.All data can be downloaded. Times can be altered for specific students Times can be altered for specific students

that miss deadlines, so tell your instructor that miss deadlines, so tell your instructor right away if you miss a deadline.right away if you miss a deadline.

CPR OVERVIEWCPR OVERVIEW

CPR deals with both writing and critiquing and CPR deals with both writing and critiquing and usually critiquing is worth more.usually critiquing is worth more.

CPR gives you practice in evaluating other people’s CPR gives you practice in evaluating other people’s work (this may make you nervous). This is a very work (this may make you nervous). This is a very powerful skill!powerful skill!

We know you are novice reviewers, but the only way We know you are novice reviewers, but the only way you will get any better is to practice!you will get any better is to practice!

There is a safety net – your instructor – who will There is a safety net – your instructor – who will regrade your work if you think your peers graded you regrade your work if you think your peers graded you badly. Every instructor will handle this differently, but badly. Every instructor will handle this differently, but it will get handled.it will get handled.

More Words of AdviceMore Words of Advice

The Writing Center (2The Writing Center (2ndnd floor of Library) will be happy to floor of Library) will be happy to look over your writing and make comments before the look over your writing and make comments before the due date.due date.

Always preview your writing before you submit to be sure Always preview your writing before you submit to be sure it looks OK. You can submit as often as you like until the it looks OK. You can submit as often as you like until the deadline. Beware of the 10min timeout.deadline. Beware of the 10min timeout.

HTML coding is easy – put <P>at the end of a line to start HTML coding is easy – put <P>at the end of a line to start a new paragraph, etc. See student FAQsa new paragraph, etc. See student FAQs

If you forget your login information, email me: If you forget your login information, email me: kennicutt@mail.chem.tamu.edukennicutt@mail.chem.tamu.edu..

Let me show you how to log in…….Let me show you how to log in…….

http://cpr.tamu.eduhttp://cpr.tamu.edu

Then GOOD LUCK!Then GOOD LUCK!

FINALLY:FINALLY: