jennifer eddy (2008) unpacking the communication standard: designing performance assessment dr....

Jennifer Eddy (2008)Jennifer Eddy (2008)

Unpacking the Unpacking the Communication Communication Standard: Designing Standard: Designing Performance Performance AssessmentAssessment

Dr. Jennifer EddyDr. Jennifer Eddy


Using a language appropriately in any Using a language appropriately in any given culture requires high adaptability, given culture requires high adaptability, tolerance of new situations, dealing with tolerance of new situations, dealing with incomplete information, and problem-incomplete information, and problem-solving without cues.solving without cues.

Assessment that most closely meets Assessment that most closely meets these criteria will be the best evidence these criteria will be the best evidence of understanding and true performance.of understanding and true performance.


Transfer—What is it?Transfer—What is it?

The ability to use of knowledge and skills in The ability to use of knowledge and skills in a different context, setting, or situation a different context, setting, or situation from how it was originally learned on one’s from how it was originally learned on one’s own, with few to no cues or supports.own, with few to no cues or supports.

The more complexities or variables the task The more complexities or variables the task contains, the more it demonstrates transfer contains, the more it demonstrates transfer and true understanding.and true understanding.

Thoughtful use of a repertoire, as opposed Thoughtful use of a repertoire, as opposed to just cued, simple plug-in or rote to just cued, simple plug-in or rote response. response.


Consider what happens Consider what happens anytime we communicate:anytime we communicate:

Interactions are non-scripted. Interactions are non-scripted. Information has gaps. Information has gaps. Materials are not filtered, Materials are not filtered,

arranged cleanly or adapted. arranged cleanly or adapted. We sift through anything we hear We sift through anything we hear

or see to get precisely what we or see to get precisely what we need to solve a problem or create need to solve a problem or create a product.a product.


TransferTransfer

Without transfer tasks, the Without transfer tasks, the learner will not be able to learner will not be able to develop the flexibility required develop the flexibility required when faced with unexpected when faced with unexpected situations they will encounter in situations they will encounter in the target culture.the target culture.

Transfer is the hallmark of a well Transfer is the hallmark of a well

designed performance task in a designed performance task in a language class. language class.


Turnarounds for TransferTurnarounds for Transfer

TravelTravel

Objective: To know the tourist Objective: To know the tourist sites in ________.sites in ________.

Task: Matching column to test Task: Matching column to test locations of tourist siteslocations of tourist sites


CommunicationCommunication

The Communication Standard The Communication Standard determines assessment and provides determines assessment and provides true evidence of learner performance. true evidence of learner performance.

The three modes of this Standard are The three modes of this Standard are the “moves for the game.”the “moves for the game.”

Integrated Performance Assessment Integrated Performance Assessment cycle and feedback make assessment cycle and feedback make assessment for instruction a seamless processfor instruction a seamless process


Performance Assessment in Performance Assessment in the Three Modesthe Three Modes

Our Our Communication Communication StandardStandard

Interpretive Mode TasksInterpretive Mode TasksReact to info, inferReact to info, infer

Interpersonal Mode Interpersonal Mode TasksTasks

Acquire new info, negotiateAcquire new info, negotiate

Presentational Mode Presentational Mode TasksTasks

Create a product, recreate Create a product, recreate texttext

Interpretive mode

Interpersonal mode

Presentational mode


Interpretive ModeInterpretive Mode

Comprehension of words, concepts, Comprehension of words, concepts, ideas, meaning of entire pieceideas, meaning of entire piece

Must be motivated by a culturally Must be motivated by a culturally authentic piece they hear, view, listen to authentic piece they hear, view, listen to or read.or read.

Text, poem, film, work of art, song, poem, Text, poem, film, work of art, song, poem, advertisement, music video, bookadvertisement, music video, book

Translation is not an Interpretive mode Translation is not an Interpretive mode task.task.


What is it?What is it? AnnouncementsAnnouncements Recorded messagesRecorded messages MusicMusic Film and TheatreFilm and Theatre SignsSigns SchedulesSchedules MapsMaps CartoonsCartoons PodcastsPodcasts InstructionsInstructions TV variety showsTV variety shows Game showsGame shows Soap operasSoap operas Youth-oriented TV Youth-oriented TV

showsshows

NewspapersNewspapers CatalogsCatalogs Short storiesShort stories Internet sitesInternet sites BlogsBlogs RecipesRecipes Letters/emailLetters/email MagazinesMagazines PoetryPoetry ConversationsConversations DebatesDebates TV public service TV public service

announcementsannouncements Radio commercials, Radio commercials,

announcements, announcements, weatherweather

Satellite radio (XM)Satellite radio (XM)


Where to find itWhere to find it Reputable Web sites Reputable Web sites Examples: online shopping advertisements Examples: online shopping advertisements

or websites, advertisements, metro maps, or websites, advertisements, metro maps, bus/train schedules, online museums, bus/train schedules, online museums, menus real estate ads, school websitesmenus real estate ads, school websites

PublicationsPublications FilmsFilms Photographs and drawingsPhotographs and drawings Songs or MusicSongs or Music Visual or Performing ArtVisual or Performing Art Radio and TelevisionRadio and Television Authentic menus, maps, advertisementsAuthentic menus, maps, advertisements Schedules, receipts, forms, posters, Schedules, receipts, forms, posters,

brochuresbrochures


Sample Interpretive tasksSample Interpretive tasks listen with visuals listen with visuals fill in graphs, charts, forms, graphic organizersfill in graphs, charts, forms, graphic organizers follow a route on a map follow a route on a map check-off items in a list check-off items in a list draw what is describeddraw what is described put sentences in correct orderput sentences in correct order

listen for the gist—identify main idealisten for the gist—identify main idea guess meaning from contextguess meaning from context identify/categorize/classify thematic vocabularyidentify/categorize/classify thematic vocabulary identify/categorize/classify authentic materialidentify/categorize/classify authentic material create questions from info in the piececreate questions from info in the piece

identify specific information found in the pieceidentify specific information found in the piece compose a title or headlinecompose a title or headline paraphrase in native language/target languageparaphrase in native language/target language brainstorm and categorize synonymsbrainstorm and categorize synonyms


Interpretive TaskInterpretive TaskTravelTravel

Using the different travel brochures Using the different travel brochures and websites from various towns and websites from various towns and cities in ___ , categorize on your and cities in ___ , categorize on your chart which towns or cities are the chart which towns or cities are the best places to visit for the best places to visit for the following:following:MusicMusicHistoric SitesHistoric SitesEasy transportationEasy transportationSpecial Events Special Events Places great for familiesPlaces great for familiesShoppingShoppingLow cost or free places to goLow cost or free places to goArt or local craftsArt or local crafts


Interpersonal ModeInterpersonal Mode Interpersonal mode tasks are Interpersonal mode tasks are

spontaneous exchanges that involve spontaneous exchanges that involve negotiation of meaning between people, negotiation of meaning between people, unrehearsed, non-scripted. Use unrehearsed, non-scripted. Use information from the interpretive task.information from the interpretive task.

Come with information the other learner Come with information the other learner does not have, creating an info gap to does not have, creating an info gap to provide and obtain information provide and obtain information

Memorized, or scripted dialogue Memorized, or scripted dialogue readings are not Interpersonal Mode readings are not Interpersonal Mode tasks.tasks.


Sample Interpersonal TasksSample Interpersonal Tasks Meeting and GreetingMeeting and Greeting Making a purchaseMaking a purchase Ordering in a restaurantOrdering in a restaurant Obtaining directionsObtaining directions Face to face or telephone conversationsFace to face or telephone conversations TransactionsTransactions DebatesDebates Discussing events of the dayDiscussing events of the day Making plansMaking plans Negotiating who does what, gets what, Negotiating who does what, gets what,

with who, how, and wherewith who, how, and where


Interpersonal TaskInterpersonal TaskTravelTravel

Using the chart, tell your partner Using the chart, tell your partner the towns or cities you would the towns or cities you would like or not like to visit, based on like or not like to visit, based on the information from the the information from the categories. categories.


Presentational TasksPresentational Tasksmust involve Transfermust involve Transfer

The best tasks or activities are those that The best tasks or activities are those that transfer or transpose knowledge to a new transfer or transpose knowledge to a new and different context from that in which it and different context from that in which it was initially learned.was initially learned.

These tasks require learners to solve These tasks require learners to solve problems, create a new product, use the problems, create a new product, use the content for a real world purpose other than content for a real world purpose other than display for the teacher or classroom.display for the teacher or classroom.

Presentational mode tasks allow learners Presentational mode tasks allow learners time to rehearse, revise, rewrite, consult time to rehearse, revise, rewrite, consult sources, or otherwise prepare ahead of sources, or otherwise prepare ahead of time. time.


Sample Presentational Sample Presentational taskstasks

Perform a step-by-step activityPerform a step-by-step activity Brochure or ItineraryBrochure or Itinerary Design oral/video presentationDesign oral/video presentation LetterLetter Web pages (Mock facebook or my space page)Web pages (Mock facebook or my space page) AdvertisementAdvertisement Agenda, Schedule or Plan of the day, weekAgenda, Schedule or Plan of the day, week New beginning or ending of story, songNew beginning or ending of story, song Visuals based on topic or textVisuals based on topic or text Solve a problemSolve a problem Demonstration Demonstration TV or Radio spotTV or Radio spot Design a survey and present findingsDesign a survey and present findings Public Service Announcement or InfomercialPublic Service Announcement or Infomercial Essays, Plays Essays, Plays Poem, Song, RapPoem, Song, Rap StoryboardStoryboard


Turnarounds for TransferTurnarounds for Transfer

Objective: To know the tourist Objective: To know the tourist sites in ______.sites in ______.

Task: Matching column to test Task: Matching column to test locations of tourist siteslocations of tourist sites

Turnaround:Turnaround:Where people choose to travel Where people choose to travel

depends a lot on their interests depends a lot on their interests and needs. and needs.


Presentational TaskPresentational TaskTurnaround for TransferTurnaround for Transfer

You are a travel agent specializing in travel You are a travel agent specializing in travel to _____. Your clients are all different. Create to _____. Your clients are all different. Create an itinerary suited for each group, keeping an itinerary suited for each group, keeping in mind the possible interests and needs of in mind the possible interests and needs of the client.the client.

1. A family of 5 with young children.1. A family of 5 with young children. 2. A businessperson who is a history buff.2. A businessperson who is a history buff. 3. Three college students with a limited 3. Three college students with a limited

budget.budget. 4. Grandparents who love small towns, local 4. Grandparents who love small towns, local

crafts, and music.crafts, and music.


The Make-over of the The Make-over of the Misnamed ModeMisnamed Mode

Are these performance-based? Are these performance-based? Do they follow the Modes?Do they follow the Modes?Is this really an interpersonal Is this really an interpersonal

task?task?Does this presentational mode Does this presentational mode

task really demonstrate task really demonstrate Transfer?Transfer?


Waiter, there’s a __ in my Waiter, there’s a __ in my soupsoup

““My students write dialogues My students write dialogues between them and the “Waiter” between them and the “Waiter” in the restaurant, and design in the restaurant, and design their own menus. They made their own menus. They made the menus based on samples the menus based on samples from an internet site. Then they from an internet site. Then they perform the dialogues they perform the dialogues they memorized. Isn’t this an memorized. Isn’t this an Interpersonal task?”Interpersonal task?”


It’s a riot to dietIt’s a riot to diet

““The students listened to a news The students listened to a news show about a healthy diet and show about a healthy diet and put the foods in categories of put the foods in categories of meats, dairy, fruit, veg, and meats, dairy, fruit, veg, and grains. I was thinking this was grains. I was thinking this was presentational mode….is it?”presentational mode….is it?”


Let’s GoLet’s Go

““Ok, for the interpretive mode task, they Ok, for the interpretive mode task, they listened to the train schedule and wrote listened to the train schedule and wrote down the departure time and track number down the departure time and track number they needed and what time they would arrive they needed and what time they would arrive at the destination on their paper. They all at the destination on their paper. They all had different places to go. had different places to go.

For the interpersonal task, they asked their For the interpersonal task, they asked their partner where they were going, when they partner where they were going, when they were going to leave, and something about were going to leave, and something about the place. the place.

For the presentational mode task, they wrote For the presentational mode task, they wrote a weekend sightseeing itinerary for their a weekend sightseeing itinerary for their friend that was going to arrive in one week”friend that was going to arrive in one week”


Remember…Remember…

The Communication Standard is The Communication Standard is The backbone of the assessment system.The backbone of the assessment system.

Interpretive tasks need culturally authentic material.Interpretive tasks need culturally authentic material.Interpersonal tasks are non-scripted and flow from Interpersonal tasks are non-scripted and flow from

Interpretive mode information.Interpretive mode information.

Presentational tasks need transferPresentational tasks need transfer

[email protected]

jennifer eddy (2008) unpacking the communication standard: designing performance assessment dr....

Documents

jennifer eddy slide

true performance

performance assessment

designed performance

true understanding

transfer tasks

communication standard

best evidence of understanding