jenny simon, el camino college louise yarnall, sri international jane ostrander, de anza college...

22
Jenny Simon, El Camino College Louise Yarnall, SRI International Jane Ostrander, De Anza College Assessment to inform practice

Upload: nathaniel-hudson

Post on 17-Dec-2015

218 views

Category:

Documents


0 download

TRANSCRIPT

Jenny Simon, El Camino CollegeLouise Yarnall, SRI InternationalJane Ostrander, De Anza College

Assessment to inform practice

Agenda

2

1. Case Study (30 mins.)2. Questions/Transition (10

mins.)3. SBL Hands-on (45 mins.)4. Reflection (15 mins.)5. Closing comments (10

mins.)

1. CaseStudyJenny Simon, El Camino College

3

The Zenof the

El Camino College Response

to the

Student Learning Outcomes

and

Assessment Mandate

Dr. Jenny Simon

Constructing a Zen Path: The Strategy – Complete

Assessment Cycles

5

Constructing a Zen Path – The Goal:

6

Constructing a Zen Path – The Plan:

7

Three co-coordinators lead a college-wide Assessment of Learning Committee tasked with:

Reporting forms and protocols

Creating outcomes and assessment plans at all levels

Designing faculty training (Flex Day & Assessment of Student Learning Week)

Growing infrastructure as the project expands

Establishing ASSESSMENT PRINCIPLES

Selected Assessment Principles

• Personnel directly involved in a course, program or service are finally responsible, but broad participation in assessment cycles is a shared responsibility.

• One size will not fit all. Student learning outcomes are defined and assessed in various ways.

• Assessment results are used to improve student learning through curricular, planning and budget decisions.

• Adjunct faculty are invited to participate in assessments, but they are not required to do so before relevant contractual issues are settled.

How the ESL Department Took on the Challenge

• First Assessment: ESL 53A (low intermediate writing/grammar class)– ESL faculty created a rubric– Took a sample of essays (5 per section)– Adjuncts invited to participate—and they

did– Data: total scores of essays– Results: used to improve assessment

itself

How the ESL Department Took on the Challenge

• Second Assessment: ESL 53B (high intermediate writing/grammar class)– Rubric taken from California Pathways– Took a sample of essays (5 per section)– Adjuncts invited to participate—and they

did– Data: total scores of essays and scores

for each primary trait on the rubric– Results: used to improve teaching and

program organization

Questions/Comments?

Jenny Simon, Ed.D.

ESL Faculty / SLO Assessment Coordinator

El Camino College

Torrance, CA

(310) 532-3670 x 5187

[email protected]

2. SBLScenario-Based Learning Project

Task Modules:Students as employeesProfessional

deliverablesFaculty as managersCollaboration &

problem solvingReflection on

experience

http://elc.fhda.edu

Fields:Network securityComputer

programmingEngineeringEnvironmental

studiesBioinformatics

12

SBL Scenario-Based Learning Project

Challenges of SBL:How do you know students are learning?How do you grade all the “soft” skills?Is this worth all the effort?

Our approach to addressing these problems:Role of Assessment

13

SBL Scenario-Based Learning Project

Assessment Activities:We engaged instructors in activities like you will

do todayWe collaboratively designed assessments with

themThey helped us study how valid they were

Goals to help instructors:Reduce the “signal to noise” around core learning

goals in SBLAvoid the trap of “low expectations” of procedural

proficiencyGain confidence in “soft skills” assessment and

feedback

14

3.SBLScenario-Based Learning Project

Hands-on Task (Introduction, 10 mins.; Task, 10 mins.)We will engage you in an activity like we did

with the SBL instructorsHand out sheets with interview protocols Team up in pairsTake turns interviewing each other for 5

minutes, filling out worksheetsHand in your worksheets

15

SBL Scenario-Based Learning Project

Design pattern creation (10 mins.)We will engage you in another activity like we

did with the SBL instructorsNeed a volunteer team selected from returned

worksheets Louise will walk through worksheets and fill

out part of design pattern

16

Design Pattern Title: Personal Business CommunicationDomain:

Summary(what is the learning goal)

How to use the Internet for emailing business contacts. Writing and using email.

Rationale(why is it important?)

Students need to learn to deal with businesses in their real lives. They can be more empowered if they improve their ability to communicate with these companies in email.

Focal KSAs(core learning goals)

Frame sentences. Compose the sentences.

Use the correct formal tone in the sentences.

How to use email software.

How to get the response they wanted: get to the point. Ask for the specific solution.

How to use protocol, etiquette.

17

Additional KSAs(background knowledgenecessary, but not taught)

Basic spellingBasic grammar and sentence constructionUse the computerKeyboarding

Potential observations(what attainment of KSAs looks like, quality of performance)

They accomplish a goal with the letter.

They can explain what they accomplished with the company letter.

Potential work products(general categories of work products)

Letter to the company

Response from the company

Characteristic features(assessment task must have these)

Assessment asks the student to distinguish between an effective and ineffective complaint letter, request for service, or letter of praise.

Variable features(you can vary the difficulty level with these)18

4. Reflectionassessment that informs practice

19

Reflect on…The Case StudySBL ActivityAssessment informing Your practice

20

1. What did the interview process feel like?

2. What did you learn from the interviews?

3. How would the case study’s processes work at your campus? In your Division?

ClosingQuestions?

21

Additional information

[email protected]@[email protected]

http://elc.fhda.edu

22