International Outcomes Assessment

Dr. Barbara WheelingMontana State University Billings

Coordinator for Institutional AssessmentCollege of Business Director of Accreditation and Assessment

October 1, 2010

Montana State University Billings2

Outline International Learning Objectives: Examples Primary Concepts of Assessment Developing Learning Objectives The Process Key Questions for Writing Learning Objectives Assessment Tasks Closing the Loop

Montana State University Billings3

International Learning Objectives Example from MSU Billings:

We want our students to be able to 1. Identify global issues and explain their

implications. 2. Specify appropriate factors for

consideration when assessing international markets and operations.

3. Recognize significance of cultural differences on business practice.

Montana State University Billings4

International Learning ObjectivesExample from Merrimack College: Demonstrate the ability to function effectively

in an international environment. Demonstrate the ability to apply international

perspectives to local business decisions.

Montana State University Billings5

International Learning ObjectivesAdditional Examples Identify differences in domestic and global

business practices. Explain the effects of exchange rates on

transactions, weights and measures. Identify a foreign market for a product or

service. Create a foreign market entry plan. Demonstrate knowledge of global legal

framework and trade regulations. Distinguish between appropriate and

inappropriate behavior in different cultural contexts.

Montana State University Billings6

International Learning ObjectivesExamples from Adelphi University Our students should be able to identify global

and multicultural issues and explain their implications.

Our students should be able to make recommendations based on global and multicultural issues.

Montana State University Billings7

Primary Concepts of Assessment The learning objectives should clearly state

what the learner should be able to do. The assessment should measure if they can,

in fact, do that.

Montana State University Billings8

Developing International Learning Objectives Look for indicators of a global perspective:

Knowledge about importing/exporting, trading partners and policies.

Analysis of foreign country’s business environment and proposing strategies that fit with local laws.

Identification of ethical issues. Identification of problems in a cross-cultural

business situation and recommendation of solutions.

Montana State University Billings9

The Process Step 1: What should students be able to do?

These are the objectives. Step 2: What indicates students have met the

objective? These are assessment tasks.

Step 3: What does good performance on the task look like? These are the criteria to assess.

Montana State University Billings10

Step 4: How well did the students perform? Use a rubric with the criteria or Compile a score for each objective

Step 5: How well should most students perform? The minimum level at which you would want

students to perform is a benchmark. Step 6: What do students need to improve

upon? Information from the rubric will provide feedback

and ideas for improving instruction.

Montana State University Billings11

Key Questions for Writing Learning Objectives 1. Is it specific?

An objective is written too broadly if It cannot be reasonably assessed with just one or two

assessments It covers several different elements of the subject

matter from a course or semester

Montana State University Billings12

2. Is it observable and measurable? Examples, not measurable:

“Students will understand how to divide two-digit numbers.”

“Students will develop an appreciation of cultural diversity in the workplace.”

Example, measurable: “Students will correctly divide two-digit numbers.” “Students will summarize in writing their feelings about

cultural diversity in the workplace.”

Montana State University Billings13

Avoid phrases such as, “have an understanding”, “have an appreciation for”,

“be knowledgeable about”

Be careful of modifiers such as, “will effectively”, “can accurately”, “should completely” These can make measurement impossible

Montana State University Billings14

3. Is it actually a teaching outcome? Avoid phrases such as:

“will be taught”, “will learn how to”, “will be evaluated on”

4. Does the objective include action verbs? Overt behavior that can be observed and

measured Examples: compile, create, plan, revise, analyze,

design, select, utilize, apply, prepare, use, compute, discuss, explain, predict, assess, compare, rate, critique.

Montana State University Billings15

Assessment Tasks Case study Video assignment Research paper• International experience learning journal• Knowledge test

Montana State University Billings16

Closing the Loop International course

Course in each discipline Globalization across the curriculum

Virtual syllabus Experiential exercises

Example: role playing in a cultural context Study abroad

Montana State University Billings17

Q & A