Economics DepartmentAnalyzing and Applying Assessment

Information

Assessment WorkshopJanuary 13, 2010

2

Assessment Measures

• Embedded questions in exams or papers

• Senior survey

3

Embedded questions

• Four level scale0: Answer demonstrates no grasp of the concept1: Answer demonstrates understanding of the basic

model, but not its application2: Application of the model is partly correct3: Application of the model is correct

4

Embedded Questions

• Scoring procedures– Select questions from upper level courses– Copy answers and prepare key– Number responses– Two assessment graders– Spreadsheet for each question– Graders agree on scoring principles– Grades entered into spreadsheet by each grader– Grade discrepancies are discussed and consensus

reached

5

Embedded Questions – ECON Analysis

Q 1: understand and apply market modelsQs 2 & 3: understand and apply key elements of

economic decision makingScore Question 1 Question 2 Question 3

0 5% 32% 21%

1 16% 26% 47%

2 26% 37% 0%

3 53% 5% 32%

Mean 2.26 1.16 1.42

Std. Dev. 0.93 0.96 1.17

N 19 19 19

6

Embedded Questions – ECON Application

• Strong grasp of supply and demand model• Little or no grasp of principles of comparative

advantage– Test again in future to determine if curricular

changes are needed– More emphasis to be placed on reviewing basic

concepts in intermediate and upper level courses

7

Embedded Questions – ECOA Analysis

Q 1: understand and apply accounting concepts and theoriesQ2: understand and apply the economic concepts and

quantitative tools used by accountants in decision making

Score Question 1 Question 2

0 0% 0%

1 26% 28%

2 46% 56%

3 28% 16%

Mean 2.02 1.88

Std. Dev. 0.75 0.66

N 46 50

8

Embedded Questions – ECOA Application

• Emphasize importance of clear, well labeled and effective analyses

• Provide more opportunities for students to develop critical thinking skills in writing assignments or oral presentations

9

Senior Survey

• Administered via Moodle– Use their economics or accounting training to

pursue their vocation– Understand important institutions in the economy

10

Senior Survey - Analysis

• Response statistics ECON/ECOA– Successful placement (45%/91% working)– Internships are important– 80%/68% increased newspaper reading– 94%/100% increased understanding because of

courses• Summary of open ended questions– Offer more electives– Offer more macro courses

11

Senior Survey - Application

• More ECON and ECOA electives are being offered– Speculation, Bubbles, and Collapse, Game Theory,

Political Economy, Operations Research, Government and Nonprofit Accounting, Ethics