school of education assessment report 2011-2012

School of EducationAssessment Report

2011-2012An Executive Summary

Programs in the SED

• Teaching, Learning & Curriculum– BSELED Bachelor of Science in Elementary Education– BS with Secondary Certification– Elementary Certification– Secondary Certification– MAT Master of Arts in Teaching (Elementary and

Secondary)– MA EdS, EdD, PhD Education—Curriculum and

Instruction (C&I)

Programs (cont’d)

• Graduate Psychology and Counseling– MS Special Education—Learning Disabilities– MA School Counseling– MA Clinical Mental Health Counseling– EdS School Psychology– MA, EdD, PhD Educational Psychology– PhD Counseling Psychology

Programs (cont’d)

• Leadership– Graduate Certificate, MA, EdS, EdD, PhD

Educational Leadership– MA, EdS, EdD, PhD Higher Education

Administration– Undergraduate Certificate, MA, EdS, EdD, PhD

Leadership

2011-2012 Candidate EnrollmentsProgram Level Elementary Secondary Advanced

Biology BachMAT 1 NA

Chemistry Bach NA

Communication Bach 1 NA

English Bach MAT 18 NA

Education, Elementary Bach MAT

615 NA

Education, Secondary BachMAT

112 NA

ESL MAT NA

History BachMAT 2 NA

Integrated Science Bach 4 NA

Language Arts Bach 1 NA

2011-2012 Enrollments (cont’d)Program Level Elementary Secondary Advanced

Lang: French Bach MAT NA

Lang: Spanish Bach MAT 5 NA

Math/Math Education Bach 7 NA

Music Education BachMAT 1 4 NA

Physics BachMAT 2 NA

Political Science Bach NA

Religion BachMAT 2 NA

Social Studies, Elem Bach 1 NA

Social Studies, Sec Bach 5 NA

Visual Arts Education Bach 1 NA

2011-2012 Enrollments (cont’d)Program Level Elementary Secondary Advanced

Curriculum & Instruction MA, EdS, Doct NA NA 1, 14, 26

Educational Leadership GrCrt*, MA, EdS, Doct NA NA 0, 1, 2, 8

Higher Educ Administration MA, EdS, Doct NA NA 5, 2, 12

Leadership UCrt*, MA, EdS, Doct NA NA 0, 7, 2, 105

Special Educ-Learning Disabil MS NA NA 12

School Counseling MA NA NA 9

School Psychology EdS NA NA 25

Educational Psychology MA, EdS, Doct NA NA 11, 1, 15

Community Counseling MA NA NA 2

Clinical Mental Health Couns MA NA NA 22

Counseling Psychology Doct NA NA 28

Achievements

• Strengths• Assessment Milestones• Accreditations

Strengths

• Teacher Education program continues to be rated “Exemplary” by the Michigan Department of Education

Unit Performance Score for Academic Years 2005-2006 to 2010-2011

Year Overall Score

MTTC Results

Tch Exit Surveys

Suprvsr Surveys

Prog Cmpltn

Rate

Prog Review Status

Diver-sity

High Need

Content

Year 70 30 5 5 10 10 5 5

05-06 66 30 10 * 6 10 5 506-07 70 30 5 5 10 10 5 507-08 70 30 5 5 10 10 5 508-09 70 30 5 5 10 10 5 509-10 70 30 5 5 10 10 5 510-11 63 25 5 5 8 10 5 5

Strengths

• Teacher Education program continues to be rated “Exemplary” by MDE

• MTTC Basic Skills cumulative pass rate: 92.9%

Strengths


• MTTC Basic Skills cumulative pass rate: 92.9%• Course evaluation ratings continue to be

high:– Means on all 25 indicators were rated above 4.00

on a scale of 1 to 5

Learning objectives or goals were stated clearly

Accomplished the course objectives

Requirements and grading system were specified

The course was challenging intellectually

The requirements of this course helped me learn

The course delivery tools were used effectively

The amount of work required was reasonable

Exams and other evaluations were fair and accurate

Grading system was appropriate for the objectives

Taught at an appropriate level of difficulty

Instructor was enthusiastic about the subject matter

Christian concepts were integrated effectively

The instructor motivated me to learn

The way this course was taught helped me learn

Feedback was provided on tests and other work

Class discussion was used effectively

Instructor was respectful of people's points of view

Instructor was available to help outside of class

Instructor was supportive of my spiritual development

This course helped me think clearly

This course helped me communicate effectively

Helped me to respect gender and cultural diversity

I understood the concepts and principles taught

Overall rating of this course

Overall rating of instructor's teaching effectiveness

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

4

5

7

5

4

7

9

6

4

5

1

5

5

8

14

7

3

4

3

4

3

2

3

6

8

3

6

7

10

9

9

7

9

7

8

4

12

8

9

11

9

3

8

15

11

12

9

5

18

12

92

87

83

83

86

82

83

81

86

85

94

78

85

81

74

80

92

83

70

84

84

83

87

73

77

Disagree/Strongly Disagree Neutral Agree/Strongly Agree


























0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

4

5

7

5

4

7

9

6

4

5

1

5

5

8

14

7

3

4

3

4

3

2

3

6

8

3

6

7

10

9

9

7

9

7

8

4

12

8

9

11

9

3

8

15

11

12

9

5

18

12

92

87

83

83

86

82

83

81

86

85

94

78

85

81

74

80

92

83

70

84

84

83

87

73

77


Instructor was re-spectful of people’s points of view

92


























0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

4

5

7

5

4

7

9

6

4

5

1

5

5

8

14

7

3

4

3

4

3

2

3

6

8

3

6

7

10

9

9

7

9

7

8

4

12

8

9

11

9

3

8

15

11

12

9

5

18

12

92

87

83

83

86

82

83

81

86

85

94

78

85

81

74

80

92

83

70

84

84

83

87

73

77


94


Instructor was en-thusiastic about the subject matter

92


























0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

4

5

7

5

4

7

9

6

4

5

1

5

5

8

14

7

3

4

3

4

3

2

3

6

8

3

6

7

10

9

9

7

9

7

8

4

12

8

9

11

9

3

8

15

11

12

9

5

18

12

92

87

83

83

86

82

83

81

86

85

94

78

85

81

74

80

92

83

70

84

84

83

87

73

77


94

92

Instructor was en-thusiastic about the subject matter



92


























0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

4

5

7

5

4

7

9

6

4

5

1

5

5

8

14

7

3

4

3

4

3

2

3

6

8

3

6

7

10

9

9

7

9

7

8

4

12

8

9

11

9

3

8

15

11

12

9

5

18

12

92

87

83

83

86

82

83

81

86

85

94

78

85

81

74

80

92

83

70

84

84

83

87

73

77


94

92

70

Instructor was sup-portive of my spiritual development

92


























0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

4

5

7

5

4

7

9

6

4

5

1

5

5

8

14

7

3

4

3

4

3

2

3

6

8

3

6

7

10

9

9

7

9

7

8

4

12

8

9

11

9

3

8

15

11

12

9

5

18

12

92

87

83

83

86

82

83

81

86

85

94

78

85

81

74

80

92

83

70

84

84

83

87

73

77


94

92

70

74

Instructor was sup-portive of my spiritual development


92

Strengths


• MTTC Basic Skills cumulative pass rate: 92.9%• Course evaluations continue to be high: > 4• High alumni and employer ratings

Strengths

• Teacher Education rated Exemplary by MDE (Table 19)

• MTTC Basic Skills cumulative pass rate: 92.9%• Course evaluations continue to be high: >4• High alumni and employer ratings– Alumni: mean ratings of > 3.74 (“Satisfactory”)

across all indicators on ‘09-’10 survey (Table 27)

Strengths

• Teacher Education rated Exemplary by MDE (Table 19)

• MTTC Basic Skills cumulative pass rate: 92.9%• Course evaluations continue to be high: >4• High alumni and employer ratings– Alumni: mean ratings of > 3.74 (“Satisfactory”)

across all indicators on ‘09-’10 survey– Employers: mean ratings of > 3.80 (“Satisfactory”)

across all indicators on ‘09-’10 survey (Table 28)

Assessment Milestones

• Growing toward being a data-driven decision-making body.


• Data-driven decision-making body. • NCATE Board of Examiners said that we

“clearly have a culture of assessment.”


• Data-driven decision-making body. • We “clearly have a culture of assessment.” • Programs are improving their assessment

instruments.


• Data-driven decision-making body. • We “clearly have a culture of assessment.” • Programs are improving their assessment

instruments. – Example: the Teacher Education program has

significantly revised its Impact on Student Learning assignment (completed during student teaching) to make it a more robust assessment.

Accreditations

• NCATE (National Council for Accreditation of Teacher Education)

Accreditations

• NCATE (National Council for Accreditation of Teacher Education):– November 2011 visit

Accreditations

• NCATE (National Council for Accreditation of Teacher Education):– November 2011 visit– SED was awarded continuing accreditation until

2018

Accreditations

• NCATE (National Council for Accreditation of Teacher Education):– November 2011 visit– SED was awarded continuing accreditation until

2018– No conditions or areas for improvement were

cited!!

Accreditations

• NCATE• CACREP (Council for Accreditation of

Counseling and Related Educational Programs):

Accreditations


Counseling and Related Educational Programs): – School Counseling and Clinical Mental Health

Counseling submitted their report to CACREP

Accreditations


Counseling and Related Educational Programs): – School Counseling and Clinical Mental Health

Counseling submitted their report to CACREP– Prepared for a site visit in November 2012—next

week!

Accreditations

• NCATE (Teacher Education)• CACREP (School Counseling & CMHC)• Educational Leadership:

Accreditations

• NCATE (Teacher Education)• CACREP (School Counseling & CMHC)• Educational Leadership: – Recognized with conditions by ELCC (Educational

Leadership Constituent Council)

Accreditations

• NCATE (Teacher Education)• CACREP (School Counseling & CMHC)• Educational Leadership: – Recognized with conditions by ELCC (Educational

Leadership Constituent Council)– Program personnel are working to meet these

conditions

Accreditations

• NCATE (Teacher Education)• CACREP (School Counseling & CMHC)• ELCC (Educational Leadership) • Math Education:

Accreditations

• NCATE (Teacher Education)• CACREP (School Counseling & CMHC)• ELCC (Educational Leadership) • Math Education:– Recognized with conditions by NCTM (National

Council of Teachers of Mathematics)

Accreditations

• NCATE (Teacher Education)• CACREP (School Counseling & CMHC)• ELCC (Educational Leadership) • Math Education:– Recognized with conditions by NCTM (National

Council of Teachers of Mathematics)– SED and Department of Mathematics personnel

are working to meet these conditions

Improvements Made

• Department Name Change• Personnel Changes• Remodeling

Department Name Change

• FROM: The Department of Educational and Counseling Psychology (ECP)



• TO: The Department of Graduate Psychology and Counseling (GPC)



• TO: The Department of Graduate Psychology and Counseling (GPC)

• REASON: To reflect the nature of their programs more accurately. Prompted by CACREP’s concern that the counseling aspects of the department needed to be better recognized.

Personnel Changes

• New Faculty Member Hired: Dr. Luana Greulich, coordinator the Special Education—Learning Disabilities program.

Personnel Changes

• New Faculty Member Hired: Dr. Luana Greulich, coordinator the Special Education—Learning Disabilities program.

• Assessment Coordinator: NCATE coordinator (Kevin Wiley) duties expanded to include SED assessment, along with SED accreditations. Re-designated as Coordinator of Accreditations and Assessment.

Remodeling of Bell Hall

• Large portions of Bell Hall remodeled during the summer of 2012.



• Reapportioning space to allow for growth and change: – Department of Graduate Psychology and

Counseling



• Reapportioning space to allow for growth and change: – Department of Graduate Psychology and

Counseling– Department of Leadership



• Reapportioning space to allow for growth and change: – Department of Graduate Psychology and Counseling– Department of Leadership– Department of Speech-Language Pathology and

Audiology (a School of Health Professions department housed in Bell Hall)

Areas of Concern

• MTTC Content Area Test Scores• Spirituality• Research

MTTC Content Area Tests, 2008-2011Program A.U.

2008-2011

N

A.U. 2008-2011

Initial% Pass

A.U. 2008-2011

Cum.% Pass

Mich. 2008-2011

N

Mich. 2008-2011

Initial% Pass

Mich.2008-2011

Cum.% Pass

Biology 1 516 66.1 85.3

Chemistry 347 64.4 81.6

Communication 26 46.2 61.5

English 7 2,216 75.8 86.9

English as a 2nd Language

4 458 87.3 93.4

French 1 106 54.7 67.0

History 4 1,729 74.3 86.3

Integ Science, El 2 1,391 57.9 69.3

Integ Science, Sec 2 276 73.6 89.9

Language Arts 11 81.8 100.0 2,832 64.7 78.2

MTTC Content Area Tests, 2008-2011 (Cont’d)

Program A.U. 2008-2011

N

A.U. 2008-2011

Initial% Pass

A.U. 2008-2011

Cum.% Pass

Mich. 2008-2011

N

Mich. 2008-2011

Initial% Pass

Mich.2008-2011

Cum.% Pass

Math, Elementary 4 1,719 76.9 86.6

Math, Secondary 4 1,127 89.7 96.6

Music Education 1 243 82.7 91.8

Music 9 311 95.5 98.7

Physics 1 204 81.9 92.6

Social Studies 12 58.3 58.3 2863 60.7 71.6

Spanish 12 91.7 91.7 628 80.1 89.2

Visual Arts 458 89.7 96.5

Elementary Educ 23 82.6 95.7 7,950 93.2 98.0

Reading 4 471 71.1 79.0

All Tests 105 81.0 86.7 36,411 78.9 88.1

Unit Performance Score for Academic Years 2005-2006 to 2010-2011

Year Overall Score

MTTC Results

Tch Exit Surveys

Suprvsr Surveys

Prog Cmpltn

Rate

Prog Review Status

Diver-sity

High Need

Content

Points

70 30 5 5 10 10 5 5

05-06 66 30 10 * 6 10 5 506-07 70 30 5 5 10 10 5 507-08 70 30 5 5 10 10 5 508-09 70 30 5 5 10 10 5 509-10 70 30 5 5 10 10 5 510-11 63 25 5 5 8 10 5 5

Spirituality

• How well does the School of Education meet “Affirm faith”?

How well does SED meet“Affirm faith”?

• 2009-2010 alumni surveys– Rated between 3.00 and 4.00 across SED

departments on spirituality-related items (> 3.74 in aggregate) (Tables 19, 20, 21, & 22, last four items)


• 2009-2010 alumni surveys– Rated > 3.74 across SED departments on

spirituality-related items. • Course evaluations, 2011-2012– Rated > 4.23 on spirituality-related items.

(Table 23, items 12 & 19)


• 2009-2010 alumni surveys– Rated > 3.74 on spirituality-related items.

• Course evaluations, 2011-2012– Rated > 4.23 on spirituality-related items.

• Advisor evaluations:




• Advisor evaluations:– “my advisor is a positive model of Christian

behavior” (mean = 4.16)




• Advisor evaluations:– “my advisor is a positive model of Christian behavior”

(mean = 4.16)– “I can go to my advisor when I have spiritual or

personal issues that impact my school work” (mean = 3.71)

Research

• We have discussed concerns about our students’ research competency.

Research

• We have discussed concerned about our students’ research competency. However, – Assessment data show respectable levels of

research competency

Research

• We have discussed concerned about students’ research competency. However, – Assessment data show respectable levels of

research competency• Conceptual Framework—Aggregated data of

ratings of research-related items:

Research

• We have been concerned with students’ research competency. However, – Assessment data show respectable levels of

research competency• Conceptual Framework—Aggregated data of

ratings of research-related items: –3.99 for SED Conceptual Framework–> 4.52 for TLC Conceptual Framework–> 4.90 for C & I Conceptual Framework

Research


research competency• Aggregated ratings of research-related

Conceptual Framework items: –3.99 for SED, >4.52 for TLC, >4.90 for C&I

• Leadership program data:

Research


research competency• Aggregated ratings of research-related

Conceptual Framework items: –3.99 for SED, >4.52 for TLC, >4.90 for C&I

• Leadership program data: –3.3 to 5.0 on research competencies

Research

• We have been concerned with students’ research competency– Assessment data show respectable levels of

research competency– Alumni survey (2009-2010): research-related

ratings ranged from 3.88 to 4.20 (Table 27)

Research

• We have been concerned with students’ research competency– Assessment data show respectable levels of

research competency– Alumni survey (2009-2010): research-related

ratings ranged from 3.88 to 4.20– Employer survey (2009-2010): research-related

items ranged from 3.80 to 4.06 (Table 28)

Available soon at the School of Education web page, www.andrews.edu/sed/resources/:

– Complete SED Annual Assessment Report, 2011-2012

– Executive Summary

http://www.andrews.edu/sed/resources/

Thank You!

school of education assessment report 2011-2012

Documents