student satisfaction report: pacific oaks college: addendum: instructional sites vs. cohorts office...

Student Satisfaction Report:Pacific Oaks College:

Addendum: Instructional Sites Vs. Cohorts

Office of Institutional ResearchTCS Education SystemSeptember 19, 2014

Table of Contents

Background 3Executive Summary 5

Detailed Findings 8

2

BackgroundThe Office of Institutional Research produced a report for Pacific Oaks College on results of its student satisfaction survey program.

After presenting the report, Pacific Oaks expressed the need to have results for non-Pasadena ground locations broken out into cohorts and instructional sites.

The purpose of this additional data analysis request was to determine if there were any statistically significant differences between cohorts and instructional sites for the 2013 and 2014 waves of the annual Pacific Oaks College student satisfaction survey.

Data were analyzed using SPSS for Windows, Version 20.0.

In this report the word “significantly” means that a statistical test was conducted to determine if the difference between cohorts and instructional sites is “real” or simply the result of random variation in the data.

3

Background

4

Survey Year

Cohort Name Number of Survey Responses

Instructional Site Name Number of Survey Responses

2013 Bay Area Cohort 13 Sacramento Instructional Site 5

Huntington Park Cohort 5 Salinas Instructional Site 6

Los Angeles City College Cohort 5 Santa Cruz Instructional Site 5

Los Angeles Mission Cohort 4

Pierce College Cohort 1

Plaza de la Raza Cohort 3

Total 31 Total 16

2014 Bay Area Cohort 8 Bay Area Instructional Site 3

East Los Angeles College Cohort 3 Foothills Instructional Site 12

HLPUSD Cohort 5

Los Angeles City College Cohort 9

Los Angeles Mission Cohort 3

Options Head Start 11

VOA – North Hollywood Cohort 6

Westside Children’s Center 4

Total 49 Total 15

Executive SummaryOverall, there are very few statistically significant differences between cohorts and instructional sites in terms of items on the annual Pacific Oaks student satisfaction survey.

Among survey items in which there are statistically significant differences between respondents from cohorts and instructional sites, the cohort scores tend to be greater than those of instructional sites.

OIR recommends that leadership of Pacific Oaks College work with students from the instructional sites to develop strategies to improve satisfaction among this group of students.

The tables on the following two pages show the items, mean scores, and the direction of the significant difference on satisfaction survey items in which there are statistically significant differences between mean ratings of students from cohorts and students from instructional sites.

5

Executive SummarySurvey Items Where the Cohort Mean is Significantly Greater than the Mean for Instructional Sites Survey

Year

Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“ 2014

Please rate your level of agreement with the statement, "I would recommend PO to friends / family …” 2014

Satisfaction with process of registering for courses 2014

Satisfaction with availability of elective courses 2014

Satisfaction with time it took Help Desk to resolve your issue 2014

Satisfaction with availability of the HelpDesk staff 2014

Agreement that at Pacific Oaks inclusive classroom and co-curricular environments promote mutual respect, reflection, critical thinking, and academic excellence

2014

Impact of experiences at Pacific Oaks in advancing student multicultural competence 2014

Impact of experiences at Pacific Oaks in advancing student professional practice skills. 2014

Impact of experiences at Pacific Oaks in preparing student to behave in a professional manner 2014

Importance of advancement in current employment to overall satisfaction with Pacific Oaks 2013

Importance of having face to face contact with Financial Aid Counselors to overall satisfaction with Pacific Oaks 2014

6

Executive Summary

7

Survey Items Where Instructional Site Mean is Significantly Greater than the Mean for Cohorts Survey Year

Satisfaction with overall experience of the practicum process 2013


Impact of experiences at Pacific Oaks in improving student ability to apply theory and scholarship to practice issues 2013


Impact of experiences at Pacific Oaks in improving student ability to apply theory and scholarship to practice issues 2013

Measures of Satisfaction and LoyaltyMeasures of Satisfaction and Loyalty ¹ Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)

Mean n Mean n Mean n Mean n

How satisfied are you with your overall academic experience at PO?

4.32 31 4.31 45 4.25 16 3.93 14

Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“

4.41 29 4.40(d)

43 4.29 14 3.75(b)

12

Please rate your level of agreement with the statement, "I would recommend PO to friends / family …”

4.45 29 4.40(d)

43 4.14 14 3.50(b)

12

My overall experience at PO has met my expectations. 4.45 29 4.30 43 4.36 14 3.92 12

1 Items use five-point scales 8

2013: No statistically significant mean differences

In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of respondents from cohorts were significantly greater than those of respondents from instructional sites on the following items:•Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“•Please rate your level of agreement with the statement, "I would recommend PO to friends / family …”

Satisfaction with Instruction and Course Work

In the PAST ACADEMIC YEAR, how satisfied have you been with the:¹

Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)


Quality of instruction provided by faculty 4.35 31 4.31 45 4.31 16 3.93 14

Consistency of instruction across faculty 3.93 30 3.80 44 4.06 16 3.57 14

Intellectual challenge of the course work 4.52 31 4.36 44 4.38 16 4.07 14

Quality of academic courses you've taken 4.48 31 4.44 45 4.31 16 4.38 13

Number of courses taught by my department's core faculty

3.61 31 4.10 41 4.25 16 3.85 13


2013: No statistically

significant mean differences



Satisfaction with Academic SupportIn the PAST ACADEMIC YEAR, how satisfied have you been with the:¹


2013(a)

2014(b)

2013(c)

2014(d)


Staff's response to concerns I've expressed 4.07 30 4.10 42 4.31 16 3.57 14

Support received from my Student Advisor 3.80 30 4.02 45 4.00 14 3.31 13

Support received from my Academic Advisor 3.87 30 3.98 45 4.31 16 3.71 14

Support received from the Financial Aid Office 4.16 31 4.05 39 4.19 16 4.08 12






Satisfaction with TechnologyIn the past academic year, how satisfied have you been with the: ¹


2013(a)

2014(b)

2013(c)

2014(d)


Quality of the classroom facilities 4.03 31 4.10 40 3.69 16 4.14 14

Availability of technological resources 3.65 31 3.87 39 3.50 16 4.21 14

Effective use of technology in courses 3.94 31 3.98 40 3.75 16 4.21 14






Satisfaction with Course RegistrationIn the past academic year, how satisfied have you been with the: 1


2013(a)

2014(b)

2013(c)

2014(d)


Process of registering for courses 3.81 31 4.51(d)

37 4.50 16 3.77(b)

13

Availability of courses to allow progress toward the completion of my degree

4.17 30 4.67 36 4.81 16 4.23 13

Availability of elective courses 3.19 31 4.31(d)

26 2.94 16 2.40(b)

5




In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of respondents from cohorts were significantly greater than those of respondents from instructional sites on the following items:•Satisfaction with process of registering for courses•Satisfaction with availability of elective courses

Use of (School)HelpDeskHave you ever used the (school) HelpDesk (email or phone)?


2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n

Yes 48.4 % 15 46.7 % 21 75.0 % 12 35.7 % 5

No 22.6 % 7 28.9 % 13 12.5 % 2 7.1 % 1

No, I’ve never had a need. 29.0 % 9 24.4 % 11 12.5 % 2 57.1 % 8

TOTAL 100.0 % 31 100.0 % 45 100.0 % 16 100.0 % 14

13

2014: No statistically significant

differences in response patterns,

cohorts vs. instructional sites




Satisfaction with (School) HelpDeskIn regards to your (school) HelpDesk experience, how satisfied have you been with the:1


2013(a)

2014(b)

2013(c)

2014(d)


Time it took to resolve your issue 4.00 15 4.55(d)

20 4.36 11 3.40(b)

5

Availability of the HelpDesk staff 4.07 15 4.57(d)

21 4.17 12 3.40(b)

5




In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of respondents from cohorts were significantly greater than those of respondents from instructional sites on the following items:•Satisfaction with time it took [for HelpDesk] to resolve your issue•Satisfaction with Availability of the HelpDesk staff

Academic AdvisingIn the PAST ACADEMIC YEAR, how satisfied have you been with the:


2013(a)

2014(b)

2013(c)

2014(d)


Accessibility to academic advising 3.58 31 4.16 43 3.81 16 3.91 11

Quality of New Student Orientation 3.90 31 4.18 40 3.19 16 3.77 13

Overall quality of academic advising 3.87 31 4.02 42 4.06 16 3.69 13

Overall experience of the practicum process 2.87(c)

31 4.23 30 4.06(a)

16 4.00 8

Overall quality of my academic program 4.35 31 4.26 43 4.13 16 3.93 14




In the 2013 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from instructional sites was significantly greater than those of respondents from cohorts on the following item:•Satisfaction with experience of the practicum process

Communication and Hours of Academic Support Departments

In the past academic year, how satisfied have you been with communication and hours of operation from the following departments:


2013(a)

2014(b)

2013(c)

2014(d)


Admissions

- Communication 3.90 29 3.98 43 4.00 14 3.92 13

- Hours of Operation 3.96 25 3.88 42 4.20 10 4.00 12

Registrar's Office

- Communication 3.97 29 3.93 43 3.87 15 3.77 13


Student Services (CARE)

- Communication 3.79 28 3.79 43 3.50 14 3.62 13


Financial Aid

- Communication 4.03 29 4.02 44 3.80 15 4.00 13





Communication and Hours of Academic Support Departments

In the past academic year, how satisfied have you been with communication and hours of operation from the following departments:


2013(a)

2014(b)

2013(c)

2014(d)


Business Office

- Communication 3.79 28 3.70 43 3.50 14 3.77 12


Information Technology

- Communication 3.72 29 3.72 43 3.50 14 3.72 12


Library

- Communication 3.50 28 3.72 43 3.13 15 3.92 12



2013: No statistically significant mean

differences

2014: No statistically significant mean

differences

Library and Computer LabConsidering the past academic year, what is your level of agreement with the following statements:


2013(a)

2014(b)

2013(c)

2014(d)


Courses are available to fit my schedule. 4.59 29 4.48 44 4.50 14 4.08 12

Library resources and services are appropriate for my needs.

3.62 29 3.91 44 3.36 14 3.58 12

The library’s hours of operation fit my schedule. 3.36 28 3.61 44 3.29 14 3.33 12

The computer lab is appropriate for my needs. 3.39 28 3.48 44 3.08 12 3.08 12

The computer lab's hours of operation fit my schedule.

3.39 28 3.44 43 3.17 12 3.08 12

Areas for study are made available to me. 3.61 28 3.65 43 3.50 12 3.25 12






Use of Smart ThinkingHave you ever used Smart Thinking?


2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n

Yes 10.3 % 3 11.4 % 5 0.0 % 0 0.0 % 0

No 31.0 % 9 61.4 % 27 42.9 % 6 66.7 % 8

I don’t know what Smart Thinking is

58.6 % 17 27.3 % 12 57.1 % 8 33.3 % 4

TOTAL 100.0 % 29 100.0 % 44 100.0 % 14 100.0 % 12

19







Use of ePortfolio / CanvasHave you used ePortfolio / Canvas at PO?


2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n

Yes 93.1 % 27 90.9 % 40 78.6 % 11 100.0 % 12

No 6.9 % 2 9.1 % 4 21.4 % 3 0.0 % 0

TOTAL 100.0 % 29 100.0 % 44 100.0 %

14 100.0 % 12

20







Satisfaction with eCollege / CanvasConsidering your use of eCollege / Canvas within the past academic year, what is your level of agreement with the following statements:


2013(a)

2014(b)

2013(c)

2014(d)


eCollege / Canvas courses are easy to navigate and use 4.00 27 3.75 40 4.10 10 3.67 12

eCollege / Canvas courses are conducted effectively by PO instructors

3.96 27 3.58 40 3.50 10 3.42 12






Personal Life and Course WorkPersonal Life and Course Work Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)


If I have questions I know which staff members to contact. 3.93 29 3.86 43 3.50 14 3.83 12

PO provides proper channels of communication for students.

3.83 29 3.83 42 3.29 14 3.67 12

As a student at PO, I am able to maintain a healthy balance between my personal life and my course work / training.

4.07 29 3.86 43 4.07 14 3.83 12






Student SafetyConsidering the past academic year, what is your level of agreement with the following statements:


2013(a)

2014(b)

2013(c)

2014(d)


I am aware of (campus) Advisory / emergency action plans.

2.62 29 2.93 43 2.62 13 3.00 12

I feel safe and secure on campus. 3.59 29 3.77 43 3.08 13 4.08 12

I feel the information I send and receive online is secure. 3.97 29 4.10 42 4.00 14 3.83 12






Preparedness in Use of IntuitHow prepared do you feel about the online student account system, Intuit?


2013(a)

2014(b)

2013(c)

2014(d)


3.76 29 3.86 43 4.00 14 3.92 12






Use of Career ServicesHave you used Career Services? Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n

Yes 0.0 % 0 4.7 % 2 14.3 % 2 0.0 % 0

No 72.4 % 21 76.7 % 33 64.3 % 9 66.7 % 8

No, but I would like to 27.6 % 8 18.6 % 8 21.4 % 3 33.3 % 4

TOTAL 100.0 % 29 100.0 % 43 100.0 % 14 100.0 % 12

25

2013: No statistically significant differences in

response patterns, cohorts vs. instructional sites

2014: No statistically significant differences in

response patterns, cohorts vs. instructional

sites

Satisfaction with Career ServicesHow satisfied are you with the following components of your Career Services experience:


2013(a)

2014(b)

2013(c)

2014(d)


Quality of Career Services NA 0 3.50 2 4.00 2 NA 0

Availability of Career Services NA 0 3.50 2 4.00 2 NA 0


Promotion of DiversityPlease rate your level of agreement with the following statements:


2013(a)

2014(b)

2013(c)

2014(d)


Faculty and staff create safe environments in which multiple voices and perspectives are shared and heard.

4.38 29 4.19 43 4.36 14 3.67 12

Course content is balanced and inclusive so that diverse perspectives are explored.

4.45 29 4.40 43 4.50 14 3.92 12

Developmental education is practiced by accommodating different learning styles, cognitive abilities, and sociocultural influences in the classroom.

4.45 29 4.28 43 4.64 14 3.75 12

Inclusive classroom and co-curricular environments promote mutual respect, reflection, critical thinking, and academic excellence.

4.52 29 4.47(d)

43 4.71 14 3.67(b)

12

I feel actively engaged in the learning process. 4.55 29 4.51 43 4.79 14 4.00 12




In the 2014 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from cohorts was significantly greater than those of respondents from instructional sites on the following item:•Agreement that inclusive classroom and co-curricular environments promote mutual respect, reflection, critical thinking, and academic excellence.

Attainment of Professional SkillsMy experiences at PO have … Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)


… advanced my multicultural competence. 4.21(c)

29 4.44(d)

43 4.86(a)

14 3.92(b)

12

… increased my awareness of writing as an important skill in my professional life.

4.41 29 4.33 43 4.86 14 4.08 12

… advanced my professional practice skills. 4.52 29 4.44(d)

43 4.71 14 3.92(b)

12

… prepared me to behave in a professional manner. 4.41 29 4.42(d)

43 4.64 14 3.83(b)

12

… improved my ability to apply theory and scholarship to practice issues.

4.36(c)

28 4.38 42 4.79(a)

14 4.08 12


In the 2013 iteration of the Pacific Oaks student satisfaction survey, mean ratings of the impact of one’s experiences at PO of respondents from instructional sites were significantly greater than those of respondents from cohorts in the following areas:•Advancing one’s multicultural competence•Improving one’s ability to apply theory and scholarship to practice issues

In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of the impact of one’s experiences at PO of respondents from cohorts were significantly greater than those of respondents from instructional sites in the following areas:•Advancing one’s multicultural competence•Advancing one’s professional practice•Preparing the respondent to behave in a professional manner

Importance of Attributes to Overall Satisfaction¹

Importance of Attributes to Overall Satisfaction ¹ Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)


Access to academic support services such as those provided by C.A.R.E., the library, and individual faculty

5.42 31 5.69 49 5.81 16 4.80 15

Learning the most you can from every experience 6.52 31 6.67 49 6.69 16 6.60 15

The academic rigor of your degree program 6.32 31 6.49 49 6.44 16 6.13 15

The value that PO places on each individual student 6.55 31 6.53 49 6.63 16 6.60 15

Being at a college that shares your vision for society 6.45 31 6.51 49 6.69 16 6.47 15

Employment in a new career after graduation 5.84 31 5.65 49 5.63 16 6.07 15

Advancement in your current employment 6.65(c)

31 6.18 49 5.63(a)

16 6.33 15

Being able to take required courses in an online delivery mode

4.58 31 4.57 49 4.81 16 4.87 15

Having face to face contact with Financial Aid Counselors 5.32 31 5.16(d)

49 4.75 16 3.80(b)

15

Being able to take required courses at an instructional site/offsite cohort

6.77 31 6.78 49 6.63 16 6.87 15

¹ Scale = 7-point importance scale 29

In the 2013 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from cohorts was significantly greater than that of respondents from instructional sites on the importance of advancement in one’s career as being important to student satisfaction.

In the 2014 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from cohorts was significantly greater than that of respondents from instructional sites on the importance of having face to face contact with financial aid counselors as being important to student satisfaction.

Interest Levels – Student ActivitiesStudent Activities Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n

Not at all Interested 41.4 % 12 40.5 % 17 21.4 % 3 50.0 % 6

Somewhat Interested 41.4 % 12 40.5 % 17 50.0 % 7 33.3 % 4

Very Interested 17.2 % 5 19.0 % 8 28.6 % 4 20.0 % 2

Total 100.0 % 29 100.0 % 42 100.0 % 14 100.0 % 12

30







Interest Levels – Copy MachinesCopy Machines Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n



Very Interested 17.9 % 5 20.9 % 9 42.9 % 6 25.0 % 3

Total 100.0 % 28 100.0 % 43 100.0 % 14 100.0 % 12

31







Interest Levels – Writing AssistanceWriting Assistance Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n



Very Interested 17.9 % 5 40.5 % 17 42.9 % 6 25.0 % 3

Total 100.0 % 28 100.0 % 42 100.0 % 14 100.0 % 12

Cohort respondents in 2013 are significantly more likely than instructional site respondents to be at least somewhat interested in writing assistance.

2014: There are no statistically significant differences in response pattern when comparing respondents from cohorts and instructional sites.

32

Interest Levels – Daytime CoursesDaytime Courses Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n



Very Interested 10.3 % 3 11.9 % 5 21.4 % 3 0.0 % 0

Total 100.0 % 29 100.0 % 42 100.0 % 14 100.0 % 12

33




2014: Students at instructional sites are

statistically significantly more likely to show no interest at all in

daytime courses than students enrolled in

cohorts.

Interest Levels – Career AssistanceCareer Assistance Cohorts Instructional Sites

2013(a)

2014(b)

2013(c)

2014(d)

% n % n % n % n



Very Interested 37.6 % 11 43.9 % 18 35.7 % 5 50.0 % 6

Total 100.0 % 29 100.0 % 41 100.0 % 14 100.0 % 12

34







student satisfaction report: pacific oaks college: addendum: instructional sites vs. cohorts office...

Documents

satisfaction survey

student satisfaction

significant differences

mean ratings of students

terms of items

cohort mean

mean scores

group of students