programme exit survey (pes)-dtp june 2013

ProgrammeExit Survey (PES)

Report

Diploma in Mechanical Engineering

(Manufacturing) - DTP

June 2013 Session

Politeknik Kota Kinabalu (PKK)

Sabah

RESEARCH COMMITTEE

Member of Advisory Committee

NO NAME POSITION1 Wan Mohamad Nasir bin Wan Abdul Rahman Director2 Zaidi bin Zakaria Deputy Director (Academic)3 Sylvester Gindan Head of Department (JKM)

Research Fellow (Polytechnic)

NO NAME1 Dr Hasnim bin Harun (Chief, Bureau of Research and Innovation)2 Azman B Talib3 Farah AsyikinAbd Rahman4 Shalizan B. Kadir5 MohdMayuzieYusof6 Fadlilhisham B Ahmad

Research Fellow in Diploma in Mechanical Engineering (Manufacturing)

NO NAME1 Johnny Yakin Sinit (Head of Program)2 Rozie Bin Ahmat3 Muhammad Zuhairy Bin Zulkifli

2PKK Program Exit Survey Report June 2013 Session (DTP)

ABSTRACT

The purpose of this Programme Exit Survey (PES) was to provide data to gauge perceptions

of various aspects of programmes and services offered and to identify areas where

improvements may be needed in the Department of Mechanical Engineering (JKM),

Politeknik Kota Kinabalu (PKK).This PES was conducted on 29 final semester students,

graduating from Diploma in Mechanical Engineering (Manufacturing) (DTP). They were the

second Cohort whose intake was in December 2010. The survey questionnaire had five main

sections: respondents’ profile; assessment of overall quality; assessment of skills and

knowledge; assessment of Lecturers and Academic Advisor; and assessment of academic

resources and facilities. All the data were analysed using the Statistical Product and Service

Solutions (SPSS) software version IBM SPSS Statistics 19.0. For the assessment of the

overall quality, attribute for teaching and learning experience was rated 100% with

“excellent”, “very good” and “good”. Skills and knowledge section was evaluated by

relating the statements with nine items as stated in the Programme Learning Outcomes

(PLO). All the PLOs’ were marked at least “good” by 97%of the students. Assessment on

lecturers and academic advisor were rated 48.3% both of “excellent” and “very good”, while

3.4% rated the item as “average”. In terms of academic resources and facilities, the items of

access to Wi-Fi, Quality of computer labs and Quality of laboratories / workshops / kitchens

had the unsatisfactory concerned from the respondent whereby 3.4% rated the item as

“average”.

Keywords: overall quality, skills and knowledge, lecturer and academic advisor, academic

resources and facilities


1. INTRODUCTION

1.1 Programme Exit Survey (PES)

PES is a method of collecting information on the quality of diploma education from the

perspective of graduating students upon the completion of their diploma programme. This

report refers to an indirect measurement method by way of self-evaluation based on

individual perception for the assessment of PLO. PLOs are the specific statements of

graduates’ knowledge, skills and attitudes acquired at the end of the programme as evidence

for the programme objectives achievements. This PES was conducted to assess the graduate

students’ satisfaction and perceptions about various aspects of their academic experiences.

100% of the final semester students from the DTP programme had participated in the survey.

The main objectives of this PES are to:

1) Determine the students perception in their attainment on the overall quality of

learning and teaching in PKK;

2) Determine the students self-assessment of knowledge, skills and soft skills

achievement after going through the PLOs of the programme;

3) Evaluate the students’ opinion towards contributions of Lecturer and Academic

Advisor system implemented based on Outcome Based Education (OBE) approach;

4) Evaluate the students’ opinion towards academic resources and facilities provided in

PKK.

1.2 Programme Learning Outcomes (PLO)

OBE is an educational philosophy that believed that educational assessment should recognise

and reflect progress made by individual students. PLOs are statements that describe what

graduates are expected to know or be able to do on graduation. In the curriculum for DTP

programme it has been specified that there are nine (9) PLOs’ to be acquired by the graduates

upon graduation. The nine PLOs are as follows:

i. Apply knowledge of mathematics, science and engineering fundamentals to well

defined mechanical and manufacturing engineering procedures and practices.

ii. Demonstrate practical skills which includes the ability to troubleshoot, repair and do

maintenance work for mechanical equipment.

iii. Communicate effectively with the engineering community and the society at large.


iv. Apply creative and critical thinking in solving problem related to assigned task.

v. Demonstrate awareness and consideration for societal, health, safety, legal and

cultural issues and the consequent responsibilities, taking into account the need for

sustainable development.

vi. Recognise the need for professional development and engage in independent

acquisition of new knowledge and skill.

vii. Recognize the need for entrepreneurship.

viii. Demonstrate an understanding of professional ethics, responsibilities and norms of

mechanical and manufacturing engineering practices.

ix. Function individually or in teams effectively with a capability to be a leader.

2. METHODOLOGY

This survey involved 29 DTP students from June 2013 semester. Students were asked to fill

up the PES questionnaires which were posted online and 100% of them responded. The

respondents were required to evaluate and rate themselves based on 5-Likert Scale indicated

below:

1 = Weak

2 = Average

3 = Good

4 = Very Good

5 = Excellent

Student’s satisfaction and acceptance level was determined from the scale. Excellent, Very

Good and Good indication rate shows the students are satisfied with the item. While Average

and Weak indication rate shows the item need some improvements and correction for the

program.

This online survey was conducted on October 2013. The survey questionnaires were

divided into five sections as follows:

i. Section A: General Information

ii. Section B: Overall Quality of Teaching and Learning

iii. Section C: Skills and Knowledge

iv. Section D: Contributions of Lecturers and Academic Advisors

v. Section E: Academic Resources and Facilities


The data collected in this survey was processed through Statistical Product and Service

Solutions (SPSS) software version IBM SPSS Statistics 19.0.

The questionnaires were based on students’ perception on teaching and learning in

PKK, students’ response on skills and knowledge related to PLO’s, students attainment on

the soft skills, students’ rating for lecturers and academic advisors contribution, student’s

opinion towards academic resources, overall services and facilities in PKK. This assessment

strategy was aligned with the Curriculum Development Cycle -“develop-implement-review”

as required by the MQA in order to improve the quality of programme.

3. RESULTS

The response from the students were analysed based on the following four criteria:

i. Students’ response to wards the Overall Quality

ii. Students’ response on Skills and Knowledge

iii. Students’ ratings for Lecturer and Academic Advisor contributions

iv. Students’ opinion towards Academic Resources and Facilities

In Section C: (Skills and Knowledge) the statements have been classified under a particular

PLO so that the data analysis can be done appropriately for accreditation purposes. The

results can be used an indicator to show how well the students have acquired their skills and

knowledge as required in the PLOs of the programme.

3.1 SECTION A: PROFILE

Table 1: Student’s Gender

GENDER

Male Female

Qty 29 0(%) 100.0 0.0

3.2SECTION B: OVERALL QUALITY6

PKK Program Exit Survey Report June 2013 Session (DTP)

Overall Quality was evaluated by relating the students experience with the teaching and

learning environment in PKK. Two survey statements were given and the results were as

follows:

Table 2: Overall Quality rating

OVERALL QUALITY Weak Average Good Very Good Excellent

What is your impression on the overall quality of curriculum; and teaching and learning at PKK?

0 0 2 18 9

(%) 0.0 0.0 6.9 62.1 31.0To what extent has the quality of teaching and learning in PKK improved since you were here?

0 0 3 17 9

(%) 0.0 0.0 10.3 58.6 31.0

3.2.1 PLO1 (Knowledge)

For PLO 1 (Knowledge), four statements were given and the results were as follows:

Table 3: PLO 1 Knowledge rating

SKILLS AND KNOWLEDGEPLO 1 (Knowledge)

Weak Average Good Very Good ExcellentI am able to apply knowledge of core discipline courses in my programme

0 0 4 16 9

(%) 0.0 0.0 13.8 55.2 31.0I am able to apply knowledge of specialized courses in my programme

0 0 3 17 9

(%) 0.0 0.0 10.3 58.6 31.0I am able to apply knowledge of elective courses in my programme

0 0 5 17 7

(%) 0.0 0.0 17.2 58.6 24.1I am able to understand the technological applications relevant to my programme of study

0 0 3 17 9

(%) 0.0 0.0 10.3 58.6 31.03.2.2 PLO2 (Technical &Practical Skills)


For PLO 2 (Technical & Practical Skills), three statements were given and the results were as

follows:

Table 4: PLO 2 Technical & Practical Skills rating

SKILLS AND KNOWLEDGEPLO 2 (Technical & Practical Skills)

Weak Average Good Very Good ExcellentI am able to apply information technology in my programme

0 0 7 16 6

(%) 0.0 0.0 24.1 55.2 20.7I am able to demonstrate my practical skills effectively

0 1 2 14 12

(%) 0.0 3.4 6.9 48.3 41.4I am able to use computing technology for applications in my programme

0 0 2 18 9

(%) 0.0 0.0 6.9 62.1 31.0

3.2.3 PLO3 (Communication Skills)

For PLO 3 (Communication Skills), three statements were provided and the results were as

follows:

Table 5: PLO 3 Communication Skills rating

SKILLS AND KNOWLEDGEPLO 3 (Communication Skills)

Weak Average Good Very Good ExcellentI am able to communicate effectively orally/visually (informal / formal / conversational / presentation)

0 1 4 16 8

(%) 0.0 3.4 13.8 55.2 27.6I am able to communicate effectively in writing (writing reports and expressing ideas and opinions clearly and concisely)

0 1 2 20 6

(%) 0.0 3.4 6.9 69.0 20.7I am able to use computing technology in communications

0 1 3 16 9

(%) 0.0 3.4 10.3 55.2 31.0


3.2.4 PLO4 (Critical Thinking & Problem Solving Skills)

For PLO 4 (Critical Thinking & Problem Solving Skills), three statements were given and the

results were as follows:

Table 6: PLO 4 Critical Thinking & Problem Solving Skills rating

SKILLS AND KNOWLEDGEPLO 4 (Critical Thinking & Problem Solving Skills)

Weak Average Good Very Good ExcellentI am able to solve problems using methods, tools and skills related to my programme

0 0 3 20 6

(%) 0.0 0.0 10.3 69.0 20.7I am able to think critically and logically

0 0 2 18 9

(%) 0.0 0.0 6.9 62.1 31.0I am able to plan, organize and complete a task

0 0 1 19 9

(%) 0.0 0.0 3.4 65.5 31.0

3.2.5 PLO5 (Social Skills and Responsibilities)

For PLO 5 (Social Skills and Responsibilities), three statements were given and the results

were as follows:

Table 7: PLO 5 Social Skills and Responsibilities rating

SKILLS AND KNOWLEDGEPLO 5 (Social Skills and Responsibilities)

Weak Average Good Very Good ExcellentI am able to understand the role of my work in relation to social or cultural issues

0 0 1 21 7

(%) 0.0 0.0 3.4 72.4 24.1I am aware of the value of considering diversity and differences in cultures in my work

0 0 1 18 10

(%) 0.0 0.0 3.4 62.1 34.5I am aware of the impact of my work in a social context

0 0 4 19 6

(%) 0.0 0.0 13.8 65.5 20.7


3.2.6 PLO6 (Continuous Learning & Information Management Skills)

For PLO 6 (Continuous Learning & Information Management Skills), four statements were

provided and the results were as follows:

Table 8: PLO 6 Continuous Learning & Information Management Skills rating

SKILLS AND KNOWLEDGEPLO 6 (Continuous Learning & Information Management Skills)

Weak Average Good Very Good ExcellentI am able to continuously learn new skills and knowledge

0 0 1 14 14

(%) 0.0 0.0 3.4 48.3 48.3I am able to engage in continuous learning beyond the classroom

0 0 1 15 13

(%) 0.0 0.0 3.4 51.7 44.8I am able to learn and apply new concepts

0 1 4 15 9

(%) 0.0 3.4 13.8 51.7 31.0I am able to use information resources (databases, libraries, internet etc)

0 0 2 16 11

(%) 0.0 0.0 6.9 55.2 37.9

3.2.7 PLO7 (Management & Entrepreneurial Skills)

For PLO 7 (Management & Entrepreneurial Skills), two statements were provided and the

results were as follows:

Table 9: PLO 7 Management & Entrepreneurial Skills rating

SKILLS AND KNOWLEDGEPLO 7 (Management & Entrepreneurial Skills)

Weak Average Good Very Good ExcellentI am able to build/develop my career upon completion of my studies

0 1 3 15 10

(%) 0.0 3.4 10.3 51.7 34.5I am able to develop time management skills

0 1 5 14 9

(%) 0.0 3.4 17.2 48.3 31.0


3.2.8 PLO8 (Professionalism, Ethics & Moral)

For PLO 8 (Professionalism, Ethics & Moral), two statements were provided and the results

were as follows:

Table 10: PLO 8 Professionalism, Ethics & Moral rating

SKILLS AND KNOWLEDGEPLO 8 (Professionalism, Ethics & Moral)

Weak Average Good Very Good ExcellentI am able to understand the professional and ethical responsibilities related to my work

0 1 2 16 10

(%) 0.0 3.4 6.9 55.2 34.5I am aware of the importance of safety issues related to my work

0 0 2 14 13

(%) 0.0 0.0 6.9 48.3 44.8

3.2.9 PLO9 (Leadership & Teamwork Skills)

For assessment of the PLO 9 (Leadership & Teamwork Skills), four statements were

provided and the results were as follows:

Table 11: PLO 9 Leadership & Teamwork Skills rating

SKILLS AND KNOWLEDGEPLO 9 (Leadership & Teamwork Skills)

Weak Average Good Very Good ExcellentI am able to work with individuals from different backgrounds

0 1 1 15 12

(%) 0.0 3.4 3.4 51.7 41.4I am able to work successfully as a member of a team

0 1 1 13 14

(%) 0.0 3.4 3.4 44.8 48.3I am able to work successfully as a leader of a team

0 1 1 18 9

(%) 0.0 3.4 3.4 62.1 31.0I am able to function in multidisciplinary teams

0 0 2 17 10

(%) 0.0 0.0 6.9 58.6 34.5


3.3 SECTION D: CONTRIBUTIONS OF LECTURERS AND ACADEMIC

ADVISORS

Responses from students towards the lecturers and academic advisors’ contributions are

summarized below. Graduates were asked to offer insights of encouragement given into the

programme delivery process. Six attributes of encouragement were offered and the results

were as follows:

Table 12: Contributions of Lecturers and Academic Advisors rating

CONTRIBUTIONSContributions of Lecturers and Academic Advisors

To what extent did your lecturer/academic advisor encourage you to:

Weak Average Good Very Good Excellent

Set high expectations for learning?

0 0 2 16 11

(%) 0.0 0.0 6.9 55.2 37.9Be an actively involved learner?

0 0 3 15 11

(%) 0.0 0.0 10.3 51.7 37.9Show concern for student learning?

0 0 2 15 12

(%) 0.0 0.0 6.9 51.7 41.4Provide feedback frequently and promptly?

0 0 4 15 10

(%) 0.0 0.0 13.8 51.7 34.5Show concern for student learning?

0 0 2 18 9

(%) 0.0 0.0 6.9 62.1 31.0Provide feedback frequently and promptly?

0 0 1 14 14

(%) 0.0 0.0 3.4 48.3 48.3

3.4 SECTION E: ACADEMIC RESOURCES/FACILITIES

In the education eco-system, academic resources/facilities were important in terms of

educational hardware. The teaching and learning process would be greatly enhanced provided

that there were sufficient resources/facilities for students to thrive academically. Table 4

shows the percentage of respondents’ ratings towards the sufficiency of resources/facilities at

the PKK. Eleven statements of resources/facilities were given and the results were as follows:


Table 13: Academic Resources/Facilities rating

ACADEMIC RESOURCES/FACILITIESTo what extent did Politeknik Kota Kinabalu provide you with the following resources/facilities?

Weak Average Good Very Good Excellent

Operation hours of the library

0 0 1 20 8

(%) 0.0 0.0 3.4 69.0 27.6Access to databases and collections both physically and online in the library

0 0 3 16 10

(%) 0.0 0.0 10.3 55.2 34.5Easy and responsive services of the HEP staff

0 0 5 16 8

(%) 0.0 0.0 17.2 55.2 27.6

Easy and responsive services of the counselling staff

0 0 2 14 13

(%) 0.0 0.0 6.9 48.3 44.8

Easy and responsive services of the library staff

0 0 3 14 12

(%) 0.0 0.0 10.3 48.3 41.4

Easy and responsive services of the administration staff

0 0 5 15 9

(%) 0.0 0.0 17.2 51.7 31.0Access to Wi-Fi internet 0 1 8 10 10

(%) 0.0 3.4 27.6 34.5 34.5Quality of computer labs 0 1 4 13 11

(%) 0.0 3.4 13.8 44.8 37.9Quality of laboratories / workshops / kitchens

0 1 2 16 10

(%) 0.0 3.4 6.9 55.2 34.5Quality of classrooms 0 0 8 12 9

(%) 0.0 0.0 27.6 41.4 31.0Quality of sports and recreational facilities

0 1 5 13 10

(%) 0.0 3.4 17.2 44.8 34.5


4. SUGGESTED IMPROVEMENTS FROM STUDENTS

There are several suggestions from student to improve the quality of teaching and learning

process, academic resources or facilities, curriculum and polytechnic management. There are:

i. Some of academic resources and facilities such as machinery, lab equipment, Wi-Fi

internet and classroom need to well manage and maintenance

ii. In teaching and learning process they suggest all lecturers should be used simple

language

iii. Lecturer or academic adviser need to monitor student and develop they self confident,

appearance and discipline.


programme exit survey (pes)-dtp june 2013

Documents