School Of Architecture And The

Built Environment

Civil Engineering Division

5th International CDIO Conference

Assessment of Student CDIO Skillsby

Ng Geok Ling

8 June 2009

School Of ABE

Civil Engineering Division

Content• The challenge• Quick Overview of CDIO Implementation in CE division• Process of integrating CDIO syllabus into module syllabus

– Stage 1 : Define and Identify CDIO skills– Stage 2 : Integrate CDIO Skills into Curriculum– Stage 3 : Develop Assessment Rubrics– Stage 4 : Curriculum Evaluation

• Conclusion• Q&A

School Of ABE

Civil Engineering Division

The Challenge

• 2 years ago

• Implemented but not clearly documented

• To reflect the integration of CDIO skills into the existing module syllabus

• To develop an outcome assessment to assess CDIO skills

School Of ABE

Civil Engineering Division

CDIO Implementation in CE

Stage 1: Define and Identify CDIO skills

Stage 2: Integrate CDIO Skills into Curriculum

Stage 3: Develop Assessment Rubrics

Stage 4: Curriculum Evaluation

Improvement to teaching and learning and curriculum

School Of ABE

Civil Engineering Division

Stage 1: Define and Identify CDIO skills

• Obtained expected PL from the industry• Students are technologist not engineer• Therefore, higher expectation in implementation and operation• Expected skills needed in a module to be entered into ITU table

Survey on Proficiency Levels of 13 CDIO skills in acad year 07-08

0.0

1.0

2.0

3.0

4.0

5.0

CDIO SkillsP

rofi

cien

cy L

evel

s (1

to

5)

Civil Staff AVE [23 attempts] 2.3 2.0 2.4 3.5 3.1 3.5 3.3 2.6 2.4 2.3 2.6 2.7 3.0

MIT Faculty AVE 4.0 3.3 2.8 3.4 3.0 3.3 3.6 2.0 1.8 3.1 3.4 2.3 2.2

Alumni - (01 to 05) [36 attempts] 3.0 2.7 3.4 3.5 3.3 3.7 3.5 2.8 3.0 3.2 2.9 2.8 3.3

Industry 2008 [32 attempts] 2.8 2.8 2.8 3.6 3.5 3.7 3.5 2.8 2.6 2.6 2.8 2.9 3.1

2.1 2.2 2.3 2.4 2.5 3.1 3.2 4.1 4.2 4.3 4.4 4.5 4.6

School Of ABE

Civil Engineering Division

ITU table• I – Introduce but not assess• T – teach and assess• U – Utilise, may or may not be assess

• Overall picture of CDIO skills for the course can be seen

School Of ABE

Civil Engineering Division

CDIO Implementation in CE

Stage 1: Define and Identify CDIO skills

Stage 2: Integrate CDIO Skills into Curriculum

Stage 3: Develop Assessment Rubrics

Stage 4: Curriculum Evaluation

Improvement to teaching and learning and curriculum

School Of ABE

Civil Engineering Division

Stage 2: Integrate CDIO Skills into Curriculum

• Example : BE750Y CAD Studio• 1st year module in DCEM• Supporting module to BE751Y BTM with

capstone project and Intro to Civil Engineering

School Of ABE

Civil Engineering Division

Step 1- Means of Assessment

• Refer to your means of assessment as written in the module syllabus

School Of ABE

Civil Engineering Division

Step 2 – Assessment Component Breakdown

• Breakdown the individual assessment component (as in SAS format) appropriately according to your module needs

School Of ABE

Civil Engineering Division

Step 3 – KSA Weightage Breakdown

• Formulate a table with the CDIO skills you have selected (refer to ITU table) and the assessment components

• CA and LAB assessment weightage spread across each CDIO skill (1 to 4)

• Minimum weightage for each skill to be 5%

• All Tests (TST1,2&3) which are formative assessment are only assigned to technical skills

School Of ABE

Civil Engineering Division

Bloom CDIO skill 2 & 3

Revised Table of SpecificationCurrent

School Of ABE

Civil Engineering Division

Step 4 – Table of Specification in Module syllabus

• Transfer the total weightage in each row from KSA weightage table

KSA Weightage Table

Table of Specification

School Of ABE

Civil Engineering Division

CDIO Implementation in CE

Stage 1: Define and Identify CDIO skills

Stage 2: Integrate CDIO Skills into Curriculum

Stage 3: Develop Assessment Rubrics

Stage 4: Curriculum Evaluation

Improvement to teaching and learning and curriculum

School Of ABE

Civil Engineering Division

Stage 3 – Develop Assessment Rubric• Assessment criteria for technical

content– up to module team to define

according to the module learning outcome

100/25% x 10%

= 40 marks

School Of ABE

Civil Engineering Division

Assessment Template – CA1

• Student is graded as:

1-poor, 2-Fair, 3-Good, 4-Very Good and 5-Excellent • in the column under skill• Lecturers refer to criteria table for the detail attributes under each skill

Marks auto-calculate = ( 25 / 5 ) x 1 = 5

Scale of 5

School Of ABE

Civil Engineering Division

CDIO Implementation in CE

Stage 1: Define and Identify CDIO skills

Stage 2: Integrate CDIO Skills into Curriculum

Stage 3: Develop Assessment Rubrics

Stage 4: Curriculum Evaluation

Improvement to teaching and learning and curriculum

School Of ABE

Civil Engineering Division

Stage 4: Curriculum Evaluation• Most important in the process• Use assessment results for improvement• Ratings of CDIO skill for the course cannot be obtained

as not all module have implemented stage 3• Example: at module level, 2 groups of 47 students• Not conclusive until more data are collected from all

groups doing the same modules

School Of ABE

Civil Engineering Division

Conclusion• Helps in develop and manage curriculum integration with

CDIO skills• Good reference to develop the process of outcome

assessment using rubrics• To achieve the expected proficiency level progressively

over the 3 years of study • Defining 3 levels of expected PL in progress

School Of ABE

Civil Engineering Division

www.sp.edu.sgSingapore Polytechnic500 Dover RoadSingapore 139651

tel. +65 6775 1133fax.+65 6870 6189

Thank You

Q & A