Internet-based Performance-centered Learning Environment for Curriculum

Support (IPLECS)

Catalina Martínez-Mediano and Nuria Rioperezcmarme@edu.uned.es

MIDE I - Faculty of Education - UNED (Spanish University for Distance Education)

AndM. Castro, N. Mileva, S. Stoyanov, W. Kicken, S. Tzanova

CONTENTS

1. IPLECS

2. IPLECS Objectives

3. The project approach: PSS

4. Application of Performance-centered Approach in m-

Learning (mPSS)

5. The evaluation projects strategies

6. The evaluation projects results

7. Conclusions

1. IPLECS

Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS) is a virtual campus platform for performance-centered reusable learning materials to apply in performance-centered settings to support university curriculum in physic-engineering education.

1. Previous works

IPSS_EE (Internet-based Performance Support System with Educational Elements) provide online access to the full range of information and guidance. Performance-centred learning Self-directed learning Based on tasks

DIPSEIL is a project, that add to IPSS_EE, a distributed system for individualized learning

2. IPLECS Objectives

Design a Master Degree, within the EHEA on Information and Communication System (ICS),

Apply the ICS master, by means of the DIPSEIL-IPLECS platform, in Plovdiv University, Bulgaria,

Evaluate the ‘ICS master’ in its design, during their application and in their results.with the collaboration of 6 European

universities (Plovdiv U, TUS Sofia, CIME-INP Grenoble, DEIS, Cork, OTC-OU Netherland, DIEEC-EDU-UNED, Madrid,

3. The project approach: PSS

Based in the ‘Principles of Electronic Performance Support System’ (EPSS), but evolved to the Higher Education System.

The EPSS concept includes the idea to provide information and help to the learner just-in-time, just-enough, and just-at-the-point-of needed

And needs computer support for an effective and efficient job performance.

3.1. The PSS concept in IPLECS

The concept of performance support system (PSS) in education, should consider the specific goals of higher education:

Students should be supported to perform the task, but also to understand the underlying processes and concepts.

4. PSS Workflow Model to guide the curriculum design

The PSS Workflow Model is based in: State a reference situation in which the students will

use what they are going to learn Formulate a few learning goals and clear and specific

objectives oriented to competences Create learning tasks, providing to the students:

Background information, Examples, Procedures and Feedback,

Summative evaluation.

5. The evaluation projects strategies

The evaluation strategy of the IPLECS and mPSS projects aims to study the total purposes, specially:

1. The coherence between every course in the ICS curriculum with the PSS Workflow Model (adequacy indicators), by means of the ‘PSS Validity Scale’

2. The Students’ attitude to learn by computer, by one specific

Questionnaire.

3. The usability and functionality of the platform (efficiency indicators), by means of the‘Computer System Usability Questionnaire’

4. The ‘ Effect of PSS curriculum on students’ learning achievement in competencies’ (efficacy indicators), by means of tests

5. The ‘Satisfaction with the curriculum and the IPLECS platform (when the course has finished) by means of Questionnaires, focus groups, interviews).

5. The evaluation projects strategies

To summarize: Planned, enacted, experienced curriculum Teachers’ and students’ experiences By means of Quantitative and qualitative

instruments and data analysis

6.The evaluation projects results 6.1. The PSS Validity Scale (adequacy)

PSS Validity Scale: Criteria Results:

1. State a reference situation in which the students will use what they are going to learn

This element didn’t appear in all the courses

2. Formulate a few learning goals and clear and specific objectives oriented to competences

This element always appears in the courses

3. Create learning tasks, providing to the students: - Background information,

- Examples,

- Procedures and

- Feedback

This element always appears in the courses, developed according to the advices given in it.

4. Support provided to the students in order to help them perform the task more easily and facilitate learning

This element didn’t always appears in the courses.

5. Summative evaluation This element always appears in the courses, but in some case the evaluation criteria are not included.

6. The evaluation projects results 6.2. The attitude to learn by computer

Attitude is considered one variable that should be controlled, because one positive attitude or a negative one affects to our research purpose.

The questionnaire, of 20 items, Likert scale (1-5 less to maximal agree), was answered by 10 students.

The items with higher punctuation (4.5): I enjoy working in internet environment; I find very positive the idea of using computers and Internet by study

different subject matters.

The items mean: 4.26 showing a positive attitude.

6. The evaluation projects results6.3. The Computer System Usability Q.

A questionnaire on usability and functionality of the IPLECS

platfom, of 19 items, Likert scale, 1-7, maximal disagree to

maximal agree with the item.

The items better valuated:

It was easy to learn to use the system (6.60)

The organization of information on the system screens is clear

I am able to efficiently complete my work using the system

Mean=5.94, S.D.=0.267, show a positive valuation and agreement

between the students.

6. The evaluation projects results6.4. Effect of PSS curriculum on students achievement in competencies’ (efficacy)

Mean of the 8 tasks (range 1 to 10) (Introduction to ITS)10,009,509,008,508,007,50

Fre

qu

ency

5

4

3

2

1

0

Histogram

Mean =8,90Std. Dev. =0,819

N =12

Introduction to Information and Telecommunication Systems

Students Tasks Range Min-max Mean St.D

12 8 1-10 7.75-10 8.90 0.89

Two subjects have been evaluated:1. Introduction to Information and Telecommunication Systems

6. The evaluation projects results6.4. Effect of PSS curriculum on students’ achievement in competencies’ (efficacy)

Means of the 8 tasks (range 1 to 10) (Advanced Electronic for ICT)

10,009,008,007,006,00

Fre

qu

ency

4

3

2

1

0

Histogram

Mean =8,49Std. Dev. =0,958

N =12

Advanced Electronics for Information and communication Technology

Students Tasks Range Min-max Mean St.D

12 8 1-10 7.25-10 8.49 0.95

2. Advanced Electronics for Information and communication Technology

6. The evaluation projects results6.5. Satisfaction with the ICS curriculum

and the IPLECS platform

The 'Reflective Questionnaire' on the general instructional design is applied in every course.

The questionnaire was integrated by 29 items, Likert scale, from 1 to 5, maximal disagree to maximal agree with the items.

We can see the resume of the descriptive statistics in two courses evaluated by the students.

6. The evaluation projects results6.5. Satisfaction with the PSS curriculum

and the IPLECS platform

Items mean. Reflective Q on 'Introduction and Telecommunication Systems'.

4,604,404,204,003,803,60

Fre

qu

ency

6

4

2

0

Histogram

Mean =4,12Std. Dev. =0,199

N =34

Reflective Q. on ‘Introduction to Information and Telecommunication Systems’ course

Students Range Mean St.D

10 1-5 4.12 0.11

6. The evaluation projects results6.5. Satisfaction with the PSS curriculum

and the IPLECS platform

Items mean. Reflective Q on 'Advanced electronics for informationand communication technologies'

4,254,003,753,503,253,00

Fre

qu

ency

20

15

10

5

0

Histogram

Mean =3,49Std. Dev. =0,334

N =34

Reflective Q. on ‘Advanced Electronics for Information and communication Technology’ course

Students Range Mean St.D

10 1-5 3.49 0.33

7. Conclusions

1. The PSS validity scale gives a heterogeneous results on the ICS courses in some items, but, in general the results show that the courses are aligned with the PSS Model.

2. The students’ attitude to learn by computer, is very positive and homogeneous.

3. The usability and functionality of the platform, present good evaluation on the screens organization and its easy learning.

…

7. Conclusions

4. The ‘ Effect of PSS curriculum on students’ learning achievement in competencies’, in the subjects evaluated, have been very positive, with a very good marks.

5. The ‘Satisfaction with the PSS curriculum and the IPLECS platform on the courses evaluated, show a high satisfaction.

Lessons learned and improvement necessities

1. In order to get a better adequacy to the instructional purpose of the DIPSEIL and PSS models is necessary that the curriculum developer and the instructional group design make and effort to work together.

2. Some changes should be done in the different instruments to collect information, to refine they.

3. We need to analyze information collected by focus groups and interviews, add their results to our report.

THANK YOU !!.

Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS)

Catalina Martínez-Medianocmarme@edu.uned.es

MIDE I - Faculty of Education- UNED (Spanish University for Distance Education)