1/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

Done-IT

Develop open operative system services for Smartphones that facilitate new evaluation methods, and enhance the use of immediate feedback on evaluation results obtained in tests

as a creative learning tool.

A Life Long Learning

Leonardo da Vinci Transfer of Innovation Project

EVALUATION REPORT

by

EXTERNAL AUDITOR

Contractor Sør-Trøndelag University College, Faculty of Technology, E. C. Dahls gt. 2, 7004 Trondheim Contact Dr. John B. Stav, John.B.Stav@hist.no Sør-Trøndelag University College, Faculty of Technology, E. C. Dahls gt. 2, 7004 Trondheim, Norway

External auditor’s data: Place: Budapest, Hungary; Date: 25.03.2013., Version: v02; Created by: Dr. Géza Gremsperger, Company: Qualiweld 96 Kft.

2/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

List of Contents

1/ Project characteristics 2/ Background

2.1/ Main aims of Done-IT project -­‐ Objectives, -­‐ Methods, -­‐ Impact, -­‐ Added value,

3/ Partnership and general characteristics of consortium.

-­‐ list and contact data of consortium members, -­‐ general characteristics of consortium

4/ Activities – Workpackages (WP) – Deliverables (D)

4.1 WP 1, 4.2 WP 2, 4.3 WP 3, 4.4 WP 4, 4.5 WP 5, 4.6 WP 6, 4.7 WP 7, 4.8 WP 8, see remarks later

5/ Is the proposed role of the participants fulfilled?

... 6/ Summary, results and future

Declaration on usage of this document This document may not be copied, reproduced or modified in whole and or in part for any purpose without written permission from the Done-IT consortium. In addition to such written permission to copy, reproduce or modify this document in whole and or in part, an acknowledgement of the authors of the document and all applicable portions of the copyright notice must be clearly referenced. All rights reserved. This document may change without notice, but consortium members should be informed and number of version, stage and date should be given.

Legal notice: This project has been funded with support from the European Commission. This publication reflects the views only of the author and the Commission cannot be held responsible for any use which may be made of the information contained therein.

3/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

1/ Project characteristics

 Project title: Develop open operative system services for Smartphones that facilitate

new evaluation methods, and enhance the use of immediate feedback on evaluation results obtained in tests as a creative learning tool

Project number: 511485-LLP-1-2010-NO-KA3-KA3MP Grant Agreement number: 2012-4074/001-001 (Bruxelles, 03.12.2010.) Sub-programme or KA: KA3-ICT Project website: http://histproject.no/node/167 Reporting period: starting: 01-01-2011

original ending :31.12.2012 finishing: 31/03/2013 (eligibility period of agreements accepted by Bruxelles on 21.12.2012.)

Report version: Report from external evaluator Deadline for Final –report:: original: 28.02.2013. new amended: 31.05.2013. Date of preparation: 25/03/2013 Beneficiary organisation: Sør-Trøndelag University College, Faculty of

Technology

Project coordinator: Dr. John B. Stav Project coordinator organisation:

Sør-Trøndelag University College Faculty of Technology 7004 Trondheim, Norway

Project coordinator telephone number:

004773559503 / 004795293101 (mob) Project coordinator email address:

John.B.Stav@hist.no

The Done- IT project management characteristics are accepted by the external auditor.

4/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

2/ Background

Today, students are unable to immediately verify their learning during tests/exams as feedback is published after several days or even weeks. This is particularly important in vocational education and training, and in higher education. Educational institutions usually don’t have access to a high number of computer science laboratories from which it is possible to run digital multiple-choice tests for all campus students. On the other hand, within a few years a majority of students will have access to cheap and easy-to-use Smartphones with high-resolution touch-sensitive screens. The main focus of the proposal is to use IT devices for teaching and learning and to increase the efficiency of this activities.

2.1/ Main aims of Done-IT project  Objectives

The Done-IT project aims to foster innovation by providing a fit for purpose method and a new model for assessing and expanding students learning skills and knowledge, since the results from multiple tests may be interconnected. The Done-IT project aims to disseminate Peer Learning Assessment Services (PELE) into 2 lifelong learning sectors, by developing new response technology services for Smartphones, pads, PCs and Macs. The PELE is going to add significant benefits to both instructors and students. Realizing the objectives of Done-It project the target group was defined:

Ø Mechanical industry training providers within material testing Ø Providers of Vocational Education and Training (VET) Ø Higher educational institutions Ø Secondary schools

Methods

The traditional final exam may be replaced with a system and methods of several tests that may be carried out in all types of rooms with Wi-Fi network access, including inquiry-based and problem solving approaches where students may use laboratory experiments as cases during/after tests. The new Peer Learning Assessment System (PELE) for Smartphones gives the teacher a new learning and/or pedagogical tool, allowing him/her to either give verification or elaborative feedback to individual students or groups of students immediately after a test. The methods are: Evaluation methods:

Part 1: Technology testing. Part 2: Discussion for improving the system developed.

Assessment phases: Ø the test question on paper,

5/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

Ø answering using a web-enable device like a Smartphone, iPod and pad,

Ø result consideration, Ø post-assessment phase discussing questions.

Certification processes: The PELE system could be used to grade assessments carried out by certification bodies as well. The certification bodies can be totally disconnected from the teaching process. The process for students is very humanistic and simply – because:

- entering the room, - using an electronic device and - responding the questions.

Impact

Students may improve their skills through active communication and interaction through immediate post-assessment peer learning processes. Students will, at a time when they still have the test questions fresh in memory, learn why the correct answer is correct and why the other ones are incorrect. Thus, mobile technology provides new evaluation and assessment criteria for education and training.

 Added value

-­‐ the new and effective learning tool providing quick respond on the knowledge level of students,

-­‐ a practical tool for teachers to clarify that subjects which are not understandable for student – hence to improve the quality of VET activities,

-­‐ the Green IT approach in which the use of a large number of PCs may be replaced by small devices that are already (soon) widespread and affordable

-­‐ less material consumption during the production process, resulting in less manufacturing costs, reduced carbon footprints, and promotes increased use of renewable energies

The teacher may display the class results of a test question without explaining details about what are (in)correct results, and let individual- or groups of students discuss the alternatives. After this active learning process some students may decide to change their mind and correct their feedback!

The Done - IT project “Main aims of Done-IT project”

is accepted by the external auditor.

6/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

3/ Partnership and general characteristics of consortium. The partnership has close contact with industry across Europe, see member’s list: List and contact data of consortium members: Centrum for Flexible Learning (CFL), Söderhamns kommun, Sweden Contact person: Per Bergegård, Per.Bergegard@soderhamn.se Klas Tallvid, klas.tallvid@soderhamn.se Mob:0046070 699 40 65 Postal address: Järnvägsgatan 7, 826 80 Söderhamn, Sweden “Petru Maior” University of Targu-Mures (UPM), Tirgu Mures, Romania Contact person: Prof. Liviu Moldovan, mliviu@engineering.upm.ro Mob: 0040 740 498 427 Office: 0040 365 808 659 Postal address: Petru Maior University of Tirgu-Mures, I Nicolae lotga street, Tirgu-Mures, 540089 Romania Magyar Hegesztéstechnikai és Anyagvizsgálati Egyesülés (MHtE), Budapest, Hungary Contact person: Bela Gayer, bgayer@mhte.hu Phone: 0036146728120 Mob: 0036303811778 Skype: gayer.bela Postal address: Hungary 1148 Budapest, Fogarasi út_10-14

Institut za Varilstvo (IzV), Ljubljana, Slovenia Contact persons: Miro Uran, miro.uran@i-var.si Phone: 00386 41940365 Skype: mirouran Postal address: Ptujska 19, 1000 Ljubljana, Slovenia

HiST Contract Research (HCR), Trondheim, Norway Contact person: Arild Smolan, arild.smolan@hist.no Phone: 004773559332 Mob: 004791376675 Postal address: E. C. Dahls gt. 2, 7004 Trondheim, Norway

Sør-Trøndelag University College, Faculty of Technology, 7004 Trondheim, Norway Contact person/project coordinator: Dr. John B. Stav, John.B.Stav@hist.no Phone: 004773559503); Mob: 004795293101 (mob) Postal address: E. C. Dahls gt. 2, 7004 Trondheim, Norway

7/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

University of Huddersfield (UoH), Huddersfield, UK Contact person: Dr. Joan Lu, j.lu@hud.ac.uk Mob: 00441484472922 Postal address: School of Computing and Engineering, University of Huddersfield, Huddersfield, West Yorkshire, UK, HD1 3DH

Remarks: Contract with UoH was terminated by HiST at 9.3.2012. General characteristics of consortium

The consortium has a strong industrial presence and includes two national certification bodies with strong ties to mechanical industry and industrial networks. These partners have experience in training standards with regards to VET in industry, as well as experience in interacting with the European Welding Federation. The wide industrial practical connections ensure that the results will be implemented in practical industry cases, as well as in additional knowledge transfer programs.

 (above  text  was  partly  taken  from  the  “Project  proposal  for  Done-­‐IT  project”)  

 The Done - IT project. “Partnership and general characteristics of consortium” is

accepted by the external auditor.

8/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

 

4/ ACTIVITIES – WORKPACKAGES (WP) – DELIVERABLES (D) GENERAL REMARK: more and detailed information, evidences for Done-It project are available on:

http://histproject.no/node/196 4.1 - WP1: Project management - there was no change to the original proposal Responsible: HiST What has been delivered? – Status Deliverables: D1.1 Bi-annual consortium meetings - Status/activity: Consortium meetings have been organized in a rotating order by the partnership. Meeting minutes have been written and published in the project member area. D1.2 Collaboration tools – Status/activity: Video conferencing and Skype have been used frequently to arrange courses, meetings and project follow-ups. D1.3 Work package management – Status/activity: Work package leaders have been appointed to each WP. The day-to-day communication has been done by use of email and Skype meetings. The management, including the pilot phases, demonstrates to be efficient. D1.4 Administrative and financial reports – Status/activity: Interim report has been uploaded to the web-site. Web-site is prepared for uploading of final report.

D1.5 Partner agreements - Status/activity: They have been completed and signed by every partner. 4.2 - WP2: - Specification of Evaluation and Operative System user requirements for mobile devices - there was no change to the original proposal Responsible: MHtE

What has been delivered? – Status Deliverables: D2.1 Evaluation feedback learning specifications – Status/activity: The description of the terms and definitions in the area of training and examination of NDT candidates is outlined in the user requirement report. The training system, the grading and the evaluation system, as well as the certification system are described in detail. The report contains descriptions of material science and material testing learning specifications in Hungary, Slovenia and Romania. Both Hungary and Slovenia uses an evaluation system where questions have four alternative solutions, only one of which is correct, the remaining

9/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

three being incorrect or incomplete. The examination process is administered by a certification body that assesses the general, specific and practical knowledge and skills of the candidate. D2.2 Operative System delivery specifications – Status/activity: The operative system delivery specifications constitute the second major component of the user requirement report. The process of turning assessment into a learning arena is described and outlined. This includes the preparation phase in front of the test, the activities carried out during the test in class, and the post assessment phase where assessment should be turned into learning by use of immediate feedback and follow up. The consortium introduced a new educational (learning and teaching) system PELE. This is a direct connection between the assessment, learning and teaching which can be realized in the Done-IT complex high effective educational program. The main components of the user interface for the teacher is described at high level. It is supported by a number of teacher and student use case scenarios. Hungary and Slovenia are interested at the training and examination of the NDT testers and their system are similar to each other, because using of the EN 473 / EN ISO 9712 /. Romania showed the learning model for material testing at higher education (advanced material from master degree). Each partner has been explained to develop their system with the results of the Done-IT project. Extremely suitable area of the examination is when the written examination using with multiple choice questionnaires. 4.3 - WP3: Develop mobile learning models that use evaluation results from tests, to provide immediate verification or elaboration feedback to students - there was no change to the original proposal Responsible: HCR

What has been delivered? – Status Deliverables: D3.1 Develop new evaluation models – Status/activity: This deliverance contains two components: - a multilingual summary of the new evaluation method to teachers or instructors that want to start using PELE. This includes a check list with 6 key points for start using the PELE assessments in class, and one video that outline how PELE is supposed to be used. PELE may be used in assignments, exercises, laboratory work, tests and exams that are structured as multiple choice questions with a certain number of alternatives. With PELE, the traditional "large" final exam at the end of the course, may be replaced with a set of smaller tests during the semester, and a reduced/smaller final exam that addresses the analytical part. The analytcal part usually requires reflection processes, whereby multiple choice questions cannot be used. It is a key issue that the students them self register their data (inclusive the student name), making it is easy for the teacher or instructor to handle several courses, each containing several tests in large classes. - a report describing the evaluation model, as well how a PELE assessment may be done at the practical level. Available: 1 video. D3.2 Video material for evaluation based training – Status/activity:

10/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

A number of online video tutorials demonstrate how teachers and instructors during the pre- and post test activities, as well as the monitoring phase of the assessment, should operate the PELE services. The online video tutorials high light the challenges which teachers may observe if the capacity in the Wi-Fi network is low, by demonstrating how MPSU slate or boxes may be used to set up local wireless networks. These videos are closely connected to deliverance D8.1: the PELE service, and are very useful tools that give the teacher a quick introduction to PELE. The video material contains interviews with students that have taken part in “PELE-assessments”, as well as teachers and instructors that have been using PELE for a long period. These videos describe why new teachers should consider starting using PELE as an immediate feedback tool in assignments, exercises, test and exams. A few videos describe two of the partners expectations by using PELE. Available: 13 videos. D3.3 Verification and elaboration based learning methods – Status/activity: This includes five different immediate feedback methods that help turning an assessment into a learning activity by use of immediate feedback. Available: 7 videos. D3.4 Instructor pilot training in 5 EU countries – Status/activity: Instructor training has been done throughout the whole projects life cycle in the 5 countries participating, as well as to a group of instructors in Portugal that want to start testing and using PELE in VET. The training has been organized as workshops in some countries, while traditional training courses have been used in other countries. Video conferencing has also been used between Norway and Hungary, and Norway and Romania. More than 15 activities have been reported during the project period, which is above the threshold numbers. Now 7 videos illustrate the activities carried out at those training events. Available: 7 videos.

4.4 - WP4: Pilot testing the mobile learning model with use of the new evaluation methods in material testing courses - there is some officially accepted deviation from the original proposal in D4.1 Training of material testers and material engineer Responsible: CFL

What has been delivered? – Status Deliverables: D4.1 Develop learning material in form of cases – Status/activity: HiST, UPM, IzV and MHtE have produced training material of high quality. CFL has not produced any training material. Due to a political decision in Sweden, the material science education has been transferred to other VET training bodies in Sweden. This decision resulted in additional challenges for CFL. They lost their expertise within material sciences. It looks like CFL has invested the time allocated for production of material, in communication and collaboration with the new organizations that today provide material science education in Sweden. By doing it in this way, they still managed to test PELE in two material science courses.

11/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

D4.2 Video for use in pilot testing courses – Status/activity: The consortium members have produced 18 online videos from pilot testing activities that illustrate how PELE may be used in various teaching and learning scenarios. This includes some interviews with teachers, instructors and students. New teachers and instructors that want to test out and apply PELE in their courses, may use these videos as a starting point. Available: 18 videos. D4.3 Pilot testing in Norway – Status/activity: HiST has used PELE in training of material students in engineering (one course), and training of students that study mathematics (two courses, both are additional deliverances that are not described in the proposal). 148 students participated in the testing during the spring 2012, and 220 additional students in the period fall 2012 to 2013. In 2011 did 10 students from 2 classes participate in the early design and testing phase of the student interfaces. This is above the target level. D4.4 Pilot testing in Sweden – Status/activity: Söderhamn lost due to political decisions the material science education provided by CFL and have therefore involved external schools that provide material testing training. CFL has delivered training of material tester specialists in upper secondary school (Staffans gymnasiet, 18.4.2012) and Material tester VET schools (Yrkesakademin, 8.5.2012). CFL has in addition tested PELE in several types of classes, e.g. two nursing classes in Söderhamn and Bollnäs (27.9-25.10.2012). In total 166 students from 12 classes had been involved in the testing process. This is above the target level. D4.5 Pilot testing in Romania – Status/activity: UPM has used the services and methods in 3 courses for material engineers during a whole semester. 144 students attended those courses This is above the minimum threshold level. D4.6 Pilot testing in Hungary – Status/activity: MHtE has tested the services and methods in several training pilots, including 3 material tester specialist courses, where the services were used in two real exams, in one international engineering course, and one course for specialists at university level. These are two additional courses. Between 550 and 600 students have tested out the PELE services. This is above the target level. D4.7 Pilot testing in Slovenia - Status/activity: IzV has used the services in material testing courses, at VET level and for material engineers. PELE has in total been used in 8 courses with 128 students This is above the minimum threshold level. 4.5 - WP5: Evaluation of project results and quality assurance project plan - there is no deviation from the original proposal Responsible: IzV

What has been delivered? – Status

12/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

Deliverables: Evaluation of the project will take place during the project life time and according to an evaluation plan. A standardized set of evaluation documents have been developed in order to ensure that the evaluation follows the same pattern and that it becomes unified in form and presentation. A set of evaluation forms, questionnaires, and results of them were developed and used. There is a summarizing document named: “Connecting technology and people – Evaluation results” which was created for detailed evaluation of Done-IT project results and it is available in web page of Done-IT project. The content of this document is:

-­‐ executive summary: o background, o developed training method, o certification processes, o evaluation (check-lists),

-­‐ harmonized project questions, -­‐ results of internal evaluation from project members (remarks: in this chapter the report of

each project member is available) Two QA systems were used during the project.

-­‐ D5.1 Internal evaluation – Status/activity: It was delivered and published on DONE-IT page and in cumulative evaluation report. An electronic system for bugg-fixing and changes have been maintained continually during the project lifewtime. D5.2 Evaluation of material testing courses in Norway – Status/activity: Several tests were carried out and reports were prepared and published on DONE-IT page and in the cumulative evaluation report. D5.3 Evaluation of material testing courses in Sweden – Status/activity: Evaluations were carried out and reports were prepared and published on DONE-IT page and in cumulative evaluation report. D5.4 Evaluation of material testing courses in Romania – Status/activity: Evaluations were carried out and reports were prepared and published on DONE-IT page and in cumulative evaluation report. D5.5 Evaluation of material testing courses in Hungary – Status/activity: Several evaluations were carried out and reports were prepared and published on DONE-IT page and in cumulative evaluation report. D5.6 Evaluation of material testing courses inn Slovenia – Status/activity: Seven evaluations were carried out and reports were prepared and published on DONE-IT page and in cumulative evaluation report. D5.7 Quality Handbook specifications – Status/activity: Special QA- system was prepared for the project at start of the project. Special standard system was used to speed up the communication between programmes of the software and end users.

13/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

D5.8 Evaluation by external expert – Status/activity: Collecting evaluation data from every participating members. Requirements outlined in the Done-IT proposal are fulfilled. 4.6 - WP6: Dissemination of project results - there is no deviation from the original proposal Responsible: HiST

What has been delivered? – Status Deliverables: D6.1 Dissemination activities in Norway– Status/activity: HiST and HCR have reported more than 50 dissemination activities in a range of European countries. This includes two presentations at one of the most important e-learning conferences in Europe; Online Educa Berlin in 2011 (dissemination event) and 2012 (stand and presentation). After completion of the project, these activities have been turned into exploitation addressing important workshops and conferences that are going to be scheduled in Norway, Russia, Germany, Poland and Serbia during 2013. The dissemination activities include a meeting with 20 directors in the Ministry of education in Oslo, Norway. This is at the top political decision level in Norway. Available: 1 video. D6.2 Dissemination activities in Sweden– Status/activity: CFL has carried out 20 dissemination activities in their region to VET schools, high schools and policymakers. They have provided presentations at the Scandinavian Mobile Learning workshop. D6.3 Dissemination activities in Romania– Status/activity: University Petrus Major has organized dissemination activities to VET providers, universities, companies and policymakers in their region. They report in total 22 activities in Romania, as well as Italy and Spain. D6.4 Dissemination activities in Hungary– Status/activity: Every 4th month MHtE has published an article about the project in the welding journal ”Hegesztéstechnika”. Industry, training centers and VET schools all over Hungary read this journal. They have also presented the results at MACTECH, which is the second largest mechanical and material science conference and exhibition in Europe, and the largest in Eastern-Europe. Together with IzV, this represents a strong potential for introducing PELE as a new certification tool towards material science industry, since the material testing and welding association MHtE is the representative for Hungarian industry. Available: 1 video. D6.5 Dissemination activities in Slovenia– Status/activity: Institute za Varilstvo (IzV) is the European Welding Federation (EWF) contact point in Slovenia. They have through their wide network disseminated the results to many industrial companies in Slovenia, as well as through the EWF network and the General Assembly. This provides efficient dissemination towards major stakeholders in industry, education and training, as well as certification. The leader of IzV, Miro Uran, is the vice director of EWF,

14/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

whereby this position provide effective dissemination towards material science industry all over Europe. 36 activities has been reported during a period of 2 years. D6.6 International conferences in Europe– Status/activity: The project reports 29 articles that has been published in proceedings at various international conferences and workshops in Europe. The publishing house IGI Global, has published one book that contain several of these articles. The project has in addition provided 25 presentations at international conferences, as well as arranged many workshops and conferences in many European countries. This includes even a forthcoming conference in Moscow, where PELE is going to be one of the major components. In Romania and Norway, 4 radio and TV interviews have been done. HiST and HCR reports 7 articles in magazines, one of them is done by The Norwegian Broadcasting Corporation, which is a national organization in Norway. Available: 3 videos. D6.7 Informational material-site – Status/activity: The poster and leaflet is designed in a professional way, and translated to the national languages. D6.8 Project web-site– Status/activity: The Done-IT web-site is presented at www.histproject.no. The information is structured in a general block for non-experts, while the detailed results are stored in the field “Results for the expert”. It is easy to access and use all the material that has been published as public material.

4.7 - WP7: Exploitation of project results - there is no deviation from the original proposal Responsible: UPM

What has been delivered? – Status Deliverables: D7.1 Developing a valorization plan – Status/activity: The VALORISATION REPORT is delivered. It describes in introduction the Done-IT project results, target groups and consortium partners involved. The theoretical aspects and the EU’s five-stage model for dissemination and exploitation adopted by consortium partners are described. Than objectives of valorisation, partners’ roles and activities developed for valorisation including employment of the evaluation software PELE in the on-going activities of the project partners are presented. The valorization model adopted by consortium partners contains the interactive model of innovation applied in the project and the project valorization in the context of relation between innovative work and VET systems. Operating range of valorization: products for valorization, target valorization with short and long term target groups are presented. Than project chart valorization, dissemination and exploitation deliverables are described including also actions to be performed. Final conclusions comprise: needs of users identification, training needs responded by the project, project results integration in the on-going activities of the project partners targeting skills development in the mechanical industry sector, and specifically in the delivery of training towards external to partner organizations target groups, business strategies for commercialization of PELE.

15/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

D7.2 Developing an exploitation plan – Status/activity: The EXPLOITATION REPORT is delivered. It describes the exploitation products, activities, roles and tasks of the project partners. The target groups and audiences of the exploitation are defined. Exploitation approach, exploitation strategy comprising four strategic options, and exploitation activities during the project lifetime are presented. The involvement of the regional and national policy-makers and decision-makers, visits and demonstrations to VET schools and mechanical industry companies, stakeholders in VET schools and universities in countries that don’t participate in this project, universities testing and using the evaluation methods and new mobile learning tools, are described. The organisations/persons exploiting PELE are presented. Other training needs sectors where PELE will be used, additional markets where the project results could be applied for obtaining multiplier effects. HCR developed a business strategy for commercialisation of new services for evaluation in educational settings outside the material testing sector. Further exploitation activities include: seminars, workshops, conferences where Done-IT results will be presented/demonstrated and PELE services exploited in the near future by consortium partners.

4.8 - WP8: Developing evaluation system for 4 Operative System (OS) platforms for Smartphones - there are some deviations from the original proposal

- The separation of UoH has been approved by the Commission (left the project at 9.3.2012).

- The responsibility and tasks for D 8.1 and D 8.2 was taken over by IzV - The project was extended by three months (2nd contract amendment) - One additional product has been delivered (D8.3)

Responsible: IzV (see more at WP5) IzV has replaced UoH,

What has been delivered? – Status Deliverables: General remarks: In the course of project a technical report (150 pages) and manuals were elaborated and cca. 1200 pages as supporting and background working papers - the structure of documentation helps the work and learning activities because there are manuals for teachers, students and MPSU too. D8.1 Developing evaluation system for 4 Operative System platforms…. Status/activity: The project has constructed, tested and validated an advanced system for provision of immediate feedback by use of students mobile devices. The systems works on laptops, tablets and smartphones, whereby it become a new platform for use of immediate response during assignments, exercises, tests or exams. Immediately after a test - when the details of the test are still fresh in the minds of the students - the students will learn why the correct answer is correct and why the other ones are incorrect. The project delivers a system solution where a teacher may request a PELE account, and afterwards easily install the

16/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

teacher client on his/her own laptop, and afterwards use PELE for free through servers hosted by HiST. The usage is supported by an easy to read instructor manual, as well as many online instructor videos. Though UOH left the project in March 2012, this has not reduced the quality of the online services. D8.2 The technical implementation report Status/activity: The report describes the main technical components of the system, and how these communicate and interact, without going too much into details. This is important for such an advanced service. D8.3 The Mobile PELE Service Unit (MPSU)         Status/activity: Too many training organizations in South-Eastern Europe are today faced with wireless networks that don’t have the capacity to utilise modern hand held devices like smartphones. The MPSU serves as a good and cheap alternative for certification bodies that want to start using PELE. The MPSU is a server and built-in Access Point (AP), setting up a local WI-FI network. Additional AP and/or Wireless Routers may be connected in order to increase the capacity of the local wireless network. The consortium ahs managed to construct the MPSU boxes within the existing budget of the project, whereby it become a new deliverance from the project. This looks like a promising and cheap to use solution for many training and certification organizations.    

The Done- IT project “activities – workpackages (WP) – deliverables (D)” are accepted by the external auditor.

17/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

5/ IS THE PROPOSED ROLE OF THE PARTICIPANTS FULFILLED?

 Partner’s name Status of fulfilling the proposed role – needed

short explanation Sør-Trøndelag University College

HiST has coordinated the project, and secured the communication towards the European Commission. HiST has had a central role in developing the new Peer Learning Assessment method, and carried out many practical tests in classes as well as carried out research activities related to the development. HiST has provided many dissemination activities, and planed an exploitation process during the first year after closure of the project. This process includes several workshops in several European countries. This will end up with a presentation of PELE at Online Educa 2013 in Berlin. The plan is to use 2013 to make PELE into a commercial assessment for learning tool that utilize immediate feedback from students own devices, and provided it to the Educational market in Europe.

Centrum for Flexible Learning (CFL)

CFL has been an end-user in this project, carrying out testing and evaluations in real market conditions in several types of classes. They have organized instructor training courses, and disseminated the services and methods at a regional level in Sweden. This includes participation in the 1st and 2nd Scandinavian Mobile Learning Workshop in Østersund, Sweden. They have supported HiST during the completion of the intermediate and final reports. They will take part in the exploitation activities, by start using PELE in VET courses.

“Petru Maior” University of Targu-Mures (UPM)

UPM in its capacity of a training organisation has participated in the project for research and accumulate materials for cases in the area, has organised instructor training courses, utilized the new training method in 3 courses, implemented the new technologies and pedagogical methods in education, organised a national conference and promoted the project results at international conferences and meetings, helped completing the intermediary/ final/ audit report.

HiST Contract Research (HCR)

HCR has been the main developer of the PELE services. Personnel from IzV supported them during the last phase of the project, taken over the role that UoH were supposed to have. The cooperation between HCR and IzV have been good.

Magyar Hegesztéstechnikai és Anyagvizsgálati Egyesülés (MHtE),

MHtE has been an end-user in this project, carrying out testing and evaluations in real market conditions in the material testing field. They have organized instructor training courses, and disseminated the services and methods at a regional and national level in Hungary. MHtE’s main activity at the Nondestructive Material Testing to develop of the using of the PELE and SRS at the exams of the NDT’s candidates at three levels 1,2,3.

18/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

The Done-IT project “the proposed role of the participants” are accepted by the external auditor.

MHtE has been published each result of the project at all area of its possibility. (“Weldingtechnology” journal, conference, flyers, poster, seminars, courses). MHtE’s pilot testing courses at the higher education level at the university with high recognition and result among the students and teachers/lecturers. This includes participation in MACHTECH and 2nd Scandinavian Mobile Learning Workshop in Østersund, Sweden. They have supported HiST during the completion of the intermediate and final reports. They will take part in the exploitation activities, by start using PELE in VET based certification courses.

Institut za Varilstvo (IzV), IZV has fulfilled all the tasks planed for IZV in proposal. Additional was IZV fully engaged in WP8 instead of UoH. IzV has been an end-user in this project, carrying out testing and evaluations in real market conditions in the material testing field. They have organized instructor training courses, and disseminated the services and methods at a regional and national level in Slovenia. This includes participation in the EWF general assemblies, and 2nd Scandinavian Mobile Learning Workshop in Østersund, Sweden. They have supported HiST during the completion of the intermediate and final reports. They will take part in the exploitation activities; by start using PELE in VET based certification courses.

19/20    

511485-LLP-1-2010-NO-KA3-KA3MP    

6/ Summary and future Due to the potential of connecting peer learning processes with new assessment methods, were given the services the name:

Peer Learning Assessment Services (PELE). The Done-IT project as whole after on-going development has been in different location presented and disseminated. The new system was proved by students and teachers and results on methodology and system was found positive. The documents containing the results of the project could be reached on web for public usage and more detailed information are available if using “restricted area” by password. The main results are:

Ø Dissemination of project results and peer learning assessment methods in workshops, seminars and international conferences, Vocational Education, training schools, industry companies, universities and high schools in many European countries.

Ø Development and initial testing and evaluation of the peer learning assessment method and the peer learning assessment services that provides immediate feedback to students after test and exams.

Ø The coordinator of the project is ready for giving information to interested parties.

Ø Deliverance of instructor training. Ø Deliverance of cca. 60 videos – making the project more usefull for

understanding the new PELE. Ø Adaptation of course material for use with PELE. Ø Instructional video material for demonstration of skills, training

methods and mobile learning technology solutions. Ø Quality project plan. Ø Guided questioning strategies were developed. Ø User requirement specification report. Ø Draft of peer learning assessment methodology report. Ø Online PELE with a user interface and back end. Ø Project web-site for dissemination of project results. Ø Leaflet and poster for dissemination of project results. Ø Scientific articles that have been published in conference

proceedings. Ø Arranged two project meetings, and regular Skype meetings for

development of services. Ø Completed partner agreements with all partners. Ø Student creativity is fostered through immediate elaborative

feedback Ø It is expected that PELE has the potential to support groups at risk

of dropping out of studies, and to stimulate them to participate more actively in education and training.

Ø A fast to use type learning tool has developed. Ø The international e-learning community (universities, VET training

bodies, and industrial training companies) has drawn their attention towards the Done-IT project, and the new assessment methods.

Contribution to EU policies