Electronic Portfolio Pilots Report-back Workshop –

Introduction and Overview

Peter Chalk

Undergraduate Centre TB2

Monday 26 November 2007

Schedule of presentations BEL2-10

• 11.30 Introduction and overview report – Peter Chalk• 11.45 Tom Lunt – Masters Degree in Events/Leisure• 12.00 Heather Wanstall and Steve Marshall – A

lecturer’s and a student’s view of BSc Dietetics HEO• 12.15 Mehryar Adibpour – Mathematics level I

employability module• 12.30 Dafna Hardbattle – CCTM project students• 12.45   Rosemary Stott – Film Studies HEO module

1.00 David Blundell – DOED Foundation Degree1.15-1.30 Discussion

(Apologies: S Atchia, J Lance, M Kendall)

Context – PDP Framework

• 3 core modules (HEO/Emp/Proj) – all represented here (plus M level) c. 500 students, 5 departments

• PDP related assessment – some pilots used WebLearn Portfolio for this

• Opportunities to reflect on feedback and progress, choice of modules and results

• Showcase of achievements & evidence

WebLearn Portfolio features to evaluate

• Environment to support the PDP Framework & integration with modules

• Set of (generic) tools to support reflective praxis: blog, home page binders, CV, guest access & views

• Set of specific resources to support Portfolio environment & tools, PDP framework – the template

Methods of evaluation

• Questionnaire

• Observation during lab introductions

• Email feedback

• Guest views of example Portfolios

• Discussions with module staff

Q’naire sections

1/2

Eportfolio Pilots Questionnaire AVERAGESNov 07 N=5 (1 staff)

Section 1

A been introduced to the WebLearn Portfolio?

0.8

B used the WebLearn Portfolio? 0.8C become aware of the WebLearn portfolio

in other ways?0.4

(yes = 1, no=0 in A-C and section 2 below)

Section 2

A added any guests to your WebLearn Portfolio?

0.5

B uploaded any files to your WebLearn Portfolio?

1.0

C posted a comment to a reflections topic (blog) in your Portfolio?

0.5

D used the CV tool? 0.3E adapted the presentation of your Portfolio

home page?0.5

Q’naire section 3 a-k

Section 3 (scored on an opinion scale of -2 negative to +2 positive)

A learning about online Portfolios? 1.3B controlling what can be seen by your

guests?1.8

C displaying your achievements (products, CV etc)?

1.0

D reflecting on your progress? 1.5E communicating? 1.3F Presentation (eg the home page)? 1.3G the initial template (the files, binders and

resources provided by us)?1.5

H helping to learn about your subject? 1.0I developing your graduate attribute A1 self-

awareness?1.0

J developing your graduate attribute A2 subject awareness?

0.8

K developing your graduate attribute A3 creativity?

0.8

Questionnaire section 3 l-sL developing your CV? 1.0

M helping you plan your career? 0.7

N helping you choose modules or plan your next academic steps?

1.0

O doing assessment for the module? 0.8P reflecting on your learning of the subject? 0.8

Q developing your employability? 0.3

In addition, what is your overall opinion of:

R Electronic Portfolios in general? 1.3S The WebLearn Portfolio in particular? 1.0

Questionnaire text commentsNotes (n)

(1)I wasn’t able to attend for the weblearn portfolio lecture. All responses 0 ms1h01

(2) mor020@londonmet.ac.uk Mohamed Rachi cs3p22

(3)

I did not answer to some of the question because still I have not use those section (developing CV). lt1h02? Sssm

(4)

It’s a little difficult to learn how to add or modify your portfolio. It took me some time to learn that but now I know how to do it. bm1h01nBut I have many friends who haven't even touched their webportfolio because they couldn't understand how to do it and didn't have the time to learn it all.

Questionnaire summary• Sample far too small – only 3 students with a

full return• Note comment “I have many friends who

haven't even touched their webportfolio because they couldn't understand how to do it and didn't have the time to learn it all.”

• Most positive scores: b guest, d reflect, g template, a learn epdp, e comms, f home page, g epdp

• Tools used: file upload, blog, guest, home page

Late addition – OR

Employability Module

Questionnaire returns (on

paper in module, N=16+)

Eportfolio Pilots Questionnaire AVERAGES

Nov 07N=16 (all level I OR emp mod on math BSc, FD, HND - M Adibpour))

Section 1

A been introduced to the WebLearn Portfolio?

1.0

B used the WebLearn Portfolio? 1.0C become aware of the WebLearn

portfolio in other ways?0.5

(yes = 1, no=0 in A-C and section 2 below)

Section 2

A added any guests to your WebLearn Portfolio?

0.9

B uploaded any files to your WebLearn Portfolio?

0.9

C posted a comment to a reflections topic (blog) in your Portfolio?

0.7

D used the CV tool? 0.4E adapted the presentation of your

Portfolio home page?0.7

Section 3 A-K

Section 3 (scored on an opinion scale of -2 negative to +2 positive)

A learning about online Portfolios? 0.5B controlling what can be seen by

your guests?1.0

C displaying your achievements (products, CV etc)?

1.0

D reflecting on your progress? 0.9E communicating? 0.7F Presentation (eg the home page)? 0.8G the initial template (the files, binders

and resources provided by us)?0.7

H helping to learn about your subject? 0.9

I developing your graduate attribute A1 self-awareness?

0.9

J developing your graduate attribute A2 subject awareness?

0.9

K developing your graduate attribute A3 creativity?

0.5

Section 3 L-

S

L developing your CV? 1.1

M helping you plan your career? 1.1

N helping you choose modules or plan your next academic steps?

0.9

O doing assessment for the module? 0.8

P reflecting on your learning of the subject?

0.8

Q developing your employability? 1.1

In addition, what is your overall opinion of:

R Electronic Portfolios in general? 0.7S The WebLearn Portfolio in

particular?0.9

Text Commentswants all 3 years of modules in weblearn now

hard to upoad files, doesn't always workmuch better than webct (no discrimination in q'naire)debby berry, c evans ok to interview but q'naire perfect 2'smy second course is not included (accounting joint)doesn't always work, difficult to usefind it a struggle with computers

Maths Employability Conclusions?

• Their results are generally lower than the 4 earlier students who replied by email (who are presumably the keenest and ablest etc).

• But they show positive opinion of guest/ display/ CV/ career/ employability (interesting as they are on an employability module).

• But they report low use of the CV tool.• Note two students with perfect 2 scores

throughout not counted in. Correct decision?

Another late questionnaire (Dietetics)

• Rated level 2 for guest control, display, employability, ePortfolios in general.

• “The e-portfolio has the potential to become a valuable resource in the future and is a great way of sharing work securely and organising & clearly identifying goals and achievements. However, it is awkward to use and not as easily customisable as is indicated in the tutorial.”

• Respondent created own site plus blog for his course.

Observation, email feedback & discussion

• CCTM at city campus:– Technical problems with JRE, specific PCs

only– Course team meetings to discuss “the PAA

role/ the PDP/ the outcome of all this which is the graduation statement./ ePortfolios”

• HHS/DOED/HAL lab introductions

• General enthusiasm, eager to experiment

Student emailed comments

• “I am using reflections tool… will be useful” (lt1h02)

• “I use blog, not CV as I use my own version, I don’t like layout, message centre not working from home” (lt1h02)

• “It is useful and helpful… at this time everything is OK”

Example screen shots – presentation (icons)

Background; additional web site

Adding a goal (learning objective)

“What I want to achieve after University

I want to start working as a junior Dietician in a hospital setting as soon as anyone will let me. I would like to gain experience in as many different areas as I can in my first employment to help me build my portfolio. I am particularly interested in Gastroenterology and allergy due to personal experience and I feel my enthusiasm and passion will be of most use in these areas.

BSc Computing Project Student – goals/calendar

Research Skills

Improve research skills. This includes improving referencing and citations as well as broadening my research methods and sources.

Time Management

Improving personal management. Placing more focus on end results and create proper plans to aid in managing resources therefore time.

Self reflection (file on home page)I set up few aims in my personal development on what to achieve at university. Most importantly to acquire more self-confidence. As a foreign student I am not confident with my speaking skills. I hope to broaden my horizons in film studies. The fact that I adore films is not enough for studying film at University. I would like to go deeper into problematic of film study and to learn the subject that I am interested in on higher level.

What do I consider to be my strengths as a student? That is a good question. To be honest, after going through all the questions from the paper you gave us last week I considered that I am definitely not able to answer all of them. And here I am coming back to my self-confidence. Coming from post communistic background, my country ‘s school system never put too much emphasis on one individual.That`s why it is not easy for me to talk about my strengths and weaknesses. It is based more on the drilling than on thinking about the subject.

I am very happy that I decided to go to university in foreign country. As it will give me much more than specific knowledge of the subject and it will broaden my views in many other aspects.

Achievement showcase (FDA)

Reflective Blog (M Level)

Starting from a blank home page

Conclusions?

• Too early to say?• Potential?• Good progress in parts by some?• Integration with WebLearn helped ease of

use?• More training, support & guidance needed• PDP framework supported, needs

amending?