Factors affecting the adoption of e-assessment in School of Engineering

by

Z.G.BaleniContinuous Professional Development Unit

CLTD, WSU

04/21/23 1

Introduction• E assessment part of WSU e learning

strategy• Objective 3 & 4 in particular

– Capacitate academic staff on e learning ( Professional Development)

– Student participation in e learning

04/21/23 2

Cont….

• Much effort goes into developing the technology

for an efficient and easy to use electronic

assessment system, BUT• Successful implementation depends as

much, or even more, on understanding campus culture and using appropriate change strategies

04/21/23 3

What’s e assessment?

• E-assessment - electronic assessment i.e. processes involving the implementation of Information ICT for the recording, transmission, presentation and processing of assessment material

• Types – Quizzes, discussion forums, group-work, e portfolio etc.

• Used for formative & summative assessment

04/21/23 4

Adoption of e assessment system

• Two theories used to explore adoption of an e-assessment system,– Rogers’(2003) Diffusion of Innovations

and– Eckel and Kezar’s (2003) Mobile Model

for

Transformational Change

04/21/23 5

Roger’s Theory

• 5 attributes explain 49–87% of the variance in the rate of adoption of

innovations: • relative advantage, • compatibility, • trialability, • observability and• complexity.04/21/23 6

Cont….

• Relative advantage - degree to which an innovation is viewed as better than the idea it supersedes.

• Compatibility - degree to which the innovation is seen ‘as consistent with the existing values, past experiences and needs of potential adopters’

04/21/23 7

Cont..

• Complexity- degree to which an innovation is viewed as difficult to understand and use

• Trialability -degree to which an innovation can be experimented with on a limited basis.

• Observability - degree to which results of an innovation can be seen by potential adopters

04/21/23 8

Eckel and Kezar’s Mobile Model for Transformational

Change5 core strategies that explain change across the institutions:•senior administrative support (show value, provide resources and add new administrative structures); • collaborative leadership; •flexible vision (clear and desirable picture of the future that does not foreclose opportunities); 04/21/23 9

Cont….

• staff development ; and • visible actions.

04/21/23 10

PURPOSE•This study was conducted to identify the factors that would enhance adoption of e-assessment systems and foster sustainment on university campuses.

04/21/23 11

Approach• Population - 2009 SoE trained leaders• Questionnaire e mailed• Out of 35, 12 responded • SPSS used to analyse data

04/21/23 12

FINDINGS

04/21/23 13

Relative advantage

14

Has e-assessment affected your students’ performance?

Yes Not Sure No

55% 20% 25%

04/21/23 15

Response Percentage

Improved their performance  26%

Able to understand some concepts better  29%

Early days  20%

Cont…

04/21/23 16

Cont……

04/21/23 17

Cont…

04/21/23 18

Compatibility

04/21/23 19

Trialability

04/21/23 20

Observability

04/21/23 21

Complexity

04/21/23 22

Lack of support from top management

 

Frequency Percent       

yes 4 33.3

no 8 66.7

Total 12 100.0

04/21/23 23

Current state of computers in our offices is not good

 

Frequency Percent     

yes 6 50.0

no 6 50.0

Total 12 100.0

04/21/23 24

Staff Development

Were you trained in e-assessment?

 

Frequency

Percent

Yes 8 66.7

No 4 33.3

Total 12 100.0

04/21/23 25

Conclusion• CLTD on track with its e learning strategy• Staff development impacting on staff• E assessment - Very useful for Formative

assessment• Bull & Danson (2004) say it is not a panacea for rising

student numbers and marking overload though if used appropriately, it can clearly relieve some of these pressures.

• If used formatively to provide detailed and timely feedback, it can support and enhance student learning in ways which are not possible with paper-based assessments.

04/21/23 26

Recommendations

• Integrate e - assessment into WSU assessment policies and practices

04/21/23 27

CLTD to promote it, incentivise its use

Improve WiseUp technology

Lecturers made aware of this feature

More computers and internet access

More training to both students and staff

Networking being reliable

Obtain word recognition software to assist in essay marking

To make sure that is always reliable

THANK YOU !!

04/21/23 28