E-ATP 2011 Prague Bert Wylin - b.wylin@televic.com

E-assessment, W-assessment, M-assessment, T-assessment E-assessment on computers, mobile devices and tablets

Overview

References – use cases

France France UK Belgium

Belgium Belgium Belgium France

Kenya UK Belgium Belgium

E-Assessment

…triggered by

Customer’s needs

more assessment than ever

more tracking and logging than ever

more flexibility asked than ever

more technological means/devices than ever…

Technology evolutions

allowing for previously impossible innovative approaches wifi, mobile, tablets, cloud computing, bandwidth available, multimedia options (webcam, audio recording…), trackpads, touchpads, data warehousing, webservices, multiplatform, standards, tagging, social networks,…

Trends in eAssessment

…solutions in eAssessment

1. SSO or webservices based user management

2. Webservices based results exchange

3. Tag based structuring and filtering create test scenarios based on metadata

4. High performance correction algorithms open questions

5. Full multimedia playing and recording authentic question types and materials

6. Mobility, wireless and new devices

7. Scalability

New User Management • Manually

• By group import with Excel sheets

• By SSO – Single Sign On Webservices that connect existing systems People only have to login once (SSO!) Deeplinking as an interesting feature

Metadata Tagging

• Tree structured

• Branches

• Metadata

• Tagging

• Linking

Open questions

Law case studies

• “Open question” question type

• Based on keywords recognition (including sophisticated scoring)

• Scoring suggestion by the system and/or human correction/editing

• Now also with ASR and TTS (FR, EN, NL)

Voice recording

(and face recording)

• Developed a “Recording” question type

• No installation

• Saved and scored (suggestion) by the system and/or human correction/editing

• Excellent for interpreter training

Smartphones and tablets

• Mobile web version

• Always online (!)

• “Touch” limitations

• 6 question types

Smartphones and tablets

• App version

• Android and iOS (free or paid)

• Connect, download, work

• In-app (purchase of) modules

• Upload/Synchronize results

Test room security

AvidaNet classroom control software

Block

applicati

ons

Block

internet

acces

Block

USB

ports

Scalability

• Decentralized assessments or exam

• Huge groups (> 1000 people)

• Cloud computing

• Switching on/off servers (energy saving)

• For extra capacity and reliability

• Pay what you use/need

• Synchronize between the local and the cloud system

Reporting Services

• Huge tracking and logging database

• Very difficult to produce “generic” reports that satisfy all customers

• Very specific combinations of data in many different views

• Reporting Web Services

• “Harvesting”: customer can harvest in our database