10 Pitfalls of Digital Testing

Digital Testing with Maple T.A.

Metha Kamminga

Formative testing

• Assisting the educating process• Guiding through the curriculum• Route to competency test• In any sector of education

Pitfall 1

• “The entry test”• Discouraging• Entry track• Concluded by an end test• Analyzing on student level

Pitfall 2

• “Extensive practising tests”• Short test in the form of a “ladder”

(15-20 minutes)• Bar the student if it is insufficient• Randomization and feedback

possibilities• Numbering the short tests

Pitfall 3

• “Offering unlimited number of attempts”

• The magical number 4• The “turning point of frustration”• Students will handle the system

better with only 4 attempts

Pitfall 4

• “A six is a pass”• Minimum score of 80%• No more skipping difficult questions• Less guesswork• A rock-solid morale booster!

Pitfall 5

• Omitting to analyze the test results• Analyzing at item level• Relatively too difficult? • Fit into the stream line?• Language used too unfamiliar?• “Language test”

Pitfall 6

• Non-obligatory participation• Firm hand• Practice track obligatory• Differentiation as regard level and

steepness of learning curve• Three tracks would be sufficient

Differentiating as regard steepness of learning curve

Entry ticket for the final test

Pitfall 7

• Bonus points• Not give out any bonus point at all• Risk of fraudulent behaviour• “Entry ticket” for the end test• Number of passing the end test is

90%

Pitfall 8

• Setting time limits for tests• Time limits ideal for digital end tests• No time limits for practicing tests• Prevend frustration• Possibility to stop halfway down the

test

Pitfall 9

• Communication• Digital learning environment• Checking exercise books• Monitoring progress• Communication at regular intervals• No emails!!!

Pitfall 10

• Omitting to supervise handling of the testing system (teachers and students)

• At the start of the course, extra effort in supervising

• Not only students but also teachers and assistents and graders supervising

• Training for itembuilders

Why students fail the end test?

• Possible diagnoses:• No good look at the feed back• No critical eye on mistakes made• Not reading the question properly• Drafting the exercises• The wrong track• “Too much help” while making the exercises• …….

The End

• Questions?

• http://www.methakamminga.nl