Transcript
Page 1: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

1

Online AssessmentExperiences from the Trenches

Lance Cpl. Dwight A. Henderson, 2nd Marine Div ~ 17/7/2009http://www.marines.mil/unit/iimef/PublishingImages/090717-M-9915H-006.jpg

Presented by:Ross Kirk (in person)

Lynda Thater (in spirit)

Endeavour Online Learninghttp://endeavour.edu.au/online-learning

Page 2: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

Background

o At Endeavour College of Natural Health we have developed over 50 online subjects at Advanced Diploma and Bachelor level. • Biosciences (Chemistry, Anatomy and Physiology), • Complementary Therapies (Naturopathy, Nutritional Medicine,

Counselling, and Herbal Medicine ) • Business oriented subjects.

o Each subject has from 3-5 pieces of assessment as part of its curriculum.

2

Page 3: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

3

Why “from the trenches”?

o We are still very much ‘in the thick of it’ working on subject development and improving current subjects – about 50% of subjects developed for online

o Regular changes and updates to meet staff and student requirements

o Experimenting with different assessment ideas in new subjects

o Introducing a blended f2f + online model very shortly – will require more innovation

Page 4: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

What types of assessment?

o Advanced assignment uploadso Forumso Wikiso Online Text Submissiono Online Quizzes and Exams

4

Page 5: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

How we offer subjects

o Most subjects are offered monthly1. develop the subject

2. put it online and enroll students

3. the next month, backup/restore subject from the current template

o LMS Administrator sets up the subjectso Tutors are assigned to each monthly cohorto All the subject materials are already there

5

Page 6: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

#1 Online Forums

o For most subjects we have preset topics for the students to answer

o They are case study, reflection or application type questions – open ended.

6

Page 7: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

#1 Online Forums conto Student’s point of view

• Advantages – they can see what the topic is, and go and research. It help develops relationships in the cohort. Some students who might be shy in a face-to-face situation, like being able to post to the website.

• Disadvantages – someone else might get a similar answer to theirs, need to read the other student’s posts can get time consuming

o LMS administrator point of view• Having preset topics, means restoring them each month. Can

be time consuming – so we have started to use the single-topic style of forum – that way it is restored from the backup

• The other problem with backup/restore was the posting dates

7

Page 8: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

#1 Online Forums cont.

o Teacher’s point of view• Advantages – ease of online marking, only have to post a certain

comment once – because everyone in the class can read it.• Disadvantages – if the item is assessable, tutors will want to give

feedback to each and every student’s postings – this can be time consuming, and can create lots of emails going to everyone.

Also, if the student posts incorrect information, the tutor has to make the correction and make sure everyone in the class knows. Students can post anytime so they start to expect the tutor to be online everyday.

8

Page 9: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

#2 Online Text Submission

o Because of some of the problems with the online forums, we started implementing online text submissions for some subjects.

o Some subjects had topics that were more matter-of-fact, not really discussion topics, more assignment-like.

9

Page 10: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

#2 Online Text Cont.o Advantages:

• Simple for the students to complete• Better privacy – only the student can see their own posting• Students don’t receive copies of each forum posting, clogging up

their inboxes• Tutors but still have the ease of marking online

o Disadvantages:• Students can’t learn from other students because they can’t see

the other discussions or feedback• Confusion over due dates – The student can update their

submission as many times as they want before the tutor marks it – so, the tutor needs to make sure they don’t start marking until after the due date.

10

Page 11: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

#3 Online Quizzeso Implemented many types at EOL:

• MCQ, fill in the blank, essay, drag and drop matching, etc

o Try to reduce plagiarism / cheating by:• Exam / quiz design• Using case studies / applied knowledge (rather than stuff they

can google)• Limiting time (30, 60, 90 minutes)• Approaching online quizzes as

being “open book” – write questions

with the approach that students can

look things up

11

Page 12: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

#3 Online Quizzes conto Problems students’ have encountered:

• Students have to have the correct browser security settings • Electricity / internet outages• Browser hangs (eg if students have too many browser windows

open surfing for the answers)• Students forget to press the submit button or submit too early

o Solutions:• Reattempt quiz, have deferred quizzes setup, extra questions• Provide practice quizzes so students can make sure they have

the correct setup before attempting the ‘real’ quiz• Need a mechanism for students to contact help desk

12

Page 13: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

Setting up Quizzes

o Most subjects have test banks• Split a test into multiple categories• Then randomly select questions from each category• Example question bank

o Importing quiz questions• MCQ ones are easy – use Aiken format• Subject developers create quizzes in Word documents• Then MCQs are imported• Essay questions can be imported using XML

13

Page 14: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

14

Page 15: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

Setting up Quizzes cont.

o Use feedback option• Instead of the tutor having to write feedback for each student • E.g. sample answers are provided to the students when the quiz

results are released• Advantage is tutors spend less time typing similar feedback for

each student.

o Other ideas to broaden the test bank but minimise workload• Use the same questions, but apply them to different case studies • Can now use random essay type questions (initially only could

have random MCQs)

15

Page 16: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

Compare the different types?

16

Forums Online Text Quizzes

Student Interactive Too many emails Time-consuming &

time-outs on long posts

Easy to use Only get one-on-one

feedback

Quick feedback from auto-marked questions

Stress of taking an exam

Tutor/Marker

Interaction Too many emails,

copying

Easy to use Can’t share feedback

between students

Easy to mark online or auto-mark

Coordinating re-attempts, deferreds

Supervision(?)

Admin Std. forums with multiple pre-posts time-consuming to setup

Simple! set & forget Coordinating re-attempts, deferreds

Page 17: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

Track My Progress

o We use the progress bar block, developed by Michael de Raadt from USQ, to help students keep track of their progression through the assessment in each subject.

o It provides a constant reminder of assessment requirements and due dates and links directly to that assessment when the student is ready to submit.

o Due dates automatically populate from the Calendar.

17

Page 18: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

Any Questions?

18

Page 19: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

FOR MORE INFO ABOUT ENDEAVOUR ONLINE LEARNING…

19

…make sure you catch the presentation

Online Learning for the

Complementary Health Sector

by Grant Beevers, Director of Online Services

4pm today in Room 104!

Page 20: MoodleMootAU10 Online Assessment at Endeavour College of Natural Health

© Endeavour College of Natural Health endeavour.edu.au

20


Top Related