a database for storing and retrieving classified and benchmarked exam questions for ict courses

13
A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for ICT Courses Repository of Wisdom ALTA Forum May 9 th , 2014 James Harland [email protected] Joint work with Margaret Hamilton, Daryl D’Souza, Raymond Lister (UTS), Ali Reza (UTS), Donna Teague (QUT)

Upload: marc

Post on 24-Feb-2016

54 views

Category:

Documents


0 download

DESCRIPTION

James Harland [email protected] Joint work with Margaret Hamilton, Daryl D’Souza, Raymond Lister ( UTS ), Ali Reza ( UTS ), Donna Teague ( QUT ). A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for ICT Courses. James Harland [email protected] - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

A Database for Storing and Retrieving Classified and

Benchmarked Exam Questions for ICT Courses

Repository of Wisdom ALTA Forum May 9th, 2014

James Harland [email protected]

Joint work with Margaret Hamilton, Daryl D’Souza,

Raymond Lister (UTS), Ali Reza (UTS), Donna Teague (QUT)

Page 2: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

A Database for Storing and Retrieving Classified and

Benchmarked Exam Questions for ICT Courses

Repository of Wisdom ALTA Forum May 9th, 2014

James Harland [email protected]

Joint work with Margaret Hamilton, Daryl D’Souza,

Raymond Lister (UTS), Ali Reza (UTS), Donna Teague (QUT)

Repository of Wisdom

Page 3: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

But First …

Repository of Wisdom ALTA Forum May 9th, 2014

Page 4: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

What?

Repository of Wisdom

Database of exam questions for introductory programming

Hosted on NECTAR Research Cloud (!!) Classification based on BABELnot project

framework for questions Syllabus specification based on ProGoSs Developing front-end with comments and ratings

features Ready by 30th June

ALTA Forum May 9th, 2014

Page 5: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Question Attributes

Repository of Wisdom ALTA Forum May 9th, 2014

Programming Language

Topic

Style Course level

Marks Skill Required

Open/closed Difficulty

Explicitness Linguistic Complexity

Conceptual Complexity

Intellectual Complexity

Code Length External domain references

Page 6: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Question Attributes

Repository of Wisdom ALTA Forum May 9th, 2014

Topic Up to three from a given listStyle multiple choice, short answer, program code, Parsons

problem, graphical representationSkill Required

knowledge recall, trace code, explain code, write code, modify code, debug code, design program, test program

Open/closed Closed if exactly one answer. Open otherwiseIntellectual knowledge, comprehension, application, analysis,

evaluation, synthesis (Bloom levels)Conceptual Low, medium, high (depending on rules about

concepts)Code Length Low, medium, high External Low, medium, high Linguistic Low, medium, high Explicitness High, medium, lowDifficulty Low, medium, high

Page 7: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Question Attributes

Repository of Wisdom ALTA Forum May 9th, 2014

Question itself is in PDF or similar

Answers and Marking Guide (optional)

Performance data (optional) Often anonymised Variable level of detail Can have several per question

Comments and ratings (1-5 stars)

Page 8: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Front page

Repository of Wisdom

Content …

ALTA Forum May 9th , 2014

Page 9: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Heading

Repository of Wisdom

Content …

ALTA Forum May 9th , 2014

Page 10: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Heading

Repository of Wisdom

Content …

ALTA Forum May 9th , 2014

Page 11: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Heading

Repository of Wisdom

Content …

ALTA Forum May 9th , 2014

Page 12: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Heading

Repository of Wisdom

Content …

ALTA Forum May 9th , 2014

Page 13: A Database for Storing and Retrieving Classified and Benchmarked Exam Questions for  ICT  Courses

Conclusion

Repository of Wisdom

Try it here Comments and Ratings are relatively new Will also be adding keyword search (soon!) Due for completion by 30th June Aim is to enable, not prescribe “Build it (IT?) and they will come … “ Comments and feedback most welcome

ALTA Forum May 9th , 2014

QUESTIONS?