1

Question Pool

Definition:

• A centralized repository where questions are stored.

• Use same question on multiple tests (only 1 actual instance of question).

• Question pool manager/administrator sets privileges to question pools; can give people manager privileges.

• 2 ways to access question pool: while creating an assessment; independent of creating an assessment

Goals:

• Save time in creating questions/assessments.

• Have access to ready-made questions that can be reused, repurposed.

• Have usage data on questions that describe reliability/validity

Notes:

• question pool is “associated” with a course, instructor, dept., ad hoc group

2

Question Pool

Preliminary Actions: • create/copy/modify/delete pool/subpool

• make pool/subpool public, share w/ specific groups, private

• add/remove questions to pool/subpool (questions can be in multiple pools)

• move/copy question from one pool/subpool to another (need to look at rules that would have to be set up if questions being moved is used on ongoing or upcoming test, esp. as it relates to random selection)

• search for question pool/subpool, questions (by author, date, usage, objectives, other metaData)

• browse questions in question pool (note: look at Socrates model)

• upload/download question pool/subpool, and questions (QTI compliant)

• preview a question

3

Question Pool

Preliminary Actions: • edit a question (all tests will reflect edited question)

• edit a question and change correct answer (all taken tests will automatically be regraded to reflect new correct answer)

• view % of students who answered questions in pool correctly (effectiveness -discrimination)

• view usage stats of questions in question pool (when, which class/instructor, “effectiveness” (should think about assessment tracking and history discussion)

Note: students and teachers need to be notified of any modifications to questions used in take tests.“Lock” questions so can’t edit during testing period

4

Metadata:•Question Pool Name

•Author/Creator

•Date

•Learning Objective

•Keyword

•Links (URL to specific materials)

•Intellectual Property

•Type (? Not sure what this would entail but Charles thought it might be good to have a placeholder)

Question Pool