item course (2)

OBJECTIVE ITEM BUILDING

( MCQ)

He who dares to teach must never cease to learn. - Richard Henry Dann

BEING AN ITEM BUILDERShould be able to apply

the principles of item building.

Should be creative.

Should possess excellent

communication skills.

►One needs to understand the aims One needs to understand the aims and objectives of the subject based and objectives of the subject based on the syllabus.on the syllabus.

►One needs to know the educational One needs to know the educational and psychological background of the and psychological background of the individuals or target students who are individuals or target students who are being assessed.being assessed.

►One needs to know WHAT to assess One needs to know WHAT to assess and the objectives of the assessment.and the objectives of the assessment.

►One needs to be an expert in the One needs to be an expert in the subject to assess.subject to assess.

OBJECTIVE ITEM

StimulusStem

Distractors

Options

Key

Statement that is informative in Statement that is informative in nature which triggers response nature which triggers response from students to an item. The from students to an item. The tasks can be in the form of open-tasks can be in the form of open-ended / close-ended questions, ended / close-ended questions, text completion or in other text completion or in other dimensions.dimensions.

Stem

An information in the form of a An information in the form of a text or graphic that is focused to text or graphic that is focused to the task and is authenticthe task and is authentic..

Stimulus

A list of possible answers in the A list of possible answers in the form of words, numerical clues, form of words, numerical clues, symbols, phrases, pictures, symbols, phrases, pictures, timetables, graphs and other timetables, graphs and other communicable forms.communicable forms.

Options

The correct answer or the best The correct answer or the best answer.answer.

Key

Options that are not the key.Options that are not the key.

Misconceptions that do not Misconceptions that do not answer the task.answer the task.

They are able to attract the They are able to attract the students who are ill-prepared.students who are ill-prepared.

Distractors are…

Example: Negative stemExample: Negative stem

Which of the following living Which of the following living things is not found in the poem things is not found in the poem “ The Lake Isle of Innisfree”?“ The Lake Isle of Innisfree”?

A.A. AntsAntsB.B. BeesBeesC.C. CricketsCricketsD.D. linnetslinnets

GUIDELINES FOR OBJECTIVE ITEM BUILDING

Overall of theitem Key

Options

Stem

Stimulus Distractors

A. OVERALL OF THE ITEMA. OVERALL OF THE ITEM1.1. Formulated based on the Formulated based on the

specification table that is specification table that is accurate in terms of:accurate in terms of:

ConstructConstruct TopicsTopics Level of DifficultyLevel of Difficulty Item typeItem type Item ClassificationItem Classification

22..To assess what is in the syllabus To assess what is in the syllabus and curriculum specification and curriculum specification ( Sukatan Mata Pelajaran ) & ( Sukatan Mata Pelajaran ) & Huraian Sukatan Mata Pelajaran.Huraian Sukatan Mata Pelajaran.

3. All the students have been 3. All the students have been given ample opportunity to learn given ample opportunity to learn the items that to be assessed the items that to be assessed ( as the items are based on the ( as the items are based on the respective syllabi / curriculum respective syllabi / curriculum specifications ). specifications ).

44. . Assess only the important aspects Assess only the important aspects contained in the HSP.contained in the HSP.

5. Be fair to all the students in terms 5. Be fair to all the students in terms of:of:

Not being biased to any groups.Not being biased to any groups. Low readability and Low readability and

appropriatenessappropriateness Lessen the time taken to read the Lessen the time taken to read the

itemitem Not meant to trick the studentsNot meant to trick the students

6.Use accurate terminology that is 6.Use accurate terminology that is being used in the curriculum.being used in the curriculum.

7. Focus on one task or problem.7. Focus on one task or problem.

B. STIMULUSB. STIMULUS1.1. RelevantRelevant

2. Stated in the most effective 2. Stated in the most effective modemode

3. Authentic Information3. Authentic Information

How did she go to the bookshop?

A. CarB. MotorcycleC. BusD. Bicycle

Relevance of Stimulus

She went to the bookshop and bought a book

C. STEMC. STEM1.1. The task is stated clearly, accurately The task is stated clearly, accurately

and briefly, is not verbose.and briefly, is not verbose.

2. Not lifted directly from text books or 2. Not lifted directly from text books or reference books.reference books.

3. No clues given to the key such as 3. No clues given to the key such as word association or open clues.word association or open clues.

4. Avoid negative stems. If at all 4. Avoid negative stems. If at all necessary bold or italic the necessary bold or italic the negative word.negative word.

5. Avoid opinion items.5. Avoid opinion items.

6. The main idea should be in the 6. The main idea should be in the stem and not in the stimulus or stem and not in the stimulus or the distractors.the distractors.

She went to a stationery shop and ……..

A. bought a bagB. bought a bookC. bought a pencilD. bought an eraser

Poor : An incomplete and unclear stem

She went to the stationery shop and bought a / an ……….

A. bagB. bookC. pencilD. eraser

Better : A complete and clear stem

Looking at the advancement in the field of communication and technology, a few rapid developments have been achieved. Reflecting on the great contribution of the contributors, which item did Alexander Graham Bell made?

A. ShipB. CarC. TelephoneD. Bridge

Poor : Verbosity

Which of the following was invented by Alexander Graham Bell?

A. Ship B. CarC. TelephoneD. Bridge

Better : A compact stem with clarity

D. OPTIONSD. OPTIONS1.1. All options must stand on its own.All options must stand on its own.

2.2. Avoid options that are ambiguous Avoid options that are ambiguous and have the same meaning.and have the same meaning.

3.3. All options must be homogenous.All options must be homogenous.

4.4. Avoid repeating the same words in all Avoid repeating the same words in all the options.the options.

5. Avoid negative options.5. Avoid negative options.6. Options must be in its correct 6. Options must be in its correct

grammatical form based on the grammatical form based on the item that is asked in line with the item that is asked in line with the task.task.

7. Arrange the options in a logical 7. Arrange the options in a logical sequence:sequence:

Numerical orderNumerical order Chronological orderChronological order Options of the same kind or in pairs Options of the same kind or in pairs Arrange the alphabets clockwise;Arrange the alphabets clockwise; from top to bottomfrom top to bottom

8. Use the correct choice of options that 8. Use the correct choice of options that are relevant and appropriate to are relevant and appropriate to minimize the chances of the students minimize the chances of the students doing the doing the

“ “ guessing game “ at random.guessing game “ at random.

9. Avoid using non-specific words like 9. Avoid using non-specific words like “always”, “very”, “about” etc.“always”, “very”, “about” etc.

10. In complex MCQ questions, avoid 10. In complex MCQ questions, avoid using only one answer for every options.using only one answer for every options.

11.Avoid using phrases like “All of the 11.Avoid using phrases like “All of the above”, “No correct answers” or “ Not above”, “No correct answers” or “ Not certain”. certain”.

What is the population in Malaysia?

A. Exceeding 10 millionB. Exceeding 12 millionC. Exceeding 14 millionD. Exceeding 17 million

Weak : Overlapping Choice

What is the Malaysian population?

A. 10 millionB. 13 millionC. 17 millionD. 25 million

Better Option : Stand-alone key

Which statement suggests that more efforts need to be taken to reduce pollution?

A. Pollution is now becoming more and more evident.

B. Pollution is now becoming more and more popular.

C. Pollution is now becoming more and more tolerable.

Weak: Using repeated words in the choice of answers

More efforts need to be taken to reduce pollution because it is more

A. evidentB. popularC. tolerable

Better Option: The words are not repeated in the answer choice

Choose the correct sentences given below.I He came and asked for his pen.II They are listening to the news.III She always speaks of his success.IV I do not wish for any fame.

A. B.C.D

Weak : Every choice of option contains the same answer

I and III and IVI,II and IIII,II,III and IV

The Romanised NumberOne appears in all the answer options.

Choose the correct sentences given below.I He came and asked for his pen.II They are listening to the news.III She always speaks of his success.IV I do not wish for any fame.

A. B.C.D

Better Option: No suggested answers that are the same in all the options

I and IIIII and IVII and IIII and IV

Varied options

The body temperature of a healthy man is

A. 98.0o FB. 98.4o FC. 99.0o FD. 99.4o F

All the answers are considered to be correct

E. KEY ( ANSWER)1. Accurate and the most appropriate

and is not ambiguous.

2. Homogenous to the other options and does not stand out as the obvious answer ( E.g always long or is followed with an explanation ).

Grades or marks can be conceptualized as

A. The level of student’s achievement.B. The level of student’s knowledge index.C. The measurement of student’s

achievement.D. The measurement of student’s achievement

based on a certain technique.

Weak : The length of the options are unequal

Which of the following is the cause of heart attack?

A. High cholesterolB. Excessive smoking C. HypertensionD. Eating too much protein

Weak : More than one answer keys

Which ministry is responsible towards the environment?

A. Ministry of LabourB. Ministry of AgricultureC. Ministry of Science and Environment D. Ministry of Culture and Tourism

Weak : The clue found in the stem appears in the options.

Which of the following ministry is responsible towards excessive logging?

A. Ministry of Labour B. Ministry of Agriculture C. Ministry of Science and Environment D. Ministry of Culture and Tourism

Better option : No clues found in the stem and options as clues to the key ( answer)

E. DISTRACTORS1. Use distractors with these criteria:

Logical Not isolated Common misconception ( possible to

attract the misinformed or inadequately prepared students)

Possible correct answers ( familiar) but not the most appropriate.

2. Avoid illogical distractors.

3. A true statement but does not satisfy the requirements of the problem.

4. Avoid using colloquial statements.

The national flower of Malaysia is the

A. hibiscusB. bananaC. frangipaniD. bougainvillea

Weak : Choice of options that are not homogenous

The national flower of Malaysia is the

A. hibiscusB. roseC. frangipaniD. bougainvillea

Better option : Homogenous options

I cannot teach

anybody anything, I can only make them

think ----

SOCRATES