Classical Item andTest Analysis ReportUser Test 1Report created on 4/28/2015This report was produced by the demo version of Iteman 4.3, which is limited to 50 items and 50 examinees.Iteman: Software for Classical AnalysisCopyright 2013 - Assessment Systems CorporationIntroductionThis report provides the results of a classical item and test analysis by the computer program Iteman Version 4.3 (Assessment Systems Corporation, 2013) for User Test 1. The output is divided into three sections: 1. Specifications2. Summary statistics3. Item-by-item results.The statistical output is also recorded in a comma-separated value (CSV) file of the same name.SpecificationsThe Windows paths for the input files used in this analysis were:C:\Users\budy\Documents\evaluasi uas.txtThe Windows paths for the output files produced by this analysis were:C:\Users\budy\Documents\hasil iteman uas.rtfC:\Users\budy\Documents\hasil iteman uas.csvC:\Users\budy\Documents\hasil iteman uas Scores.csvTable 1 presents the specifications and basic information concerning the analysis. This provides important documentation of the setup of the program for historical purposes.Table 1: SpecificationsSpecificationValueSpecificationValueNumber of examinees12Total Items20Scored Items20Pretest Items0Multiple Choice Items20Polytomous Items0Number of domains1External scoresNoMinimum P0.00Maximum P1.00Minimum item mean0.00Maximum item mean15.00Minimum item correlation0.00Maximum item correlation1.00ITEMAN 3.0 HeaderYesExclude omits from option statisticsNoNumber of ID columns10ID begins in column1Responses begin in column11Omit character0Not Admin characterNProduce quantile tablesYesCorrect for spuriousnessYesProduce quantile plotsYesSave data matrixNoInclude omit codes in matrixN/AInclude Not Admin codes in matrixN/AInclude scaled scores forN/AScaling functionN/AScaled score setting 1N/AScaled score setting 2N/ADichotomous ClassificationNoClassify based onN/ACutpointN/ALow group labelLowHigh group labelHighData is delimited byN/ATest for DIFNoGroup status is in columnN/AAbility levels for DIFN/AGroup 1 codeN/AGroup 2 codeN/AGroup 1 labelN/AGroup 2 labelN/ASummary statisticsTable 2 presents the summary statistics of the test, for the scored items. Definitions of these statistics are found in the Iteman manual.Table 2: Summary statisticsScoreItemsMeanSDMin ScoreMax ScoreMean PMean RpbisScored Items2017.5830.79316190.879-0.006Table 3 presents a reliability analysis of the tests. Alpha (also known as KR-20) is the most commonly used index of reliability, and is therefore used to calculate the standard error of measurement (SEM) on the raw score scale. Also presented are three configurations of split-half reliability, first as uncorrected correlations, and then as Spearman-Brown (S-B) corrected correlations. This is because an uncorrected split-half correlation is referenced to a "test" that only contains half as many items as the full test, and therefore underestimates reliability.Table 3: ReliabilityScoreAlphaSEMSplit-Half (Random)Split-Half (First-Last)Split-Half (Odd-Even)S-B RandomS-B First-LastS-B Odd-EvenScored items-0.0520.813-0.155-0.092-0.092-0.367-0.203-0.203Table 4 presents the item statistics and flags for the item(s) that were flagged during the analysisTable 4: Summary Statistics for the Flagged ItemsItem IDP / Item MeanRFlag(s)40.917-0.141K, LR50.917-0.141K, LR80.1670.061K120.917-0.141K, LR150.833-0.423K, LRFigure 1 displays the distribution of the raw scores for the scored items across all domains.Table 5 displays the frequency distribution for total score shown in Figure 1.Figure 1: Total score for the scored itemsTable 5: Frequency Distribution for Total ScoreScoreFrequency161174186191Figure 2 displays the distribution of the P values for the dichotomously scored items (correct/incorrect).Table 6 displays the frequency distribution of the P values shown in Figure 2.Figure 2: P values for the scored itemsTable 6: Frequency Distribution for the P valuesScoreFrequency0.0 to 0.110.1 to 0.210.2 to 0.300.3 to 0.400.4 to 0.500.5 to 0.600.6 to 0.700.7 to 0.800.8 to 0.910.9 to 1.017Figure 3 displays the distribution of the Point-Biserial Correlations for the dichotomously scored items (correct/incorrect). Table 7 displays the frequency distribution of the Point-Biserial correlations shown in Figure 3.Figure 3: Rpbis for the scored itemsTable 7: Frequency Distribution for the RpbisScoreFrequency-0.5 to -0.41-0.4 to -0.30-0.3 to -0.20-0.2 to -0.13-0.1 to 0.000.0 to 0.110.1 to 0.200.2 to 0.300.3 to 0.420.4 to 0.500.5 to 0.600.6 to 0.700.7 to 0.800.8 to 0.900.9 to 1.00Figure 4 displays the scatterplot of P (difficulty) by Rpbis (discrimination) for the dichotomously scored items (correct/incorrect).Figure 4: P by RpbisFigure 5 displays a graph of the Conditional Standard Error of Measurement (CSEM) Formula IV.Figure 5: CSEMItem-by-item resultsThe following section presents the item-by-item results of the analysis. Each item has several tables and a figure. The figure, called a quantile plot, shows the proportion of examinees selecting each option, for consecutive segments of the examinees as ranked by score. The key thing to evaluate in this figure is that the line for the correct answer has a positive slope (goes up from left to right), which means that examinees with higher scores tend to answer correctly more often. Conversely, the lines for the incorrect options, called distractors, should have a negative slope. Note, however, that the use of a small number of groups (e.g., 3 or fewer) oversimplifies the graph, so that items which are very difficult or very easy (that is, discriminating in only the top or bottom 20% of examinees) might appear to have poor quantile plots and classical statistics. For such items, item response theory presents significant advantages in analysisThere are four tables presented for each item.1. Item information table: records the information supplied by the control file (or Iteman 3 header) for this item.2. Item statistics table: overall item statistics.3. Option statistics: detailed statistics for each item, which helps diagnose issues in items with poor statistics.4. Quantile plot data: the values used to create the quantile plot.The item statistics table presents overall item statistics in the first row of numbers. The two most important item-level statistics for dichotomously scored (correct/incorrect) items are the P value and the point-biserial correlation, which represent the difficulty and discrimination of the item, respectively. For polytomously scored (rating scale or partial credit) items, the difficulty is represented by the mean (average) item score, while the discrimination is represented by a Pearson r correlation.The P value is the proportion of examinees that answered an item in the keyed direction. P ranges from 0 to 1. A high value (0.95) means that an item is easy, a low value (0.25) means that the item is difficult. The point-biserial correlation (Rpbis) is a measure of the discriminating, or differentiating, power of the item. Rpbis ranges from -1 to 1. A negative Rpbis is indicative of a bad item as lower scoring examinees are more likely than higher scoring examinees to respond in the keyed direction.For rating scale or partial credit items, the mean item score ranges from the minimum to the maximum of the scale. For example, if the item has a rating scale of 1 to 5, the possible range for the mean is 1 to 5. The Pearson r is similar to the Rpbis in that it ranges from -1 to 1, with a positive r indicating that the item correlates well with total score.The option statistics table presents statistics for each individual option (alternative). The key thing to examine in this portion of the table is that no distractors have a higher Rpbis than the correct answer. That indicates that higher scoring examinees are selecting the incorrect answer, which therefore might be arguably correct.The quantile plot data table simply presents the values calculated to create the quantile plot. Because it contains the same information, the quantile plot itself presents a useful picture of the item's performance, but this table can be used to examine that performance in detail to help diagnose possible issues.Item informationSeq.IDKeyScoredNum OptionsDomainFlags11CYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC121.0000.0000.00017.5831.311Blue**KEY**D00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC121.0001.0000.0000.0001.000Blue**KEY**D00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags22DYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC00.000--------BlueD121.0000.0000.00017.5831.311Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD121.0001.0000.0000.0001.000Olive**KEY**Item informationSeq.IDKeyScoredNum OptionsDomainFlags33BYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB121.0000.0000.00017.5831.311Green**KEY**C00.000--------BlueD00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB121.0001.0000.0000.0001.000Green**KEY**C00.0000.0000.0000.0000.000BlueD00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags44DYes41K, LRItem statisticsNPTotal RpbisTotal RbisAlpha w/o120.917-0.141-0.2540.040Option statisticsOptionNProp.RpbisRbisMeanSDColorA10.0830.1410.25417.0000.000MaroonB00.000--------GreenC00.000--------BlueD110.917-0.141-0.25417.6361.325Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA10.0000.2500.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD111.0000.7500.0000.0001.000Olive**KEY**Item informationSeq.IDKeyScoredNum OptionsDomainFlags55AYes41K, LRItem statisticsNPTotal RpbisTotal RbisAlpha w/o120.917-0.141-0.2540.040Option statisticsOptionNProp.RpbisRbisMeanSDColorA110.917-0.141-0.25417.6361.325Maroon**KEY**B10.0830.1410.25417.0000.000GreenC00.000--------BlueD00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA111.0000.7500.0000.0001.000Maroon**KEY**B10.0000.2500.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags66CYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC121.0000.0000.00017.5831.311Blue**KEY**D00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC121.0001.0000.0000.0001.000Blue**KEY**D00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags77DYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o120.9170.3370.607-0.396Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC10.083-0.337-0.60716.0000.000BlueD110.9170.3370.60717.7271.232Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC11.0000.0000.0000.0000.000BlueD110.0001.0000.0000.0001.000Olive**KEY**Item informationSeq.IDKeyScoredNum OptionsDomainFlags88DYes41KItem statisticsNPTotal RpbisTotal RbisAlpha w/o120.1670.0610.091-0.174Option statisticsOptionNProp.RpbisRbisMeanSDColorA80.667-0.385-0.49917.2500.707MaroonB20.1670.4260.63518.0000.000GreenC00.000--------BlueD20.1670.0610.09118.5001.581Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA81.0001.0000.0000.0000.429MaroonB20.0000.0000.0000.0000.286GreenC00.0000.0000.0000.0000.000BlueD20.0000.0000.0000.0000.286Olive**KEY**Item informationSeq.IDKeyScoredNum OptionsDomainFlags99BYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB121.0000.0000.00017.5831.311Green**KEY**C00.000--------BlueD00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB121.0001.0000.0000.0001.000Green**KEY**C00.0000.0000.0000.0000.000BlueD00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags1010DYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC00.000--------BlueD121.0000.0000.00017.5831.311Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD121.0001.0000.0000.0001.000Olive**KEY**Item informationSeq.IDKeyScoredNum OptionsDomainFlags1111AYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA121.0000.0000.00017.5831.311Maroon**KEY**B00.000--------GreenC00.000--------BlueD00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA121.0001.0000.0000.0001.000Maroon**KEY**B00.0000.0000.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags1212CYes41K, LRItem statisticsNPTotal RpbisTotal RbisAlpha w/o120.917-0.141-0.2540.040Option statisticsOptionNProp.RpbisRbisMeanSDColorA10.0830.1410.25417.0000.000MaroonB00.000--------GreenC110.917-0.141-0.25417.6361.325Blue**KEY**D00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA10.0000.2500.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC111.0000.7500.0000.0001.000Blue**KEY**D00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags1313DYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC00.000--------BlueD121.0000.0000.00017.5831.311Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD121.0001.0000.0000.0001.000Olive**KEY**Item informationSeq.IDKeyScoredNum OptionsDomainFlags1414CYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o120.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA90.7500.4630.63117.7780.667MaroonB10.083-0.242-0.43617.0000.000GreenC00.000--------Blue**KEY**D20.167-0.359-0.53517.0001.414OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA90.0000.7500.0000.0000.857MaroonB10.0000.2500.0000.0000.000GreenC00.0000.0000.0000.0000.000Blue**KEY**D21.0000.0000.0000.0000.143OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags1515BYes41K, LRItem statisticsNPTotal RpbisTotal RbisAlpha w/o120.833-0.423-0.6300.323Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB100.833-0.423-0.63017.6001.350Green**KEY**C10.0830.0950.17117.0000.000BlueD10.0830.4750.85618.0000.000OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB101.0000.7500.0000.0000.857Green**KEY**C10.0000.2500.0000.0000.000BlueD10.0000.0000.0000.0000.143OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags1616CYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC121.0000.0000.00017.5831.311Blue**KEY**D00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC121.0001.0000.0000.0001.000Blue**KEY**D00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags1717DYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB00.000--------GreenC00.000--------BlueD121.0000.0000.00017.5831.311Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD121.0001.0000.0000.0001.000Olive**KEY**Item informationSeq.IDKeyScoredNum OptionsDomainFlags1818BYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB121.0000.0000.00017.5831.311Green**KEY**C00.000--------BlueD00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB121.0001.0000.0000.0001.000Green**KEY**C00.0000.0000.0000.0000.000BlueD00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags1919BYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o121.0000.0000.000-0.052Option statisticsOptionNProp.RpbisRbisMeanSDColorA00.000--------MaroonB121.0000.0000.00017.5831.311Green**KEY**C00.000--------BlueD00.000--------OliveOmit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA00.0000.0000.0000.0000.000MaroonB121.0001.0000.0000.0001.000Green**KEY**C00.0000.0000.0000.0000.000BlueD00.0000.0000.0000.0000.000OliveItem informationSeq.IDKeyScoredNum OptionsDomainFlags2020DYes41Item statisticsNPTotal RpbisTotal RbisAlpha w/o120.9170.3370.607-0.396Option statisticsOptionNProp.RpbisRbisMeanSDColor;l/pi;////A10.083-0.337-0.60716.0000.000MaroonB00.000--------GreenC00.000--------BlueD110.9170.3370.60717.7271.232Olive**KEY**Omit0Not Admin0Quantile plot dataOptionN0-20%20-40%40-60%60-80%80-100%ColorA11.0000.0000.0000.0000.000MaroonB00.0000.0000.0000.0000.000GreenC00.0000.0000.0000.0000.000BlueD110.0001.0000.0000.0001.000Olive**KEY**