2001 reading and mathematics pssa technical analysis - pa.gov
TRANSCRIPT
TECHNICAL ANALYSIS
PENNSYLVANIASYSTEM OF SCHOOL ASSESSMENT
2001 READING AND MATHEMATICS PSSA
DATA RECOGNITION CORPORATION
RONALD MEAD, PH. D.SENIOR PSYCHOMETRICIAN
Vince Maurelli, M.S.Lead PsychometricianKirsten Melby, M.A.
Statistical Analyst
APRIL 2002
i
THE PENNSYLVANIA SYSTEM OF SCHOOL ASSESSMENT 2001
TABLE OF CONTENTSChapter 1: Introduction
PSSA: The Pennsylvania System of School Assessment: 1Types of Assessment Measures 2Matrix Sampling Assessment Design 4
Chapter 2: Form Analysis and Item CalibrationTest Form Statistics 21Traditional Item Statistics 22Rasch Item Statistics And Equating 242001 PSSA Omitted Items 27
Chapter 3: Linking and EquatingGrade 5: Mathematics 28Grade 5: Reading 29Grade 8: Mathematics 31Grade 8: Reading 33Grade 11: Mathematics 35Grade 11:Reading 37
Chapter 4: Item Bias ReviewLimitations of Statistical Detection 39Mantel-Haenszel Procedure for Differential Item Functioning 39
Chapter 5: Student and School Level ScalingOverview of PSSA Design 45Common Items and Matrix-Sampled Items 46Scaled Scores for Content Standards 47
Chapter 6: Interpreting Scaled Scores on the PSSADefinition of Scaled Score 50School-Level Scales Scores 50Student Level Scaled Scores 54
Chapter 7: Reliability of Performance Standards 55
ii
Appendix A: PSSA 2000 Mathematics and Reading — Distribution Summaries by Form
Appendix B: PSSA Grade Five Item Analysis — Multiple Choice for Mathematics
Appendix C: PSSA Grade Eight Item Analysis — Multiple Choice for Mathematics
Appendix D: PSSA Grade Eleven Item Analysis — Multiple Choice for Mathematics
Appendix E: PSSA Grade Five Task Analysis — Open Ended Tasks for Mathematics
Appendix F: PSSA Grade Eight Task Analysis — Open Ended Tasks for Mathematics
Appendix 0: PSSA Grade Eleven Task Analysis - Open Ended Tasks for Mathematics
Appendix H: PSSA Grade Five Item Analysis — Multiple Choice for Reading
Appendix I: PSSA Grade Eight Item Analysis —Multiple Choice for Reading
Appendix J: PSSA Grade Eleven Item Analysis — Multiple Choice for Reading
Appendix K: PSSA Grade Five Task Analysis - Open Ended Tasks for Reading
Appendix L: PSSA Grade Eight Task Analysis - Open Ended Tasks for Reading
Appendix M: PSSA Grade Eleven Task Analysis — Open Ended Tasks for Reading
Appendix N: PSSA Grade Five - Across Year Linking
Appendix 0: PSSA Grade Eight - Across Year Linking
Appendix P: PSSA Grade Eleven — Across Year Linking
Appendix Q: PSSA Grade Five Mathematics — Between Group
Appendix R: PSSA Grade Five Reading — Between Group
Appendix 5: PSSA Grade Eight Mathematics - Between Group
Appendix T: PSSA Grade Eight Reading— Between Group
Appendix U: PSSA Grade Eleven Mathematics - Between Group
Appendix V: PSSA Grade Eleven Reading - Between Group
Appendix W: PSSA 2000 School Level Percentile Ranks
Appendix X: Percentile Rank Conversion Tables for Scaled Scores
The Pennsylvania System of School AssessmentChapter 1: Introduction
PSSA: The Pennsylvania System of School AssessmentThe purposes of the 2001 statewide assessment component of the Pennsylvania System ofSchool Assessment, as specified in the new Chapter 4 Regulations, include providing:
(1) an understanding of the students’ and schools’ achievement of the academic standardsto students, parents, educators and community citizens, (2) a measure of the degree towhich school programs enable students to attain the academic standards, (3) results toschool districts, charter schools and AVTSs, Intermediate Units, Private ResidentialRehabilatative Institutions, Approved Private Schools, Non-public and private schools foruse in their strategic plans, (4) information to the general public and state policymakersregarding school achievement of the academic standards, and (5) aggregated results for allstudents as well as for Individualized Education Plan (IEP) and non-IEP students.
The broad purpose of the State Assessments is to provide information to teachers andschools to guide the redesign of curricula and instructional strategies to enable students toachieve the academic standards. The areas assessed in 2001 are mathematics and readingat grades 5, 8 and 11. The Department strongly discourages the use of this testinginformation for the purpose of “ranking” schools.
2
Types of Assessment Measures
The PSSA mathematics assessment employs two types of test items: multiple-choice andopen-ended. These provide differing types of information about mathematicsachievement.
Multiple-Choice Items
The majority of the mathematics items included in the PSSA are multiple-choice items.Multiple-choice questions are also termed “selected-response” since students choose theiranswers from among those provided. Such items are an efficient means of assessing abroad range of curriculum. They are relatively easy to develop and can be administered ina short amount of time.
In the PSSA mathematics assessment, all multiple-choice items have only one correctresponse choice, and the student is awarded one point for choosing it. For all items,students are provided with four response choices.
Multiple-choice questions can be used to assess a variety of skill levels, from short-termrecall of facts to problem solving. The great majority of the PSSA multiple-choicemathematics questions require students to carry out some process to find their answers,rather than simply recalling information from memory.
Open-Ended Tasks
Open-ended tasks require students to read a problem or task description and to write outtheir answers. Major components of such answers are both students’ clear presentationsof their computations and their explanations of the steps they followed in solving theproblem. The types of tasks utilized do not always require solving a problem involvingcomputations. Students may also be asked to perform such tasks as drawing a graph,shading some portion of a figure or listing object combinations that meet specifiedcriteria.
Open-ended tasks are especially useful for measuring students’ problem-solving skills inmathematics. In most of these tasks students are asked to show how they arrived at ananswer or what thinking was behind the answer they gave. The tasks present real-lifesituations that require students to solve problems using math abilities learned in theclassroom. There are no response choices on the page as with multiple-choice items.Students must read the task carefully, select the necessary information, devise a methodof solution, perform the calculations, enter the response directly on the page on which thetask is presented and explain the procedure to support the given response. This providesinsight into the students’ knowledge, mathematical abilities and reasoning processes.
3
Open-ended tasks are scored in terms of a continuum of correctness. This continuum isdefined by a “rubric,” which outlines what the general requirements are at each scalepoint. Then, scoring guidelines based upon the general rubric are developed to scoreindividual items. The rubric approach to scoring has made it possible to include open—ended tasks in large-scale assessments, such as the PSSA. Large numbers of studentpapers can be scored in a highly reliable way by persons who have received training inapplying the rubric.
TYPES OF ASSESSMENT MEASURESThe PSSA reading assessment employs two types of test items: multiple-choice andperformance tasks. They are designed to measure students’ comprehension of theinformation contained in the reading passages and their ability to respond to them.
Multiple—Choice ItemsMultiple-choice/selected-response items measure such concepts as how well studentscomprehend the overall meaning of a passage or make basic inferences about it. At times,asking students to choose a preferred answer is the best way to determine whether theyhave gleaned certain important information from a story. Such information may includesetting, central idea or main events and their chronology.
Single-response multiple-choice items are the familiar four response choices with onecorrect answer type. The student is awarded one score point for choosing the correctresponse. All multiple-choice items at grades 5 and 8 and the multiple-choice items in thegrade 11 matrix sections are of this type. Distracters (incorrect responses) appeal to somekind of misinterpretation, predisposition, unsound reasoning or casual reading.
Performance TasksPerformance tasks are designed to address comprehension of text in ways that multiple-choice items cannot. A written response allows students to reflect on what they have read,integrate prior/background knowledge with text-based information, extend meaning andexpress their ideas.
These tasks are scored using the Pennsylvania Reading Assessment Rubric. This four-point scoring rubric clearly describes a range of performance requirements at each levelfrom minimal to very accomplished. Each task is carefully constructed to reflect thescoring rubric and to be text-dependent. Students may have the Pennsylvania ReadingAssessment Rubric, a thesaurus and a dictionary when responding to a performance task.
The rubric approach to scoring has made it possible to include performance tasks in large-scale reading assessments, such as the PSSA. The rubric approach also provides a highlyreliable way to score a large number of student papers by persons who have receivedtraining in applying the rubric.
4
The rubric describes a hierarchy of responses containing each of the following threeelements:
• Understanding of the text is demonstrated through a response that is both text-basedand factual.
• Level of comprehension of the text is demonstrated through levels of thinking, fromliteral to personal, critical or evaluative responses.
• Connection to the text is demonstrated through responses that make connections toand go beyond the text.
Matrix Sampling Assessment DesignThe PSSA was originally designed as a complex matrix-sampling scheme, which wasvery efficient for measuring school-level performance but less efficient for providingstudent-level assessments and diagnostics. In this design, there is a common core of itemsthat all students respond to and blocks of matrix items that are form specific. The matrixforms are spiraled within classrooms so than all forms are distributed uniformly withineach classroom. This ensures that each matrix form is administered to an unbiased andeffectively random sample of students in each school.
Since multiple forms are administered within each classroom, every student potentiallycould take a different set of items. This allows the assessment to cover a wide range oftopics at the classroom level. Comparisons between students are more problematicbecause they not only took different items, but they may have been tested on differenttopics.
Both the common and matrix sections of the PSSA use traditional multiple-choice itemsand more innovative open-ended performance tasks. Psychometrically, multiple-choiceitems are very useful and efficient tools for collecting information about a student’sacademic status. Open-ended performance tasks are less efficient in the sense that theygenerate fewer scoreable points in the same amount of testing time. They do, however,provide tasks that are more realistic and better sample the higher-level skills. The designof the PSSA attempts to achieve a reasonable balance between the two formats.
The design changes that began to take effect with the spring 2000 administration haveshifted the focus of the measurement toward the student and away from the school.Beginning in 2000, student-level results were reported on the Individual Student Report(ISR) with diagnostic results at the academic content standard level. All student-levelresults are based on the common items only and presented in the raw-score percent-correct metric only1. In order to accommodate this change in focus, the common section
1 While the student-level scaled scores are not reported on the ISR, they are used for many of theunderlying calculations.
5
has been expanded to better reflect the curriculum. Unfortunately, to administer the testsin a reasonable length of time, enhancing the common sections came at the expense of thematrix sections.
The PSSA design is an attempt to have the best of both worlds:
• All student-level results are based on the common core of all items that all students ina grade were administered. This ensures that all students are treated equally.
• All school-level results are based on the greater breadth of the matrix-samplingdesign. This enables the school-level results to better sample the entire curriculum.
Unfortunately, these dual objectives require some compromises:
• Many of the content standards are assessed with a minimal number of items.Consequently, scores reported at this level in any metric would have large standarderrors and are at risk of over-interpretation.
• The mean of the student level scores will not necessarily equal the school-level scorebecause they rely on different sets of items. They will be statistically equal since bothare estimates of the same school-level status but there is no reason to expect that theywill be numerically equal.
The following tables show how the two types of items and the content standards aredistributed across forms. Form W refers to the common sections and was the given to allstudents. Forms A through J for reading and mathematics are the matrix sections and eachstudent took one of these forms in reading and one in math.
CChhaapptteerr 22:: FFoorrmm AAnnaallyyssiiss aanndd IItteemm CCaalliibbrraattiioonn
TEST FORM STATISTICS
The table below contains an overview of the form-level data. Test length (L), meanpercent correct (P), typical test-retest reliability (R) and typical standard error ofmeasurement (SE) are shown for each form by grade and content area. These statisticsare based on the total test using both multiple-choice and open-ended tasks and bothcommon and matrix sections for each form. The test lengths pertain to the data used forschool-level estimates and not for student-level results.
The test-retest reliability can be thought of as the correlation between scores if thestudents could be tested twice with the same instrument without the second testing beingaffected by the first. It is computed as the ratio of the variance associated with truescores divided by the total variance. The total variance contains a component due to thevariance in true scores and a component due to the imperfections in the measurementprocess.
The standard error of measurement is another indicator of precision. If everyone beingtested had the same true score1, there would still be some variation in observed scoresdue to imperfections in the measurement process. These may be random differences inattention during instruction or concentration during testing. Or perhaps differences couldarise because of problems with the wording of the items or layout of the answer sheet.The standard error is the standard deviation2 of the distribution of observed scores forstudents with identical true scores.
Both reliability and the standard error increase with test length; although, it is not the soledeterminant in either case. Comparing the information in tables 2.1 and 2.2 should givesome insight into the complexities and tendencies of the these statistics.
Table 2.1: Summary of Matrix Form Performances
Mathematics ReadingGrade L P R SE L P R SE
05 105 63 95 5.0 89-90 64 92 4.2
08 105 57 94 5.3 120 61 94 4.9
11 105 54 94 5.1 123-132 62 94 5.3
The Student-Level Scaled Scores were estimated using the common items only. Thisresulted in shorter test lengths and therefore slightly lower form reliabilities. Thefollowing table pertains to the common-item measures.
1 True score is the score the person deserves and would actually receive if the measurement process wereperfect.2 The standard deviation of a distribution is a measure of the dispersion of the observations. For the normaldistribution about 16% of the observations are more than one standard deviation about the mean and thesame percentage are more than one standard deviation below the mean. To illustrate, using the data in table2.1, about 68% of students with true scores of 70 will have observed scores between 65 and 75.
Item Analysis and Calibration 22
Table 2.2: Summary of Common Item Performances
Mathematics ReadingGrade L P R SE L P R SE
05 85 64 92 4.4 60 64 89 3.5
08 85 58 92 4.7 80 62 90 4.1
11 85 56 92 4.5 88 61 91 4.4
Appendix A presents detailed descriptions of the performance of each form by grade andcontent area.
The standard deviation shown in the table is the standard deviation of observed scores.Assuming normally distributed scores, one would expect about two-thirds of theobservations to be within one standard deviation of the mean. An estimate of thestandard deviation of the true scores can be computed as the sqrt{(SD*SD) – (SE*SE)}.For grade 5 math, this would be sqrt{(15.5*15.5)-(4.5*4.5)} = 14.8.
The reliability can also be computed from these data. Again for grade 5 math common,R={(15.5*15.5)-(4.5*4.5)}/(15.5*15.5) = 0.92.
TRADITIONAL ITEM STATISTICS
Although all items had been reviewed several times, a thorough item analysis wasconducted to ensure that the items and forms performed as expected. With anypsychometric model, an item analysis is a search for unexpected results. In general, moreable3 students are expected to pass easy items and less able students are expected to faildifficult items. If either of these situations do not occur, the item should be reviewedonce more to determine the nature of the problem and the characteristics of the studentsaffected.
The most familiar indices of item performance are proportion correct (p-value) and itemreliability. Reliability for dichotomous items is typically represented by the point biserialcorrelation coefficient. This statistic will be positive if the total test mean score is higherfor the students who respond correctly to the item than for the students who respondincorrectly. Hence, the correlation will be low if there is a more able way to fail the itemor a less able way to pass it.
The p-value is a subtler indicator of item quality but the value should be appropriate forthe item. If there is a more able way to miss an item, the item will appear more difficultthan the underlying problem. Conversely, if there is a less able way to pass the item, itmay appear surprisingly easy.
Table 2.3 gives the mean p-value and point biserial correlation (PtBis) for the multiple-choice items in each grade and content area as a frame of reference of evaluating items.The p-value is the proportion of the students who responded correctly to an item. The
3 Following the Rasch literature, ability is used in this discussion as a generic term for the construct that isbeing measured by the exam. Competence, achievement, learning and status are among the alternativesthat are sometimes used but are all subject to some degree of misinterpretation.
Item Analysis and Calibration 23
point biserial correlation is the correlation between the student’s score on the item (zeroor one) and the score on the total test. This can be computed as the familiar Pearsonproduct-moment correlation but because the item score is a dichotomous variable, theformula can be written in a simpler form.
The point biserial correlation is also called the item reliability. The correlation will havea positive value when the mean score of the students answering correctly is higher thanthe mean score of the students answering incorrectly. This is a very reasonablerequirement since it indicates that students who did well on the total test tended to dowell on this item. The index will take its maximum theoretical value of 1.0 if everystudent who answered the item correctly scored better on the test than any student whoanswered incorrectly4.
In general, with the mean p-values in the low 0.6 range, the PSSA was quite challengingto most students. With the average point biserial correlations near 0.4, the overall itemquality was quite good.
Table 2.3: Typical Form Statistics by Grade and Content
Mathematics Reading
Grade P-value PtBis P-value PtBis
05 .66 .46 .68 .44
08 .61 .47 .65 .43
11 .55 .45 .62 .43
The item level analyses done for the PSSA also included the percent of students selectingeach incorrect response (foil) and the correlation between selecting a response and totaltest score. This information is useful to help item writers and editors understand theitem’s behavior. The percent selecting each response is an indicator of which foils areparticularly attractive.
The correlations by response are a further refinement on this idea. They indicate whichresponses are attractive to high scoring students and which to low scoring students. Theideal pattern would be a strong positive correlation for the correct response and strongnegative correlations for the incorrect responses. This pattern would indicate that theincorrect responses tend to attract students who tended to do less well on the total test.Consequently, one could conclude that the item is measuring the same construct as is thetest as a whole.
4 It is legitimate to view the point biserial correlations as standardized means. A positive value meansstudents who chose that response had a higher mean score than the average student; a negative value meansstudents who chose that response had a lower than average mean score.
Item Analysis and Calibration 24
RASCH ITEM STATISTICS AND EQUATING
Software implementing the Rasch model was used to obtain estimates of logit difficultiesfor both dichotomously- and polychotomously-scored items. The parameters estimatedfor polychotomous items are the step difficulties associated with the Masters PartialCredit model. This software has been adapted to handle all the item types currently inuse with the PSSA.
Rather than percent correct, the Rasch model expresses item difficulty (and studentability) in units typically referred to as logits. In the simplest case, a logit is atransformed p-value with the average p-value becoming a logit of zero. In this form,logits resemble z-scores or standard normal deviates; a very difficult item might have alogit of +4 and a very easy item might have a logit of –4. They actually have no formalrelationship to the normal distribution.
The logit metric has several mathematical advantages over p-values. It is an intervalscale meaning two items with logits of zero and one are the same distance apart as itemswith logits of +3 and +4. Logits are not dependent on the ability level of the students. Aspecific form will have a mean logit of zero whether the average p-value of the sample is0.8 or 0.3.
The standard Rasch calibration procedure arbitrarily sets the mean difficulty of the itemson any form at zero. Any item with a p-value lower than the average item on the formreceives a positive logit difficulty and any item with a p-value higher than the averagereceives a negative logit. Consequently, the logits for any calibration, whether it is athird grade reading test or a high school science test, relate to an arbitrary origin definedby the center of items on that form. The average third grade reading item will have alogit of zero; the average high school science item will have a logit of zero. This appliesto logits for both item difficulties and student abilities.
There are any number of other arbitrary choices that could be made for centering the itemdifficulties. Rather than using all the items, the origin could be defined by a subset. Forthe PSSA, all test forms in a particular grade and content area share a common block ofitems. The items on all forms can then be easily adjusted to a single (but still arbitrary)origin by defining the origin as the mean of the common items. With this done, theorigins for all ten forms will be statistically equal. Items on forms A and J that areequally difficult should now have equal logit difficulties.
Since the test forms were spiraled within classrooms, there are some cross checks that aremade to ensure the calibrations and links are reasonable. First, because of the spiraling,each form will be administered to a statistically equivalent sample of students and so anydifferences in performances observed among the groups should be due only to differencesin form difficulty. After linking, the mean and standard deviation of the logit abilitiesshould be statistically equal for each sample of students.
Second, because of the equivalent samples, the common items should have the same p-values regardless of which form and sample is being considered. And finally, for allitems, both common and matrix, a plot of the relationship between the p-value and thelogit should fall along a single, curved line.
Item Analysis and Calibration 25
The curve using the diamond plotting symbol for Logit 2000 in Figure 2.1 below forGrade 5 Mathematics illustrates a situation in which these conditions were met quite well.This curve shows the transformation from p-values (x-axis) to logits (y-axis) for the year2000. The curve is nearly linear in the center but curves towards asymptotes of zero (onthe left) and one (on the right).
In theory, with the Rasch model, linking the exam for the current year to the exam forprevious years is just as straightforward as linking forms within year. However, thestudent samples can not be assumed equivalent across years and identical items can havedifferent properties in different years because of changes in the item’s context or changesin the students’ experiences. Consequently, between-year linking is somewhat lesscertain than within-year linking.
The link between years must be from items that are used in both years in approximatelythe same context. The same context in this situation means the items are not altered inany way, they appear in about the same position in the booklet, and they are administeredat about the same time of day. PDE provides a code for each item as part of the answerkey file that indicates the item’s appropriateness for linking. Codes between 1 and 6represent the gradation of the item’s suitability. A code of ’1’ means the item text isidentical and its sequence number has not changed by more than 2 or 3. A code of ’5’means the item has been significantly revised. A code of ’6’ indicates a completely newitem.
For within-year linking, the procedure is to link forms through the common section. Theresult is a bank of items with comparable logit difficulties. For between-year linking, theprocedure is to link the current year’s bank to the previous year’s banks. Theoretically,the process is identical to within-year.
(1) Overlapping items are identified.
(2) Adjusting the logit difficulties (of all items) in the current year’s bank so that themean logit difficulty for the overlapping items is equal to the mean logit difficulty forthe same items in previous year’s bank.
Figure 2.1: Grade 5 Math Comparison of 2000 and 2001
-3
-2
-1
0
1
2
0 0.2 0.4 0.6 0.8 1
2000 P-Values
Lo
git
s
0
0.2
0.4
0.6
0.8
1
logit 2000
logit 2001
P 2001
Item Analysis and Calibration 26
(3) Assess the validity of the link by identifying any items that do not maintain theirrelative position across years.
Plotting p-values against logit difficulties across year is not as reliable as it is within yearbut it is still informative. Within year, a given p-value will translate to a given logitregardless of the form it is used on, within the limits of statistical precision. Within year,the p-value-to-logit plot should be a single curved line; between years, the plot couldhave separate lines for each year. The difference between the two lines is a reflection ofthe adjustment (positive or negative) that is required to equate the two item banks. This isthe situation shown in Figure 2.1 with the curves using the square and the triangleplotting symbols.
The plot of the p-values for overlapping items from the two years can also beinformative. If the p-values for the current year are systematically higher than for thesame items last year, the scale scores should also show a systematic improvement afterthe two item banks have been properly linked. This is shown in Figure 2.1 with thediamond-plotting symbol.
There are some checks on the reasonableness of the linking process that can beperformed. Item calibration should be invariant across years, except for an arbitrarylocation constant. When the logit difficulties of the overlapping items for the current yearare plotted against their logit difficulties for a previous year, the result should be astraight line, whose width reflects the standard errors of estimation for the itemdifficulties. Identifying any outliers and recomputing the adjustment based on an editedset of overlapping items should improve the link.
Figure 2.2 above uses the same data as Figure 2.1 but focuses entirely on logitdifficulties. It shows more clearly the relationship between 2000 logits and 2001 logits.There is a well-defined line with a few outliers. From the intercepts which are (0, -0.5)and (0.5, 0) approximately, it can be seen that the required translation constant is slightlyless than 0.5 logits. Subtracting 0.5 from the 2001 logits (or adding 0.5 to 2000 logits)would shift the line to pass through the origin.
Figure 2.2: Grade 5 Math 2001 Link to 2000
-3
-2.5
-2
-1.5
-1
-0.5
0
0.5
1
-3 -2 -1 0 1 2
2001 Logits
2000
Lo
git
s
Item Analysis and Calibration 27
2001 PSSA OMITTED ITEMS
Numerous items from Grades 5, 8, and 11 were omitted from scoring due to poorstatistical performance. Items with low p-values or negative point biserial correlationsindicate that another answer option is a plausible alternative to the correct answer option.The following items were flagged during item analysis and were omitted from finalscoring. All omitted items were Reading items.
Table 2.4 PSSA 2001 Omitted Items
Grade 5 Grade 8 Grade 8Continued
Grade 11 Grade 11Continued
A165 A205 G190 A189 E222
B164 A208 G191 A190 F192
B177 A211 G196 A205 F216
C176 A213 G200 A208 F202
C183 B182 G208 A211 F226
D171 B190 G211 B214 H191
E168 B193 H189 C198 H196
F164 B197 H196 C224 H197
F179 B203 H200 D192 H202
G163 B208 H212 D205 H203
G179 C182 I187 D208 H207
I178 C194 I190 D212 H210
J164 C210 I193 D222 H206
J177 D195 I195 D227 I191
E181 I213 D228 I209
E206 J179 E190 I210
F185 J185 E198 I225
F191 J190 E205 I228
J199 E207 J194
E214
E215
E216
CChhaapptteerr 33:: LLiinnkkiinngg aanndd EEqquuaattiinngg
Grade 5: MathematicsThe traditional item statistics, percent correct and point biserial correlations, displayedtypical and reasonable distributions for Grade 5 Mathematics, as shown in Figure 3.1below. These statistics were computed for each test form so, in this plot, clusters ofpoints represent a single common item that occurred on all ten forms. The points nearpercent correct of 0.85 and correlation of 0.17 illustrate this.
The percent correct scores range from about 0.25 to about 0.96 with the majority of theitems in the range 0.5 to 0.82. Most of the item reliabilities are between 0.3 and 0.5 withonly two items below 0.2, both of which are matrix items. It might also be useful toinvestigate the items with reliabilities near 0.6. They may be exemplars for what itemsshould be or they might be tapping some extracurricular experience primarily available tothe better math students.
Figure 3.2 entitled Grade 5 Mathematics Link 2001 to 2000 contains several pieces ofinformation for the items that were used to link the 2001 exam to the 2000 exam. Thediagonal line, rising from left to right, shows the item logit difficulties in the two years.One would expect the relationship to form a straight line with slope one. The extent towhich the line does not pass through the origin indicates a shift in the form difficulty.The intercepts are in fact an estimate of the between year equating constant. For gradefive mathematics, the logit shift is close to one logit.
The two lines sloping downward toward the right relate item p-values for the two years tothe 2000 logits. The line using the diamond plotting symbol shows the relationshipbetween p-value and logit difficulty for the 2000 data. It shows the curvilinearrelationship required by the model with low p-values being translated into high logitdifficulties and high p-values into low difficulties. The smoothness of this line indicates
Figure 3.1: Grade 5 Mathematics Traditional Statistics
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.00 0.10 0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00
2001 P-value
Linking and Equating 29
good agreement among the ten forms. Because the ten forms were spiraled withinclassroom, the samples generated are randomly equivalent and one would expect the
same p-value to translate into the same logit. This is the case with these data.
The line with the cross plotting symbol shows the relationship between the p-values from2001 and the logits from 2000 for the linking items. It also shows the curvilinearrelationship but the line is not as smooth. This is expected because the p-values andlogits were produced by completely different samples. With the exception of a fewitems, this line indicates reasonable agreement between the two years.
The degree to which these two lines do not coincide indicates a change in the p-valuebetween the two years. Most of the item p-values are slightly higher in 2001 than theywere in 2000. Note this chart is based on the overlapping items that were administered inidentical form in both years. The change in p-value indicates improvement and isconsistent with the change in the state level mean scale score.
Grade 5: ReadingThe traditional item statistics, percent correct and point biserial correlations, displayedtypical and reasonable distributions for Grade 5 Reading, as shown in Figure 3.3 below.These statistics were computed for each test form so, in this plot, clusters of pointsrepresent a single common item that occurred on all ten forms.
The percent correct scores range from about 0.3 to about 0.9 but the majority of the itemdifficulties are greater than 0.5. Most of the item reliabilities are between 0.3 and 0.6with only a few items below 0.2. The three lowest are matrix items. It might also beuseful to investigate the items with reliability near 0.6. They may be exemplars for whatitems should be or might be tapping some extracurricular experience primarily availableto the better students. There is also a consistent pattern of the lowest reliabilities being
Figure 3.2: Grade 5 Mathematics Link 2001 to 2000
-3.50
-3.00
-2.50
-2.00
-1.50
-1.00
-0.50
0.00
0.50
1.00
-3 -2.5 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2
2000 Logits
2001
Lo
git
s
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
P-v
alu
es
Linking and Equating 30
associated with the lowest p-values. Most, but not all, items in this region are matrixitems. These items are too difficult for these students to contribute to the measurement.
Figure 3.4, entitled Grade Five Reading Link 2001 to 2000, contains several pieces of
diagonal line, rising from left to right, shows the item logit difficulties in the two years.
One would expect the relationship to form a straight line with slope one. The extent towhich the line does not pass through the origin indicates a shift in the form difficulty.The intercepts are in fact an estimate of the between year equating constant. For gradefive reading, the logit shift is approximately 0.7 logit.
Figure 3.3: Grade 5 ReadingTraditional Statistics
-0.10
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.00 0.10 0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00
2001 P-value
Po
int
Bis
eria
l Co
rrel
atio
n
Figure 3.4: Grade 5 Reading Link 2001 to 2000
-2.50
-2.00
-1.50
-1.00
-0.50
0.00
0.50
1.00
1.50
-2.00 -1.50 -1.00 -0.50 0.00 0.50 1.00 1.50 2.00
2000 Logits
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.80
0.90
1.00
Linking and Equating 31
The line using the diamond plotting symbol (top line with downward slope) shows therelationship between p-value and logit difficulty for the 2000 data. It suggests thecurvilinear relationship imposed by the model with low p-values being translated intohigh logit difficulties and high p-values into low difficulties. The smoothness of this lineindicates very good agreement among the ten forms. Because the ten forms were spiraledwithin classroom, the samples generated are randomly equivalent and one would expectthe same p-value to translate into the same logit. This is the case with these data.
The line with the cross plotting symbol shows the relationship between the p-values from2001 and the logits from 2000 for the linking items. It also shows the curvilinearrelationship but the line is not as smooth. This is expected because the p-values andlogits were produced by completely different samples. With the exception of a fewitems, this line indicates reasonable agreement between the two years.
The degree to which these two lines do not coincide indicates a change in the p-valuebetween the two years. Most of the item p-values are very slightly higher in 2001 thanthey were in 2000. Note this chart is based on the overlapping items that wereadministered in identical form in both years. The change in p-value indicates someimprovement and is consistent with the change in the state level mean scale score.
Grade 8: MathematicsThe traditional item statistics, percent correct and point biserial correlations, displayedtypical and reasonable distributions for Grade 8 Mathematics, as shown in Figure 3.5.These statistics were computed for each test form so, in this plot, clusters of pointsrepresent a single common item that occurred on all ten forms.
The percent correct scores range from about 0.35 to about 0.85. Most of the itemreliabilities are between 0.3 and 0.6 with only a few items below 0.2. It might also beuseful to investigate the items with reliability near 0.6. They may be exemplars for whatitems should be or might be tapping some extracurricular experience primarily availableto the better students.
Figure 3.5: Grade 8 MathematicsTraditional Statistics
-0.10
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.00 0.10 0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00
2001 P-values
Po
int
Bis
eria
l Co
rrel
atio
ns
Linking and Equating 32
Figure 3.6, entitled Grade 8 Mathematics Link 2001 to 2000, contains several pieces ofinformation for the items that were used to link the 2001 exam to the 2000 exam. Thediagonal line, rising from left to right, shows the item logit difficulties in the two years.One would expect the relationship to form a straight line with slope one. The extent towhich the line does not pass through the origin indicates a shift in the form difficulty.The intercepts are in fact an estimate of the between year equating constant. For gradefive mathematics, the logit shift is close to one half logit.
The two lines sloping downward toward the right relate item p-values for the two years tothe 2000 logits. The line using the diamond plotting symbol shows the relationshipbetween p-value and logit difficulty for the 2000 data. It shows the curvilinearrelationship required by the model with low p-values being translated into high logitdifficulties and high p-values into low difficulties. The smoothness of this line indicatesgood agreement among the ten forms. Because the ten forms were spiraled withinclassroom, the samples generated are randomly equivalent and one would expect thesame p-value to translate into the same logit. This is the case with these data.
The line with the cross-plotting symbol shows the relationship between the p-values from2001 and the logits from 2000 for the linking items. It also shows the curvilinearrelationship but the line is not as smooth. This is expected because the p-values andlogits were produced by completely different samples. With the exception of a fewitems, this line indicates reasonable agreement between the two years.
The degree to which these two lines do not coincide indicates a change in the p-valuebetween the two years. Most of the item p-values are very slightly higher in 2001 thanthey were in 2000. Note this chart is based on the overlapping items that wereadministered in identical forms in both years. The change in p-value indicates someimprovement and is consistent with the change in the state level mean scale score.
Figure 3.6: Grade 8 MathematicsLink 2001 to 2000
-3.00
-2.50
-2.00
-1.50
-1.00
-0.50
0.00
0.50
1.00
1.50
-2 -1.5 -1 -0.5 0 0.5 1 1.5
2000 Logits
2001
Lo
git
s
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
P-v
alu
es
Linking and Equating 33
Grade 8: ReadingThe traditional item statistics, percent correct and point biserial correlations, displayed asomewhat unusual distribution for Grade 8 Reading, as shown in Figure 3.7. There is anunusually strong relationship between difficulty and reliability. These statistics werecomputed for each test form so, in this plot, clusters of points represent a single commonitem that occurred on all ten forms.
The percent correct scores range from about 0.3 to about 0.9. Most of the itemreliabilities are between 0.2 and 0.6 but there is a substantial number below 0.2. The verylow reliabilities are all associated with item with low p-values. These items are notcontributing to the measurement and should be reviewed to determine if they aredefective or simply too difficult for these students. It might also be useful to investigatethe items with reliability near 0.6. They may be exemplars for what items should be ormight be tapping some extracurricular experience primarily available to the betterstudents.
Figure 3.8, entitled Grade 8 Reading Link 2001 to 2000, contains several pieces ofinformation for the items that were used to link the 2001 exam to the 2000 exam. Thediagonal line, rising from left to right, shows the item logit difficulties in the two years.One would expect the relationship to form a straight line with slope one. The extent towhich the line does not pass through the origin indicates a shift in the form difficulty.The intercepts are in fact an estimate of the between year equating constant. For gradefive mathematics, the logit shift is close to one half logit.
Figure 3.7: Grade 8 ReadingTraditional Statistics
0.00
0.10
0.20
0.30
0.40
0.50
0.60
0.70
0.00 0.10 0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00
2001 P-values
Linking and Equating 34
The line using the diamond-plotting symbol (top line with downward slope) shows therelationship between p-value and logit difficulty for the 2001 data. It suggests thecurvilinear relationship required by the model with low p-values being translated intohigh logit difficulties and high p-values into low difficulties. The smoothness of this lineindicates very good agreement among the ten forms. Because the ten forms were spiraledwithin classroom, the samples generated are randomly equivalent and one would expectthe same p-value to translate into the same logit. This is the case with these data.
The line with the triangle-plotting symbol shows the relationship between the p-valuesfrom 2001 and the logits from 2000 for the linking items. It also shows the curvilinearrelationship but the line is not as smooth. This is expected because the p-values andlogits were produced by completely different samples. With the exception of a fewitems, this line indicates reasonable agreement between the two years.
The degree to which these two lines do not coincide indicates a change in the p-valuebetween the two years. Most of the item p-values are very slightly higher in 2001 thanthey were in 2000. Note this chart is based on the overlapping items that wereadministered in identical form in both years. The change in p-value indicates someimprovement and is consistent with the change in the state level mean scale score.
Figure 3.8: Grade 8 Reading Link 2001 to 2000
-2.50
-2.00
-1.50
-1.00
-0.50
0.00
0.50
1.00
1.50
-2 -1 0 1 2
2000 Logit0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Linking and Equating 35
Grade 11: MathematicsThe traditional item statistics, percent correct and point biserial correlations, displayedsubstantial curvilinear relationship for Grade 11 Mathematics, as shown in Figure 3.9.These statistics were computed for each test form so, in this plot, clusters of pointsrepresent a single common item that occurred on all ten forms.
The percent correct scores range from about 0.2 to about 0.9. Most of the itemreliabilities are between 0.3 and 0.6 but there is a significant number below 0.2. Withfew exceptions, the very low reliabilities are all associated with items with low p-values.It might also be useful to investigate the items with reliability near 0.6. They may beexemplars for what items should be or might be tapping some extracurricular experienceprimarily available to the better students.
Figure 3.10, entitled Grade 11 Mathematics Link 2001 to 2000, contains several pieces ofinformation for the items that were used to link the 2001 exam to the 2000 exam. Thediagonal line, rising from left to right, shows the item logit difficulties in the two years.One would expect the relationship to form a straight line with slope one. The extent towhich the line does not pass through the origin indicates a shift in the form difficulty.The intercepts are in fact an estimate of the between year equating constant. For gradefive mathematics, the logit shift is about 0.2 logits.
The line using the diamond-plotting symbol shows the relationship between p-value andlogit difficulty for the 2001 data. It suggests the curvilinear relationship imposed by themodel with low p-values being translated into high logit difficulties and high p-valuesinto low difficulties. The smoothness of this line indicates very good agreement amongthe ten forms. Because the ten forms were spiraled within classroom, the samplesgenerated are randomly equivalent and one would expect the same p-value to translateinto the same logit. This is the case with these data.
F ig u r e 3 .9 : G r a d e 1 1 M a th e m a t ic sT r a d i t io n a l S ta t is t ic s
0
0 .1
0 .2
0 .3
0 .4
0 .5
0 .6
0 .7
0 0 .2 0 .4 0 .6 0 .8 1
2 0 0 1 P - v a lu e s
Linking and Equating 36
The line with the cross-plotting symbol shows the relationship between the p-values from2001 and the logits from 2000 for the linking items. It also shows the curvilinearrelationship but the line is not as smooth. This is expected because the p-values andlogits were produced by completely different samples. With the exception of a fewitems, this line indicates reasonable agreement between the two years.
The degree to which these two lines do not coincide indicates a change in the p-valuebetween the two years. Most of the item p-values are very slightly higher in 2001 thanthey were in 2000. Note this chart is based on the overlapping items that wereadministered in identical form in both years. The change in p-value indicates someimprovement and is consistent with the change in the state level mean scale score.
It is unusual for the lines to have different slopes. The plot suggests more growth on theeasy items than on the hard items. This probably is an artifact of the modifications indesign of the test.
F i g u r e 3 .1 0 : G r a d e 1 1 M a t h e m a t ic s L in k 2 0 0 1 t o 2 0 0 0
- 3
- 2 . 5
- 2
- 1 . 5
- 1
- 0 . 5
0
0 . 5
1
1 . 5
- 3 - 2 - 1 0 1 2
2 0 0 0 L o g i t
0
0 . 1
0 . 2
0 . 3
0 . 4
0 . 5
0 . 6
0 . 7
0 . 8
0 . 9
1
Linking and Equating 37
Grade 11: ReadingThe traditional item statistics, percent correct and point biserial correlations, displayedtypical and reasonable distributions, as shown in Figure 3.11. These statistics werecomputed for each test form so, in this plot, clusters of points represent a single commonitem that occurred on all ten forms.
The percent correct scores range from about 0.2 to about 0.9. Most of the itemreliabilities are between 0.3 and 0.6 but there is a significant number below 0.2 and a fewbelow zero. The very low reliabilities tend to be associated with items with low p-values.It might also be useful to investigate the items with reliability near 0.6. They may beexemplars for what items should be or might be tapping some extracurricular experienceprimarily available to the better students.
Figure 3.12, entitled Grade 11 Reading Link 2001 to 2000 contains several pieces ofinformation for the items that were used to link the 2001 exam to the 2000 exam. Thediagonal line, rising from left to right, shows the item logit difficulties in the two years.One would expect the relationship to form a straight line with slope one. The extent towhich the line does not pass through the origin indicates a shift in the form difficulty.The intercepts are in fact an estimate of the between year equating constant. For gradefive mathematics, the logit shift is about one-half logit.
The line using the triangle-plotting symbol shows the relationship between p-value andlogit difficulty for the 2001 data. It suggests the curvilinear relationship imposed by themodel with low p-values being translated into high logit difficulties and high p-valuesinto low difficulties. The smoothness of this line indicates very good agreement amongthe ten forms. Because the ten forms were spiraled within classroom, the samplesgenerated are randomly equivalent and one would expect the same p-value to translateinto the same logit. This is the case with these data.
F i g u r e 3 . 1 1 : G r a d e 1 1 R e a d i n gT r a d i t i o n a l S t a t i s t i c s
- 0 . 3
- 0 . 2
- 0 . 1
0
0 . 1
0 . 2
0 . 3
0 . 4
0 . 5
0 . 6
0 . 7
0 . 8
0 0 . 2 0 . 4 0 . 6 0 . 8 1
2 0 0 1 P - v a l u e s
Linking and Equating 38
The line with the diamond-plotting symbol shows the relationship between the p-valuesfrom 2001 and the logits from 2000 for the linking items. It also shows the curvilinearrelationship but the line is not as smooth. This is expected to some extent because the p-values and logits were produced by completely different samples. Even with thedisturbances in these data, it is still possible to define a set of points that are in reasonableagreement between the two years.
The degree to which these two lines do not coincide indicates a change in the p-valuebetween the two years. Most of the item p-values are very slightly higher in 2001 thanthey were in 2000. Note this chart is based on the overlapping items that wereadministered in identical form in both years. The change in p-value indicates someimprovement and is consistent with the change in the state level mean scale score.
It is unusual for the lines to have different slopes. The plot suggests more growth on theeasy items than on the hard items. This probably is an artifact of the modifications indesign of the test.
F ig u r e 3 .1 2 : G r a d e 1 1 R e a d in g L in k 2 0 0 1 t o 2 0 0 0
- 2 .5
-2
-1 .5
-1
-0 .5
0
0 .5
1
1 .5
-2 -1 0 1 2
2 0 0 0 L o g i ts0
0 .1
0 .2
0 .3
0 .4
0 .5
0 .6
0 .7
0 .8
0 .9
CChhaapptteerr 44:: IItteemm BBiiaass RReevviieewwTest item bias can present itself in a variety of ways in items: through the language, theformat, the content, or the behaviors required. It can result from membership in aspecific subpopulation or from factors correlated to the subpopulation. It can affect allmembers of the subpopulation or it may affect only those in specific ranges of ability.How bias arises and how it presents itself clearly will affect how best to detect andcorrect it.
Limitations of Statistical DetectionNo statistical procedure should be used as a substitute for rigorous, hands-on reviews bycontent and bias specialists. The statistical results can help to organize the review so theeffort is concentrated on the most problematic cases; however, no items should beautomatically rejected simply because some statistical method flagged them or acceptedbecause they were not flagged.
Statistical detection of item bias is at best an inexact science. There has been a variety ofmethods proposed for detecting bias but no one statistic to date can be considered eithernecessary or sufficient. Different methods are more or less successful depending on thesituation and circumstances. No analysis can guarantee that a test is free of bias andalmost any thoughtful analysis will uncover the most flagrant problems.
A fundamental shortcoming of all of the statistical methods is that all are intrinsic to thetest being evaluated. If a test overall is unbiased but with one or two biased items, mostmethods will locate the problems. If however the test itself is biased against one or moresubpopulations, a statistical analysis of the items will not be able to separate bias effectsfrom true differences in achievement.
Mantel-Haenszel Procedure for Differential Item FunctioningThe Mantel-Haenszel procedure for detecting differential item functioning is the mostcommonly used technique in educational testing. It does not depend on the application orthe fit of any specific measurement model. It does have some philosophical overlap withthe Rasch model since it uses total score to organize the analysis.
Differential item functioning is present when examinees of equal ability do not have thesame chance of passing the item. If this inequity is associated with gender or ethnicgroups, the item could be described as biased. The Mantel-Haenszel procedure looks foritems that meet this idea of differential functioning.
The procedure as implemented by DRC contrasts a focal group with a reference group.While it makes no practical difference in the analysis which group is defined as the focalgroup, the protected class or the group most apt to the disadvantaged by a biasedmeasurement is typically defined as the focal group. The Mantel-Haenszel statistic (MH)for each item is computed from a two-by-two-by-eight contingency table. It has twogroups (focal and reference), two outcomes (right or wrong) and eight ability groupings.The ability groups are defined by the octiles of the score distribution for the totalexaminee populations.
Item Bias Review 40
The basic MH statistic is a single degree of freedom chi-square that compares theobserved number in each cell to the expected number. The expected counts are computedto ensure that the analysis is not confounded with differences in the achievement level ofthe two groups.
For constructed response items, a comparable statistic is computed based on thestandardized mean difference computed as the differences in mean scores for the focaland reference groups if both groups had the same score distribution.
To assist the review committees in interpreting the analyses, the items are assigned aseverity code based on the magnitude of the MH statistic. Items classified as A+ or A-have no statistical indication of differential item functioning. Items classified as B+ or B-have some indication and may not require revision. Items classified as C+ or C- havestrong evidence of a problem and should be reviewed and revised if they are to be usedagain. The plus sign indicates the item favors the focal group and a minus sign indicatesthe item disfavors the focal group.
Displays such as the following are produced for all items given the C classification andare shown in Appendices S and V. This display identifies the item by form and sequencenumber and provides all the descriptive statistics. For each score grouping, the displaygives the number in each group and the percentage of the group who answered the itemcorrectly. For example, for the item shown, there were 901 students from the focal groupin the lowest group and 45% of them answered the item correctly.
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code B 135 2 1 8 447.43 55.93 2.13 -1.8 C-0____1____2____3____4____5____6____7____8____9____0 FOCAL -REFERENCE-| | *+ 1.00 928 0.99 761| | -* 0.98 962 0.99 870| | -*| 0.96 871 0.98 814| | * | 0.96 892 0.97 920| | --* | 0.93 922 0.95 882| | ---* | 0.86 881 0.92 923| | -------* | 0.75 881 0.88 896| -----------* | 0.45 901 0.65 7870____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
The following tables provide counts of the number of items from each grade and contentarea that were assigned to each severity code. Overall, there were relatively few itemsthat showed strong evidence of differential item functioning. In most cases, these werematrix items and the majority of the problems were associated with ethnic group.
Item Bias Review 41
Table 4.1: Counts of Item Severity Codes by Grade for Mathematics
Form Code Five Eight Eleven TotalA A- 8 8 8 24
A+ 7 6 7 20B- 1 1B+C-C+
B A- 11 8 3 22A+ 2 6 11 19B-B+ 1 1C- 1 1C+ 1 1 2
C A- 8 6 8 22A+ 6 8 5 19B- 1 1 2B+ 1 1C-C+ 1 1
D A- 7 9 8 24A+ 7 4 5 16B- 1 1 2B+ 1 1 1 3C-C+
E A- 8 8 7 23A+ 7 6 8 21B-B+C-C+ 1 1
F A- 6 6 7 19A+ 9 7 8 24B- 1 1B+ 1 1C-C+
G A- 6 8 10 24A+ 8 7 5 20B-B+ 1 1C-C+
Item Bias Review 42
Table 4.1 continued: Counts of Item Severity Codes by Grade for Mathematics
Form Code Five Eight Eleven TotalH A- 6 7 3 16
A+ 6 8 12 26B-B+ 2 2C-C+ 1 1
I A- 8 6 8 22A+ 6 9 5 20B- 1 1B+ 1 1 2C-C+
J A- 8 9 4 21A+ 6 6 10 22B- 1 1 2B+C-C+
W A- 34 32 35 101A+ 36 37 31 104B- 1 1B+ 1 2 3C-C+ 1 1
Table 4.2: Counts of Item Severity Codes by Grade for Reading
Form Code Five Eight Eleven TotalA A- 8 17 20 45
A+ 15 15 13 43B- 1 1 2B+ 1 3 1 5C-C+ 1 1
B A- 10 14 17 41A+ 14 17 18 49B- 2 3 5B+ 3 1 4C-C+
Item Bias Review 43
Table 4.2 continued: Counts of Item Severity Codes by Grade for Reading
Form Code Five Eight Eleven TotalC A- 9 18 22 49
A+ 13 15 16 44B-B+ 1 3 4C-C+ 1 1
D A- 14 16 17 47A+ 9 16 15 40B- 1 1 2B+ 2 2C-C+ 1 1 2
E A- 13 9 18 40A+ 10 25 13 48B- 1 1B+ 1 1C-C+ 1 1 2
F A- 12 16 20 48A+ 11 18 14 43B- 1 1B+ 1 1 1 3C-C+ 1 1
G A- 13 15 23 51A+ 10 18 13 41B- 1 1B+ 2 3 5C-C+ 1 1 2
H A- 12 18 14 44A+ 12 15 12 39B- 3 3B+ 1 3 4C-C+ 2 2 4
Item Bias Review 44
Table 4.2 continued: Counts of Item Severity Codes by Grade for Reading
Form Code Five Eight Eleven TotalI A- 11 18 20 49
A+ 12 15 14 41B- 1 1B+ 1 3 4C-C+ 1 1
J A- 10 10 19 39A+ 14 22 17 53B- 1 3 4B+ 2 2C-C+ 1 1
W A- 29 41 32 102A+ 22 30 45 97B- 2 2B+ 1 1 1 3C-C+
CChhaapptteerr 55:: SSttuuddeenntt aanndd SScchhooooll LLeevveell SSccaalliinnggPrior to 2000 testing, when the PSSA design was more heavily matrix sampling,estimating school-level scale scores presented some statistical and psychometricchallenges. For example, the statistically efficient method to compute the school-levelscale score often gave an answer different for what would be obtained by averagingstudent ability estimates. To avoid this source of misunderstanding, the school levelscores were forced to equal the average of the appropriate students. The matrix samplingcomponent of the design was used at the standard level to estimate relative strengths andweaknesses for the school.
In 2000, with the new reporting design, more emphasis was placed on the commonsections. It became necessary to compute reliable estimates of student-level abilities, asindicated by the standard errors, at the level of the content standards. It is then possibleto aggregate all scale scores to the school, district and state levels without resorting to anycomplex algorithms. The results should be simpler to explain and interpret.
Because the original design of the PSSA was intended to produce school-level estimatesonly, the reporting metric was defined at the school level. For the base year, the mean ofall schools in the norming sample was set at 1300 and the standard deviation at 100. Thedistribution to which these apply is the content area scale score with all schools weightedequally. Consequently, the expectation now is for state-level means near 1300 andstandard deviations near 100. The state mean of student level scale scores will in generalbe somewhat different. This difference occurs because the mean of the school-levelscores counts schools equally regardless of size while the mean of the student-levelscores counts students equally.
For the eleventh grade, the PSSA also requires computing school-level estimatesseparately for vocational/technical students and non-vocational/technical students.Because student-level scale scores are now available for every student, this step requiresa different aggregation of the students but doesn’t require recomputing the student scalescores.
One would not expect large changes from year to year at the state level. Any changewould typically be in the same direction and proportional to changes in the p-values forthe linking items. One would also expect that schools that put more resources intoeffecting changes to show relatively more progress than those that do not. This type ofinformation is not available in a systematic way and any evaluation of this type woulddepend on anecdotal information.
Table 5.1 gives the transformations that were used to convert 2001 logits into the ScaledScores. These translation constants included the adjustments to equate 2001 to prioryears as well as the rescaling needed to convert to the (1300, 100) metric. Thesetransformations are used for all scale score calculations.
Table 5.1: Transformation to Scaled ScoresGrade Math ReadingFive 175x + 1243 185X + 1202Eight 160X + 1302 208X + 1297
Eleven 200X + 1268 400X + 1252
46
Common Items and Matrix Sampled ItemsWith the new design for the 2000 PSSA, school-level scale scores are based on all itemson all forms. This ensures that the scale scores used for school accountability are basedon the widest possible sampling of the curriculum. Student-level scores are based on thecommon items only. This ensures that any decision made about students will be done inthe most equitable manner.
This double system is intended to provide the best information possible for both types ofdecisions. The process requires computing two sets of student scores. The first set isbased on the common items and is used for calculations involving the students. Thesecond set is based on the common and matrix items and is used to aggregate up to theschool, district, and state levels.
In addition to adding complexity to the processing, this approach also introduces somepotential confusion. The mean of the student-level scale scores for a school will notequal the school-level scale score. While this is an obvious consequence of basing thescores on different sets of items, it is less obvious to the users of the reports.
Theoretically, it does not matter if a school is evaluated using the common items only orthe common plus matrix items. Both approaches to computing the school-level scalescores should estimate the same location on the underlying construct. As shown in figure5.1, for grade five, the correlation between the two school-level estimates is very near 1.0for both reading and math. This result is typical of those seen for the other grades aswell. Correlations at the student level will be lower, closer to the range of the typicalform reliabilities. While the two measures are both estimates of the same construct, theyare not equally good estimates. The measure using both common and matrix items relieson more items and so it has:
� Better coverage of the curriculum, and
� Smaller standard errors of measurement.
Because the correlations between the two measures are not perfect, some schools andsome students will appear to do better on one measure or the other.
Table 5.5: Grade Five Common versus Common + Matrix
800
900
1000
1100
1200
1300
1400
1500
1600
800 1000 1200 1400 1600
School level scaled Scores Common Items
Sta
nd
ard
s S
cale
d S
core
s A
ll I
tem
s
Read
Math
47
Scaled Scores for Content StandardsFrom the point of view of curriculum and instruction, content standards make eminentsense. For the point of view of test development, there is no problem writing itemspecifications and test items themselves that align with the content standards. Forreporting to educators and parents, performance by content standard is valued and iscarefully scrutinized. From the point of view of measurement, content standards are alogical problem.
If all items on the math or the reading assessment are to be aggregated into a singlemeasure, then all items must be measuring a single construct. This does not seem toleave room for content standards within the general content area. If the content standardsare truly different, then they should not be aggregated into a single score; if they are notdifferent, there is no point in reporting them separately.
The PSSA turns out to be typical of most assessments. Empirically, the content standardsare different but not very different. In any content area, one strong general factorcontains all the content standards. It is also possible to find some schools and somestudents for which the content standards are distinctly different.
The plots below illustrate the strong relationship among the content standards whencomputed at the school level. The correlations among content standard tend to be about0.90 across all grades and contents. Correlations at the student level would be lower.
There is a tendency for the content standard scaled scores to have slightly differentslopes. This tends to be associated with the different weighting given to constructedresponse tasks in the different areas. In prior years, this effect was much morepronounced in grade 11 reading which used another item type. Without the multipleresponse multiple choice items, this plot is very similar to the others.
48
Figure 5.2: Grade 5 Mathematics School Level Content Standards
800
1000
1200
1400
1600
800 1000 1200 1400 1600
School Level Scaled Scores
Co
nte
nt
Sta
nd
ard
s S
cale
d S
core
s
Figure 5.3: Grade 8 Mathematics School level Content Standards
800
1000
1200
1400
1600
800 1000 1200 1400 1600
School Level Scaled Scores
Co
nte
nt
Sta
nd
ard
S
cale
d S
core
s
Figure 5.4: Grade 11 Math School level Content Standards
800
1000
1200
1400
1600
800 1000 1200 1400 1600
School level Scaled Scores
Co
nte
nt
Sta
nd
ard
S
cale
d S
core
s
49
Figure 5.7: Grade 11 Reading School level Content Standards
800
1000
1200
1400
1600
800 1000 1200 1400 1600
School level Scaled Scores
Co
nte
nt
Sta
nd
ard
S
cale
d S
core
s
Figure 5.6: Grade 8 Reading School Level Content Standards
800
1000
1200
1400
1600
800 1000 1200 1400 1600
School Level Scaled Scores
Co
nte
nt
Sta
nd
ard
s S
cale
d S
core
s
Figure 5.5: Grade 5 Reading School Level Content Standards
800
1000
1200
1400
1600
800 1000 1200 1400 1600
School Level Scaled Scores
Co
nte
nt
Sta
nd
ard
s S
cale
d S
core
s
CChhaapptteerr 66:: IInntteerrpprreettiinngg SSccaalleedd SSccoorreess oonn tthhee PPSSSSAAA Scaled Score, in the simplest sense, is a transformed number correct score1. When allstudents take the same items, as in the common sections of the PSSA, the more points thestudent earns, the higher the scaled score received will be. The value of switching to themore abstract scaled score metric is to produce a more general result.
A raw score of, say, 30 is almost meaningless unless the reader is also told how manypoints were possible. The same score has quite different meanings if it is based on athirty-item test or on a sixty-item test. Number correct scores are transformed to percentcorrect scores to remove the effect of test length. In the same way, a score based on sixtydifficult items is quite different from the same score based on sixty easy items. Numbercorrect scores are transformed to scaled scores to remove the effects of test length anditem difficulty.
On the surface, a scaled score of, say, 1300 does not appear to have any more meaningthan a raw score of 30. A temperature of 37 degrees does not provide useful informationunless the scale is anchored to some known points. Useful anchors might be the freezingpoint of water or perhaps the normal body temperature for humans.2 To be meaningful,the new metric must be related to known objects and situations, in other words, to somesort of measurement standard.
School-Level Scales ScoresThe PSSA scaled score metric has been anchored to the mean school level scaled scorefor a base year and that point has been arbitrarily labeled 1300. The point on the scalethat is one standard deviation above the mean was labeled 1400. These labels arecompletely arbitrary; they could have be called zero and one or any other ordered pairwithout affecting any of the relationships among schools, years, students or items. Itwould simply be changing the labels on the axis of a graph without moving any of thepoints.
The 1300-metric was chosen so that negative or fractional scale scores are not needed andso that the PSSA scaled scores are not easily confused with the results from any othertesting program. Like the temperature scales of Fahrenheit and Celsius, the new scalewill acquire meaning only with experience.
A scaled score of 1300, or any other value, should have the same absolute meaning in thecurrent year as it had in previous years, when properly equated across years. A schoolwith a scaled score above 1300 performed better than did the average school in the baseyear.
More importantly, an increase in the scaled score from last year to the current year meansthe students’ performance has improved; it does not say anything about whether the examis easier or harder. To make these interpretations requires no information about thelength or the difficulty of the test in either year, although all of those are essentialinformation for deriving the scaled scores. 1 This is done in two steps. First, there is a nonlinear transformation that converts number correct scores tologits and then a linear transformation to convert logits to scaled scores.2 Most adults have enough experience with temperature scales that being told the temperature is on theFahrenheit scale or on the Celsius scale is enough information to render the measure useful.
Interpreting Scaled Scores 51
In the base year, the standard deviation of the school-level scaled scores was set to avalue of 100. If school scores are approximately normally distributed, a scaled score of1400, one standard deviation above the base year mean, means the school did better thanabout 5/6 of the schools in the base year. About two thirds of the schools will have scaledscores between 1200 and 1400. Conversely, about 16% of the schools will be below1200. Scaled scores of 1000 and 1600 are three standard deviations from the mean andso are extreme scores.
The best guide for giving meaning to the scaled scores is experience. Knowing thetypical school had a scaled score of 1300 in the base year provides a beginning forunderstanding the metric. Noting the performance of other known schools, such as thoseclassified as similar schools, will also help define the school-level scores. Mostimportantly, comparing a school’s score to its scores in previous years should be a goodindicator of progress.
Table 6.1: Grade Five StateWide Means of School Level Scaled Scores
Common Items Only Common and Matrix ItemsMean Std. Dev Mean Std. DevNorm NonNorm Norm NonNorm Norm NonNorm Norm NonNorm
Read 1311.4 1209.0 98.4 202.7 1310.2 1198.9 100.0 210.3Std 01 1333.0 1225.2 112.5 216.6 1330.6 1213.2 111.9 226.9Std 02 1330.9 1208.4 109.9 229.1 1325.5 1205.5 106.9 218.4Std 03 1313.3 1183.6 113.3 231.2 1311.6 1170.1 111.0 236.6Std 07 1315.2 1253.1 92.7 203.2 1317.9 1237.5 102.1 217.4Std 08 1319.2 1214.8 103.2 239.4 1322.6 1211.7 107.7 240.6
Std MCQ 1312.8 1219.6 97.5 198.9 1311.1 1210.2 98.8 205.8Std OE 1300.3 1069.4 156.9 336.2 1304.9 1060.8 146.4 334.5
Math 1314.4 1194.0 96.9 147.3 1313.4 1192.3 95.2 147.9Std 01 1326.3 1192.1 102.7 179.3 1326.2 1191.3 101.7 180.8Std 02 1327.5 1192.9 111.7 187.4 1325.0 1190.4 109.6 183.6
Calc 1321.3 1171.9 111.2 194.5 1320.1 1172.3 108.8 190.7NonCalc 1330.2 1221.6 111.9 202.4 1330.2 1221.6 111.9 202.4Std 03 1312.0 1211.4 106.7 152.8 1312.4 1206.1 106.9 151.1Std 04 1306.8 1208.7 94.8 178.5 1311.1 1204.7 97.4 178.9Std 05 1330.8 1156.0 103.6 194.2 1328.4 1158.0 99.2 193.5Std 06 1318.2 1198.2 105.1 194.0 1321.9 1199.2 105.9 191.5Std 07 1306.3 1182.4 101.2 190.4 1318.3 1185.7 105.7 194.1Std 08 1310.2 1182.7 95.3 148.2 1312.2 1183.8 95.5 151.4Std 09 1318.2 1172.0 114.1 152.4 1319.1 1176.4 108.8 148.9Std 10 1303.5 1177.8 112.7 154.2 1304.3 1181.4 113.1 150.7Std 11 1303.0 1210.1 86.8 148.0 1309.1 1209.5 89.4 148.9
Std MCQ 1314.2 1200.0 102.2 150.8 1313.0 1197.2 101.0 151.2Std OE 1330.8 1156.0 103.6 194.2 1328.4 1158.0 99.2 193.5
Interpreting Scaled Scores 52
Table 6.2: Grade Eight StateWide Means of School Level Scaled Scores
Common Items Only Common and Matrix ItemsMean Std. Dev Mean Std. DevNorm NonNorm Norm NonNorm Norm NonNorm Norm NonNorm
Read 1292.9 1195.2 95.6 224.5 1291.2 1183.4 103.3 239.3Std 01 1303.0 1222.3 93.9 222.4 1298.1 1203.3 104.0 241.9Std 02 1301.7 1194.5 106.3 243.3 1300.2 1181.5 114.3 255.2Std 03 1300.3 1177.9 113.0 255.5 1298.3 1170.1 114.3 258.7Std 07 1303.9 1215.2 102.6 247.2 1302.0 1201.5 109.3 260.0Std 08 1301.0 1196.1 99.6 231.8 1296.1 1190.2 103.0 237.3
Std MCQ 1292.6 1202.2 91.8 216.3 1290.6 1189.8 99.4 231.3Std OE 1295.1 1078.9 177.2 410.4 1290.0 1064.2 178.8 414.0
Math 1296.6 1222.9 92.4 175.4 1297.1 1222.1 92.0 175.7Std 01 1297.2 1204.0 109.3 206.2 1300.8 1205.0 111.5 207.5Std 02 1301.4 1240.6 94.9 202.4 1302.4 1236.2 94.5 202.5
Calc 1309.2 1238.1 90.3 185.5 1308.0 1227.5 94.4 196.4NonCalc 1291.4 1243.9 114.1 232.7 1291.4 1243.9 114.1 232.7Std 03 1308.7 1208.8 115.6 205.2 1307.3 1213.0 114.3 200.1Std 04 1277.9 1209.7 89.7 184.3 1282.1 1206.1 92.6 190.1Std 05 1332.7 1222.8 98.5 198.8 1335.7 1207.1 101.2 218.5Std 06 1294.1 1224.3 77.0 151.1 1296.4 1223.9 79.5 162.1Std 07 1276.6 1195.2 113.5 210.9 1290.2 1199.5 115.0 217.8Std 08 1303.2 1228.2 105.1 212.8 1302.3 1226.9 104.0 206.7Std 09 1288.1 1216.3 98.4 170.1 1289.9 1217.0 97.9 171.3Std 10 1304.1 1224.1 91.5 167.2 1303.1 1227.0 90.8 164.6Std 11 1271.0 1203.9 79.5 159.3 1273.9 1203.7 81.6 168.1
Std MCQ 1289.8 1223.1 93.3 174.5 1287.6 1221.8 92.6 174.1Std OE 1332.7 1222.8 98.5 198.8 1335.7 1207.1 101.2 218.5
Tables 6.1 through 6.3 provide the state level scaled score means for schools for both thetotal test and for the common section only. The total test was the basis for all school-level reporting while the common section was used for student level measures.
Table 6.3: Grade Eleven StateWide Means of Student Level Scaled Scores
Common Items Only Common and Matrix ItemsMean Std. Dev Mean Std. DevNorm NonNorm Norm NonNorm Norm NonNorm Norm NonNorm
Read 1291.7 1110.4 81.0 164.2 1291.3 1092.1 87.2 178.3Std 01 1296.8 1120.5 77.2 173.6 1294.2 1099.2 81.9 187.6Std 02 1302.4 1115.8 85.3 174.7 1299.9 1090.2 92.6 191.4Std 03 1302.4 1063.5 114.7 221.2 1299.0 1059.6 111.8 209.7Std 07 1301.7 1153.9 73.4 164.6 1299.6 1120.2 80.8 181.9Std 08 1298.8 1125.9 75.9 156.9 1296.5 1105.1 83.6 173.0
Std MCQ 1291.0 1121.3 77.0 157.8 1290.3 1100.9 83.4 173.3Std OE 1323.0 975.2 162.7 325.5 1310.4 952.8 162.1 323.3
Interpreting Scaled Scores 53
Common Items Only Common and Matrix ItemsMean Std. Dev Mean Std. DevNorm NonNorm Norm NonNorm Norm NonNorm Norm NonNorm
Math 1293.2 1109.9 85.0 146.4 1291.8 1112.4 83.6 144.5Std 01 1294.0 1107.3 98.5 168.5 1295.6 1100.4 100.2 169.0Std 02 1316.6 1124.7 85.8 166.2 1315.8 1121.6 87.7 169.0
Calc 1301.3 1083.1 95.7 175.5 1308.6 1089.0 98.3 183.9NonCalc 1299.5 1155.3 71.2 166.2 1299.5 1155.3 71.2 166.2Std 03 1279.0 1105.1 98.0 147.0 1280.6 1103.6 96.3 151.2Std 04 1290.9 1148.1 78.7 148.9 1292.4 1140.1 80.5 155.1Std 05 1264.3 999.1 105.8 217.4 1259.7 985.8 107.1 225.6Std 06 1277.3 1060.4 108.4 184.8 1280.6 1067.7 104.7 180.1Std 07 1295.6 1112.0 93.3 183.8 1296.4 1113.1 92.6 182.2Std 08 1298.2 1067.6 99.6 187.8 1293.0 1078.9 94.0 178.8Std 09 1295.6 1088.1 95.1 175.8 1291.7 1089.7 93.5 168.0Std 10 1290.2 1170.1 72.4 122.3 1290.7 1167.5 75.7 121.3Std 11 1299.3 1113.5 82.4 174.5 1302.0 1112.7 85.4 177.5
Std MCQ 1298.7 1120.3 86.7 148.2 1296.6 1123.2 85.0 146.7Std OE 1264.3 999.1 105.8 217.4 1259.7 985.8 107.1 225.6
Another approach to benchmarks is the percentile rank as shown in Figure 6.1 below.This chart converts the School level scaled score into a percentile rank that describes thedistribution of scores for all schools in the norming sample for the current year. Thischart applies only to School-level scaled scores computed from the common sections ofthe exam and can not be used for student-level scores. A complete table of school levelpercentile ranks is given in the appendix.
2001 School Level Percentiles
800
900
1000
1100
1200
1300
1400
1500
1600
0 10 20 30 40 50 60 70 80 90 100
Percentile Rank
Sch
oo
l Lev
el S
cale
d S
core
Reading 5 Math 5 Reading 8 Math 8 Reading 11 Math 11
Interpreting Scaled Scores 54
Student Level Scaled Scores
This discussion has been focused on the meaning of the metric at the school level. Forthe students, the mean scaled score will also be close to 1300 but the standard deviationwill about twice as large.
In interpreting a student-level scale score, the student’s measure can be compared to themean of the school or to other students in the state. Another approach is the percentilerank table (Table 6.4). This table converts the student level scaled score into a percentilerank that describes the distribution of score for all students in the norming sample for thecurrent year. This table applies only to student-level scaled scores computed from thecommon sections of the exam and cannot be used for school-level scores.
A complete percentile rank table that includes conversions for points received as well asscaled scores is included in the appendices.
Table 6.4: PSSA 2001 Percentile Ranks For StudentsGrade Five Grade Eight Grade Eleven
Percentile Math Reading Math Reading Math Reading Percentile
1 906 852 923 788 889 790 1
5 997 954 1005 914 969 890 5
10 1065 1025 1053 1008 1026 978 10
15 1108 1091 1097 1081 1066 1046 15
20 1149 1140 1129 1124 1104 1110 20
25 1180 1172 1161 1167 1141 1161 2530 1210 1220 1191 1210 1178 1200 30
35 1241 1254 1222 1240 1202 1238 35
40 1262 1271 1253 1269 1238 1265 40
45 1283 1306 1274 1300 1261 1292 45
50 1316 1325 1306 1331 1297 1319 50
55 1338 1363 1339 1363 1332 1347 55
60 1362 1383 1361 1380 1356 1376 60
65 1386 1404 1395 1414 1392 1406 65
70 1411 1426 1418 1432 1417 1437 70
75 1437 1449 1453 1450 1455 1454 75
80 1481 1473 1490 1489 1497 1488 80
85 1512 1527 1528 1509 1542 1524 85
90 1547 1557 1570 1552 1594 1563 90
95 1633 1627 1637 1599 1678 1606 95
99 1769 1774 1778 1713 1835 1707 99
Chapter 7: PSSA Reliability of Performance StandardsWith the advent of Criterion Referenced Testing (CRT), it became clear that thetraditional indicators of test reliability were not appropriate for the new situation. Thetraditional indicators depend on the variance of the trait in the population. However, withCRT, it is possible for the test to perfectly place the examinees with respect to thecriterion although there is little or no variance in the scores.
Livingston1 proposed a natural extension of the KR-20 coefficient that incorporates boththe measurement error and the errors of classification. The formula proposed for thisstatistic is:
� Κ2 = (σ2Τ + (µ − λ)2 ) / ( σ2
Τ + (µ − λ)2 + σ2ε)
In this notation, µ is the population mean and λ is the performance standard. Withmultiple choice items, this expression reduces to KR20 when the performance standard isnumerically equal to the mean. Inspection of the formula also indicates that K2 will neverbe less than the KR20.
Conversely unlike the KR20, this expression will yield a large positive value, even ifeveryone has the same ability (σ2
Τ = 0.0), if the distance from the ability to the standardis large compared to the size of the standard error.
The following table reports the value if for each performance standard of the 2001 PSSA.Because the standard for the proficient category is very near the state mean, the reliabilityis very near the value of the total test reliability. These statistics are computed in thescale score metric, which will typically yield slightly higher values than the raw scores.This reflects the nonlinear rescaling from raw score to logit score.
Table 1: Reliability and Standard Error of Performance Standards for the PSSA
Reliability of
Performance Standards
Standard Error at
Performance Standards
GradeContent
AreaTest
LengthTotal TestReliability
Basic Proficient Advanced Basic Proficient Advanced
5 Math 85 0.93 0.96 0.93 0.96 44 46 53
8 Math 85 0.94 0.96 0.94 0.97 53 57 68
11 Math 85 0.94 0.96 0.94 0.97 43 43 48
5 Read 60 0.89 0.94 0.9 0.94 59 61 68
8 Read 80 0.91 0.95 0.92 0.95 50 50 52
11 Read 88 0.92 0.95 0.93 0.96 59 59 66
1 Livingston, S.A. 1972. Criterion Referenced Applications of Classical Test Theory. Journal ofEducational Measurement 9: 13-26.
56
It is also informative to consider the standard error of measurement at Performancestandards. For the PSSA, these typically range from about 45 scale score points to about70 scale score points depending on how near the standard is to the center of the items.The standard errors can be used to create confidence intervals around the standards.
Ideally, these intervals would be small. However, the width is largely determined by thetotal number of items and the difficulty of the items with respect to the standard. It isreassuring to note that the intervals do not overlap. In all cases, the high value for onecategory is well below the low value for the next category.
Ap
pen
dix
A:
2001
PS
SA
Dis
trib
uti
on
Su
mm
arie
s b
y F
orm
M
ath
emat
ics
and
Rea
din
g
Gra
de
Co
nte
nt
Fo
rmN
um
ber
of
Exa
min
ees
Nu
mb
er
of
Sco
re
Po
ints
Mea
nS
td D
evS
td E
rro
r o
f M
eas
Tes
t R
etes
t R
elia
bili
tyM
in S
core
25th
%
tile
Med
ian
75th
%
tile
Max
S
core
5M
ath
Co
mm
on
142,
671
8554
.015
.54.
40.
927.
750
.465
.478
.010
0A
1430
610
565
.619
.05.
00.
934.
849
.264
.677
.099
B14
407
105
66.1
19.0
4.9
0.93
12.4
49.9
64.8
77.5
99C
1444
910
566
.119
.55.
00.
934.
849
.564
.977
.910
0D
1436
010
566
.419
.35.
10.
9311
.449
.965
.278
.010
0E
1433
910
564
.718
.85.
00.
935.
748
.862
.979
.510
0F
1431
410
565
.819
.04.
90.
936.
749
.464
.377
.110
0G
1438
010
565
.719
.04.
90.
935.
749
.664
.676
.910
0H
1444
210
565
.418
.84.
90.
935.
749
.264
.076
.899
I14
302
105
66.5
19.1
5.0
0.93
6.7
50.3
65.5
77.8
100
J13
372
105
66.0
19.0
4.9
0.93
10.5
50.1
64.8
77.2
100
8M
ath
Co
mm
on
139,
322
8549
.417
.04.
70.
926.
642
.258
.674
.110
0A
1407
410
559
.520
.95.
20.
944.
840
.757
.372
.710
0B
1387
910
560
.021
.25.
20.
945.
740
.857
.573
.810
0C
1389
310
560
.220
.85.
30.
9411
.441
.457
.873
.210
0D
1381
410
560
.821
.15.
30.
949.
542
.058
.874
.010
0E
1403
010
559
.721
.05.
30.
946.
741
.056
.772
.910
0F
1386
310
560
.221
.15.
20.
941.
041
.457
.773
.810
0G
1394
710
561
.121
.35.
30.
946.
742
.059
.174
.510
0H
1393
610
559
.921
.15.
20.
947.
640
.957
.273
.410
0I
1397
510
559
.420
.75.
20.
946.
740
.957
.172
.310
0J
1391
110
560
.921
.35.
30.
9410
.541
.758
.574
.510
011
Mat
hC
om
mo
n11
6,13
785
47.9
16.3
4.5
0.92
4.5
40.9
56.2
71.6
99.2
8A
1195
510
557
.720
.45.
10.
943.
839
.054
.570
.599
B11
750
105
57.4
20.8
5.2
0.94
0.0
38.2
54.2
71.0
98.1
C11
262
105
56.3
19.5
5.0
0.93
8.6
38.6
52.8
67.9
100
D11
690
105
57.5
20.5
5.1
0.94
0.0
38.8
54.1
70.5
99E
1169
710
556
.620
.15.
00.
942.
938
.253
.369
.399
F11
671
105
57.6
20.0
5.2
0.93
8.6
39.5
54.6
70.2
97.1
G11
725
105
56.9
19.9
5.1
0.93
0.0
39.0
53.3
68.9
100
H11
476
105
56.6
19.6
5.0
0.94
4.8
39.0
53.5
68.7
99I
1155
910
556
.619
.05.
00.
938.
639
.553
.567
.698
.1J
1135
210
556
.820
.15.
10.
935.
738
.553
.668
.910
0
Per
cen
t o
f P
oin
ts R
ecei
ved
Nu
mb
er o
f P
oin
ts R
ecei
ved
A 1
Ap
pen
dix
A:
2001
PS
SA
Dis
trib
uti
on
Su
mm
arie
s b
y F
orm
M
ath
emat
ics
and
Rea
din
g
Gra
de
Co
nte
nt
Fo
rmN
um
ber
of
Exa
min
ees
Nu
mb
er
of
Sco
re
Po
ints
Mea
nS
td D
evS
td E
rro
r o
f M
eas
Tes
t R
etes
t R
elia
bili
tyM
in S
core
25th
%
tile
Med
ian
75th
%
tile
Max
S
core
5R
ead
Co
mm
on
142,
810
6038
.110
.43.
50.
897.
852
.266
.977
.198
.5A
1433
289
57.1
15.3
4.2
0.92
5.6
53.3
68.2
77.5
97.8
B14
407
9057
.214
.84.
10.
926.
753
.367
.276
.393
.3C
1447
590
56.9
14.7
4.1
0.92
6.7
53.4
66.8
75.9
94.4
D14
373
9058
.214
.94.
20.
9211
.154
.968
.477
.497
.8E
1433
690
57.7
15.1
4.2
0.92
5.6
53.9
67.9
77.1
94.4
F14
342
9056
.314
.64.
10.
924.
452
.166
.075
.293
.3G
1440
490
57.5
14.8
4.1
0.92
6.7
54.0
67.5
76.7
94.4
H14
459
9058
.915
.44.
20.
937.
855
.469
.278
.796
.7I
1430
490
57.8
14.9
4.2
0.92
2.2
54.3
67.8
76.8
95.6
J13
378
9057
.415
.04.
10.
9310
.053
.767
.776
.795
.68
Rea
dC
om
mo
n13
9,07
380
49.4
12.9
4.1
0.90
7.5
51.7
64.9
74.2
94.7
7A
1403
912
073
.219
.14.
90.
936.
751
.564
.773
.291
.7B
1384
712
071
.418
.84.
80.
939.
249
.862
.871
.690
.8C
1388
012
074
.019
.44.
90.
940.
052
.165
.574
.292
.5D
1377
012
075
.620
.24.
90.
945.
052
.867
.176
.192
.5E
1397
612
073
.219
.75.
00.
946.
750
.564
.473
.893
.3F
1384
412
075
.619
.54.
90.
941.
753
.666
.775
.492
.5G
1393
612
072
.319
.24.
80.
945.
050
.663
.972
.689
.2H
1391
912
072
.618
.64.
90.
936.
751
.263
.872
.491
.7I
1397
212
072
.719
.04.
80.
947.
551
.464
.372
.790
.8J
1389
012
072
.019
.14.
90.
935.
850
.063
.372
.394
.211
Rea
dC
om
mo
n11
5,56
688
53.4
15.0
4.4
0.91
3.0
49.3
64.1
74.1
94.9
1A
1191
312
778
.322
.55.
30.
942.
449
.865
.575
.794
.5B
1167
913
182
.323
.15.
40.
950.
051
.067
.076
.693
.9C
1121
513
079
.122
.95.
40.
940.
049
.064
.574
.793
.8D
1165
112
575
.721
.55.
30.
940.
048
.964
.174
.295
.2E
1163
812
375
.521
.55.
20.
948.
950
.065
.275
.293
.5F
1162
112
877
.222
.25.
30.
944.
748
.163
.774
.292
.2G
1165
413
282
.123
.45.
40.
953.
050
.665
.976
.495
.5H
1141
812
474
.921
.55.
30.
940.
048
.864
.074
.294
.4I
1148
812
778
.622
.15.
30.
946.
350
.465
.875
.694
.5J
1128
913
182
.722
.75.
30.
9511
.552
.367
.476
.794
.7
Nu
mb
er o
f P
oin
ts R
ecei
ved
Per
cen
t o
f P
oin
ts R
ecei
ved
A 2
Ap
pen
dix
B:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r M
ath
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)A
128
B-2
.95
0.00
0.95
0.32
0.01
0.95
*0.
030.
010.
000.
00-0
.10
0.32
*-0
.24
-0.0
8A
129
D-2
.20
0.00
0.89
0.25
0.07
0.02
0.01
0.89
*0.
000.
00-0
.11
-0.1
6-0
.15
0.25
*A
130
D-0
.67
0.00
0.60
0.45
0.06
0.10
0.24
0.60
*0.
000.
00-0
.25
-0.1
5-0
.24
0.45
*A
131
C-0
.98
0.00
0.68
0.54
0.09
0.10
0.68
*0.
130.
010.
00-0
.24
-0.2
20.
54*
-0.3
0A
132
B-0
.71
0.00
0.61
0.55
0.06
0.61
*0.
180.
140.
010.
00-0
.15
0.55
*-0
.28
-0.3
1A
133
B-0
.22
0.00
0.48
0.49
0.13
0.48
*0.
200.
190.
010.
00-0
.24
0.49
*-0
.10
-0.3
0A
134
D-0
.64
0.00
0.60
0.55
0.13
0.13
0.14
0.60
*0.
010.
00-0
.18
-0.2
8-0
.29
0.55
*A
135
D-0
.40
0.00
0.53
0.39
0.11
0.15
0.21
0.53
*0.
010.
00-0
.12
-0.1
8-0
.20
0.39
*A
136
A-2
.25
0.00
0.90
0.43
0.90
*0.
020.
060.
010.
010.
000.
43*
-0.2
0-0
.28
-0.1
6A
137
C-0
.02
0.00
0.43
0.37
0.09
0.12
0.43
*0.
350.
010.
00-0
.17
-0.1
60.
37*
-0.1
5A
138
D-1
.32
0.00
0.76
0.57
0.09
0.07
0.09
0.76
*0.
010.
00-0
.31
-0.2
6-0
.29
0.57
*A
139
B0.
110.
000.
400.
200.
170.
40*
0.29
0.14
0.01
0.00
-0.0
70.
20*
-0.0
3-0
.12
A14
0A
-0.9
60.
000.
680.
600.
68*
0.07
0.11
0.14
0.01
0.00
0.60
*-0
.20
-0.2
5-0
.40
A14
1D
-1.2
50.
000.
740.
580.
070.
150.
040.
74*
0.01
0.00
-0.2
2-0
.41
-0.2
10.
58*
A14
2B
-0.4
40.
000.
540.
450.
170.
54*
0.15
0.13
0.01
0.00
-0.1
80.
45*
-0.1
9-0
.22
B12
8C
-1.5
50.
000.
780.
560.
060.
100.
78*
0.04
0.01
0.00
-0.3
2-0
.33
0.56
*-0
.18
B12
9A
-2.6
90.
000.
940.
340.
94*
0.02
0.03
0.02
0.00
0.00
0.34
*-0
.17
-0.1
6-0
.18
B13
0D
-1.4
20.
000.
760.
400.
150.
050.
040.
76*
0.01
0.00
-0.2
2-0
.16
-0.2
30.
40*
B13
1A
-1.3
60.
000.
740.
410.
74*
0.03
0.03
0.20
0.00
0.00
0.41
*-0
.19
-0.1
9-0
.26
B13
2C
-1.1
20.
000.
690.
490.
130.
070.
69*
0.11
0.01
0.00
-0.2
7-0
.20
0.49
*-0
.24
B13
3B
-0.8
70.
000.
620.
460.
180.
62*
0.06
0.14
0.00
0.00
-0.2
00.
46*
-0.1
6-0
.28
B13
4C
-0.9
60.
000.
650.
510.
150.
120.
65*
0.08
0.01
0.00
-0.2
4-0
.30
0.51
*-0
.18
B13
5D
-2.2
00.
000.
890.
490.
020.
050.
040.
89*
0.01
0.00
-0.2
1-0
.27
-0.2
70.
49*
B13
6B
-0.2
30.
000.
450.
460.
130.
45*
0.14
0.28
0.00
0.00
-0.2
90.
46*
-0.1
0-0
.18
B13
7C
-0.3
70.
000.
490.
490.
040.
380.
49*
0.09
0.01
0.00
-0.2
3-0
.20
0.49
*-0
.32
B13
8A
-2.4
40.
000.
910.
430.
91*
0.02
0.03
0.03
0.00
0.00
0.43
*-0
.20
-0.2
4-0
.22
B13
9D
-1.9
80.
000.
860.
500.
040.
040.
060.
86*
0.00
0.00
-0.2
5-0
.25
-0.2
70.
50*
B14
0C
-0.0
60.
000.
400.
420.
350.
080.
40*
0.16
0.01
0.00
-0.2
6-0
.16
0.42
*-0
.07
B14
1C
-0.7
00.
000.
580.
400.
060.
290.
58*
0.07
0.01
0.00
-0.1
5-0
.19
0.40
*-0
.23
B14
2D
-1.1
80.
000.
700.
560.
130.
110.
060.
70*
0.01
0.00
-0.3
3-0
.26
-0.2
10.
56*
B 1
Ap
pen
dix
B:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r M
ath
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)C
128
C-1
.82
0.00
0.85
0.51
0.03
0.04
0.85
*0.
080.
000.
00-0
.21
-0.1
90.
51*
-0.3
7C
129
B-0
.86
0.00
0.64
0.42
0.27
0.64
*0.
020.
060.
000.
00-0
.22
0.42
*-0
.21
-0.2
4C
130
D-1
.29
0.00
0.74
0.49
0.04
0.09
0.13
0.74
*0.
010.
00-0
.12
-0.2
9-0
.29
0.49
*C
131
C-1
.59
0.00
0.81
0.53
0.03
0.13
0.81
*0.
030.
000.
00-0
.23
-0.3
80.
53*
-0.1
8C
132
B-1
.15
0.00
0.71
0.52
0.15
0.71
*0.
050.
080.
000.
00-0
.30
0.52
*-0
.25
-0.2
3C
133
D-1
.30
0.00
0.75
0.53
0.10
0.06
0.09
0.75
*0.
000.
00-0
.29
-0.2
8-0
.24
0.53
*C
134
A-0
.87
0.00
0.64
0.62
0.64
*0.
160.
040.
160.
010.
000.
62*
-0.3
9-0
.19
-0.2
9C
135
B-0
.28
0.00
0.48
0.38
0.08
0.48
*0.
360.
080.
010.
00-0
.22
0.38
*-0
.14
-0.2
0C
136
A-0
.30
0.00
0.48
0.53
0.48
*0.
140.
240.
140.
010.
000.
53*
-0.1
3-0
.31
-0.2
2C
137
C-0
.99
0.00
0.67
0.54
0.15
0.11
0.67
*0.
060.
000.
00-0
.33
-0.2
30.
54*
-0.2
1C
138
C-0
.30
0.00
0.48
0.51
0.07
0.11
0.48
*0.
340.
000.
00-0
.20
-0.3
00.
51*
-0.2
2C
139
C-0
.79
0.00
0.62
0.58
0.12
0.11
0.62
*0.
150.
000.
00-0
.26
-0.2
40.
58*
-0.3
2C
140
C-1
.86
0.00
0.86
0.50
0.04
0.06
0.86
*0.
050.
000.
00-0
.22
-0.3
00.
50*
-0.2
6C
141
B-0
.95
0.00
0.66
0.51
0.20
0.66
*0.
060.
070.
010.
00-0
.36
0.51
*-0
.22
-0.1
2C
142
D-0
.26
0.00
0.47
0.51
0.24
0.18
0.11
0.47
*0.
010.
00-0
.29
-0.1
6-0
.19
0.51
*D
128
D-1
.57
0.00
0.81
0.54
0.03
0.02
0.13
0.81
*0.
000.
00-0
.16
-0.1
9-0
.44
0.54
*D
129
B-0
.73
0.00
0.63
0.48
0.05
0.63
*0.
080.
240.
000.
00-0
.18
0.48
*-0
.21
-0.3
0D
130
B-1
.54
0.00
0.81
0.39
0.08
0.81
*0.
060.
050.
000.
00-0
.19
0.39
*-0
.17
-0.2
5D
131
A-1
.24
0.00
0.75
0.52
0.75
*0.
050.
110.
090.
010.
000.
52*
-0.2
4-0
.28
-0.2
7D
132
A-0
.84
0.00
0.66
0.40
0.66
*0.
090.
070.
190.
000.
000.
40*
-0.1
1-0
.14
-0.2
9D
133
D-1
.23
0.00
0.75
0.47
0.07
0.05
0.13
0.75
*0.
000.
00-0
.25
-0.1
9-0
.26
0.47
*D
134
A-1
.06
0.00
0.71
0.39
0.71
*0.
170.
090.
040.
000.
000.
39*
-0.1
8-0
.21
-0.2
2D
135
D-0
.35
0.00
0.53
0.55
0.13
0.11
0.23
0.53
*0.
010.
00-0
.28
-0.2
0-0
.25
0.55
*D
136
D-0
.79
0.00
0.64
0.57
0.12
0.17
0.07
0.64
*0.
000.
00-0
.28
-0.3
4-0
.20
0.57
*D
137
C-0
.38
0.00
0.53
0.40
0.09
0.22
0.53
*0.
150.
000.
00-0
.24
-0.1
70.
40*
-0.1
4D
138
B0.
210.
000.
380.
520.
120.
38*
0.41
0.09
0.00
0.00
-0.1
40.
52*
-0.3
4-0
.11
D13
9D
-1.6
60.
000.
830.
510.
080.
050.
040.
83*
0.00
0.00
-0.2
8-0
.27
-0.2
40.
51*
D14
0B
-0.3
00.
000.
510.
340.
060.
51*
0.37
0.05
0.01
0.00
-0.1
50.
34*
-0.1
6-0
.23
D14
1C
-0.4
30.
000.
550.
510.
060.
100.
55*
0.28
0.00
0.00
-0.2
5-0
.23
0.51
*-0
.25
D14
2C
-0.2
60.
000.
500.
420.
050.
120.
50*
0.32
0.01
0.00
-0.1
7-0
.18
0.42
*-0
.22
B 2
Ap
pen
dix
B:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r M
ath
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)E
128
D-0
.52
0.00
0.58
0.35
0.05
0.07
0.30
0.58
*0.
000.
00-0
.19
-0.1
6-0
.18
0.35
*E
129
C-0
.73
0.00
0.63
0.34
0.07
0.23
0.63
*0.
060.
010.
00-0
.19
-0.1
30.
34*
-0.2
1E
130
D-1
.40
0.00
0.78
0.47
0.04
0.10
0.07
0.78
*0.
000.
00-0
.20
-0.2
6-0
.25
0.47
*E
131
A-1
.32
0.00
0.77
0.50
0.77
*0.
070.
090.
080.
000.
000.
50*
-0.2
4-0
.23
-0.3
0E
132
A-1
.67
0.00
0.83
0.47
0.83
*0.
080.
050.
040.
000.
000.
47*
-0.2
6-0
.24
-0.2
3E
133
D-0
.48
0.00
0.56
0.54
0.10
0.11
0.22
0.56
*0.
010.
00-0
.23
-0.2
3-0
.29
0.54
*E
134
B-0
.92
0.00
0.68
0.46
0.12
0.68
*0.
170.
030.
000.
00-0
.22
0.46
*-0
.27
-0.1
9E
135
A0.
410.
000.
340.
570.
34*
0.14
0.48
0.04
0.00
0.00
0.57
*-0
.07
-0.4
1-0
.15
E13
6C
-0.7
70.
000.
640.
450.
140.
160.
64*
0.06
0.00
0.00
-0.2
2-0
.23
0.45
*-0
.21
E13
7D
-0.9
80.
000.
690.
470.
080.
070.
150.
69*
0.00
0.00
-0.2
7-0
.24
-0.2
00.
47*
E13
8B
0.37
0.00
0.35
0.44
0.19
0.35
*0.
220.
240.
000.
00-0
.17
0.44
*-0
.24
-0.0
8E
139
A-1
.42
0.00
0.79
0.42
0.79
*0.
090.
060.
060.
010.
000.
42*
-0.1
7-0
.25
-0.2
3E
140
C-1
.17
0.00
0.73
0.51
0.06
0.14
0.73
*0.
060.
000.
00-0
.22
-0.3
10.
51*
-0.2
2E
141
A0.
100.
000.
410.
310.
41*
0.09
0.38
0.12
0.00
0.00
0.31
*-0
.22
-0.0
4-0
.19
E14
2B
-1.0
40.
000.
710.
490.
080.
71*
0.13
0.08
0.01
0.00
-0.2
30.
49*
-0.2
5-0
.25
F12
8A
-2.8
40.
000.
950.
310.
95*
0.01
0.02
0.01
0.00
0.00
0.31
*-0
.14
-0.1
9-0
.15
F12
9B
-0.6
70.
000.
580.
420.
120.
58*
0.17
0.12
0.00
0.00
-0.1
40.
42*
-0.2
2-0
.23
F13
0B
-0.9
90.
000.
670.
530.
140.
67*
0.09
0.10
0.00
0.00
-0.2
50.
53*
-0.2
7-0
.26
F13
1B
-1.2
60.
000.
730.
500.
160.
73*
0.06
0.05
0.00
0.00
-0.3
40.
50*
-0.2
2-0
.17
F13
2A
-2.4
40.
000.
920.
340.
92*
0.03
0.01
0.04
0.00
0.00
0.34
*-0
.20
-0.1
6-0
.18
F13
3C
-0.2
90.
000.
480.
540.
120.
140.
48*
0.26
0.00
0.00
-0.3
0-0
.23
0.54
*-0
.19
F13
4B
-1.0
20.
000.
670.
500.
140.
67*
0.15
0.04
0.00
0.00
-0.3
00.
50*
-0.2
5-0
.19
F13
5D
-1.3
10.
000.
740.
510.
090.
110.
060.
74*
0.00
0.00
-0.1
9-0
.36
-0.2
10.
51*
F13
6D
-0.3
10.
000.
480.
500.
110.
090.
320.
48*
0.00
0.00
-0.2
6-0
.15
-0.2
60.
50*
F13
7A
-1.1
90.
000.
720.
560.
72*
0.08
0.07
0.13
0.00
0.00
0.56
*-0
.26
-0.2
3-0
.33
F13
8B
-0.5
80.
000.
560.
460.
070.
56*
0.12
0.25
0.00
0.00
-0.1
60.
46*
-0.1
9-0
.28
F13
9D
-0.2
10.
000.
460.
450.
310.
130.
100.
46*
0.01
0.00
-0.2
1-0
.22
-0.1
40.
45*
F14
0B
-0.6
80.
000.
580.
560.
090.
58*
0.12
0.21
0.00
0.00
-0.2
90.
56*
-0.2
5-0
.25
F14
1C
-1.3
20.
000.
750.
460.
110.
080.
75*
0.06
0.00
0.00
-0.2
6-0
.24
0.46
*-0
.19
F14
2C
-0.7
30.
000.
600.
500.
160.
130.
60*
0.11
0.01
0.00
-0.2
1-0
.32
0.50
*-0
.17
B 3
Ap
pen
dix
B:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r M
ath
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)G
128
D-1
.18
0.00
0.73
0.45
0.09
0.04
0.13
0.73
*0.
000.
00-0
.33
-0.1
7-0
.17
0.45
*G
129
D-1
.08
0.00
0.71
0.55
0.10
0.07
0.12
0.71
*0.
010.
00-0
.27
-0.2
8-0
.27
0.55
*G
130
C-1
.34
0.00
0.77
0.59
0.06
0.11
0.77
*0.
060.
000.
00-0
.19
-0.4
40.
59*
-0.2
5G
131
B-1
.16
0.00
0.73
0.50
0.10
0.73
*0.
110.
070.
010.
00-0
.23
0.50
*-0
.28
-0.2
2G
132
A-1
.17
0.00
0.73
0.61
0.73
*0.
060.
130.
080.
010.
000.
61*
-0.2
2-0
.46
-0.2
1G
133
C-0
.33
0.00
0.51
0.49
0.09
0.27
0.51
*0.
130.
010.
00-0
.15
-0.1
70.
49*
-0.3
4G
134
D-1
.95
0.00
0.87
0.38
0.02
0.05
0.06
0.87
*0.
000.
00-0
.17
-0.2
4-0
.20
0.38
*G
135
B-1
.12
0.00
0.72
0.49
0.08
0.72
*0.
070.
130.
010.
00-0
.24
0.49
*-0
.22
-0.2
7G
136
D-0
.59
0.00
0.58
0.57
0.29
0.07
0.06
0.58
*0.
000.
00-0
.45
-0.1
7-0
.10
0.57
*G
137
C-0
.45
0.00
0.54
0.52
0.16
0.16
0.54
*0.
140.
010.
00-0
.28
-0.1
80.
52*
-0.2
3G
138
B-1
.27
0.00
0.75
0.37
0.03
0.75
*0.
210.
020.
000.
00-0
.20
0.37
*-0
.24
-0.1
6G
139
A0.
450.
000.
300.
310.
30*
0.15
0.32
0.22
0.01
0.00
0.31
*-0
.13
-0.1
1-0
.07
G14
0C
-0.9
40.
000.
670.
510.
090.
150.
67*
0.09
0.01
0.00
-0.3
0-0
.20
0.51
*-0
.26
G14
1B
0.57
0.00
0.28
0.37
0.18
0.28
*0.
440.
100.
010.
00-0
.16
0.37
*-0
.12
-0.1
2G
142
B-1
.52
0.00
0.80
0.45
0.03
0.80
*0.
120.
050.
010.
00-0
.21
0.45
*-0
.24
-0.2
5H
128
D-1
.30
0.00
0.75
0.41
0.04
0.18
0.04
0.75
*0.
000.
00-0
.18
-0.2
6-0
.19
0.41
*H
129
C-1
.93
0.00
0.86
0.53
0.02
0.11
0.86
*0.
010.
000.
00-0
.16
-0.4
40.
53*
-0.1
4H
130
D-1
.67
0.00
0.82
0.44
0.03
0.11
0.04
0.82
*0.
000.
00-0
.23
-0.2
6-0
.20
0.44
*H
131
B-0
.73
0.00
0.61
0.53
0.10
0.61
*0.
200.
090.
010.
00-0
.24
0.53
*-0
.28
-0.2
4H
132
B-1
.16
0.00
0.71
0.50
0.06
0.71
*0.
110.
110.
000.
00-0
.19
0.50
*-0
.23
-0.3
1H
133
A0.
070.
000.
390.
280.
39*
0.19
0.28
0.14
0.01
0.00
0.28
*-0
.21
-0.1
20.
03?
H13
4B
-2.8
30.
000.
950.
310.
030.
95*
0.01
0.01
0.00
0.00
-0.1
80.
31*
-0.1
3-0
.15
H13
5B
-0.5
00.
000.
540.
530.
250.
54*
0.16
0.05
0.00
0.00
-0.2
10.
53*
-0.3
1-0
.23
H13
6A
-0.0
20.
000.
410.
500.
41*
0.21
0.32
0.06
0.00
0.00
0.50
*-0
.14
-0.2
3-0
.30
H13
7D
-1.3
30.
000.
750.
450.
030.
030.
190.
75*
0.00
0.00
-0.1
7-0
.20
-0.3
10.
45*
H13
8A
-0.8
50.
000.
640.
490.
64*
0.12
0.14
0.10
0.00
0.00
0.49
*-0
.21
-0.2
5-0
.23
H13
9C
-0.4
10.
000.
520.
600.
050.
400.
52*
0.03
0.00
0.00
-0.2
0-0
.45
0.60
*-0
.13
H14
0A
-1.2
60.
000.
740.
500.
74*
0.13
0.06
0.07
0.00
0.00
0.50
*-0
.25
-0.2
8-0
.24
H14
1C
-0.3
50.
000.
500.
480.
110.
300.
50*
0.09
0.00
0.00
-0.2
6-0
.21
0.48
*-0
.18
H14
2B
-0.8
30.
000.
630.
570.
120.
63*
0.07
0.17
0.01
0.00
-0.3
00.
57*
-0.2
4-0
.27
B 4
Ap
pen
dix
B:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r M
ath
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)I
128
A-2
.08
0.00
0.88
0.43
0.88
*0.
040.
020.
050.
000.
000.
43*
-0.2
0-0
.18
-0.2
8I
129
B-1
.15
0.00
0.71
0.53
0.13
0.71
*0.
110.
050.
000.
00-0
.25
0.53
*-0
.32
-0.2
1I
130
A-0
.98
0.00
0.67
0.56
0.67
*0.
130.
110.
090.
000.
000.
56*
-0.3
5-0
.28
-0.1
6I
131
C-1
.92
0.00
0.86
0.51
0.07
0.03
0.86
*0.
040.
000.
00-0
.34
-0.2
10.
51*
-0.2
2I
132
D-0
.73
0.00
0.61
0.50
0.25
0.08
0.06
0.61
*0.
000.
00-0
.39
-0.2
20.
00?
0.50
*I
133
B-1
.51
0.00
0.79
0.43
0.07
0.79
*0.
080.
050.
000.
00-0
.20
0.43
*-0
.26
-0.1
9I
134
B-0
.66
0.00
0.59
0.52
0.21
0.59
*0.
080.
120.
010.
00-0
.31
0.52
*-0
.12
-0.2
6I
135
B0.
100.
000.
380.
420.
310.
38*
0.14
0.17
0.01
0.00
-0.1
40.
42*
-0.1
5-0
.21
I13
6A
-0.8
70.
000.
650.
550.
65*
0.08
0.06
0.21
0.00
0.00
0.55
*-0
.24
-0.2
4-0
.31
I13
7A
-1.1
30.
000.
710.
400.
71*
0.07
0.14
0.07
0.01
0.00
0.40
*-0
.19
-0.1
8-0
.24
I13
8B
-0.5
00.
000.
550.
540.
150.
55*
0.05
0.25
0.00
0.00
-0.2
30.
54*
-0.2
2-0
.29
I13
9D
-1.4
70.
000.
780.
450.
050.
090.
070.
78*
0.00
0.00
-0.2
0-0
.26
-0.2
00.
45*
I14
0C
-0.4
50.
000.
530.
480.
240.
090.
53*
0.13
0.01
0.00
-0.2
8-0
.23
0.48
*-0
.12
I14
1C
-0.4
00.
000.
520.
400.
110.
280.
52*
0.08
0.01
0.00
-0.2
1-0
.15
0.40
*-0
.21
I14
2A
-0.9
90.
000.
680.
520.
68*
0.10
0.05
0.17
0.01
0.00
0.52
*-0
.19
-0.2
4-0
.33
J12
8C
-1.6
30.
000.
810.
440.
030.
110.
81*
0.04
0.00
0.00
-0.2
3-0
.26
0.44
*-0
.20
J12
9D
-1.0
30.
000.
680.
500.
160.
050.
110.
68*
0.00
0.00
-0.2
9-0
.20
-0.2
30.
50*
J13
0B
-2.3
30.
000.
910.
440.
030.
91*
0.03
0.04
0.00
0.00
-0.2
00.
44*
-0.2
1-0
.27
J13
1D
-0.8
60.
000.
640.
440.
130.
060.
170.
64*
0.00
0.00
-0.2
6-0
.24
-0.1
50.
44*
J13
2B
-1.3
00.
000.
750.
510.
050.
75*
0.04
0.16
0.00
0.00
-0.2
20.
51*
-0.2
3-0
.33
J13
3D
-0.5
70.
000.
570.
600.
140.
080.
220.
57*
0.00
0.00
-0.3
2-0
.27
-0.2
50.
60*
J13
4A
-1.5
40.
000.
800.
430.
80*
0.08
0.06
0.07
0.00
0.00
0.43
*-0
.22
-0.2
5-0
.19
J13
5B
-0.9
10.
000.
650.
430.
090.
65*
0.17
0.09
0.01
0.00
-0.2
20.
43*
-0.2
2-0
.17
J13
6A
-0.0
10.
000.
410.
450.
41*
0.06
0.23
0.30
0.01
0.00
0.45
*-0
.20
-0.1
9-0
.18
J13
7A
-1.2
30.
000.
730.
490.
73*
0.11
0.10
0.05
0.00
0.00
0.49
*-0
.23
-0.2
6-0
.24
J13
8D
-1.1
80.
000.
720.
550.
090.
070.
120.
72*
0.00
0.00
-0.2
3-0
.27
-0.3
20.
55*
J13
9C
0.37
0.00
0.32
0.38
0.15
0.36
0.32
*0.
170.
000.
00-0
.20
-0.0
70.
38*
-0.1
6J
140
D-1
.92
0.00
0.86
0.51
0.04
0.05
0.05
0.86
*0.
000.
00-0
.27
-0.2
4-0
.29
0.51
*J
141
C-0
.92
0.00
0.66
0.50
0.11
0.12
0.66
*0.
100.
000.
00-0
.28
-0.3
00.
50*
-0.1
3J
142
A-0
.13
0.00
0.44
0.39
0.44
*0.
130.
310.
110.
010.
000.
39*
-0.1
4-0
.11
-0.2
7
B 5
Ap
pen
dix
B:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r M
ath
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)W
1B
-1.9
70.
000.
850.
340.
070.
85*
0.05
0.03
0.00
0.00
-0.1
30.
34*
-0.3
0-0
.14
W2
A-1
.51
0.00
0.78
0.48
0.78
*0.
110.
080.
030.
000.
000.
48*
-0.2
9-0
.24
-0.2
6W
3B
-1.0
90.
000.
710.
560.
060.
71*
0.12
0.12
0.00
0.00
-0.2
20.
56*
-0.2
9-0
.35
W4
C-1
.78
0.00
0.82
0.42
0.08
0.07
0.82
*0.
030.
000.
00-0
.28
-0.2
00.
42*
-0.1
9W
5C
-0.7
10.
000.
630.
540.
080.
260.
63*
0.04
0.00
0.00
-0.3
4-0
.30
0.54
*-0
.17
W6
B-1
.56
0.00
0.79
0.42
0.11
0.79
*0.
060.
050.
000.
00-0
.27
0.42
*-0
.17
-0.2
3W
7C
-0.7
00.
000.
620.
440.
110.
190.
62*
0.08
0.00
0.00
-0.3
2-0
.19
0.44
*-0
.12
W8
D-1
.01
0.00
0.69
0.41
0.05
0.18
0.08
0.69
*0.
000.
00-0
.24
-0.2
2-0
.20
0.41
*W
9C
-0.7
10.
000.
620.
370.
170.
090.
62*
0.12
0.00
0.00
-0.0
5-0
.13
0.37
*-0
.37
W10
A-2
.01
0.00
0.86
0.37
0.86
*0.
030.
030.
080.
000.
000.
37*
-0.1
4-0
.17
-0.2
8W
11D
-2.6
90.
000.
920.
350.
020.
030.
030.
92*
0.00
0.00
-0.2
0-0
.20
-0.1
90.
35*
W12
D-0
.96
0.00
0.68
0.33
0.04
0.12
0.17
0.68
*0.
000.
00-0
.17
-0.2
2-0
.13
0.33
*W
13A
-2.0
10.
000.
860.
330.
86*
0.05
0.01
0.08
0.00
0.00
0.33
*-0
.19
-0.1
4-0
.21
W14
C-1
.40
0.00
0.76
0.28
0.04
0.12
0.76
*0.
080.
000.
00-0
.14
-0.0
60.
28*
-0.2
6W
15D
-0.7
20.
000.
630.
450.
140.
170.
070.
63*
0.00
0.00
-0.3
6-0
.17
-0.1
20.
45*
W16
A-2
.62
0.00
0.92
0.39
0.92
*0.
030.
030.
020.
000.
000.
39*
-0.2
3-0
.22
-0.2
0W
17A
-0.6
00.
000.
600.
500.
60*
0.16
0.19
0.04
0.00
0.00
0.50
*-0
.23
-0.3
1-0
.18
W18
B-1
.68
0.00
0.81
0.50
0.03
0.81
*0.
060.
100.
000.
00-0
.22
0.50
*-0
.25
-0.3
3W
19D
-1.8
60.
000.
840.
380.
060.
030.
080.
84*
0.00
0.00
-0.1
8-0
.21
-0.2
30.
38*
W20
C-0
.76
0.00
0.64
0.51
0.08
0.14
0.64
*0.
140.
000.
00-0
.26
-0.2
90.
51*
-0.2
2W
21D
-0.0
60.
000.
480.
360.
120.
280.
130.
48*
0.00
0.00
-0.2
7-0
.03
-0.2
40.
36*
W22
B-0
.41
0.00
0.56
0.57
0.11
0.56
*0.
200.
130.
000.
00-0
.13
0.57
*-0
.30
-0.3
5W
23C
0.05
0.00
0.45
0.35
0.20
0.23
0.45
*0.
110.
010.
00-0
.18
-0.0
90.
35*
-0.1
9W
24C
-1.3
30.
000.
750.
510.
040.
100.
75*
0.11
0.00
0.00
-0.1
9-0
.29
0.51
*-0
.29
W26
A-3
.06
0.00
0.95
0.31
0.95
*0.
010.
010.
040.
000.
000.
31*
-0.1
2-0
.11
-0.2
5W
27B
-1.9
20.
000.
840.
520.
070.
84*
0.03
0.06
0.00
0.00
-0.3
10.
52*
-0.2
0-0
.33
W28
D-1
.28
0.00
0.74
0.44
0.03
0.18
0.05
0.74
*0.
000.
00-0
.18
-0.3
4-0
.17
0.44
*W
29C
-0.7
20.
000.
630.
440.
190.
090.
63*
0.09
0.00
0.00
-0.2
3-0
.21
0.44
*-0
.21
W30
B-0
.50
0.00
0.58
0.48
0.11
0.58
*0.
180.
130.
000.
00-0
.15
0.48
*-0
.30
-0.2
1W
31B
-2.3
90.
000.
900.
350.
030.
90*
0.03
0.05
0.00
0.00
-0.2
20.
35*
-0.1
8-0
.19
W32
A-0
.11
0.00
0.49
0.58
0.49
*0.
210.
040.
270.
000.
000.
58*
-0.2
4-0
.21
-0.3
5W
33D
-1.9
00.
000.
840.
400.
040.
020.
100.
84*
0.00
0.00
-0.1
6-0
.15
-0.3
10.
40*
W34
D-0
.92
0.00
0.67
0.52
0.11
0.11
0.11
0.67
*0.
000.
00-0
.23
-0.3
1-0
.25
0.52
*W
35A
-0.5
30.
000.
590.
410.
59*
0.24
0.10
0.08
0.00
0.00
0.41
*-0
.24
-0.1
6-0
.19
W36
D-0
.22
0.00
0.51
0.49
0.26
0.09
0.13
0.51
*0.
000.
00-0
.44
-0.1
3-0
.04
0.49
*W
37A
-2.4
70.
000.
910.
420.
91*
0.04
0.03
0.03
0.00
0.00
0.42
*-0
.27
-0.2
1-0
.23
B 6
Ap
pen
dix
B:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r M
ath
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)W
38D
-1.3
90.
000.
760.
560.
070.
110.
060.
76*
0.00
0.00
-0.2
0-0
.44
-0.2
20.
56*
W39
B0.
500.
000.
350.
150.
370.
35*
0.09
0.19
0.00
0.00
0.09
?0.
15*
-0.2
3-0
.12
W40
D-1
.20
0.00
0.73
0.47
0.05
0.14
0.08
0.73
*0.
000.
00-0
.26
-0.2
1-0
.29
0.47
*W
41B
-0.8
00.
000.
650.
540.
280.
65*
0.05
0.03
0.00
0.00
-0.4
80.
54*
-0.1
1-0
.10
W42
C-0
.01
0.00
0.46
0.40
0.18
0.08
0.46
*0.
280.
000.
00-0
.13
-0.2
00.
40*
-0.2
2W
43C
-0.8
50.
000.
660.
380.
080.
180.
66*
0.08
0.00
0.00
-0.0
9-0
.23
0.38
*-0
.24
W44
C0.
130.
000.
430.
340.
480.
070.
43*
0.02
0.00
0.00
-0.1
6-0
.27
0.34
*-0
.13
W45
B-0
.40
0.00
0.56
0.43
0.18
0.56
*0.
200.
060.
000.
00-0
.22
0.43
*-0
.21
-0.1
7W
46A
0.18
0.00
0.42
0.33
0.42
*0.
200.
110.
270.
000.
000.
33*
-0.2
9-0
.20
0.04
?W
47B
-1.0
60.
000.
700.
570.
030.
70*
0.09
0.19
0.00
0.00
-0.2
30.
57*
-0.2
5-0
.39
W48
D-1
.64
0.00
0.80
0.46
0.05
0.03
0.12
0.80
*0.
000.
00-0
.26
-0.2
2-0
.28
0.46
*W
49C
-0.2
80.
000.
530.
330.
210.
120.
53*
0.14
0.00
0.00
-0.1
1-0
.20
0.33
*-0
.16
W51
C-1
.08
0.00
0.70
0.29
0.06
0.08
0.70
*0.
150.
000.
00-0
.14
-0.1
70.
29*
-0.1
4W
52C
-2.6
70.
000.
920.
360.
010.
010.
92*
0.06
0.00
0.00
-0.1
3-0
.15
0.36
*-0
.28
W53
D-0
.88
0.00
0.66
0.36
0.26
0.05
0.02
0.66
*0.
000.
00-0
.20
-0.2
3-0
.17
0.36
*W
54B
-2.0
70.
000.
860.
430.
050.
86*
0.06
0.03
0.00
0.00
-0.3
30.
43*
-0.1
9-0
.19
W55
B-0
.04
0.00
0.47
0.33
0.19
0.47
*0.
270.
060.
000.
00-0
.15
0.33
*-0
.10
-0.2
5W
56B
-0.2
30.
000.
520.
440.
130.
52*
0.21
0.15
0.00
0.00
-0.2
00.
44*
-0.2
6-0
.13
W57
D-0
.26
0.00
0.52
0.51
0.04
0.03
0.40
0.52
*0.
000.
00-0
.18
-0.1
9-0
.37
0.51
*W
58C
-0.8
00.
000.
640.
420.
160.
120.
64*
0.08
0.00
0.00
-0.1
2-0
.29
0.42
*-0
.23
W59
B-1
.21
0.00
0.73
0.44
0.12
0.73
*0.
110.
050.
000.
00-0
.27
0.44
*-0
.23
-0.1
8W
60A
-0.4
30.
000.
560.
430.
56*
0.20
0.11
0.13
0.00
0.00
0.43
*-0
.23
-0.1
8-0
.20
W61
D-1
.29
0.00
0.74
0.55
0.03
0.09
0.13
0.74
*0.
000.
00-0
.26
-0.3
2-0
.29
0.55
*W
62C
0.70
0.00
0.31
0.39
0.31
0.15
0.31
*0.
220.
000.
00-0
.04
-0.2
10.
39*
-0.2
0W
63C
-0.5
70.
000.
590.
490.
120.
130.
59*
0.16
0.00
0.00
-0.2
5-0
.32
0.49
*-0
.15
W64
C-0
.98
0.00
0.56
0.40
0.10
0.21
0.56
*0.
120.
000.
00-0
.29
-0.1
10.
40*
-0.1
9W
65A
-0.1
40.
000.
500.
330.
50*
0.36
0.07
0.07
0.00
0.00
0.33
*-0
.09
-0.2
4-0
.24
W66
B-1
.27
0.00
0.74
0.50
0.12
0.74
*0.
110.
030.
000.
00-0
.34
0.50
*-0
.22
-0.2
1W
67A
-0.1
20.
000.
490.
400.
49*
0.14
0.03
0.34
0.00
0.00
0.40
*-0
.29
-0.1
3-0
.16
W68
D-0
.18
0.00
0.50
0.32
0.12
0.05
0.32
0.50
*0.
000.
00-0
.17
-0.1
5-0
.15
0.32
*W
69C
-1.5
00.
000.
780.
370.
060.
070.
78*
0.09
0.00
0.00
-0.2
4-0
.16
0.37
*-0
.19
W70
A-0
.33
0.00
0.54
0.38
0.54
*0.
140.
120.
190.
000.
000.
38*
-0.1
9-0
.28
-0.0
8W
71A
-0.7
00.
000.
620.
370.
62*
0.08
0.19
0.10
0.00
0.00
0.37
*-0
.27
-0.1
1-0
.22
W72
C-0
.74
0.00
0.63
0.46
0.08
0.06
0.63
*0.
220.
000.
00-0
.26
-0.2
50.
46*
-0.2
1
B 7
Ap
pen
dix
C:
2001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)A
148
B-0
.17
0.00
0.51
0.47
0.26
0.51
*0.
120.
100.
010.
00-0
.13
0.47
*-0
.28
-0.2
4A
149
D-0
.64
0.00
0.63
0.58
0.09
0.13
0.15
0.63
*0.
010.
00-0
.23
-0.3
1-0
.27
0.58
*A
150
A-0
.67
0.00
0.64
0.61
0.64
*0.
090.
140.
120.
010.
000.
61*
-0.2
6-0
.36
-0.2
4A
151
C-0
.46
0.00
0.59
0.45
0.23
0.12
0.59
*0.
060.
010.
00-0
.25
-0.1
70.
45*
-0.1
9A
152
C-0
.27
0.00
0.53
0.57
0.20
0.21
0.53
*0.
060.
010.
00-0
.29
-0.2
50.
57*
-0.2
5A
153
D-0
.42
0.00
0.58
0.35
0.05
0.23
0.14
0.58
*0.
010.
00-0
.25
-0.1
2-0
.16
0.35
*A
154
A-0
.29
0.00
0.54
0.59
0.54
*0.
350.
030.
070.
010.
000.
59*
-0.3
9-0
.23
-0.2
0A
155
B0.
050.
000.
450.
380.
240.
45*
0.18
0.12
0.01
0.00
-0.0
40.
38*
-0.2
6-0
.16
A15
6D
-0.8
80.
000.
690.
610.
140.
040.
110.
69*
0.01
0.00
-0.3
9-0
.22
-0.2
60.
61*
A15
7B
-1.4
30.
000.
810.
490.
080.
81*
0.07
0.03
0.01
0.00
-0.2
40.
49*
-0.2
8-0
.22
A15
8D
-0.0
90.
000.
490.
500.
030.
190.
280.
49*
0.01
0.00
-0.2
1-0
.34
-0.1
50.
50*
A15
9C
-1.4
00.
000.
800.
440.
090.
050.
80*
0.06
0.01
0.00
-0.2
2-0
.24
0.44
*-0
.20
A16
0A
0.11
0.00
0.43
0.40
0.43
*0.
160.
190.
210.
010.
000.
40*
-0.1
5-0
.15
-0.1
8A
161
B-0
.35
0.00
0.56
0.51
0.22
0.56
*0.
130.
090.
010.
00-0
.27
0.51
*-0
.20
-0.2
1A
162
D0.
290.
000.
390.
350.
070.
090.
450.
39*
0.01
0.00
-0.1
7-0
.20
-0.1
10.
35*
B14
8D
-1.2
70.
000.
780.
470.
110.
060.
040.
78*
0.01
0.00
-0.2
7-0
.24
-0.1
80.
47*
B14
9D
0.05
0.00
0.43
0.55
0.21
0.15
0.20
0.43
*0.
010.
00-0
.16
-0.2
7-0
.24
0.55
*B
150
A-0
.23
0.00
0.51
0.57
0.51
*0.
050.
070.
360.
010.
000.
57*
-0.2
2-0
.23
-0.3
4B
151
D-0
.22
0.00
0.51
0.50
0.23
0.16
0.09
0.51
*0.
010.
00-0
.18
-0.3
0-0
.17
0.50
*B
152
B0.
000.
000.
450.
450.
260.
45*
0.18
0.11
0.01
0.00
-0.2
20.
45*
-0.1
8-0
.13
B15
3D
-0.6
40.
000.
630.
570.
100.
140.
130.
63*
0.01
0.00
-0.2
0-0
.30
-0.2
80.
57*
B15
4A
-0.6
00.
000.
620.
540.
62*
0.11
0.20
0.07
0.01
0.00
0.54
*-0
.31
-0.2
5-0
.19
B15
5B
-1.3
10.
000.
790.
420.
130.
79*
0.05
0.02
0.01
0.00
-0.2
60.
42*
-0.1
9-0
.17
B15
6A
-0.5
00.
000.
590.
610.
59*
0.12
0.08
0.20
0.01
0.00
0.61
*-0
.25
-0.2
6-0
.33
B15
7D
-1.0
90.
000.
740.
580.
090.
070.
090.
74*
0.01
0.00
-0.2
9-0
.28
-0.2
80.
58*
B15
8C
-0.3
00.
000.
530.
390.
150.
150.
53*
0.15
0.02
0.00
-0.1
8-0
.17
0.39
*-0
.14
B15
9D
-0.2
60.
000.
520.
660.
060.
200.
210.
52*
0.01
0.00
-0.2
2-0
.29
-0.3
50.
66*
B16
0C
-0.2
60.
000.
520.
570.
170.
210.
52*
0.09
0.01
0.00
-0.3
7-0
.23
0.57
*-0
.12
B16
1A
0.21
0.00
0.39
0.45
0.39
*0.
240.
280.
080.
010.
000.
45*
-0.1
0-0
.26
-0.1
7B
162
A-0
.49
0.00
0.59
0.43
0.59
*0.
160.
180.
070.
010.
000.
43*
-0.2
2-0
.15
-0.2
1
C 1
Ap
pen
dix
C:
2001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)C
148
D-0
.25
0.00
0.53
0.51
0.08
0.09
0.28
0.53
*0.
010.
00-0
.21
-0.2
3-0
.26
0.51
*C
149
B-0
.74
0.00
0.66
0.34
0.21
0.66
*0.
090.
030.
010.
00-0
.09
0.34
*-0
.27
-0.1
9C
150
D0.
070.
000.
450.
550.
070.
290.
190.
45*
0.01
0.00
-0.2
0-0
.31
-0.1
80.
55*
C15
1A
-0.3
10.
000.
550.
460.
55*
0.10
0.13
0.22
0.01
0.00
0.46
*-0
.18
-0.1
3-0
.29
C15
2D
-0.4
00.
000.
570.
560.
200.
130.
090.
57*
0.01
0.00
-0.2
4-0
.26
-0.2
70.
56*
C15
3B
-0.8
00.
000.
670.
340.
240.
67*
0.05
0.03
0.01
0.00
-0.1
50.
34*
-0.2
2-0
.20
C15
4C
-0.5
00.
000.
600.
530.
070.
300.
60*
0.03
0.01
0.00
-0.2
5-0
.33
0.53
*-0
.16
C15
5B
1.18
0.00
0.20
0.23
0.09
0.20
*0.
64?
0.06
0.01
0.00
-0.1
40.
23*
0.02
?-0
.18
C15
6C
-1.1
30.
000.
750.
230.
120.
100.
75*
0.02
0.01
0.00
-0.1
0-0
.10
0.23
*-0
.15
C15
7C
-0.4
70.
000.
590.
590.
120.
130.
59*
0.16
0.01
0.00
-0.2
4-0
.25
0.59
*-0
.32
C15
8B
-1.3
30.
000.
780.
490.
090.
78*
0.05
0.07
0.01
0.00
-0.2
50.
49*
-0.2
7-0
.24
C15
9D
-0.2
20.
000.
530.
500.
110.
180.
170.
53*
0.01
0.00
-0.1
9-0
.27
-0.1
90.
50*
C16
0C
0.02
0.00
0.46
0.38
0.17
0.20
0.46
*0.
160.
010.
00-0
.11
-0.2
00.
38*
-0.1
5C
161
A-0
.54
0.00
0.61
0.49
0.61
*0.
140.
120.
130.
010.
000.
49*
-0.2
4-0
.22
-0.2
1C
162
A-0
.83
0.00
0.68
0.63
0.68
*0.
070.
160.
080.
010.
000.
63*
-0.2
8-0
.38
-0.2
4D
148
A0.
030.
000.
430.
420.
43*
0.11
0.24
0.22
0.01
0.00
0.42
*-0
.27
-0.1
7-0
.07
D14
9B
-1.3
80.
000.
780.
550.
050.
78*
0.12
0.04
0.01
0.00
-0.2
60.
55*
-0.3
4-0
.21
D15
0C
-0.9
90.
000.
700.
560.
120.
100.
70*
0.08
0.01
0.00
-0.2
8-0
.26
0.56
*-0
.26
D15
1A
-0.9
10.
000.
680.
470.
68*
0.05
0.06
0.20
0.01
0.00
0.47
*-0
.22
-0.2
3-0
.23
D15
2C
-0.2
60.
000.
500.
470.
210.
190.
50*
0.09
0.01
0.00
-0.1
2-0
.26
0.47
*-0
.22
D15
3B
-0.6
90.
000.
620.
380.
200.
62*
0.15
0.02
0.01
0.00
-0.1
60.
38*
-0.2
3-0
.16
D15
4B
-0.7
90.
000.
650.
490.
190.
65*
0.09
0.06
0.01
0.00
-0.2
30.
49*
-0.2
8-0
.18
D15
5C
-1.0
70.
000.
720.
440.
120.
080.
72*
0.08
0.01
0.00
-0.1
7-0
.26
0.44
*-0
.20
D15
6A
-1.2
30.
000.
750.
470.
75*
0.06
0.15
0.03
0.01
0.00
0.47
*-0
.25
-0.2
3-0
.23
D15
7B
-0.1
60.
000.
480.
470.
200.
48*
0.20
0.12
0.01
0.00
-0.2
20.
47*
-0.1
7-0
.17
D15
8D
-0.6
30.
000.
610.
540.
140.
080.
160.
61*
0.01
0.00
-0.1
7-0
.31
-0.2
80.
54*
D15
9A
-1.0
90.
000.
720.
530.
72*
0.11
0.07
0.09
0.01
0.00
0.53
*-0
.29
-0.2
3-0
.23
D16
0A
-0.5
60.
000.
590.
440.
59*
0.17
0.19
0.05
0.01
0.00
0.44
*-0
.14
-0.2
6-0
.20
D16
1D
-0.7
50.
000.
640.
550.
100.
070.
190.
64*
0.01
0.00
-0.2
1-0
.21
-0.3
30.
55*
D16
2B
-0.2
50.
000.
500.
470.
090.
50*
0.20
0.20
0.01
0.00
-0.0
60.
47*
-0.2
5-0
.24
C 2
Ap
pen
dix
C:
2001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)E
148
D-0
.51
0.00
0.60
0.52
0.14
0.16
0.10
0.60
*0.
010.
00-0
.21
-0.2
7-0
.24
0.52
*E
149
A-0
.52
0.00
0.60
0.51
0.60
*0.
260.
100.
020.
010.
000.
51*
-0.2
8-0
.27
-0.1
7E
150
A-1
.70
0.00
0.85
0.43
0.85
*0.
020.
040.
080.
010.
000.
43*
-0.1
7-0
.22
-0.2
6E
151
D-0
.86
0.00
0.69
0.44
0.09
0.10
0.12
0.69
*0.
010.
00-0
.24
-0.2
1-0
.18
0.44
*E
152
D-0
.37
0.00
0.57
0.64
0.15
0.17
0.11
0.57
*0.
010.
00-0
.37
-0.2
9-0
.20
0.64
*E
153
A-0
.08
0.00
0.49
0.46
0.49
*0.
110.
340.
060.
010.
000.
46*
-0.2
1-0
.22
-0.1
8E
154
D-0
.34
0.00
0.56
0.55
0.12
0.13
0.19
0.56
*0.
010.
00-0
.32
-0.2
6-0
.17
0.55
*E
155
C0.
080.
000.
450.
310.
120.
280.
45*
0.14
0.01
0.00
-0.2
10.
00?
0.31
*-0
.20
E15
6A
0.10
0.00
0.44
0.46
0.44
*0.
360.
070.
120.
010.
000.
46*
-0.2
4-0
.23
-0.1
1E
157
B0.
060.
000.
450.
410.
210.
45*
0.18
0.15
0.01
0.00
-0.2
00.
41*
-0.2
0-0
.08
E15
8C
-0.1
00.
000.
490.
390.
120.
260.
49*
0.11
0.01
0.00
-0.1
4-0
.20
0.39
*-0
.13
E15
9B
-0.5
50.
000.
610.
490.
120.
61*
0.13
0.13
0.01
0.00
-0.2
30.
49*
-0.2
4-0
.21
E16
0D
0.33
0.00
0.38
0.39
0.19
0.19
0.23
0.38
*0.
010.
00-0
.12
-0.1
6-0
.16
0.39
*E
161
C-0
.56
0.00
0.61
0.53
0.16
0.13
0.61
*0.
090.
010.
00-0
.28
-0.2
60.
53*
-0.1
8E
162
B-1
.01
0.00
0.72
0.48
0.12
0.72
*0.
100.
050.
010.
00-0
.26
0.48
*-0
.24
-0.1
9F
148
D-0
.51
0.00
0.56
0.52
0.13
0.13
0.17
0.56
*0.
010.
00-0
.23
-0.2
1-0
.25
0.52
*F
149
B-0
.56
0.00
0.58
0.48
0.15
0.58
*0.
240.
040.
010.
00-0
.27
0.48
*-0
.24
-0.1
3F
150
A-0
.42
0.00
0.53
0.57
0.53
*0.
130.
170.
160.
010.
000.
57*
-0.1
7-0
.26
-0.3
1F
151
C-0
.60
0.00
0.59
0.59
0.17
0.22
0.59
*0.
020.
010.
00-0
.38
-0.2
80.
59*
-0.1
3F
152
C-1
.85
0.00
0.87
0.42
0.02
0.07
0.87
*0.
030.
010.
00-0
.19
-0.2
40.
42*
-0.2
2F
153
B-0
.59
0.00
0.58
0.53
0.26
0.58
*0.
090.
070.
010.
00-0
.25
0.53
*-0
.28
-0.2
3F
154
A0.
180.
000.
370.
470.
37*
0.23
0.19
0.21
0.01
0.00
0.47
*-0
.15
-0.2
1-0
.17
F15
5C
-0.2
30.
000.
480.
490.
320.
060.
48*
0.13
0.01
0.00
-0.2
8-0
.24
0.49
*-0
.12
F15
6C
-1.4
20.
000.
790.
380.
050.
060.
79*
0.09
0.01
0.00
-0.2
2-0
.24
0.38
*-0
.13
F15
7D
-0.4
70.
000.
550.
560.
130.
140.
180.
55*
0.01
0.00
-0.1
9-0
.28
-0.2
70.
56*
F15
8B
-1.1
90.
000.
740.
490.
090.
74*
0.06
0.09
0.01
0.00
-0.2
70.
49*
-0.2
5-0
.20
F15
9D
-0.7
80.
000.
640.
490.
050.
180.
130.
64*
0.01
0.00
-0.1
8-0
.34
-0.1
50.
49*
F16
0D
0.04
0.00
0.40
0.57
0.27
0.14
0.18
0.40
*0.
010.
00-0
.20
-0.2
1-0
.26
0.57
*F
161
A-0
.64
0.00
0.60
0.48
0.60
*0.
260.
080.
060.
010.
000.
48*
-0.2
1-0
.29
-0.2
1F
162
B-2
.00
0.00
0.89
0.38
0.03
0.89
*0.
040.
030.
010.
00-0
.17
0.38
*-0
.22
-0.1
7
C 3
Ap
pen
dix
C:
2001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)G
148
B-0
.50
0.00
0.58
0.40
0.19
0.58
*0.
190.
030.
010.
00-0
.13
0.40
*-0
.28
-0.1
4G
149
D-0
.60
0.00
0.61
0.53
0.08
0.09
0.22
0.61
*0.
010.
00-0
.27
-0.3
2-0
.19
0.53
*G
150
D-0
.51
0.00
0.58
0.59
0.10
0.25
0.07
0.58
*0.
010.
00-0
.30
-0.3
5-0
.15
0.59
*G
151
C-0
.37
0.00
0.54
0.58
0.09
0.30
0.54
*0.
060.
010.
00-0
.27
-0.3
30.
58*
-0.1
9G
152
A-1
.27
0.00
0.77
0.43
0.77
*0.
040.
160.
030.
010.
000.
43*
-0.2
1-0
.27
-0.1
8G
153
C0.
090.
000.
420.
480.
310.
140.
42*
0.13
0.01
0.00
-0.2
0-0
.21
0.48
*-0
.16
G15
4D
-1.0
60.
000.
730.
540.
090.
110.
070.
73*
0.01
0.00
-0.2
7-0
.26
-0.2
70.
54*
G15
5A
-0.2
20.
000.
500.
430.
50*
0.17
0.23
0.10
0.01
0.00
0.43
*-0
.14
-0.2
4-0
.17
G15
6B
-0.9
50.
000.
700.
470.
090.
70*
0.17
0.04
0.01
0.00
-0.1
80.
47*
-0.3
0-0
.20
G15
7A
-0.1
80.
000.
490.
470.
49*
0.17
0.15
0.18
0.01
0.00
0.47
*-0
.19
-0.2
1-0
.20
G15
8B
-0.0
70.
000.
460.
430.
030.
46*
0.44
0.06
0.01
0.00
-0.2
00.
43*
-0.2
3-0
.20
G15
9D
-0.4
60.
000.
570.
610.
030.
260.
130.
57*
0.01
0.00
-0.1
9-0
.41
-0.2
20.
61*
G16
0C
-0.4
70.
000.
570.
540.
090.
240.
57*
0.10
0.01
0.00
-0.2
9-0
.31
0.54
*-0
.13
G16
1C
-0.6
10.
000.
610.
500.
150.
140.
61*
0.09
0.01
0.00
-0.1
8-0
.30
0.50
*-0
.21
G16
2B
-1.3
50.
000.
790.
510.
140.
79*
0.05
0.02
0.01
0.00
-0.3
60.
51*
-0.2
2-0
.17
H14
8A
-0.7
60.
000.
630.
560.
63*
0.07
0.15
0.14
0.01
0.00
0.56
*-0
.18
-0.2
3-0
.35
H14
9A
-1.5
40.
000.
820.
480.
82*
0.06
0.05
0.06
0.01
0.00
0.48
*-0
.23
-0.2
3-0
.25
H15
0A
-1.0
40.
000.
710.
460.
71*
0.15
0.07
0.07
0.01
0.00
0.46
*-0
.19
-0.2
1-0
.30
H15
1D
0.18
0.00
0.37
0.55
0.09
0.42
0.12
0.37
*0.
010.
00-0
.17
-0.3
1-0
.15
0.55
*H
152
A-0
.58
0.00
0.58
0.48
0.58
*0.
110.
070.
230.
010.
000.
48*
-0.3
2-0
.18
-0.1
6H
153
B-0
.17
0.00
0.46
0.47
0.18
0.46
*0.
190.
150.
010.
00-0
.18
0.47
*-0
.18
-0.2
2H
154
C-1
.25
0.00
0.76
0.47
0.07
0.10
0.76
*0.
060.
010.
00-0
.26
-0.2
80.
47*
-0.1
5H
155
A-0
.59
0.00
0.59
0.53
0.59
*0.
200.
120.
090.
010.
000.
53*
-0.2
3-0
.23
-0.2
7H
156
C-0
.88
0.00
0.67
0.58
0.14
0.09
0.67
*0.
100.
010.
00-0
.35
-0.2
00.
58*
-0.2
5H
157
C-0
.80
0.00
0.64
0.51
0.04
0.18
0.64
*0.
130.
010.
00-0
.24
-0.3
30.
51*
-0.1
4H
158
B-0
.90
0.00
0.67
0.53
0.12
0.67
*0.
110.
090.
010.
00-0
.25
0.53
*-0
.27
-0.2
3H
159
B-0
.54
0.00
0.57
0.52
0.07
0.57
*0.
280.
080.
010.
00-0
.26
0.52
*-0
.28
-0.1
7H
160
A-0
.85
0.00
0.66
0.56
0.66
*0.
210.
070.
060.
010.
000.
56*
-0.3
2-0
.25
-0.2
3H
161
D-0
.12
0.00
0.45
0.51
0.13
0.23
0.17
0.45
*0.
010.
00-0
.17
-0.1
7-0
.29
0.51
*H
162
C-0
.29
0.00
0.50
0.53
0.08
0.12
0.50
*0.
290.
010.
00-0
.22
-0.1
50.
53*
-0.3
0
C 4
Ap
pen
dix
C:
2001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)I
148
B-0
.55
0.00
0.61
0.53
0.17
0.61
*0.
060.
160.
010.
00-0
.24
0.53
*-0
.22
-0.2
8I
149
D-0
.41
0.00
0.57
0.41
0.26
0.06
0.11
0.57
*0.
010.
00-0
.04
-0.3
0-0
.32
0.41
*I
150
C-1
.70
0.00
0.85
0.49
0.03
0.05
0.85
*0.
070.
010.
00-0
.21
-0.2
40.
49*
-0.2
8I
151
A-0
.69
0.00
0.64
0.58
0.64
*0.
190.
060.
100.
010.
000.
58*
-0.3
7-0
.27
-0.1
6I
152
C0.
120.
000.
430.
490.
130.
310.
43*
0.13
0.01
0.00
-0.2
5-0
.31
0.49
*0.
00?
I15
3D
0.05
0.00
0.44
0.51
0.40
0.04
0.10
0.44
*0.
010.
00-0
.23
-0.2
3-0
.25
0.51
*I
154
B0.
070.
000.
440.
470.
080.
44*
0.23
0.25
0.01
0.00
-0.1
40.
47*
-0.2
6-0
.17
I15
5C
-1.2
50.
000.
770.
540.
060.
080.
77*
0.09
0.01
0.00
-0.2
5-0
.30
0.54
*-0
.25
I15
6C
-0.0
90.
000.
480.
400.
140.
270.
48*
0.10
0.01
0.00
-0.2
1-0
.19
0.40
*-0
.09
I15
7A
0.37
0.00
0.36
0.35
0.36
*0.
360.
150.
120.
010.
000.
35*
-0.1
6-0
.13
-0.0
8I
158
C-1
.49
0.00
0.81
0.54
0.03
0.12
0.81
*0.
020.
010.
00-0
.23
-0.3
80.
54*
-0.1
8I
159
A-1
.20
0.00
0.76
0.52
0.76
*0.
080.
140.
020.
010.
000.
52*
-0.2
7-0
.31
-0.1
9I
160
B-1
.49
0.00
0.81
0.46
0.08
0.81
*0.
070.
030.
010.
00-0
.30
0.46
*-0
.18
-0.2
0I
161
D-0
.17
0.00
0.50
0.48
0.11
0.12
0.26
0.50
*0.
010.
00-0
.25
-0.2
9-0
.11
0.48
*I
162
B0.
260.
000.
390.
280.
100.
39*
0.40
0.10
0.01
0.00
-0.1
30.
28*
-0.0
4-0
.21
J14
8B
-0.8
10.
000.
650.
590.
110.
65*
0.16
0.07
0.01
0.00
-0.3
40.
59*
-0.2
9-0
.21
J14
9B
-0.1
40.
000.
470.
540.
080.
47*
0.23
0.21
0.01
0.00
-0.1
70.
54*
-0.2
3-0
.28
J15
0D
-0.1
60.
000.
470.
590.
160.
190.
170.
47*
0.01
0.00
-0.2
1-0
.25
-0.2
70.
59*
J15
1B
-1.1
10.
000.
720.
490.
060.
72*
0.15
0.06
0.01
0.00
-0.2
50.
49*
-0.2
6-0
.23
J15
2D
-0.5
10.
000.
570.
340.
140.
130.
160.
57*
0.01
0.00
-0.0
5-0
.17
-0.2
30.
34*
J15
3A
-0.8
70.
000.
670.
550.
67*
0.12
0.10
0.11
0.01
0.00
0.55
*-0
.25
-0.2
9-0
.25
J15
4C
-0.8
70.
000.
670.
510.
180.
070.
67*
0.08
0.01
0.00
-0.2
3-0
.26
0.51
*-0
.26
J15
5D
-0.3
60.
000.
530.
520.
170.
120.
180.
53*
0.01
0.00
-0.1
0-0
.26
-0.3
20.
52*
J15
6C
-1.3
40.
000.
780.
580.
030.
140.
78*
0.05
0.01
0.00
-0.2
3-0
.37
0.58
*-0
.28
J15
7A
-0.9
40.
000.
690.
460.
69*
0.15
0.11
0.04
0.01
0.00
0.46
*-0
.25
-0.2
2-0
.20
J15
8A
-1.0
20.
000.
700.
610.
70*
0.09
0.09
0.11
0.01
0.00
0.61
*-0
.32
-0.2
9-0
.28
J15
9A
-0.2
90.
000.
510.
520.
51*
0.28
0.13
0.08
0.01
0.00
0.52
*-0
.24
-0.2
4-0
.20
J16
0D
-0.8
00.
000.
650.
520.
100.
140.
110.
65*
0.01
0.00
-0.1
6-0
.34
-0.2
30.
52*
J16
1B
-0.4
10.
000.
540.
460.
090.
54*
0.27
0.09
0.01
0.00
-0.2
20.
46*
-0.1
8-0
.24
J16
2B
-0.8
50.
000.
120.
000.
210.
12*
0.54
?0.
130.
010.
00-0
.18
0.00
*0.
26?
-0.1
3
C 5
Ap
pen
dix
C:
2001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)W
1B
-2.1
80.
000.
880.
280.
020.
88*
0.03
0.07
0.00
0.00
-0.1
00.
28*
-0.0
7-0
.25
W2
A-0
.24
0.00
0.52
0.55
0.52
*0.
050.
140.
290.
000.
000.
55*
-0.1
6-0
.17
-0.3
9W
3B
-0.8
60.
000.
660.
380.
040.
66*
0.10
0.20
0.00
0.00
-0.1
30.
38*
-0.2
5-0
.20
W4
C0.
260.
000.
400.
420.
51?
0.06
0.40
*0.
020.
000.
00-0
.34
-0.1
20.
42*
-0.0
3W
5D
-0.6
80.
000.
620.
520.
090.
190.
100.
62*
0.00
0.00
-0.1
2-0
.40
-0.2
00.
52*
W6
C-1
.74
0.00
0.82
0.31
0.13
0.03
0.82
*0.
020.
000.
00-0
.26
-0.0
90.
31*
-0.0
9W
7D
-0.1
30.
000.
490.
500.
300.
080.
130.
49*
0.00
0.00
-0.3
1-0
.16
-0.1
70.
50*
W8
C-0
.73
0.00
0.63
0.46
0.21
0.10
0.63
*0.
060.
000.
00-0
.17
-0.3
00.
46*
-0.2
6W
9D
-1.5
80.
000.
800.
440.
140.
040.
020.
80*
0.00
0.00
-0.3
2-0
.21
-0.1
50.
44*
W10
B-1
.21
0.00
0.73
0.59
0.03
0.73
*0.
110.
130.
000.
00-0
.15
0.59
*-0
.41
-0.3
2W
11C
-1.8
30.
000.
840.
440.
040.
070.
84*
0.06
0.00
0.00
-0.2
3-0
.22
0.44
*-0
.27
W12
A-0
.87
0.00
0.66
0.44
0.66
*0.
090.
210.
050.
000.
000.
44*
-0.2
4-0
.25
-0.1
7W
13D
-0.4
70.
000.
570.
540.
120.
080.
230.
57*
0.00
0.00
-0.2
7-0
.23
-0.2
70.
54*
W14
A-1
.46
0.00
0.78
0.32
0.78
*0.
140.
050.
040.
000.
000.
32*
-0.1
2-0
.19
-0.2
6W
15C
-0.2
30.
000.
510.
440.
050.
210.
51*
0.23
0.00
0.00
-0.1
9-0
.14
0.44
*-0
.29
W16
B-0
.71
0.00
0.63
0.37
0.14
0.63
*0.
180.
050.
010.
00-0
.21
0.37
*-0
.16
-0.1
9W
17B
-1.3
40.
000.
760.
460.
160.
76*
0.06
0.02
0.00
0.00
-0.3
40.
46*
-0.2
3-0
.14
W18
D-0
.37
0.00
0.55
0.49
0.12
0.18
0.15
0.55
*0.
010.
00-0
.17
-0.2
7-0
.23
0.49
*W
19D
-0.4
30.
000.
560.
290.
040.
070.
330.
56*
0.00
0.00
-0.2
3-0
.18
-0.1
10.
29*
W20
B-0
.71
0.00
0.63
0.38
0.23
0.63
*0.
070.
070.
000.
00-0
.21
0.38
*-0
.18
-0.1
9W
21A
-0.1
10.
000.
480.
230.
48*
0.28
0.12
0.12
0.00
0.00
0.23
*-0
.05
-0.1
9-0
.08
W22
A-1
.18
0.00
0.73
0.46
0.73
*0.
040.
050.
190.
000.
000.
46*
-0.2
5-0
.26
-0.2
5W
23C
-0.7
20.
000.
630.
420.
090.
210.
63*
0.08
0.00
0.00
-0.2
3-0
.26
0.42
*-0
.12
W24
D-1
.68
0.00
0.82
0.31
0.08
0.06
0.05
0.82
*0.
000.
00-0
.12
-0.1
8-0
.20
0.31
*W
26A
-1.5
70.
000.
800.
280.
80*
0.07
0.08
0.06
0.00
0.00
0.28
*-0
.20
-0.1
0-0
.15
W27
D-1
.39
0.00
0.77
0.49
0.09
0.09
0.05
0.77
*0.
000.
00-0
.30
-0.2
0-0
.29
0.49
*W
28A
0.44
0.00
0.36
0.25
0.36
*0.
440.
030.
170.
000.
000.
25*
-0.0
3-0
.22
-0.1
7W
29D
-0.0
50.
000.
470.
450.
140.
160.
230.
47*
0.00
0.00
-0.2
2-0
.11
-0.2
50.
45*
W30
A-2
.34
0.00
0.90
0.42
0.90
*0.
040.
040.
020.
000.
000.
42*
-0.2
4-0
.25
-0.2
1W
31B
-1.1
00.
000.
710.
420.
150.
71*
0.06
0.07
0.00
0.00
-0.1
80.
42*
-0.2
5-0
.26
W32
A-0
.74
0.00
0.63
0.52
0.63
*0.
160.
140.
070.
010.
000.
52*
-0.3
0-0
.24
-0.2
2W
33D
-1.3
00.
000.
750.
530.
170.
030.
040.
75*
0.00
0.00
-0.4
1-0
.21
-0.1
90.
53*
W34
B-0
.33
0.00
0.54
0.32
0.10
0.54
*0.
320.
040.
000.
00-0
.04
0.32
*-0
.21
-0.2
3W
35D
-0.9
50.
000.
680.
460.
080.
120.
130.
68*
0.00
0.00
-0.1
8-0
.24
-0.2
70.
46*
W36
A-1
.47
0.00
0.78
0.44
0.78
*0.
070.
080.
070.
000.
000.
44*
-0.1
9-0
.26
-0.2
3W
37C
-0.5
90.
000.
600.
490.
180.
140.
60*
0.09
0.00
0.00
-0.1
2-0
.30
0.49
*-0
.32
C 6
Ap
pen
dix
C:
2001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)W
38B
-0.3
30.
000.
540.
510.
090.
54*
0.19
0.18
0.00
0.00
-0.1
30.
51*
-0.1
9-0
.36
W39
D0.
090.
000.
440.
460.
260.
190.
120.
44*
0.00
0.00
-0.1
2-0
.28
-0.2
00.
46*
W40
C-0
.24
0.00
0.52
0.32
0.11
0.12
0.52
*0.
250.
000.
00-0
.05
-0.2
50.
32*
-0.1
4W
41A
-0.5
10.
000.
580.
520.
58*
0.11
0.22
0.08
0.00
0.00
0.52
*-0
.19
-0.2
7-0
.31
W42
B-0
.59
0.00
0.60
0.33
0.11
0.60
*0.
210.
080.
000.
00-0
.20
0.33
*-0
.15
-0.1
3W
43A
-1.1
60.
000.
720.
530.
72*
0.14
0.10
0.03
0.00
0.00
0.53
*-0
.32
-0.2
9-0
.21
W44
D-0
.90
0.00
0.67
0.51
0.13
0.09
0.12
0.67
*0.
000.
00-0
.20
-0.2
9-0
.28
0.51
*W
45B
-0.4
20.
000.
560.
560.
180.
56*
0.18
0.09
0.00
0.00
-0.3
10.
56*
-0.2
1-0
.26
W46
C-2
.04
0.00
0.87
0.47
0.02
0.07
0.87
*0.
040.
000.
00-0
.21
-0.3
20.
47*
-0.2
3W
47B
-1.0
20.
000.
690.
540.
080.
69*
0.09
0.13
0.00
0.00
-0.2
70.
54*
-0.3
1-0
.24
W48
C-1
.19
0.00
0.73
0.52
0.07
0.17
0.73
*0.
040.
000.
00-0
.26
-0.3
40.
52*
-0.1
8W
49C
-0.8
10.
000.
650.
610.
150.
120.
65*
0.07
0.00
0.00
-0.3
8-0
.27
0.61
*-0
.24
W51
C-1
.72
0.00
0.82
0.44
0.04
0.05
0.82
*0.
090.
000.
00-0
.21
-0.2
00.
44*
-0.3
0W
52D
-0.6
90.
000.
620.
210.
120.
120.
130.
62*
0.00
0.00
0.01
?-0
.14
-0.1
80.
21*
W53
A-1
.42
0.00
0.77
0.47
0.77
*0.
070.
130.
030.
000.
000.
47*
-0.3
0-0
.25
-0.2
2W
54A
-1.4
30.
000.
770.
450.
77*
0.11
0.08
0.03
0.00
0.00
0.45
*-0
.27
-0.2
6-0
.19
W55
D-0
.45
0.00
0.57
0.49
0.11
0.19
0.13
0.57
*0.
000.
00-0
.37
-0.2
3-0
.11
0.49
*W
56C
-0.9
50.
000.
680.
570.
090.
110.
68*
0.12
0.00
0.00
-0.2
9-0
.30
0.57
*-0
.27
W57
D0.
400.
000.
370.
550.
160.
300.
170.
37*
0.01
0.00
-0.3
3-0
.18
-0.1
50.
55*
W58
C-0
.76
0.00
0.64
0.34
0.07
0.21
0.64
*0.
090.
000.
00-0
.16
-0.2
10.
34*
-0.1
4W
59B
-1.0
90.
000.
500.
440.
210.
50*
0.14
0.15
0.00
0.00
-0.2
10.
44*
-0.1
4-0
.23
W60
C-0
.69
0.00
0.62
0.55
0.10
0.16
0.62
*0.
120.
000.
00-0
.30
-0.2
70.
55*
-0.2
4W
61D
-0.1
90.
000.
500.
450.
360.
050.
080.
50*
0.00
0.00
-0.2
4-0
.22
-0.2
10.
45*
W62
A-1
.01
0.00
0.69
0.49
0.69
*0.
160.
110.
040.
000.
000.
49*
-0.3
2-0
.24
-0.1
7W
63C
-0.3
00.
000.
530.
360.
140.
140.
53*
0.19
0.00
0.00
-0.1
4-0
.30
0.36
*-0
.06
W64
C-0
.30
0.00
0.53
0.42
0.16
0.26
0.53
*0.
050.
000.
00-0
.27
-0.2
10.
42*
-0.0
8W
65C
-1.1
00.
000.
710.
550.
060.
090.
71*
0.14
0.00
0.00
-0.2
5-0
.30
0.55
*-0
.29
W66
A-0
.90
0.00
0.67
0.42
0.67
*0.
130.
130.
070.
000.
000.
42*
-0.2
1-0
.25
-0.1
7W
67B
-0.0
40.
000.
470.
390.
080.
47*
0.31
0.14
0.00
0.00
-0.2
30.
39*
-0.0
8-0
.27
W68
B-1
.23
0.00
0.74
0.47
0.12
0.74
*0.
090.
050.
000.
00-0
.32
0.47
*-0
.22
-0.1
7W
69C
-0.2
30.
000.
510.
430.
060.
100.
51*
0.32
0.00
0.00
-0.2
3-0
.29
0.43
*-0
.16
W70
B-0
.76
0.00
0.64
0.51
0.10
0.64
*0.
140.
120.
000.
00-0
.18
0.51
*-0
.36
-0.2
0W
71B
-0.1
70.
000.
500.
380.
200.
50*
0.17
0.13
0.00
0.00
-0.2
30.
38*
-0.1
8-0
.09
W72
A-0
.71
0.00
0.63
0.34
0.63
*0.
110.
140.
130.
000.
000.
34*
-0.1
8-0
.19
-0.1
2
C 7
Ap
pen
dix
D:
2001
PS
SA
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
For
mS
eque
nce
Key
Logi
tS
EC
P-V
alue
PtB
is C
orr
%A
%B
%C
%D
Bla
nkIn
valid
R(A
)(R
B)
R(C
)R
(D)
A15
6B
-1.6
80.
000.
870.
330.
020.
87*
0.02
0.08
0.01
0.00
-0.1
50.
33*
-0.1
4-0
.17
A15
7C
-1.1
20.
000.
770.
540.
120.
070.
77*
0.04
0.01
0.00
-0.3
5-0
.25
0.54
*-0
.15
A15
8C
-0.6
50.
000.
660.
580.
190.
110.
66*
0.04
0.01
0.00
-0.3
9-0
.23
0.58
*-0
.14
A15
9C
-0.0
10.
000.
480.
410.
110.
250.
48*
0.13
0.02
0.00
-0.1
2-0
.20
0.41
*-0
.15
A16
0A
0.28
0.00
0.40
0.44
0.40
*0.
250.
230.
090.
020.
000.
44*
-0.2
5-0
.06
-0.1
9A
161
B-0
.94
0.00
0.73
0.58
0.03
0.73
*0.
210.
020.
010.
00-0
.15
0.58
*-0
.46
-0.1
6A
162
C-0
.45
0.00
0.61
0.56
0.12
0.18
0.61
*0.
090.
010.
00-0
.30
-0.2
70.
56*
-0.1
8A
163
A0.
080.
000.
460.
530.
46*
0.12
0.23
0.18
0.01
0.00
0.53
*-0
.20
-0.2
3-0
.20
A16
4D
0.21
0.00
0.42
0.43
0.10
0.42
0.05
0.42
*0.
010.
00-0
.27
-0.1
5-0
.14
0.43
*A
165
A1.
030.
000.
220.
320.
22*
0.23
0.36
0.15
0.03
0.00
0.32
*0.
05?
-0.1
9-0
.11
A16
6D
0.69
0.00
0.30
0.51
0.38
0.19
0.12
0.30
*0.
010.
00-0
.13
-0.2
5-0
.15
0.51
*A
167
C0.
110.
000.
450.
510.
280.
210.
45*
0.05
0.01
0.00
-0.3
0-0
.18
0.51
*-0
.10
A16
8D
-0.2
90.
000.
560.
560.
090.
260.
080.
56*
0.01
0.00
-0.2
1-0
.32
-0.2
00.
56*
A16
9B
0.51
0.00
0.34
0.36
0.31
0.34
*0.
220.
110.
020.
00-0
.14
0.36
*-0
.10
-0.1
2A
170
B-0
.40
0.00
0.59
0.55
0.14
0.59
*0.
160.
090.
020.
00-0
.24
0.55
*-0
.30
-0.1
7B
156
C0.
460.
000.
360.
390.
160.
190.
36*
0.25
0.03
0.00
-0.1
7-0
.21
0.39
*-0
.07
B15
7B
0.18
0.00
0.43
0.54
0.44
0.43
*0.
080.
030.
010.
00-0
.33
0.54
*-0
.23
-0.1
0B
158
D-0
.48
0.00
0.61
0.59
0.17
0.15
0.06
0.61
*0.
010.
00-0
.34
-0.2
5-0
.20
0.59
*B
159
B-0
.45
0.00
0.61
0.52
0.18
0.61
*0.
120.
080.
010.
00-0
.26
0.52
*-0
.24
-0.2
0B
160
B-0
.20
0.00
0.54
0.58
0.38
0.54
*0.
040.
040.
010.
00-0
.43
0.58
*-0
.18
-0.1
3B
161
B0.
550.
000.
340.
470.
120.
34*
0.29
0.24
0.01
0.00
-0.2
00.
47*
-0.0
3-0
.30
B16
2C
-0.0
80.
000.
510.
450.
030.
270.
51*
0.18
0.01
0.00
-0.1
3-0
.10
0.45
*-0
.35
B16
3C
-1.1
60.
000.
780.
460.
110.
050.
78*
0.05
0.01
0.00
-0.3
0-0
.18
0.46
*-0
.17
B16
4D
0.30
0.00
0.40
0.51
0.21
0.18
0.20
0.40
*0.
010.
00-0
.17
-0.2
3-0
.18
0.51
*B
165
A-0
.62
0.00
0.65
0.54
0.65
*0.
160.
050.
130.
010.
000.
54*
-0.2
0-0
.22
-0.3
4B
166
B-0
.23
0.00
0.55
0.40
0.08
0.55
*0.
260.
100.
010.
00-0
.10
0.40
*-0
.27
-0.1
0B
167
C-0
.22
0.00
0.54
0.52
0.14
0.12
0.54
*0.
190.
010.
00-0
.23
-0.2
40.
52*
-0.2
1B
168
A0.
390.
000.
380.
310.
38*
0.18
0.21
0.22
0.02
0.00
0.31
*-0
.06
-0.1
2-0
.13
B16
9C
-0.9
50.
000.
730.
520.
060.
150.
73*
0.04
0.01
0.00
-0.2
5-0
.32
0.52
*-0
.18
B17
0B
0.44
0.00
0.36
0.52
0.28
0.36
*0.
220.
130.
020.
00-0
.21
0.52
*-0
.18
-0.1
8
D 1
Ap
pen
dix
D:
2001
PS
SA
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
For
mS
eque
nce
Key
Logi
tS
EC
P-V
alue
PtB
is C
orr
%A
%B
%C
%D
Bla
nkIn
valid
R(A
)(R
B)
R(C
)R
(D)
C15
6D
-0.4
10.
000.
600.
460.
130.
100.
160.
60*
0.01
0.00
-0.2
9-0
.16
-0.1
50.
46*
C15
7B
-1.0
00.
000.
740.
510.
120.
74*
0.09
0.03
0.02
0.00
-0.3
10.
51*
-0.2
4-0
.12
C15
8C
-0.5
30.
000.
630.
480.
050.
260.
63*
0.05
0.01
0.00
-0.2
3-0
.26
0.48
*-0
.17
C15
9C
-0.3
30.
000.
580.
550.
350.
030.
58*
0.03
0.01
0.00
-0.4
0-0
.16
0.55
*-0
.15
C16
0D
-0.3
90.
000.
590.
540.
160.
060.
170.
59*
0.02
0.00
-0.2
1-0
.22
-0.2
70.
54*
C16
1D
-0.2
50.
000.
560.
500.
160.
070.
190.
56*
0.02
0.00
-0.2
2-0
.18
-0.2
30.
50*
C16
2C
-0.2
10.
000.
550.
570.
150.
230.
55*
0.06
0.01
0.00
-0.2
2-0
.29
0.57
*-0
.21
C16
3B
-0.2
30.
000.
550.
490.
030.
55*
0.36
0.05
0.01
0.00
-0.1
70.
49*
-0.3
3-0
.16
C16
4A
0.36
0.00
0.40
0.35
0.40
*0.
160.
290.
130.
020.
000.
35*
-0.1
0-0
.10
-0.2
0C
165
B0.
540.
000.
360.
350.
230.
36*
0.19
0.19
0.03
0.00
-0.0
20.
35*
-0.1
6-0
.16
C16
6C
-0.2
20.
000.
550.
350.
080.
200.
55*
0.15
0.02
0.00
-0.1
4-0
.08
0.35
*-0
.20
C16
7C
0.09
0.00
0.47
0.34
0.15
0.24
0.47
*0.
110.
030.
00-0
.15
-0.1
40.
34*
-0.0
9C
168
B0.
460.
000.
380.
430.
080.
38*
0.45
0.08
0.01
0.00
-0.2
30.
43*
-0.1
5-0
.16
C16
9C
0.53
0.00
0.36
0.43
0.14
0.38
0.36
*0.
100.
020.
00-0
.21
-0.1
40.
43*
-0.1
3C
170
A0.
700.
000.
320.
420.
32*
0.38
0.12
0.16
0.02
0.00
0.42
*-0
.13
-0.2
0-0
.10
D15
6C
-1.7
20.
000.
870.
300.
020.
080.
87*
0.02
0.01
0.00
-0.1
5-0
.15
0.30
*-0
.14
D15
7B
-1.1
20.
000.
760.
470.
060.
76*
0.13
0.04
0.01
0.00
-0.2
50.
47*
-0.2
4-0
.21
D15
8B
-0.7
20.
000.
670.
560.
100.
67*
0.07
0.15
0.01
0.00
-0.1
90.
56*
-0.2
4-0
.34
D15
9D
-0.3
20.
000.
550.
610.
210.
110.
120.
55*
0.01
0.00
-0.2
4-0
.33
-0.2
60.
61*
D16
0A
-0.0
90.
000.
490.
570.
49*
0.07
0.33
0.10
0.02
0.00
0.57
*-0
.19
-0.3
4-0
.17
D16
1A
-0.6
80.
000.
650.
520.
65*
0.25
0.04
0.05
0.01
0.00
0.52
*-0
.34
-0.1
9-0
.20
D16
2B
-0.9
00.
000.
710.
590.
070.
71*
0.15
0.06
0.01
0.00
-0.2
80.
59*
-0.3
4-0
.23
D16
3B
-0.0
30.
000.
470.
550.
210.
47*
0.08
0.23
0.01
0.00
-0.1
60.
55*
-0.2
3-0
.30
D16
4D
0.41
0.00
0.35
0.47
0.20
0.27
0.16
0.35
*0.
010.
00-0
.19
-0.2
0-0
.10
0.47
*D
165
C-0
.04
0.00
0.48
0.65
0.39
0.08
0.48
*0.
050.
010.
00-0
.43
-0.2
00.
65*
-0.1
9D
166
D-0
.52
0.00
0.61
0.63
0.12
0.12
0.14
0.61
*0.
010.
00-0
.28
-0.3
3-0
.25
0.63
*D
167
A0.
000.
000.
460.
500.
46*
0.27
0.18
0.08
0.02
0.00
0.50
*-0
.18
-0.2
3-0
.24
D16
8A
0.49
0.00
0.33
0.13
0.33
*0.
290.
220.
130.
030.
000.
13*
-0.1
2-0
.03
0.08
?D
169
C0.
630.
000.
300.
370.
150.
120.
30*
0.42
0.01
0.00
-0.0
9-0
.14
0.37
*-0
.13
D17
0D
0.09
0.00
0.44
0.60
0.22
0.18
0.16
0.44
*0.
020.
00-0
.30
-0.1
6-0
.24
0.60
*
D 2
Ap
pen
dix
D:
2001
PS
SA
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
For
mS
eque
nce
Key
Logi
tS
EC
P-V
alue
PtB
is C
orr
%A
%B
%C
%D
Bla
nkIn
valid
R(A
)(R
B)
R(C
)R
(D)
E15
6A
-1.0
90.
000.
760.
530.
76*
0.05
0.06
0.12
0.01
0.00
0.53
*-0
.23
-0.2
4-0
.28
E15
7D
-1.3
50.
000.
810.
370.
130.
020.
020.
81*
0.01
0.00
-0.2
0-0
.18
-0.1
70.
37*
E15
8B
-0.5
10.
000.
620.
570.
220.
62*
0.10
0.04
0.02
0.00
-0.3
10.
57*
-0.2
8-0
.18
E15
9A
-0.8
80.
000.
720.
440.
72*
0.13
0.04
0.11
0.01
0.00
0.44
*-0
.20
-0.1
9-0
.23
E16
0B
-0.4
30.
000.
600.
540.
140.
60*
0.16
0.09
0.02
0.00
-0.2
60.
54*
-0.3
1-0
.12
E16
1B
-0.6
10.
000.
650.
590.
040.
65*
0.07
0.23
0.01
0.00
-0.2
30.
59*
-0.2
0-0
.37
E16
2D
-0.4
00.
000.
590.
620.
080.
110.
200.
59*
0.02
0.00
-0.2
1-0
.29
-0.3
10.
62*
E16
3D
-0.1
10.
000.
510.
560.
100.
090.
290.
51*
0.01
0.00
-0.2
9-0
.27
-0.2
00.
56*
E16
4C
-0.5
20.
000.
620.
410.
090.
140.
62*
0.12
0.02
0.00
-0.2
1-0
.20
0.41
*-0
.13
E16
5A
0.17
0.00
0.43
0.56
0.43
*0.
120.
350.
090.
020.
000.
56*
-0.2
5-0
.24
-0.1
9E
166
D0.
570.
000.
330.
480.
100.
230.
320.
33*
0.03
0.00
-0.1
7-0
.24
-0.1
00.
48*
E16
7C
0.27
0.00
0.40
0.60
0.26
0.15
0.40
*0.
180.
020.
00-0
.32
-0.1
50.
60*
-0.2
0E
168
C0.
390.
000.
370.
370.
120.
180.
37*
0.31
0.01
0.00
-0.1
8-0
.26
0.37
*0.
02?
E16
9B
0.80
0.00
0.27
0.33
0.20
0.27
*0.
160.
360.
020.
000.
01?
0.33
*-0
.24
-0.0
7E
170
A0.
600.
000.
320.
320.
32*
0.28
0.19
0.20
0.02
0.00
0.32
*-0
.14
-0.0
8-0
.06
F15
6A
-0.1
00.
000.
510.
600.
51*
0.10
0.15
0.24
0.01
0.00
0.60
*-0
.26
-0.2
1-0
.29
F15
7A
-0.7
30.
000.
670.
540.
67*
0.04
0.05
0.23
0.01
0.00
0.54
*-0
.21
-0.2
4-0
.33
F15
8B
-1.0
10.
000.
740.
500.
110.
74*
0.06
0.09
0.01
0.00
-0.2
50.
50*
-0.2
1-0
.24
F15
9A
-0.6
40.
000.
650.
530.
65*
0.20
0.08
0.06
0.01
0.00
0.53
*-0
.25
-0.2
8-0
.23
F16
0D
0.03
0.00
0.47
0.48
0.11
0.20
0.20
0.47
*0.
010.
00-0
.20
-0.2
6-0
.11
0.48
*F
161
A-0
.69
0.00
0.66
0.49
0.66
*0.
150.
140.
040.
010.
000.
49*
-0.2
4-0
.25
-0.1
9F
162
C-1
.02
0.00
0.74
0.47
0.04
0.16
0.74
*0.
050.
010.
00-0
.22
-0.2
70.
47*
-0.1
8F
163
B-0
.90
0.00
0.71
0.48
0.21
0.71
*0.
030.
040.
010.
00-0
.29
0.48
*-0
.21
-0.1
9F
164
C-0
.61
0.00
0.64
0.52
0.04
0.22
0.64
*0.
090.
010.
00-0
.21
-0.3
70.
52*
-0.1
1F
165
C0.
060.
000.
460.
440.
140.
160.
46*
0.22
0.02
0.00
-0.2
5-0
.18
0.44
*-0
.11
F16
6C
0.31
0.00
0.40
0.35
0.11
0.12
0.40
*0.
360.
010.
00-0
.20
-0.2
10.
35*
-0.0
3F
167
A-0
.03
0.00
0.49
0.46
0.49
*0.
210.
240.
050.
020.
000.
46*
-0.2
3-0
.20
-0.1
3F
168
D0.
140.
000.
440.
480.
150.
210.
190.
44*
0.01
0.00
-0.2
8-0
.10
-0.1
90.
48*
F16
9A
0.61
0.00
0.32
0.38
0.32
*0.
310.
230.
120.
020.
000.
38*
-0.0
3-0
.20
-0.1
8F
170
D1.
200.
000.
200.
260.
280.
230.
270.
20*
0.02
0.00
-0.0
4-0
.15
-0.0
10.
26*
D 3
Ap
pen
dix
D:
2001
PS
SA
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
For
mS
eque
nce
Key
Logi
tS
EC
P-V
alue
PtB
is C
orr
%A
%B
%C
%D
Bla
nkIn
valid
R(A
)(R
B)
R(C
)R
(D)
G15
6A
-1.1
70.
000.
770.
490.
77*
0.10
0.07
0.04
0.01
0.00
0.49
*-0
.28
-0.2
4-0
.17
G15
7D
-0.9
80.
000.
730.
390.
070.
140.
050.
73*
0.01
0.00
-0.2
0-0
.17
-0.1
80.
39*
G15
8B
-0.7
50.
000.
680.
520.
040.
68*
0.15
0.12
0.01
0.00
-0.1
90.
52*
-0.3
1-0
.21
G15
9C
-0.4
50.
000.
600.
340.
050.
290.
60*
0.04
0.01
0.00
-0.1
9-0
.16
0.34
*-0
.15
G16
0A
-0.7
10.
000.
670.
510.
67*
0.23
0.04
0.06
0.01
0.00
0.51
*-0
.31
-0.1
9-0
.22
G16
1A
-0.0
30.
000.
490.
440.
49*
0.09
0.11
0.30
0.01
0.00
0.44
*-0
.21
-0.2
0-0
.15
G16
2D
-0.3
90.
000.
590.
590.
090.
140.
170.
59*
0.02
0.00
-0.2
4-0
.29
-0.2
50.
59*
G16
3B
-0.3
90.
000.
590.
570.
230.
59*
0.14
0.03
0.01
0.00
-0.2
80.
57*
-0.3
1-0
.16
G16
4B
-0.4
30.
000.
600.
490.
110.
60*
0.16
0.13
0.01
0.00
-0.1
40.
49*
-0.2
8-0
.21
G16
5D
0.27
0.00
0.41
0.49
0.21
0.19
0.18
0.41
*0.
010.
00-0
.17
-0.1
2-0
.24
0.49
*G
166
B0.
170.
000.
440.
340.
130.
44*
0.20
0.21
0.03
0.00
-0.1
30.
34*
-0.1
8-0
.07
G16
7C
-0.1
60.
000.
530.
520.
100.
130.
53*
0.23
0.02
0.00
-0.1
6-0
.17
0.52
*-0
.30
G16
8C
0.84
0.00
0.28
0.34
0.08
0.50
?0.
28*
0.13
0.01
0.00
-0.1
8-0
.20
0.34
*0.
07?
G16
9A
0.71
0.00
0.31
0.40
0.31
*0.
410.
120.
150.
010.
000.
40*
-0.1
5-0
.13
-0.1
1G
170
A0.
770.
000.
290.
350.
29*
0.21
0.30
0.17
0.03
0.00
0.35
*-0
.11
-0.1
3-0
.07
H15
6C
-0.9
30.
000.
730.
530.
070.
140.
73*
0.05
0.01
0.00
-0.2
5-0
.27
0.53
*-0
.24
H15
7B
-1.1
10.
000.
770.
400.
050.
77*
0.05
0.12
0.01
0.00
-0.2
20.
40*
-0.2
3-0
.13
H15
8B
-1.0
70.
000.
760.
530.
130.
76*
0.08
0.03
0.01
0.00
-0.3
20.
53*
-0.2
6-0
.16
H15
9D
-0.4
40.
000.
610.
530.
130.
090.
160.
61*
0.01
0.00
-0.2
8-0
.19
-0.2
40.
53*
H16
0A
-0.8
50.
000.
710.
520.
71*
0.10
0.12
0.05
0.01
0.00
0.52
*-0
.28
-0.2
6-0
.18
H16
1A
0.10
0.00
0.47
0.38
0.47
*0.
110.
390.
020.
010.
000.
38*
-0.2
3-0
.16
-0.1
0H
162
B0.
190.
000.
440.
540.
110.
44*
0.30
0.13
0.01
0.00
-0.1
10.
54*
-0.3
0-0
.21
H16
3C
0.31
0.00
0.41
0.44
0.18
0.35
0.41
*0.
040.
010.
00-0
.29
-0.1
20.
44*
-0.1
0H
164
A0.
090.
000.
470.
470.
47*
0.17
0.26
0.09
0.01
0.00
0.47
*0.
04?
-0.3
7-0
.20
H16
5D
0.88
0.00
0.28
0.36
0.14
0.26
0.30
0.28
*0.
020.
00-0
.07
-0.0
6-0
.18
0.36
*H
166
B0.
540.
000.
350.
360.
070.
35*
0.29
0.26
0.02
0.00
-0.1
10.
36*
-0.1
2-0
.15
H16
7C
0.27
0.00
0.42
0.58
0.39
0.09
0.42
*0.
080.
010.
00-0
.32
-0.2
10.
58*
-0.1
6H
168
B-0
.14
0.00
0.53
0.52
0.11
0.53
*0.
160.
180.
020.
00-0
.20
0.52
*-0
.25
-0.2
0H
169
D0.
890.
000.
270.
390.
110.
380.
220.
27*
0.02
0.00
-0.2
0-0
.04
-0.1
60.
39*
H17
0C
0.17
0.00
0.45
0.40
0.23
0.16
0.45
*0.
150.
020.
00-0
.15
-0.1
70.
40*
-0.1
3
D 4
Ap
pen
dix
D:
2001
PS
SA
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
For
mS
eque
nce
Key
Logi
tS
EC
P-V
alue
PtB
is C
orr
%A
%B
%C
%D
Bla
nkIn
valid
R(A
)(R
B)
R(C
)R
(D)
I15
6C
-2.1
40.
000.
900.
420.
020.
040.
90*
0.04
0.01
0.00
-0.1
9-0
.20
0.42
*-0
.19
I15
7A
-1.8
90.
000.
870.
410.
87*
0.06
0.04
0.01
0.01
0.00
0.41
*-0
.21
-0.2
1-0
.14
I15
8A
-0.0
10.
000.
500.
490.
50*
0.29
0.12
0.09
0.01
0.00
0.49
*-0
.22
-0.2
2-0
.19
I15
9C
0.18
0.00
0.45
0.44
0.18
0.25
0.45
*0.
100.
020.
00-0
.20
-0.1
50.
44*
-0.1
6I
160
B0.
590.
000.
350.
120.
050.
35*
0.09
0.50
0.01
0.00
-0.1
80.
12*
-0.1
30.
10?
I16
1A
-1.0
00.
000.
730.
500.
73*
0.12
0.08
0.06
0.01
0.00
0.50
*-0
.26
-0.2
2-0
.20
I16
2B
-0.8
70.
000.
700.
430.
050.
70*
0.19
0.05
0.01
0.00
-0.2
00.
43*
-0.2
1-0
.20
I16
3C
-0.6
20.
000.
650.
470.
060.
070.
65*
0.22
0.01
0.00
-0.1
9-0
.19
0.47
*-0
.26
I16
4A
-0.4
00.
000.
590.
390.
59*
0.07
0.21
0.11
0.01
0.00
0.39
*-0
.19
-0.1
9-0
.12
I16
5D
0.13
0.00
0.46
0.52
0.09
0.27
0.17
0.46
*0.
010.
00-0
.14
-0.2
6-0
.21
0.52
*I
166
B0.
990.
000.
270.
220.
070.
27*
0.54
?0.
110.
010.
00-0
.19
0.22
*0.
06?
-0.1
6I
167
B0.
440.
000.
390.
450.
320.
39*
0.15
0.13
0.02
0.00
-0.1
90.
45*
-0.1
3-0
.18
I16
8D
0.98
0.00
0.27
0.32
0.15
0.32
0.24
0.27
*0.
030.
00-0
.06
-0.0
6-0
.15
0.32
*I
169
A0.
550.
000.
360.
510.
36*
0.25
0.28
0.10
0.02
0.00
0.51
*-0
.14
-0.2
1-0
.19
I17
0B
0.37
0.00
0.40
0.41
0.08
0.40
*0.
360.
150.
010.
00-0
.20
0.41
*-0
.12
-0.1
7J
156
B-0
.10
0.00
0.51
0.45
0.08
0.51
*0.
190.
200.
020.
00-0
.14
0.45
*-0
.26
-0.1
5J
157
C-0
.14
0.00
0.53
0.43
0.09
0.22
0.53
*0.
160.
010.
00-0
.11
-0.1
80.
43*
-0.2
3J
158
C-0
.03
0.00
0.50
0.46
0.16
0.15
0.50
*0.
170.
020.
00-0
.18
-0.2
00.
46*
-0.1
7J
159
D-0
.61
0.00
0.65
0.65
0.12
0.11
0.11
0.65
*0.
010.
00-0
.31
-0.3
3-0
.26
0.65
*J
160
B0.
230.
000.
430.
390.
160.
43*
0.19
0.20
0.03
0.00
-0.1
20.
39*
-0.2
1-0
.09
J16
1A
-0.8
70.
000.
710.
420.
71*
0.10
0.04
0.14
0.01
0.00
0.42
*-0
.27
-0.2
2-0
.13
J16
2B
-0.6
50.
000.
660.
400.
080.
66*
0.08
0.17
0.01
0.00
-0.1
40.
40*
-0.2
3-0
.17
J16
3B
-0.5
40.
000.
630.
560.
180.
63*
0.13
0.05
0.01
0.00
-0.2
80.
56*
-0.2
7-0
.20
J16
4D
-0.6
30.
000.
650.
620.
120.
090.
130.
65*
0.01
0.00
-0.3
2-0
.21
-0.3
10.
62*
J16
5C
-0.1
40.
000.
530.
480.
220.
110.
53*
0.13
0.01
0.00
-0.1
5-0
.25
0.48
*-0
.22
J16
6B
-0.0
80.
000.
510.
540.
250.
51*
0.17
0.06
0.02
0.00
-0.2
70.
54*
-0.2
4-0
.16
J16
7A
0.39
0.00
0.39
0.31
0.39
*0.
220.
200.
180.
020.
000.
31*
-0.0
3-0
.15
-0.1
3J
168
D0.
820.
000.
280.
430.
210.
240.
250.
28*
0.02
0.00
-0.1
2-0
.13
-0.1
40.
43*
J16
9C
0.57
0.00
0.34
0.31
0.26
0.28
0.34
*0.
090.
030.
00-0
.12
-0.0
60.
31*
-0.1
5J
170
A-0
.14
0.00
0.53
0.51
0.53
*0.
120.
230.
100.
020.
000.
51*
-0.2
0-0
.25
-0.1
7
D 5
Ap
pen
dix
D:
2001
PS
SA
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
For
mS
eque
nce
Key
Logi
tS
EC
P-V
alue
PtB
is C
orr
%A
%B
%C
%D
Bla
nkIn
valid
R(A
)(R
B)
R(C
)R
(D)
W1
C-1
.11
0.00
0.72
0.42
0.08
0.20
0.72
*0.
010.
000.
00-0
.21
-0.3
00.
42*
-0.1
2W
2B
-1.2
70.
000.
750.
430.
040.
75*
0.11
0.10
0.00
0.00
-0.1
30.
43*
-0.2
8-0
.24
W3
C-0
.25
0.00
0.53
0.16
0.37
0.06
0.53
*0.
040.
000.
00-0
.13
-0.0
50.
16*
-0.0
2W
4A
-0.5
00.
000.
590.
460.
59*
0.22
0.06
0.13
0.00
0.00
0.46
*-0
.25
-0.1
5-0
.24
W5
B-2
.50
0.00
0.91
0.30
0.05
0.91
*0.
020.
010.
000.
00-0
.20
0.30
*-0
.17
-0.1
4W
6B
-2.0
40.
000.
870.
330.
050.
87*
0.03
0.06
0.00
0.00
-0.2
00.
33*
-0.1
9-0
.15
W7
A-2
.24
0.00
0.89
0.34
0.89
*0.
010.
030.
070.
000.
000.
34*
-0.1
4-0
.19
-0.2
3W
8C
-1.7
20.
000.
820.
470.
030.
050.
82*
0.09
0.00
0.00
-0.1
6-0
.23
0.47
*-0
.34
W9
C-1
.17
0.00
0.73
0.35
0.04
0.15
0.73
*0.
080.
000.
00-0
.18
-0.1
90.
35*
-0.1
9W
10B
-0.8
10.
000.
650.
410.
070.
65*
0.14
0.14
0.00
0.00
-0.2
00.
41*
-0.1
9-0
.23
W11
C-1
.41
0.00
0.77
0.52
0.06
0.10
0.77
*0.
070.
000.
00-0
.28
-0.3
00.
52*
-0.2
5W
12D
-0.8
90.
000.
670.
610.
050.
130.
150.
67*
0.00
0.00
-0.2
3-0
.35
-0.3
30.
61*
W13
B-0
.64
0.00
0.62
0.30
0.12
0.62
*0.
180.
080.
000.
00-0
.13
0.30
*-0
.14
-0.1
7W
14A
-0.2
40.
000.
530.
430.
53*
0.11
0.10
0.26
0.01
0.00
0.43
*-0
.18
-0.2
2-0
.20
W15
C-1
.25
0.00
0.75
0.36
0.07
0.11
0.75
*0.
070.
000.
00-0
.13
-0.2
30.
36*
-0.1
9W
16C
0.02
0.00
0.47
0.43
0.30
0.10
0.47
*0.
130.
010.
00-0
.14
-0.2
90.
43*
-0.1
8W
17D
-0.1
50.
000.
510.
390.
330.
130.
030.
51*
0.00
0.00
-0.2
1-0
.18
-0.1
90.
39*
W18
A-0
.12
0.00
0.50
0.58
0.50
*0.
180.
180.
130.
010.
000.
58*
-0.2
3-0
.33
-0.2
1W
19B
-0.7
10.
000.
630.
500.
100.
63*
0.15
0.12
0.00
0.00
-0.2
50.
50*
-0.3
2-0
.15
W20
D-0
.07
0.00
0.49
0.52
0.14
0.10
0.27
0.49
*0.
000.
00-0
.35
-0.2
4-0
.15
0.52
*W
21D
-0.5
40.
000.
600.
480.
220.
130.
060.
60*
0.00
0.00
-0.2
7-0
.21
-0.2
30.
48*
W22
C0.
940.
000.
270.
270.
320.
140.
27*
0.26
0.01
0.00
-0.0
2-0
.08
0.27
*-0
.19
W23
A-0
.10
0.00
0.50
0.20
0.50
*0.
190.
150.
150.
010.
000.
20*
-0.0
1-0
.11
-0.1
6W
24D
0.09
0.00
0.45
0.31
0.13
0.15
0.26
0.45
*0.
010.
00-0
.10
-0.1
8-0
.13
0.31
*W
26A
-2.3
10.
000.
900.
360.
90*
0.04
0.02
0.04
0.00
0.00
0.36
*-0
.20
-0.2
0-0
.21
W27
C-1
.17
0.00
0.73
0.53
0.09
0.13
0.73
*0.
050.
000.
00-0
.25
-0.3
20.
53*
-0.2
6W
28A
-1.4
00.
000.
770.
490.
77*
0.13
0.07
0.03
0.00
0.00
0.49
*-0
.29
-0.2
9-0
.21
W29
C-1
.57
0.00
0.80
0.43
0.07
0.08
0.80
*0.
060.
000.
00-0
.29
-0.2
30.
43*
-0.1
7W
30B
-0.8
90.
000.
670.
560.
180.
67*
0.09
0.06
0.00
0.00
-0.4
10.
56*
-0.2
3-0
.16
W31
A-0
.60
0.00
0.61
0.31
0.61
*0.
310.
030.
050.
000.
000.
31*
-0.2
3-0
.18
-0.0
5W
32D
-0.1
80.
000.
510.
550.
160.
100.
220.
51*
0.00
0.00
-0.0
8-0
.32
-0.3
50.
55*
W33
D-0
.05
0.00
0.48
0.50
0.05
0.09
0.38
0.48
*0.
000.
00-0
.18
-0.2
5-0
.29
0.50
*W
34C
-1.0
40.
000.
700.
410.
040.
080.
70*
0.18
0.00
0.00
-0.2
4-0
.26
0.41
*-0
.17
W35
A-0
.93
0.00
0.68
0.53
0.68
*0.
090.
110.
110.
000.
000.
53*
-0.2
6-0
.28
-0.2
6W
36B
-1.5
40.
000.
790.
500.
090.
79*
0.08
0.03
0.00
0.00
-0.3
20.
50*
-0.2
6-0
.20
W37
B-1
.03
0.00
0.70
0.47
0.16
0.70
*0.
090.
040.
010.
00-0
.24
0.47
*-0
.31
-0.1
8
D 6
Ap
pen
dix
D:
2001
PS
SA
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Mat
hem
atic
s
For
mS
eque
nce
Key
Logi
tS
EC
P-V
alue
PtB
is C
orr
%A
%B
%C
%D
Bla
nkIn
valid
R(A
)(R
B)
R(C
)R
(D)
W38
B-0
.23
0.00
0.52
0.50
0.05
0.52
*0.
230.
190.
000.
00-0
.13
0.50
*-0
.15
-0.4
0W
39A
-1.0
10.
000.
700.
510.
70*
0.09
0.13
0.08
0.00
0.00
0.51
*-0
.27
-0.2
5-0
.27
W40
B-0
.41
0.00
0.57
0.36
0.21
0.57
*0.
130.
090.
010.
00-0
.18
0.36
*-0
.18
-0.1
6W
41B
-0.3
30.
000.
550.
240.
230.
55*
0.14
0.07
0.02
0.00
0.00
0.24
*-0
.24
-0.1
5W
42A
-1.0
10.
000.
700.
550.
70*
0.10
0.08
0.12
0.00
0.00
0.55
*-0
.35
-0.3
2-0
.17
W43
D-1
.02
0.00
0.70
0.63
0.06
0.12
0.12
0.70
*0.
000.
00-0
.28
-0.3
5-0
.32
0.63
*W
44B
-0.8
10.
000.
660.
440.
100.
66*
0.11
0.14
0.00
0.00
-0.3
00.
44*
-0.2
6-0
.11
W45
D0.
390.
000.
380.
500.
420.
100.
100.
38*
0.00
0.00
-0.2
2-0
.29
-0.1
60.
50*
W46
D0.
320.
000.
400.
480.
220.
200.
170.
40*
0.01
0.00
-0.1
7-0
.23
-0.1
90.
48*
W47
C0.
020.
000.
470.
270.
060.
070.
47*
0.39
0.00
0.00
-0.2
1-0
.23
0.27
*-0
.04
W48
C0.
670.
000.
330.
320.
210.
300.
33*
0.16
0.01
0.00
-0.0
2-0
.12
0.32
*-0
.23
W49
D0.
120.
000.
450.
400.
220.
150.
170.
45*
0.01
0.00
0.04
?-0
.26
-0.3
00.
40*
W51
B-2
.10
0.00
0.87
0.41
0.05
0.87
*0.
040.
040.
000.
00-0
.20
0.41
*-0
.25
-0.2
3W
52D
-1.9
30.
000.
850.
460.
030.
060.
060.
85*
0.00
0.00
-0.2
3-0
.28
-0.2
40.
46*
W53
C-1
.88
0.00
0.85
0.44
0.05
0.09
0.85
*0.
010.
000.
00-0
.24
-0.3
10.
44*
-0.1
5W
54D
-1.0
50.
000.
700.
540.
010.
030.
250.
70*
0.00
0.00
-0.1
5-0
.22
-0.4
30.
54*
W55
D-1
.21
0.00
0.74
0.30
0.05
0.05
0.16
0.74
*0.
000.
00-0
.21
-0.2
2-0
.10
0.30
*W
56A
-1.3
30.
000.
760.
430.
76*
0.06
0.15
0.02
0.00
0.00
0.43
*-0
.27
-0.2
6-0
.17
W57
D-0
.97
0.00
0.69
0.49
0.04
0.23
0.04
0.69
*0.
000.
00-0
.24
-0.3
2-0
.23
0.49
*W
58B
-0.1
50.
000.
510.
470.
220.
51*
0.16
0.11
0.00
0.00
-0.3
90.
47*
-0.0
2-0
.19
W59
B-0
.73
0.00
0.64
0.45
0.15
0.64
*0.
140.
060.
000.
00-0
.15
0.45
*-0
.32
-0.2
0W
60B
-1.6
00.
000.
810.
520.
060.
81*
0.09
0.05
0.00
0.00
-0.2
90.
52*
-0.3
0-0
.24
W61
A-0
.29
0.00
0.54
0.46
0.54
*0.
190.
170.
100.
010.
000.
46*
-0.1
7-0
.19
-0.3
0W
62D
-0.1
80.
000.
510.
400.
050.
320.
110.
51*
0.00
0.00
-0.1
9-0
.23
-0.1
50.
40*
W63
A-0
.06
0.00
0.49
0.46
0.49
*0.
180.
220.
100.
010.
000.
46*
-0.2
2-0
.25
-0.1
3W
64C
0.04
0.00
0.46
0.33
0.17
0.24
0.46
*0.
110.
010.
00-0
.15
-0.1
20.
33*
-0.1
8W
65B
-0.2
70.
000.
540.
430.
060.
54*
0.35
0.06
0.00
0.00
-0.0
90.
43*
-0.2
5-0
.31
W66
B-0
.53
0.00
0.59
0.47
0.12
0.59
*0.
210.
070.
000.
00-0
.28
0.47
*-0
.20
-0.2
0W
67C
-0.1
80.
000.
510.
440.
130.
180.
51*
0.17
0.01
0.00
-0.1
7-0
.26
0.44
*-0
.16
W68
A0.
740.
000.
310.
280.
31*
0.46
0.15
0.08
0.01
0.00
0.28
*-0
.03
-0.2
2-0
.14
W69
C0.
550.
000.
350.
220.
100.
130.
35*
0.41
0.00
0.00
-0.0
9-0
.15
0.22
*-0
.05
W70
C0.
780.
000.
310.
330.
200.
190.
31*
0.31
0.00
0.00
-0.0
1-0
.18
0.33
*-0
.16
W71
B0.
320.
000.
400.
370.
200.
40*
0.24
0.15
0.01
0.00
-0.1
90.
37*
-0.1
2-0
.15
W72
A0.
110.
000.
450.
430.
45*
0.19
0.17
0.18
0.01
0.00
0.43
*-0
.20
-0.1
8-0
.16
D 7
Ap
pen
dix
E:
2001
PS
SA
Gra
de
Fiv
e T
ask
An
alys
isO
pen
En
ded
Tas
ks f
or
Mat
hem
atic
s
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Zer
o%
On
e%
Tw
o%
Th
ree
% F
ou
r%
Fiv
eR
(0)
R(1
)R
(2)
R(3
)R
(4)
R(5
)A
150
1-0
.88
2.27
0.65
0.17
0.14
0.23
0.23
0.18
0.05
-0.4
5-0
.22
-0.0
90.
210.
380.
252
-0.7
03
0.00
40.
735
2.22
B15
01
-0.8
01.
950.
640.
210.
220.
200.
180.
110.
07-0
.52
-0.1
60.
070.
270.
260.
262
-0.0
93
0.32
41.
135
1.57
C15
01
-1.3
82.
260.
680.
140.
200.
240.
160.
170.
08-0
.46
-0.2
5-0
.04
0.16
0.35
0.33
2-0
.48
30.
414
0.45
51.
61D
150
1-0
.69
2.66
0.68
0.19
0.13
0.11
0.14
0.23
0.20
-0.4
9-0
.22
-0.1
00.
030.
280.
442
-0.2
73
-0.3
14
-0.2
45
0.83
E15
01
0.63
1.26
0.58
0.47
0.17
0.15
0.11
0.05
0.05
-0.5
30.
040.
200.
230.
220.
282
0.28
30.
904
1.68
51.
33F
150
1-1
.73
2.00
0.66
0.12
0.34
0.19
0.20
0.07
0.08
-0.4
2-0
.34
0.08
0.30
0.24
0.32
20.
233
0.24
41.
615
1.06
G15
01
-0.2
51.
870.
680.
250.
120.
320.
150.
150.
02-0
.59
-0.0
60.
080.
220.
390.
192
-0.9
33
0.91
40.
755
3.32
E 1
Ap
pen
dix
E:
2001
PS
SA
Gra
de
Fiv
e T
ask
An
alys
isO
pen
En
ded
Tas
ks f
or
Mat
hem
atic
s
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Zer
o%
On
e%
Tw
o%
Th
ree
% F
ou
r%
Fiv
eR
(0)
R(1
)R
(2)
R(3
)R
(4)
R(5
)
H15
01
-1.5
31.
520.
580.
160.
430.
210.
150.
040.
01-0
.46
-0.1
50.
210.
300.
220.
112
0.61
30.
854
2.18
53.
09I1
501
-0.8
62.
290.
610.
180.
200.
060.
280.
240.
03-0
.41
-0.2
6-0
.06
0.20
0.37
0.21
20.
403
-1.1
14
0.59
52.
83J1
501
-0.8
92.
110.
550.
150.
120.
400.
180.
110.
04-0
.41
-0.1
80.
050.
120.
260.
262
-1.3
33
0.88
41.
125
2.00
W25
1-1
.25
2.17
0.69
0.13
0.18
0.30
0.26
0.04
0.09
-0.4
5-0
.29
-0.0
60.
340.
190.
372
-0.8
23
0.25
42.
305
0.48
W50
1-2
.62
2.48
0.65
0.05
0.18
0.30
0.22
0.19
0.05
-0.3
5-0
.37
-0.1
10.
170.
350.
272
-1.0
23
0.24
40.
645
2.24
W73
1-1
.53
2.59
0.64
0.09
0.09
0.28
0.28
0.19
0.07
-0.3
9-0
.27
-0.1
70.
130.
340.
292
-1.3
43
-0.1
64
0.77
51.
94
E 2
Ap
pen
dix
F:
2001
PS
SA
Gra
de
Eig
ht
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r M
ath
emat
ics
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Zer
o%
On
e%
Tw
o%
Th
ree
% F
ou
r%
Fiv
eR
(0)
R(1
)R
(2)
R(3
)R
(4)
R(5
)A
170
1-0
.76
1.73
0.63
0.22
0.22
0.27
0.21
0.06
0.02
-0.4
9-0
.13
0.09
0.30
0.28
0.22
2-0
.29
30.
614
2.03
52.
45B
170
1-1
.37
2.44
0.64
0.10
0.12
0.26
0.23
0.27
0.01
-0.3
5-0
.33
-0.1
10.
100.
490.
112
-1.0
73
0.03
40.
325
4.77
C17
01
-0.4
82.
160.
720.
230.
140.
240.
090.
240.
07-0
.56
-0.1
60.
000.
130.
410.
342
-0.6
03
0.88
4-0
.34
52.
27D
170
1-1
.02
2.23
0.69
0.19
0.22
0.17
0.10
0.20
0.11
-0.5
1-0
.21
0.02
0.10
0.35
0.38
2-0
.10
30.
454
-0.0
35
1.47
E17
01
-1.3
51.
840.
730.
170.
390.
150.
060.
130.
09-0
.48
-0.2
50.
100.
150.
340.
452
0.73
30.
974
0.15
51.
39F
170
1-0
.14
1.59
0.69
0.35
0.21
0.16
0.11
0.15
0.03
-0.6
1-0
.03
0.14
0.25
0.39
0.23
20.
243
0.65
40.
545
2.85
G17
01
-0.3
72.
620.
790.
190.
080.
190.
120.
300.
12-0
.56
-0.2
2-0
.15
0.01
0.40
0.47
2-0
.27
30.
534
0.21
51.
66
F 3
Ap
pen
dix
F:
2001
PS
SA
Gra
de
Eig
ht
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r M
ath
emat
ics
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Zer
o%
On
e%
Tw
o%
Th
ree
% F
ou
r%
Fiv
eR
(0)
R(1
)R
(2)
R(3
)R
(4)
R(5
)
H17
01
0.29
1.33
0.70
0.41
0.16
0.21
0.12
0.06
0.03
-0.6
20.
000.
240.
320.
290.
252
-0.0
93
1.03
41.
575
2.18
I170
10.
161.
360.
700.
410.
210.
130.
120.
100.
03-0
.61
0.00
0.17
0.30
0.38
0.23
20.
563
0.59
41.
115
2.65
J170
1-0
.55
2.19
0.74
0.23
0.16
0.15
0.17
0.21
0.08
-0.5
7-0
.22
0.02
0.20
0.39
0.33
2-0
.23
3-0
.07
40.
305
1.89
W25
10.
091.
390.
640.
380.
210.
230.
030.
080.
06-0
.54
-0.0
30.
200.
160.
290.
352
0.06
32.
194
0.30
51.
53W
501
-0.8
71.
410.
640.
250.
370.
210.
080.
060.
03-0
.46
-0.1
80.
260.
270.
280.
242
0.60
31.
404
1.36
52.
14W
731
-0.2
91.
770.
690.
320.
240.
160.
020.
160.
11-0
.58
-0.0
80.
140.
050.
330.
422
0.36
31.
864
-0.8
75
1.38
F 4
Ap
pen
dix
G:
2001
PS
SA
Gra
de
Ele
ven
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r M
ath
emat
ics
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Zer
o%
On
e%
Tw
o%
Th
ree
% F
ou
r%
Fiv
eR
(0)
R(1
)R
(2)
R(3
)R
(4)
R(5
)A
180
1-1
.39
1.98
0.78
0.15
0.37
0.09
0.16
0.16
0.06
-0.4
7-0
.37
0.07
0.28
0.43
0.33
20.
853
-0.1
44
0.59
52.
05B
180
10.
481.
890.
790.
380.
110.
080.
120.
240.
06-0
.68
-0.1
00.
040.
200.
510.
322
0.22
3-0
.16
4-0
.12
52.
29C
180
1-1
.43
1.16
0.66
0.20
0.62
0.06
0.05
0.05
0.02
-0.4
90.
010.
150.
280.
340.
252
2.50
30.
964
1.32
52.
65D
180
1-0
.03
1.38
0.75
0.39
0.26
0.14
0.06
0.10
0.06
-0.6
50.
000.
260.
220.
370.
332
0.66
31.
274
0.53
51.
77E
180
11.
010.
850.
690.
570.
150.
160.
060.
030.
02-0
.67
0.19
0.38
0.31
0.24
0.19
20.
353
1.78
42.
065
2.32
F18
01
0.39
1.78
0.67
0.34
0.10
0.18
0.19
0.13
0.05
-0.5
6-0
.11
0.14
0.22
0.34
0.27
2-0
.49
30.
194
1.12
52.
18G
180
10.
560.
930.
700.
540.
240.
050.
080.
050.
03-0
.64
0.20
0.20
0.32
0.30
0.31
21.
753
0.42
41.
725
1.98
G 5
Ap
pen
dix
G:
2001
PS
SA
Gra
de
Ele
ven
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r M
ath
emat
ics
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Zer
o%
On
e%
Tw
o%
Th
ree
% F
ou
r%
Fiv
eR
(0)
R(1
)R
(2)
R(3
)R
(4)
R(5
)
H18
01
-0.1
80.
810.
590.
430.
430.
070.
030.
030.
01-0
.48
0.16
0.31
0.21
0.25
0.17
22.
163
2.01
41.
425
2.91
I180
1-0
.07
0.90
0.63
0.42
0.35
0.16
0.02
0.03
0.01
-0.5
20.
090.
370.
190.
250.
202
1.17
32.
854
1.39
52.
60J1
801
1.10
0.91
0.71
0.61
0.16
0.05
0.06
0.08
0.03
-0.6
50.
180.
180.
280.
390.
302
1.42
30.
634
0.89
52.
28W
251
0.60
1.37
0.75
0.48
0.16
0.08
0.11
0.16
0.02
-0.6
7-0
.01
0.16
0.30
0.48
0.21
20.
703
0.16
40.
615
3.27
W50
1-1
.50
1.50
0.70
0.17
0.48
0.15
0.11
0.08
0.02
-0.4
9-0
.22
0.20
0.32
0.35
0.20
21.
013
0.86
41.
355
2.99
W73
1-0
.74
2.13
0.68
0.15
0.10
0.42
0.17
0.13
0.04
-0.4
7-0
.18
-0.0
90.
220.
380.
292
-1.4
73
0.91
40.
985
2.40
G 6
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)A
159
C-2
.16
0.00
0.88
0.43
0.03
0.06
0.88
*0.
030.
004
0.00
-0.2
7-0
.19
0.43
*-0
.21
A16
0D
-0.5
00.
000.
580.
320.
200.
040.
170.
58*
0.00
50.
00-0
.23
-0.2
4-0
.01
0.32
*A
161
C-1
.91
0.00
0.85
0.56
0.05
0.08
0.85
*0.
020.
004
0.00
-0.3
6-0
.28
0.56
*-0
.23
A16
2D
-1.1
00.
000.
710.
550.
070.
120.
090.
71*
0.00
50.
00-0
.27
-0.3
1-0
.22
0.55
*A
163
D-1
.75
0.00
0.83
0.54
0.08
0.06
0.03
0.83
*0.
005
0.00
-0.3
0-0
.27
-0.2
70.
54*
A16
4D
0.12
0.00
0.42
0.27
0.07
0.42
0.08
0.42
*0.
005
0.00
-0.2
00.
02?
-0.2
70.
27*
A16
5C
0.85
0.00
0.26
0.19
0.13
0.17
0.26
*0.
430.
007
0.00
-0.0
8-0
.13
0.19
*0.
02?
A16
6D
-2.6
70.
000.
930.
500.
030.
020.
020.
93*
0.00
40.
00-0
.25
-0.2
7-0
.26
0.50
*A
167
D-1
.45
0.00
0.78
0.48
0.03
0.05
0.13
0.78
*0.
005
0.00
-0.2
8-0
.31
-0.2
10.
48*
A16
8B
-0.8
00.
000.
650.
500.
190.
65*
0.13
0.03
0.00
50.
00-0
.31
0.50
*-0
.19
-0.2
3A
169
A-1
.12
0.00
0.72
0.49
0.72
*0.
030.
090.
160.
005
0.00
0.49
*-0
.29
-0.2
3-0
.25
A17
0B
-1.3
20.
000.
760.
540.
080.
76*
0.10
0.06
0.00
50.
00-0
.24
0.54
*-0
.27
-0.3
0A
171
D-1
.59
0.00
0.80
0.52
0.06
0.05
0.08
0.80
*0.
005
0.00
-0.2
7-0
.30
-0.2
20.
52*
A17
2B
-0.3
10.
000.
530.
360.
410.
53*
0.03
0.03
0.00
50.
00-0
.20
0.36
*-0
.19
-0.2
0A
173
A-2
.50
0.00
0.91
0.52
0.91
*0.
030.
030.
030.
005
0.00
0.52
*-0
.29
-0.2
7-0
.24
A17
4A
-0.3
90.
000.
550.
520.
55*
0.27
0.12
0.05
0.00
60.
000.
52*
-0.2
8-0
.28
-0.1
3A
175
C-0
.12
0.00
0.48
0.36
0.08
0.37
0.48
*0.
070.
005
0.00
-0.2
3-0
.07
0.36
*-0
.27
A17
6A
-1.4
70.
000.
780.
480.
78*
0.08
0.07
0.06
0.00
60.
000.
48*
-0.2
4-0
.29
-0.1
7A
177
A-2
.18
0.00
0.88
0.53
0.88
*0.
040.
030.
040.
006
0.00
0.53
*-0
.28
-0.3
1-0
.23
A17
8D
0.43
0.00
0.35
0.24
0.07
0.37
0.20
0.35
*0.
006
0.00
-0.2
20.
02?
-0.1
30.
24*
A17
9B
-1.4
70.
000.
780.
530.
030.
78*
0.07
0.11
0.00
60.
00-0
.26
0.53
*-0
.21
-0.3
2A
180
A-1
.07
0.00
0.71
0.42
0.71
*0.
210.
050.
030.
006
0.00
0.42
*-0
.19
-0.3
0-0
.19
A18
1B
-1.0
60.
000.
710.
470.
060.
71*
0.09
0.15
0.00
70.
00-0
.24
0.47
*-0
.31
-0.1
5A
182
D-0
.68
0.00
0.62
0.45
0.30
0.03
0.04
0.62
*0.
006
0.00
-0.2
2-0
.28
-0.2
50.
45*
A18
3C
-0.8
40.
000.
660.
410.
130.
070.
66*
0.14
0.00
60.
00-0
.16
-0.3
00.
41*
-0.1
5A
184
B-0
.25
0.00
0.51
0.39
0.29
0.51
*0.
130.
050.
007
0.00
-0.2
00.
39*
-0.1
0-0
.25
H 1
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)B
159
C-2
.33
0.00
0.90
0.54
0.06
0.03
0.90
*0.
020.
003
0.00
-0.3
7-0
.28
0.54
*-0
.18
B16
0C
-1.2
20.
000.
730.
310.
170.
050.
73*
0.04
0.00
40.
00-0
.12
-0.2
10.
31*
-0.1
8B
161
B-0
.76
0.00
0.63
0.32
0.03
0.63
*0.
050.
290.
004
0.00
-0.2
60.
32*
-0.2
5-0
.10
B16
2A
-0.3
50.
000.
530.
310.
53*
0.13
0.26
0.07
0.00
60.
000.
31*
-0.2
0-0
.10
-0.1
3B
163
C-2
.08
0.00
0.87
0.57
0.02
0.03
0.87
*0.
080.
004
0.00
-0.2
8-0
.28
0.57
*-0
.36
B16
4C
1.48
0.00
0.14
0.19
0.27
0.34
0.14
*0.
240.
005
0.00
-0.1
30.
02?
0.19
*-0
.02
B16
5D
-0.4
10.
000.
550.
420.
060.
310.
080.
55*
0.00
40.
00-0
.24
-0.1
2-0
.31
0.42
*B
166
D-1
.85
0.00
0.84
0.53
0.04
0.09
0.03
0.84
*0.
004
0.00
-0.3
1-0
.25
-0.3
00.
53*
B16
7D
-2.7
60.
000.
930.
550.
020.
020.
020.
93*
0.00
40.
00-0
.30
-0.2
8-0
.29
0.55
*B
168
A-1
.64
0.00
0.81
0.55
0.81
*0.
070.
040.
080.
005
0.00
0.55
*-0
.29
-0.2
7-0
.29
B16
9B
0.13
0.00
0.41
0.28
0.25
0.41
*0.
200.
140.
004
0.00
-0.0
90.
28*
-0.1
1-0
.12
B17
0B
-1.3
60.
000.
760.
540.
080.
76*
0.08
0.08
0.00
40.
00-0
.27
0.54
*-0
.26
-0.2
8B
171
D-2
.37
0.00
0.90
0.55
0.03
0.03
0.04
0.90
*0.
004
0.00
-0.2
8-0
.30
-0.2
90.
55*
B17
2D
-1.5
00.
000.
790.
550.
090.
060.
060.
79*
0.00
50.
00-0
.40
-0.2
3-0
.19
0.55
*B
173
D-2
.70
0.00
0.93
0.47
0.01
0.02
0.03
0.93
*0.
005
0.00
-0.2
4-0
.27
-0.2
40.
47*
B17
4C
-0.8
60.
000.
660.
540.
130.
130.
66*
0.07
0.00
60.
00-0
.25
-0.2
80.
54*
-0.2
5B
175
A-1
.19
0.00
0.73
0.41
0.73
*0.
220.
030.
030.
005
0.00
0.41
*-0
.23
-0.2
4-0
.23
B17
6B
-1.1
50.
000.
720.
410.
170.
72*
0.06
0.04
0.00
50.
00-0
.18
0.41
*-0
.24
-0.2
1B
177
B1.
060.
000.
210.
170.
51?
0.21
*0.
220.
060.
005
0.00
0.11
?0.
17*
-0.1
1-0
.27
B17
8D
-1.1
20.
000.
710.
520.
040.
180.
060.
71*
0.00
50.
00-0
.30
-0.2
4-0
.29
0.52
*B
179
B-0
.98
0.00
0.68
0.46
0.09
0.68
*0.
050.
170.
005
0.00
-0.2
60.
46*
-0.2
5-0
.17
B18
0A
-2.5
70.
000.
920.
520.
92*
0.03
0.02
0.02
0.00
50.
000.
52*
-0.3
0-0
.27
-0.2
5B
181
C-0
.72
0.00
0.63
0.49
0.19
0.05
0.63
*0.
130.
006
0.00
-0.2
7-0
.24
0.49
*-0
.19
B18
2C
-0.0
10.
000.
450.
420.
130.
100.
45*
0.32
0.00
50.
00-0
.14
-0.3
00.
42*
-0.1
2B
183
D-0
.60
0.00
0.60
0.48
0.34
0.03
0.03
0.60
*0.
005
0.00
-0.2
8-0
.27
-0.2
60.
48*
B18
4A
-0.5
80.
000.
590.
410.
59*
0.08
0.25
0.07
0.00
60.
000.
41*
-0.2
2-0
.16
-0.2
3
H 2
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)C
159
C-0
.71
0.00
0.63
0.45
0.06
0.03
0.63
*0.
270.
005
0.00
-0.2
9-0
.22
0.45
*-0
.20
C16
0B
-1.2
70.
000.
750.
560.
150.
75*
0.05
0.04
0.00
50.
00-0
.37
0.56
*-0
.26
-0.1
8C
161
A-2
.41
0.00
0.90
0.43
0.90
*0.
030.
020.
040.
005
0.00
0.43
*-0
.26
-0.2
8-0
.13
C16
2C
0.13
0.00
0.43
0.42
0.12
0.22
0.43
*0.
230.
005
0.00
-0.1
8-0
.10
0.42
*-0
.22
C16
3A
-0.8
80.
000.
670.
500.
67*
0.08
0.11
0.14
0.00
60.
000.
50*
-0.2
1-0
.16
-0.3
2C
164
A-0
.76
0.00
0.64
0.44
0.64
*0.
080.
110.
170.
005
0.00
0.44
*-0
.17
-0.3
5-0
.11
C16
5B
-2.5
50.
000.
920.
490.
030.
92*
0.03
0.02
0.00
50.
00-0
.25
0.49
*-0
.25
-0.2
3C
166
A-0
.90
0.00
0.68
0.38
0.68
*0.
020.
280.
020.
005
0.00
0.38
*-0
.26
-0.2
1-0
.22
C16
7C
-0.4
60.
000.
580.
470.
320.
040.
58*
0.07
0.00
60.
00-0
.23
-0.2
50.
47*
-0.2
4C
168
B-1
.96
0.00
0.86
0.50
0.03
0.86
*0.
040.
080.
005
0.00
-0.2
60.
50*
-0.2
3-0
.28
C16
9A
-1.6
80.
000.
820.
590.
82*
0.06
0.05
0.07
0.00
60.
000.
59*
-0.3
1-0
.31
-0.2
8C
170
C0.
190.
000.
420.
270.
080.
390.
42*
0.12
0.00
60.
00-0
.20
-0.0
60.
27*
-0.1
0C
171
C-0
.37
0.00
0.55
0.29
0.08
0.07
0.55
*0.
300.
005
0.00
-0.2
6-0
.20
0.29
*-0
.02
C17
2C
-2.1
00.
000.
870.
480.
060.
040.
87*
0.02
0.00
50.
00-0
.30
-0.2
30.
48*
-0.1
6C
173
C-1
.31
0.00
0.76
0.52
0.04
0.05
0.76
*0.
140.
006
0.00
-0.2
6-0
.28
0.52
*-0
.25
C17
4B
-0.6
90.
000.
630.
350.
200.
63*
0.10
0.07
0.00
60.
00-0
.02
0.35
*-0
.20
-0.3
3C
175
A-1
.95
0.00
0.86
0.62
0.86
*0.
080.
040.
020.
006
0.00
0.62
*-0
.41
-0.2
8-0
.25
C17
6B
1.11
0.00
0.21
0.19
0.49
0.21
*0.
230.
060.
006
0.00
0.07
?0.
19*
-0.0
8-0
.25
C17
7C
-2.0
80.
000.
870.
530.
040.
040.
87*
0.04
0.00
60.
00-0
.28
-0.2
60.
53*
-0.2
6C
178
B1.
040.
000.
230.
140.
320.
23*
0.22
0.23
0.00
80.
00-0
.08
0.14
*-0
.02
0.01
?C
179
D-2
.30
0.00
0.89
0.54
0.04
0.03
0.03
0.89
*0.
006
0.00
-0.2
7-0
.27
-0.2
70.
54*
C18
0C
-1.4
50.
000.
780.
460.
130.
060.
78*
0.02
0.00
70.
00-0
.21
-0.3
00.
46*
-0.2
0C
181
A-1
.32
0.00
0.76
0.39
0.76
*0.
040.
090.
110.
007
0.00
0.39
*-0
.28
-0.2
2-0
.09
C18
2D
-1.7
40.
000.
830.
550.
060.
040.
060.
83*
0.00
70.
00-0
.26
-0.2
9-0
.28
0.55
*C
183
C0.
600.
000.
320.
200.
050.
040.
32*
0.59
?0.
007
0.00
-0.2
2-0
.29
0.20
*0.
06?
C18
4A
-0.4
10.
000.
560.
490.
56*
0.09
0.25
0.09
0.00
80.
000.
49*
-0.1
8-0
.27
-0.1
9
H 3
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)D
159
B1.
520.
000.
140.
020.
440.
14*
0.29
0.12
0.00
40.
000.
04?
0.02
*-0
.06
0.03
?D
160
A-0
.91
0.00
0.67
0.44
0.67
*0.
120.
160.
050.
005
0.00
0.44
*-0
.19
-0.2
3-0
.23
D16
1D
-1.1
10.
000.
710.
530.
220.
030.
040.
71*
0.00
40.
00-0
.29
-0.2
8-0
.33
0.53
*D
162
C-1
.09
0.00
0.71
0.41
0.07
0.07
0.71
*0.
150.
005
0.00
-0.2
8-0
.19
0.41
*-0
.14
D16
3B
-0.8
60.
000.
660.
490.
140.
66*
0.15
0.05
0.00
40.
00-0
.19
0.49
*-0
.29
-0.2
3D
164
A-1
.77
0.00
0.83
0.52
0.83
*0.
070.
050.
050.
004
0.00
0.52
*-0
.22
-0.2
6-0
.35
D16
5C
-1.4
50.
000.
780.
580.
130.
070.
78*
0.03
0.00
40.
00-0
.42
-0.1
90.
58*
-0.2
3D
166
B-0
.93
0.00
0.67
0.27
0.04
0.67
*0.
260.
030.
004
0.00
-0.2
90.
27*
-0.0
3-0
.28
D16
7B
-2.6
30.
000.
920.
440.
020.
92*
0.03
0.03
0.00
40.
00-0
.23
0.44
*-0
.26
-0.2
0D
168
D-2
.38
0.00
0.90
0.59
0.05
0.02
0.03
0.90
*0.
004
0.00
-0.3
6-0
.29
-0.2
80.
59*
D16
9D
-0.6
90.
000.
620.
550.
220.
050.
120.
62*
0.00
50.
00-0
.31
-0.2
8-0
.22
0.55
*D
170
C-1
.13
0.00
0.72
0.49
0.07
0.14
0.72
*0.
070.
005
0.00
-0.2
3-0
.23
0.49
*-0
.25
D17
1A
0.32
0.00
0.37
0.30
0.37
*0.
460.
050.
120.
004
0.00
0.30
*-0
.08
-0.2
0-0
.14
D17
2A
-2.0
10.
000.
860.
450.
86*
0.02
0.04
0.08
0.00
40.
000.
45*
-0.2
1-0
.31
-0.2
1D
173
D-2
.23
0.00
0.88
0.50
0.04
0.03
0.04
0.88
*0.
005
0.00
-0.2
6-0
.29
-0.2
30.
50*
D17
4D
-1.6
40.
000.
810.
600.
070.
090.
040.
81*
0.00
50.
00-0
.37
-0.2
5-0
.31
0.60
*D
175
B-1
.70
0.00
0.82
0.59
0.07
0.82
*0.
070.
050.
005
0.00
-0.3
70.
59*
-0.2
3-0
.32
D17
6A
-0.5
50.
000.
590.
260.
59*
0.31
0.08
0.03
0.00
50.
000.
26*
0.02
?-0
.29
-0.2
6D
177
D-1
.03
0.00
0.70
0.55
0.16
0.09
0.05
0.70
*0.
005
0.00
-0.2
1-0
.33
-0.2
90.
55*
D17
8D
-0.1
10.
000.
480.
230.
070.
170.
270.
48*
0.00
60.
00-0
.20
-0.0
9-0
.03
0.23
*D
179
D-0
.93
0.00
0.67
0.45
0.11
0.07
0.14
0.67
*0.
005
0.00
-0.1
8-0
.31
-0.1
80.
45*
D18
0C
-1.5
90.
000.
800.
520.
060.
080.
80*
0.06
0.00
50.
00-0
.30
-0.2
10.
52*
-0.2
7D
181
D0.
030.
000.
440.
400.
150.
300.
100.
44*
0.00
70.
00-0
.12
-0.1
5-0
.22
0.40
*D
182
A-2
.43
0.00
0.90
0.60
0.90
*0.
040.
030.
020.
006
0.00
0.60
*-0
.37
-0.3
2-0
.24
D18
3B
-1.7
60.
000.
830.
490.
100.
83*
0.04
0.03
0.00
60.
00-0
.21
0.49
*-0
.32
-0.2
6D
184
D-0
.99
0.00
0.69
0.49
0.07
0.12
0.12
0.69
*0.
007
0.00
-0.2
5-0
.21
-0.2
40.
49*
H 4
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)E
159
A-2
.00
0.00
0.86
0.59
0.86
*0.
020.
020.
090.
004
0.00
0.59
*-0
.28
-0.2
4-0
.40
E16
0A
-2.3
20.
000.
890.
380.
89*
0.03
0.02
0.05
0.00
40.
000.
38*
-0.2
4-0
.29
-0.1
0E
161
C-0
.76
0.00
0.63
0.43
0.05
0.03
0.63
*0.
290.
005
0.00
-0.2
8-0
.22
0.43
*-0
.21
E16
2C
0.03
0.00
0.44
0.40
0.12
0.22
0.44
*0.
230.
005
0.00
-0.2
0-0
.10
0.40
*-0
.19
E16
3A
-0.9
00.
000.
660.
500.
66*
0.08
0.11
0.14
0.00
50.
000.
50*
-0.2
0-0
.17
-0.3
3E
164
A-1
.08
0.00
0.70
0.46
0.70
*0.
060.
100.
140.
004
0.00
0.46
*-0
.19
-0.3
8-0
.12
E16
5C
-1.9
90.
000.
860.
310.
100.
030.
86*
0.01
0.00
40.
00-0
.16
-0.1
80.
31*
-0.1
7E
166
A-2
.34
0.00
0.90
0.57
0.90
*0.
040.
030.
030.
004
0.00
0.57
*-0
.30
-0.2
9-0
.29
E16
7C
-0.4
90.
000.
570.
460.
320.
040.
57*
0.07
0.00
50.
00-0
.20
-0.2
70.
46*
-0.2
6E
168
C1.
030.
000.
210.
040.
54?
0.03
0.21
*0.
220.
004
0.00
0.07
?-0
.24
0.04
*0.
00E
169
A-1
.01
0.00
0.69
0.56
0.69
*0.
110.
130.
070.
004
0.00
0.56
*-0
.24
-0.2
7-0
.30
E17
0D
-1.4
70.
000.
780.
440.
050.
070.
100.
78*
0.00
40.
00-0
.27
-0.2
6-0
.16
0.44
*E
171
D-1
.45
0.00
0.78
0.49
0.03
0.04
0.15
0.78
*0.
004
0.00
-0.2
4-0
.28
-0.2
60.
49*
E17
2C
-1.2
70.
000.
740.
530.
090.
060.
74*
0.11
0.00
50.
00-0
.26
-0.2
70.
53*
-0.2
7E
173
A-2
.57
0.00
0.92
0.52
0.92
*0.
030.
030.
020.
004
0.00
0.52
*-0
.32
-0.2
6-0
.22
E17
4C
-1.1
60.
000.
720.
500.
100.
060.
72*
0.12
0.00
50.
00-0
.24
-0.3
10.
50*
-0.2
2E
175
A-0
.78
0.00
0.64
0.40
0.64
*0.
040.
210.
110.
005
0.00
0.40
*-0
.23
-0.1
1-0
.28
E17
6C
-0.7
90.
000.
640.
460.
180.
110.
64*
0.07
0.00
50.
00-0
.30
-0.0
70.
46*
-0.2
6E
177
A-0
.72
0.00
0.62
0.38
0.62
*0.
190.
070.
110.
005
0.00
0.38
*-0
.12
-0.2
7-0
.18
E17
8B
0.91
0.00
0.24
0.12
0.28
0.24
*0.
260.
220.
006
0.00
-0.0
90.
12*
0.00
0.02
?E
179
D-1
.11
0.00
0.71
0.52
0.04
0.18
0.06
0.71
*0.
005
0.00
-0.3
1-0
.23
-0.3
00.
52*
E18
0C
-1.4
50.
000.
780.
550.
060.
110.
78*
0.05
0.00
50.
00-0
.29
-0.3
40.
55*
-0.1
9E
181
B-2
.05
0.00
0.86
0.48
0.07
0.86
*0.
040.
030.
005
0.00
-0.2
80.
48*
-0.2
6-0
.19
E18
2B
-1.6
70.
000.
810.
530.
070.
81*
0.08
0.04
0.00
60.
00-0
.26
0.53
*-0
.26
-0.3
0E
183
A-0
.89
0.00
0.66
0.44
0.66
*0.
060.
080.
190.
006
0.00
0.44
*-0
.25
-0.2
8-0
.15
E18
4C
-0.8
00.
000.
640.
560.
230.
040.
64*
0.08
0.00
70.
00-0
.31
-0.2
10.
56*
-0.3
0
H 5
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)F
159
A0.
780.
000.
290.
320.
29*
0.21
0.22
0.27
0.00
70.
000.
32*
0.00
?-0
.15
-0.1
5F
160
D-2
.93
0.00
0.94
0.39
0.01
0.01
0.03
0.94
*0.
004
0.00
-0.2
1-0
.20
-0.1
80.
39*
F16
1C
-1.4
50.
000.
790.
560.
120.
060.
79*
0.04
0.00
50.
00-0
.31
-0.2
80.
56*
-0.2
7F
162
B-0
.24
0.00
0.53
0.41
0.38
0.53
*0.
030.
060.
005
0.00
-0.2
00.
41*
-0.2
5-0
.22
F16
3C
-1.1
60.
000.
740.
540.
160.
060.
74*
0.04
0.00
50.
00-0
.30
-0.2
70.
54*
-0.2
5F
164
B0.
770.
000.
290.
280.
430.
29*
0.21
0.06
0.00
50.
00-0
.03
0.28
*-0
.10
-0.2
4F
165
D0.
480.
000.
350.
260.
070.
390.
180.
35*
0.00
50.
00-0
.20
-0.0
2-0
.13
0.26
*F
166
A-2
.74
0.00
0.93
0.48
0.93
*0.
020.
030.
020.
004
0.00
0.48
*-0
.23
-0.2
8-0
.23
F16
7A
-2.8
20.
000.
940.
480.
94*
0.02
0.02
0.02
0.00
40.
000.
48*
-0.2
6-0
.24
-0.2
4F
168
D-0
.75
0.00
0.65
0.49
0.25
0.08
0.02
0.65
*0.
005
0.00
-0.2
8-0
.23
-0.2
40.
49*
F16
9B
-1.2
90.
000.
760.
470.
150.
76*
0.06
0.03
0.00
50.
00-0
.20
0.47
*-0
.31
-0.2
4F
170
B-1
.09
0.00
0.72
0.49
0.08
0.72
*0.
150.
040.
005
0.00
-0.2
00.
49*
-0.2
9-0
.24
F17
1B
-1.6
10.
000.
810.
600.
060.
81*
0.04
0.09
0.00
50.
00-0
.31
0.60
*-0
.24
-0.3
7F
172
C-0
.95
0.00
0.69
0.33
0.20
0.06
0.69
*0.
040.
005
0.00
-0.1
5-0
.20
0.33
*-0
.16
F17
3C
-1.8
90.
000.
850.
470.
030.
080.
85*
0.04
0.00
50.
00-0
.27
-0.2
20.
47*
-0.2
4F
174
D-0
.57
0.00
0.61
0.34
0.17
0.05
0.17
0.61
*0.
005
0.00
-0.2
4-0
.23
-0.0
30.
34*
F17
5A
-0.4
70.
000.
580.
370.
58*
0.14
0.20
0.07
0.00
60.
000.
37*
-0.1
9-0
.14
-0.1
7F
176
B0.
300.
000.
400.
250.
230.
40*
0.22
0.15
0.00
60.
00-0
.07
0.25
*-0
.12
-0.0
7F
177
D-0
.13
0.00
0.50
0.32
0.07
0.34
0.09
0.50
*0.
006
0.00
-0.2
0-0
.04
-0.2
60.
32*
F17
8C
-0.9
20.
000.
690.
520.
240.
040.
69*
0.03
0.00
60.
00-0
.35
-0.2
00.
52*
-0.2
0F
179
C1.
580.
000.
150.
230.
240.
410.
15*
0.20
0.00
70.
00-0
.22
0.01
?0.
23*
0.06
?F
180
D-0
.38
0.00
0.56
0.45
0.08
0.28
0.07
0.56
*0.
006
0.00
-0.2
3-0
.15
-0.3
00.
45*
F18
1B
-0.7
70.
000.
650.
520.
180.
65*
0.12
0.04
0.00
60.
00-0
.31
0.52
*-0
.20
-0.2
3F
182
A-1
.02
0.00
0.71
0.47
0.71
*0.
040.
080.
170.
006
0.00
0.47
*-0
.28
-0.2
3-0
.22
F18
3D
-1.0
10.
000.
700.
470.
130.
080.
080.
70*
0.00
60.
00-0
.21
-0.2
1-0
.25
0.47
*F
184
C-1
.01
0.00
0.71
0.61
0.15
0.08
0.71
*0.
060.
007
0.00
-0.3
3-0
.26
0.61
*-0
.31
H 6
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)G
159
B-2
.12
0.00
0.88
0.43
0.03
0.88
*0.
050.
030.
006
0.00
-0.2
20.
43*
-0.1
8-0
.25
G16
0C
-2.1
90.
000.
890.
480.
050.
040.
89*
0.02
0.00
50.
00-0
.28
-0.2
30.
48*
-0.1
9G
161
A-2
.73
0.00
0.93
0.47
0.93
*0.
020.
020.
030.
005
0.00
0.47
*-0
.23
-0.2
4-0
.24
G16
2C
-0.2
40.
000.
520.
390.
070.
360.
52*
0.06
0.00
60.
00-0
.19
-0.1
40.
39*
-0.2
7G
163
B1.
160.
000.
200.
170.
56?
0.20
*0.
190.
060.
006
0.00
0.07
?0.
17*
-0.0
9-0
.22
G16
4A
-1.0
00.
000.
700.
400.
70*
0.24
0.03
0.03
0.00
60.
000.
40*
-0.2
1-0
.22
-0.2
3G
165
D-0
.80
0.00
0.65
0.42
0.06
0.12
0.17
0.65
*0.
006
0.00
-0.2
2-0
.20
-0.1
70.
42*
G16
6A
-2.4
50.
000.
910.
470.
91*
0.03
0.02
0.03
0.00
50.
000.
47*
-0.2
5-0
.25
-0.2
1G
167
C-1
.62
0.00
0.81
0.51
0.05
0.09
0.81
*0.
050.
005
0.00
-0.2
8-0
.30
0.51
*-0
.18
G16
8D
0.10
0.00
0.43
0.38
0.18
0.28
0.11
0.43
*0.
006
0.00
-0.1
0-0
.17
-0.1
80.
38*
G16
9C
-0.8
00.
000.
650.
510.
050.
180.
65*
0.12
0.00
60.
00-0
.19
-0.2
30.
51*
-0.3
0G
170
D-0
.93
0.00
0.68
0.45
0.10
0.16
0.06
0.68
*0.
005
0.00
-0.2
2-0
.22
-0.2
00.
45*
G17
1D
-0.8
10.
000.
650.
500.
290.
030.
030.
65*
0.00
50.
00-0
.33
-0.2
3-0
.24
0.50
*G
172
A-0
.90
0.00
0.67
0.45
0.67
*0.
110.
160.
050.
006
0.00
0.45
*-0
.19
-0.2
5-0
.19
G17
3B
1.68
0.00
0.12
-0.0
10.
460.
12*
0.29
0.13
0.00
60.
000.
09?
-0.0
1*
-0.0
70.
03?
G17
4D
-1.0
00.
000.
700.
560.
220.
040.
040.
70*
0.00
60.
00-0
.30
-0.2
7-0
.33
0.56
*G
175
C-0
.88
0.00
0.67
0.38
0.09
0.08
0.67
*0.
150.
006
0.00
-0.2
3-0
.19
0.38
*-0
.12
G17
6B
-0.6
80.
000.
620.
490.
160.
62*
0.16
0.05
0.00
70.
00-0
.18
0.49
*-0
.29
-0.2
1G
177
C-1
.85
0.00
0.84
0.58
0.02
0.03
0.84
*0.
100.
006
0.00
-0.2
7-0
.28
0.58
*-0
.35
G17
8D
-1.6
20.
000.
810.
500.
030.
050.
100.
81*
0.00
60.
00-0
.29
-0.2
9-0
.20
0.50
*G
179
C1.
110.
000.
210.
150.
130.
170.
21*
0.49
0.00
70.
00-0
.10
-0.1
40.
15*
0.09
?G
180
A-0
.87
0.00
0.67
0.38
0.67
*0.
030.
280.
020.
006
0.00
0.38
*-0
.26
-0.1
8-0
.23
G18
1D
-1.4
10.
000.
780.
560.
070.
070.
080.
78*
0.00
70.
00-0
.27
-0.2
9-0
.26
0.56
*G
182
A-0
.98
0.00
0.69
0.60
0.69
*0.
100.
100.
110.
007
0.00
0.60
*-0
.30
-0.2
8-0
.27
G18
3A
-2.5
50.
000.
920.
520.
92*
0.03
0.03
0.02
0.00
70.
000.
52*
-0.2
9-0
.28
-0.2
1G
184
B-0
.86
0.00
0.66
0.42
0.21
0.66
*0.
070.
060.
007
0.00
-0.1
10.
42*
-0.2
7-0
.30
H 7
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)H
159
C-1
.66
0.00
0.80
0.44
0.04
0.04
0.80
*0.
120.
004
0.00
-0.2
4-0
.25
0.44
*-0
.22
H16
0A
-0.9
30.
000.
650.
410.
65*
0.15
0.07
0.13
0.00
60.
000.
41*
-0.1
6-0
.24
-0.1
9H
161
C-1
.03
0.00
0.67
0.47
0.08
0.15
0.67
*0.
090.
006
0.00
-0.1
7-0
.28
0.47
*-0
.21
H16
2A
-0.9
70.
000.
660.
380.
66*
0.03
0.20
0.11
0.00
40.
000.
38*
-0.2
1-0
.11
-0.2
9H
163
B-1
.46
0.00
0.77
0.40
0.15
0.77
*0.
050.
030.
005
0.00
-0.1
80.
40*
-0.2
5-0
.20
H16
4D
-1.2
40.
000.
720.
510.
130.
100.
050.
72*
0.00
40.
00-0
.19
-0.3
1-0
.28
0.51
*H
165
D-1
.21
0.00
0.71
0.51
0.03
0.18
0.07
0.71
*0.
004
0.00
-0.2
8-0
.25
-0.2
80.
51*
H16
6D
-0.7
10.
000.
600.
420.
160.
070.
180.
60*
0.00
40.
00-0
.16
-0.2
8-0
.16
0.42
*H
167
C-1
.50
0.00
0.77
0.47
0.07
0.09
0.77
*0.
060.
004
0.00
-0.2
8-0
.16
0.47
*-0
.27
H16
8C
-0.1
30.
000.
440.
410.
150.
120.
44*
0.29
0.00
50.
00-0
.13
-0.3
10.
41*
-0.1
0H
169
C-2
.35
0.00
0.90
0.54
0.04
0.04
0.90
*0.
030.
005
0.00
-0.2
8-0
.29
0.54
*-0
.28
H17
0D
-1.1
20.
000.
690.
500.
070.
120.
110.
69*
0.00
40.
00-0
.24
-0.2
5-0
.23
0.50
*H
171
C-0
.58
0.00
0.56
0.32
0.25
0.10
0.56
*0.
080.
005
0.00
-0.0
3-0
.24
0.32
*-0
.23
H17
2C
-2.2
30.
000.
880.
580.
070.
030.
88*
0.02
0.00
40.
00-0
.41
-0.2
90.
58*
-0.1
7H
173
B-1
.34
0.00
0.74
0.55
0.16
0.74
*0.
060.
040.
005
0.00
-0.3
30.
55*
-0.2
8-0
.21
H17
4C
-1.8
70.
000.
840.
590.
050.
090.
84*
0.02
0.00
50.
00-0
.35
-0.3
20.
59*
-0.2
6H
175
A-1
.71
0.00
0.81
0.53
0.81
*0.
090.
060.
040.
005
0.00
0.53
*-0
.25
-0.2
7-0
.30
H17
6A
-0.9
30.
000.
650.
510.
65*
0.08
0.12
0.14
0.00
60.
000.
51*
-0.2
2-0
.18
-0.3
1H
177
C-0
.25
0.00
0.47
0.40
0.11
0.22
0.47
*0.
200.
005
0.00
-0.2
2-0
.11
0.40
*-0
.18
H17
8A
-2.0
90.
000.
870.
590.
87*
0.05
0.03
0.05
0.00
40.
000.
59*
-0.2
9-0
.29
-0.3
3H
179
C-1
.90
0.00
0.84
0.36
0.10
0.04
0.84
*0.
010.
005
0.00
-0.1
8-0
.22
0.36
*-0
.19
H18
0B
-0.9
10.
000.
640.
250.
040.
64*
0.28
0.03
0.00
50.
00-0
.27
0.25
*0.
00-0
.27
H18
1D
-0.8
70.
000.
630.
600.
210.
050.
100.
63*
0.00
50.
00-0
.32
-0.3
3-0
.24
0.60
*H
182
A-1
.61
0.00
0.79
0.57
0.79
*0.
090.
040.
080.
006
0.00
0.57
*-0
.31
-0.2
8-0
.28
H18
3C
-1.2
00.
000.
710.
500.
070.
150.
71*
0.07
0.00
60.
00-0
.28
-0.2
40.
50*
-0.2
2H
184
B-1
.95
0.00
0.85
0.51
0.06
0.85
*0.
030.
060.
006
0.00
-0.2
30.
51*
-0.3
0-0
.26
H 8
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)I
159
B-0
.39
0.00
0.55
0.36
0.39
0.55
*0.
040.
020.
004
0.00
-0.1
70.
36*
-0.2
8-0
.21
I16
0A
-2.6
40.
000.
920.
470.
92*
0.03
0.02
0.03
0.00
40.
000.
47*
-0.2
4-0
.22
-0.2
6I
161
A-0
.53
0.00
0.58
0.53
0.58
*0.
250.
110.
050.
005
0.00
0.53
*-0
.30
-0.3
0-0
.11
I16
2C
-0.1
40.
000.
490.
380.
080.
380.
49*
0.06
0.00
50.
00-0
.27
-0.0
90.
38*
-0.2
5I
163
A-1
.53
0.00
0.79
0.49
0.79
*0.
080.
070.
050.
006
0.00
0.49
*-0
.29
-0.2
7-0
.16
I16
4A
-2.2
50.
000.
890.
530.
89*
0.04
0.02
0.05
0.00
50.
000.
53*
-0.2
4-0
.27
-0.3
1I
165
D0.
390.
000.
360.
220.
070.
400.
170.
36*
0.00
50.
00-0
.21
-0.0
1-0
.09
0.22
*I
166
B-1
.63
0.00
0.81
0.52
0.03
0.81
*0.
060.
100.
004
0.00
-0.2
40.
52*
-0.2
2-0
.33
I16
7A
-1.1
80.
000.
730.
420.
73*
0.19
0.05
0.02
0.00
50.
000.
42*
-0.1
6-0
.36
-0.1
7I
168
B-1
.23
0.00
0.74
0.48
0.05
0.74
*0.
070.
130.
005
0.00
-0.2
20.
48*
-0.3
3-0
.18
I16
9D
-0.7
30.
000.
630.
440.
280.
030.
050.
63*
0.00
50.
00-0
.20
-0.2
4-0
.31
0.44
*I
170
C-0
.88
0.00
0.67
0.45
0.12
0.06
0.67
*0.
140.
005
0.00
-0.1
6-0
.30
0.45
*-0
.20
I17
1B
-0.3
40.
000.
540.
400.
290.
54*
0.13
0.04
0.00
50.
00-0
.19
0.40
*-0
.15
-0.2
4I
172
C-2
.02
0.00
0.86
0.44
0.04
0.07
0.86
*0.
030.
005
0.00
-0.3
2-0
.17
0.44
*-0
.18
I17
3D
-0.5
00.
000.
580.
350.
190.
050.
180.
58*
0.00
60.
00-0
.22
-0.3
0-0
.01
0.35
*I
174
C-1
.85
0.00
0.84
0.57
0.06
0.08
0.84
*0.
020.
005
0.00
-0.3
4-0
.31
0.57
*-0
.21
I17
5C
0.02
0.00
0.45
0.43
0.13
0.20
0.45
*0.
210.
006
0.00
-0.2
7-0
.10
0.43
*-0
.16
I17
6D
-1.6
30.
000.
810.
590.
100.
060.
030.
81*
0.00
50.
00-0
.35
-0.2
6-0
.28
0.59
*I
177
D-0
.11
0.00
0.48
0.36
0.08
0.34
0.09
0.48
*0.
006
0.00
-0.1
7-0
.06
-0.3
00.
36*
I17
8C
1.06
0.00
0.21
0.16
0.16
0.14
0.21
*0.
480.
008
0.00
-0.1
1-0
.12
0.16
*0.
06?
I17
9D
-2.4
30.
000.
910.
560.
040.
020.
030.
91*
0.00
50.
00-0
.29
-0.2
4-0
.34
0.56
*I
180
D-1
.28
0.00
0.75
0.49
0.03
0.06
0.15
0.75
*0.
006
0.00
-0.2
8-0
.34
-0.1
80.
49*
I18
1B
-0.7
60.
000.
640.
530.
190.
64*
0.12
0.04
0.00
60.
00-0
.31
0.53
*-0
.19
-0.2
9I
182
A-1
.14
0.00
0.72
0.45
0.72
*0.
030.
090.
150.
006
0.00
0.45
*-0
.28
-0.2
1-0
.21
I18
3B
-1.3
20.
000.
760.
540.
070.
76*
0.11
0.05
0.00
60.
00-0
.23
0.54
*-0
.30
-0.2
7I
184
D-1
.52
0.00
0.79
0.52
0.06
0.06
0.08
0.79
*0.
007
0.00
-0.2
4-0
.36
-0.1
90.
52*
H 9
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)J
159
D-1
.50
0.00
0.79
0.56
0.09
0.07
0.06
0.79
*0.
005
0.00
-0.3
8-0
.26
-0.2
00.
56*
J16
0D
-2.7
80.
000.
940.
430.
010.
020.
030.
94*
0.00
40.
00-0
.21
-0.2
5-0
.21
0.43
*J
161
C-0
.89
0.00
0.66
0.54
0.14
0.13
0.66
*0.
060.
006
0.00
-0.2
6-0
.28
0.54
*-0
.24
J16
2A
-1.2
00.
000.
730.
400.
73*
0.22
0.02
0.02
0.00
40.
000.
40*
-0.2
3-0
.23
-0.2
2J
163
B-1
.22
0.00
0.73
0.39
0.17
0.73
*0.
050.
040.
005
0.00
-0.1
80.
39*
-0.2
3-0
.20
J16
4B
1.13
0.00
0.19
0.16
0.53
?0.
19*
0.22
0.06
0.00
50.
000.
10?
0.16
*-0
.09
-0.2
6J
165
D-1
.11
0.00
0.71
0.53
0.04
0.18
0.07
0.71
*0.
004
0.00
-0.2
9-0
.25
-0.3
00.
53*
J16
6B
-1.0
70.
000.
700.
450.
080.
70*
0.05
0.17
0.00
40.
00-0
.26
0.45
*-0
.28
-0.1
7J
167
A-2
.62
0.00
0.92
0.54
0.92
*0.
020.
030.
020.
004
0.00
0.54
*-0
.29
-0.2
9-0
.26
J16
8C
-0.8
00.
000.
640.
500.
180.
050.
64*
0.13
0.00
50.
00-0
.27
-0.2
60.
50*
-0.2
0J
169
C-0
.03
0.00
0.45
0.41
0.14
0.10
0.45
*0.
300.
006
0.00
-0.1
3-0
.29
0.41
*-0
.12
J17
0D
-0.7
20.
000.
620.
510.
310.
030.
030.
62*
0.00
50.
00-0
.30
-0.2
7-0
.26
0.51
*J
171
A-0
.63
0.00
0.60
0.41
0.60
*0.
070.
250.
070.
005
0.00
0.41
*-0
.25
-0.1
5-0
.22
J17
2C
-2.0
90.
000.
870.
590.
070.
030.
87*
0.02
0.00
40.
00-0
.40
-0.3
00.
59*
-0.1
9J
173
C-1
.05
0.00
0.70
0.33
0.20
0.06
0.70
*0.
040.
004
0.00
-0.1
2-0
.23
0.33
*-0
.18
J17
4B
-0.7
70.
000.
630.
360.
040.
63*
0.06
0.27
0.00
50.
00-0
.27
0.36
*-0
.29
-0.0
9J
175
A-0
.43
0.00
0.55
0.36
0.55
*0.
120.
260.
070.
006
0.00
0.36
*-0
.21
-0.1
0-0
.19
J17
6C
-1.9
30.
000.
850.
610.
020.
040.
85*
0.09
0.00
50.
00-0
.29
-0.3
10.
61*
-0.3
6J
177
C1.
400.
000.
150.
180.
280.
330.
15*
0.24
0.00
60.
00-0
.13
0.04
?0.
18*
-0.0
1J
178
D-0
.41
0.00
0.55
0.41
0.07
0.30
0.08
0.55
*0.
005
0.00
-0.2
6-0
.09
-0.3
00.
41*
J17
9D
-1.7
20.
000.
820.
590.
050.
090.
040.
82*
0.00
40.
00-0
.37
-0.2
7-0
.29
0.59
*J
180
D-2
.55
0.00
0.92
0.58
0.03
0.03
0.03
0.92
*0.
004
0.00
-0.3
1-0
.30
-0.3
10.
58*
J18
1A
-1.6
20.
000.
810.
570.
81*
0.08
0.04
0.07
0.00
50.
000.
57*
-0.3
1-0
.29
-0.2
8J
182
B0.
150.
000.
400.
250.
250.
40*
0.21
0.13
0.00
60.
00-0
.08
0.25
*-0
.11
-0.0
9J
183
B-1
.35
0.00
0.76
0.56
0.08
0.76
*0.
090.
070.
005
0.00
-0.2
80.
56*
-0.2
6-0
.29
J18
4D
-2.1
30.
000.
880.
580.
030.
040.
040.
88*
0.00
60.
00-0
.28
-0.3
1-0
.31
0.58
*
H 1
0
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)W
74C
-0.2
40.
000.
550.
450.
100.
260.
55*
0.09
0.00
10.
00-0
.24
-0.0
90.
45*
-0.3
7W
75A
-1.6
30.
000.
800.
500.
80*
0.03
0.13
0.04
0.00
10.
000.
50*
-0.2
6-0
.34
-0.2
0W
76A
-0.7
10.
000.
640.
350.
64*
0.09
0.03
0.24
0.00
10.
000.
35*
-0.1
8-0
.18
-0.2
0W
77C
0.01
0.00
0.49
0.46
0.10
0.10
0.49
*0.
300.
001
0.00
-0.3
1-0
.34
0.46
*-0
.07
W78
D-1
.15
0.00
0.72
0.52
0.19
0.04
0.05
0.72
*0.
002
0.00
-0.3
1-0
.29
-0.2
50.
52*
W79
B-1
.58
0.00
0.79
0.42
0.07
0.79
*0.
050.
090.
001
0.00
-0.2
10.
42*
-0.2
5-0
.22
W80
A-0
.36
0.00
0.57
0.30
0.57
*0.
120.
060.
250.
001
0.00
0.30
*-0
.24
-0.3
10.
01?
W81
B-1
.16
0.00
0.73
0.51
0.07
0.73
*0.
180.
020.
001
0.00
-0.3
00.
51*
-0.3
1-0
.22
W82
C-0
.19
0.00
0.53
0.45
0.15
0.16
0.53
*0.
160.
001
0.00
-0.1
9-0
.19
0.45
*-0
.23
W83
C-0
.38
0.00
0.57
0.44
0.09
0.05
0.57
*0.
290.
001
0.00
-0.2
7-0
.26
0.44
*-0
.19
W84
B-1
.37
0.00
0.76
0.42
0.10
0.76
*0.
090.
050.
001
0.00
-0.1
20.
42*
-0.2
4-0
.32
W85
A-2
.18
0.00
0.87
0.43
0.87
*0.
050.
050.
030.
002
0.00
0.43
*-0
.26
-0.2
5-0
.18
W86
D-1
.30
0.00
0.75
0.45
0.10
0.05
0.10
0.75
*0.
001
0.00
-0.2
7-0
.32
-0.1
40.
45*
W87
B-1
.40
0.00
0.77
0.42
0.12
0.77
*0.
070.
040.
002
0.00
-0.2
90.
42*
-0.1
6-0
.20
W88
C-1
.17
0.00
0.73
0.53
0.12
0.09
0.73
*0.
070.
002
0.00
-0.3
3-0
.22
0.53
*-0
.26
W89
B-0
.76
0.00
0.65
0.48
0.13
0.65
*0.
120.
100.
002
0.00
-0.2
50.
48*
-0.1
8-0
.29
W90
D-1
.06
0.00
0.71
0.50
0.11
0.07
0.12
0.71
*0.
001
0.00
-0.3
9-0
.27
-0.1
20.
50*
W91
A-1
.03
0.00
0.70
0.29
0.70
*0.
180.
050.
070.
002
0.00
0.29
*-0
.08
-0.2
6-0
.18
W92
C-1
.43
0.00
0.77
0.21
0.15
0.03
0.77
*0.
050.
002
0.00
-0.0
4-0
.26
0.21
*-0
.15
W93
A-0
.84
0.00
0.67
0.53
0.67
*0.
160.
130.
040.
002
0.00
0.53
*-0
.27
-0.2
8-0
.29
W94
B-0
.35
0.00
0.57
0.34
0.08
0.57
*0.
090.
260.
004
0.00
-0.1
90.
34*
-0.2
4-0
.12
W95
D-0
.17
0.00
0.53
0.48
0.10
0.11
0.26
0.53
*0.
002
0.00
-0.2
0-0
.31
-0.1
90.
48*
W96
D-0
.35
0.00
0.57
0.29
0.06
0.15
0.22
0.57
*0.
002
0.00
-0.2
3-0
.11
-0.1
10.
29*
W97
A-1
.22
0.00
0.74
0.46
0.74
*0.
060.
040.
160.
002
0.00
0.46
*-0
.29
-0.2
5-0
.22
W98
A0.
000.
000.
500.
220.
50*
0.23
0.16
0.11
0.00
30.
000.
22*
0.00
-0.1
8-0
.13
W99
C-2
.34
0.00
0.88
0.38
0.05
0.04
0.88
*0.
020.
003
0.00
-0.2
1-0
.21
0.38
*-0
.22
W10
1A
-0.6
90.
000.
640.
310.
64*
0.05
0.04
0.27
0.00
20.
000.
31*
-0.2
2-0
.20
-0.1
4W
102
B-1
.11
0.00
0.72
0.46
0.05
0.72
*0.
150.
080.
001
0.00
-0.2
60.
46*
-0.2
9-0
.17
W10
3B
-1.3
00.
000.
750.
350.
140.
75*
0.07
0.04
0.00
10.
00-0
.10
0.35
*-0
.31
-0.1
9W
104
D-0
.68
0.00
0.64
0.46
0.11
0.09
0.16
0.64
*0.
003
0.00
-0.1
8-0
.22
-0.2
70.
46*
W10
5A
-1.4
70.
000.
780.
500.
78*
0.09
0.08
0.06
0.00
10.
000.
50*
-0.2
3-0
.26
-0.3
2W
106
B-0
.85
0.00
0.67
0.43
0.17
0.67
*0.
110.
050.
001
0.00
-0.2
80.
43*
-0.1
3-0
.24
W10
7C
-1.2
20.
000.
740.
550.
080.
140.
74*
0.05
0.00
10.
00-0
.24
-0.3
50.
55*
-0.2
7W
108
C-1
.59
0.00
0.79
0.54
0.08
0.06
0.79
*0.
070.
001
0.00
-0.3
1-0
.31
0.54
*-0
.25
W10
9B
-0.7
50.
000.
650.
400.
160.
65*
0.09
0.10
0.00
10.
00-0
.04
0.40
*-0
.25
-0.3
5W
110
B0.
560.
000.
380.
170.
260.
38*
0.25
0.11
0.00
20.
00-0
.11
0.17
*0.
03?
-0.1
4
H 1
1
Ap
pen
dix
H:
2001
PS
SA
Gra
de
Fiv
e It
em A
nal
ysis
Mu
ltip
le C
ho
ice
Item
s fo
r R
ead
ing
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lid(R
A)
(RB
)R
(C)
R(D
)W
111
D0.
390.
000.
410.
350.
360.
070.
160.
41*
0.00
10.
00-0
.10
-0.1
7-0
.22
0.35
*W
112
D-0
.66
0.00
0.63
0.44
0.05
0.07
0.24
0.63
*0.
003
0.00
-0.2
6-0
.30
-0.1
80.
44*
W11
3D
-0.6
00.
000.
620.
460.
090.
060.
230.
62*
0.00
10.
00-0
.20
-0.2
8-0
.23
0.46
*W
114
C-1
.28
0.00
0.75
0.37
0.05
0.17
0.75
*0.
030.
002
0.00
-0.3
0-0
.17
0.37
*-0
.18
W11
5B
-1.9
90.
000.
850.
560.
060.
85*
0.05
0.04
0.00
20.
00-0
.34
0.56
*-0
.28
-0.2
8W
116
D-0
.30
0.00
0.56
0.38
0.17
0.12
0.15
0.56
*0.
002
0.00
-0.1
7-0
.24
-0.1
30.
38*
W11
7A
-1.3
60.
000.
760.
360.
76*
0.17
0.04
0.03
0.00
10.
000.
36*
-0.2
0-0
.22
-0.2
0W
118
A-0
.86
0.00
0.67
0.45
0.67
*0.
120.
100.
110.
002
0.00
0.45
*-0
.24
-0.2
7-0
.15
W11
9B
-1.1
80.
000.
730.
400.
040.
73*
0.14
0.09
0.00
20.
00-0
.27
0.40
*-0
.31
-0.0
6W
120
D0.
880.
000.
310.
250.
310.
330.
050.
31*
0.00
20.
000.
00?
-0.1
3-0
.27
0.25
*W
121
C-0
.24
0.00
0.55
0.27
0.25
0.13
0.55
*0.
070.
003
0.00
-0.1
0-0
.13
0.27
*-0
.17
W12
2C
-1.6
90.
000.
810.
530.
060.
070.
81*
0.06
0.00
20.
00-0
.25
-0.3
40.
53*
-0.2
5W
123
B-0
.92
0.00
0.68
0.30
0.06
0.68
*0.
220.
040.
003
0.00
-0.2
40.
30*
-0.1
0-0
.21
W12
4A
-1.3
20.
000.
750.
410.
75*
0.10
0.11
0.04
0.00
20.
000.
41*
-0.2
2-0
.20
-0.2
3W
125
A0.
120.
000.
470.
310.
47*
0.10
0.05
0.38
0.00
30.
000.
31*
-0.2
1-0
.28
-0.0
5W
126
C-0
.47
0.00
0.59
0.43
0.17
0.12
0.59
*0.
110.
004
0.00
-0.2
0-0
.19
0.43
*-0
.23
H 1
2
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)A
179
D-2
.65
0.00
0.92
0.52
0.03
0.02
0.02
0.92
*0.
010.
00-0
.28
-0.2
5-0
.22
0.52
*A
180
B-2
.31
0.00
0.89
0.54
0.04
0.89
*0.
040.
020.
010.
00-0
.26
0.54
*-0
.31
-0.2
2A
181
B-2
.08
0.00
0.87
0.50
0.08
0.87
*0.
020.
020.
010.
00-0
.28
0.50
*-0
.26
-0.2
3A
182
B-0
.57
0.00
0.62
0.31
0.18
0.62
*0.
070.
130.
010.
00-0
.11
0.31
*-0
.29
-0.0
3A
183
B-2
.03
0.00
0.87
0.48
0.07
0.87
*0.
030.
020.
010.
00-0
.22
0.48
*-0
.28
-0.2
2A
184
B0.
030.
000.
470.
270.
090.
47*
0.41
0.02
0.01
0.00
-0.2
30.
27*
-0.0
2-0
.22
A18
5A
-1.7
40.
000.
830.
430.
83*
0.12
0.02
0.02
0.01
0.00
0.43
*-0
.22
-0.2
7-0
.20
A18
6D
-2.5
00.
000.
910.
570.
030.
030.
030.
91*
0.01
0.00
-0.2
6-0
.30
-0.2
90.
57*
A18
7B
-0.3
80.
000.
570.
430.
150.
57*
0.16
0.11
0.01
0.00
-0.2
10.
43*
-0.1
2-0
.22
A18
8C
-0.2
80.
000.
550.
370.
260.
060.
55*
0.13
0.01
0.00
-0.1
4-0
.22
0.37
*-0
.14
A18
9D
-1.4
90.
000.
790.
500.
090.
040.
070.
79*
0.01
0.00
-0.1
8-0
.31
-0.2
60.
50*
A19
0D
-0.7
30.
000.
650.
430.
220.
050.
070.
65*
0.01
0.00
-0.1
3-0
.29
-0.2
30.
43*
A19
1D
-0.1
90.
000.
530.
490.
140.
170.
150.
53*
0.01
0.00
-0.2
0-0
.17
-0.2
30.
49*
A19
2C
-1.6
30.
000.
810.
310.
040.
120.
81*
0.02
0.01
0.00
-0.2
3-0
.06
0.31
*-0
.23
A19
3A
-0.3
50.
000.
560.
380.
56*
0.29
0.05
0.08
0.01
0.00
0.38
*-0
.10
-0.2
5-0
.22
A19
4B
-1.1
30.
000.
730.
530.
120.
73*
0.09
0.06
0.01
0.00
-0.2
30.
53*
-0.2
8-0
.24
A19
5B
-1.2
90.
000.
760.
500.
110.
76*
0.07
0.05
0.01
0.00
-0.2
30.
50*
-0.2
8-0
.21
A19
6B
0.13
0.00
0.45
0.32
0.24
0.45
*0.
180.
130.
010.
00-0
.09
0.32
*-0
.12
-0.1
6A
197
C-1
.28
0.00
0.76
0.54
0.05
0.11
0.76
*0.
070.
010.
00-0
.26
-0.3
00.
54*
-0.2
1A
198
C-1
.52
0.00
0.80
0.58
0.06
0.07
0.80
*0.
060.
010.
00-0
.27
-0.3
10.
58*
-0.2
5A
199
D-0
.52
0.00
0.60
0.40
0.05
0.30
0.05
0.60
*0.
010.
00-0
.26
-0.0
9-0
.34
0.40
*A
200
B-1
.29
0.00
0.76
0.48
0.04
0.76
*0.
160.
030.
010.
00-0
.28
0.48
*-0
.24
-0.2
2A
201
A-1
.28
0.00
0.76
0.56
0.76
*0.
060.
110.
070.
010.
000.
56*
-0.3
1-0
.24
-0.2
6A
202
D0.
020.
000.
470.
410.
310.
160.
050.
47*
0.01
0.00
-0.1
4-0
.16
-0.2
80.
41*
A20
3A
-0.7
60.
000.
660.
430.
66*
0.05
0.05
0.23
0.01
0.00
0.43
*-0
.32
-0.3
3-0
.08
A20
4C
-1.1
10.
000.
730.
590.
070.
080.
73*
0.12
0.01
0.00
-0.2
9-0
.30
0.59
*-0
.25
A20
5A
0.70
0.00
0.31
0.16
0.31
*0.
490.
130.
050.
010.
000.
16*
0.17
?-0
.24
-0.2
3A
206
D-0
.32
0.00
0.56
0.37
0.28
0.08
0.08
0.56
*0.
010.
000.
00-0
.30
-0.2
70.
37*
A20
7B
0.42
0.00
0.38
0.34
0.15
0.38
*0.
300.
170.
010.
00-0
.10
0.34
*-0
.17
-0.0
6A
208
D0.
630.
000.
330.
280.
310.
110.
240.
33*
0.01
0.00
-0.0
1-0
.24
-0.0
50.
28*
A20
9D
-1.7
50.
000.
830.
590.
040.
060.
060.
83*
0.01
0.00
-0.3
0-0
.29
-0.2
70.
59*
A21
0A
-1.8
30.
000.
840.
570.
84*
0.06
0.05
0.05
0.01
0.00
0.57
*-0
.32
-0.2
8-0
.22
A21
1A
0.80
0.00
0.29
0.25
0.29
*0.
180.
220.
300.
010.
000.
25*
-0.1
9-0
.01
-0.0
2A
212
B-1
.01
0.00
0.71
0.41
0.20
0.71
*0.
060.
030.
010.
00-0
.10
0.41
*-0
.31
-0.2
6A
213
B0.
880.
000.
280.
160.
380.
28*
0.18
0.16
0.01
0.00
0.11
?0.
16*
-0.2
3-0
.04
A21
4A
-0.5
90.
000.
620.
390.
62*
0.15
0.13
0.09
0.01
0.00
0.39
*-0
.20
-0.1
0-0
.19
I 1
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)B
179
D-2
.60
0.00
0.92
0.43
0.03
0.02
0.02
0.92
*0.
010.
00-0
.20
-0.2
0-0
.18
0.43
*B
180
C-0
.55
0.00
0.61
0.47
0.09
0.08
0.61
*0.
230.
010.
00-0
.16
-0.2
60.
47*
-0.2
2B
181
B-2
.30
0.00
0.90
0.54
0.03
0.90
*0.
040.
020.
010.
00-0
.24
0.54
*-0
.32
-0.2
2B
182
C0.
500.
000.
350.
170.
210.
090.
35*
0.34
0.01
0.00
-0.0
9-0
.14
0.17
*0.
05?
B18
3D
-1.1
50.
000.
740.
500.
140.
090.
030.
74*
0.01
0.00
-0.2
3-0
.25
-0.2
50.
50*
B18
4A
-1.8
40.
000.
850.
500.
85*
0.07
0.03
0.05
0.01
0.00
0.50
*-0
.23
-0.2
7-0
.24
B18
5A
-2.3
90.
000.
910.
500.
91*
0.03
0.02
0.03
0.01
0.00
0.50
*-0
.23
-0.2
5-0
.24
B18
6D
-2.3
60.
000.
900.
560.
030.
030.
030.
90*
0.01
0.00
-0.2
4-0
.28
-0.2
90.
56*
B18
7B
0.06
0.00
0.45
0.34
0.02
0.45
*0.
360.
160.
010.
00-0
.24
0.34
*-0
.07
-0.2
0B
188
A-0
.67
0.00
0.63
0.46
0.63
*0.
210.
130.
030.
010.
000.
46*
-0.1
9-0
.22
-0.2
8B
189
D-0
.15
0.00
0.51
0.45
0.23
0.16
0.10
0.51
*0.
010.
00-0
.14
-0.2
2-0
.19
0.45
*B
190
B-0
.92
0.00
0.69
0.42
0.08
0.69
*0.
150.
080.
010.
00-0
.22
0.42
*-0
.18
-0.1
7B
191
B-1
.52
0.00
0.80
0.47
0.14
0.80
*0.
030.
020.
010.
00-0
.22
0.47
*-0
.28
-0.2
2B
192
D-1
.69
0.00
0.83
0.59
0.09
0.04
0.04
0.83
*0.
010.
00-0
.30
-0.2
9-0
.30
0.59
*B
193
B1.
120.
000.
220.
090.
71?
0.22
*0.
020.
040.
010.
000.
16?
0.09
*-0
.25
-0.2
3B
194
D-1
.29
0.00
0.76
0.50
0.12
0.06
0.05
0.76
*0.
010.
00-0
.25
-0.2
1-0
.24
0.50
*B
195
D-1
.04
0.00
0.71
0.58
0.19
0.05
0.04
0.71
*0.
010.
00-0
.29
-0.2
7-0
.30
0.58
*B
196
A0.
240.
000.
410.
290.
41*
0.27
0.12
0.20
0.01
0.00
0.29
*-0
.10
-0.2
0-0
.02
B19
7B
0.61
0.00
0.32
0.22
0.14
0.32
*0.
500.
030.
010.
00-0
.17
0.22
*0.
04?
-0.2
1B
198
D-0
.02
0.00
0.47
0.41
0.16
0.27
0.09
0.47
*0.
010.
00-0
.15
-0.1
2-0
.23
0.41
*B
199
B-1
.18
0.00
0.74
0.58
0.07
0.74
*0.
100.
090.
010.
00-0
.28
0.58
*-0
.30
-0.2
3B
200
B-1
.54
0.00
0.80
0.57
0.05
0.80
*0.
080.
050.
010.
00-0
.29
0.57
*-0
.27
-0.2
7B
201
A-0
.78
0.00
0.66
0.52
0.66
*0.
190.
090.
050.
010.
000.
52*
-0.2
5-0
.28
-0.1
7B
202
C-0
.62
0.00
0.62
0.41
0.05
0.08
0.62
*0.
240.
010.
00-0
.24
-0.2
60.
41*
-0.1
2B
203
B0.
470.
000.
350.
300.
400.
35*
0.03
0.21
0.01
0.00
-0.0
10.
30*
-0.2
7-0
.16
B20
4B
-0.8
00.
000.
660.
480.
070.
66*
0.18
0.07
0.01
0.00
-0.2
10.
48*
-0.1
7-0
.30
B20
5B
-2.4
90.
000.
920.
520.
020.
92*
0.03
0.02
0.01
0.00
-0.2
50.
52*
-0.2
6-0
.23
B20
6C
-0.0
50.
000.
480.
350.
110.
250.
48*
0.15
0.01
0.00
-0.1
9-0
.12
0.35
*-0
.11
B20
7A
-0.7
50.
000.
650.
470.
65*
0.18
0.12
0.04
0.01
0.00
0.47
*-0
.26
-0.1
4-0
.25
B20
8B
-0.2
50.
000.
530.
230.
060.
53*
0.11
0.28
0.01
0.00
-0.2
40.
23*
-0.2
50.
12?
B20
9C
0.64
0.00
0.31
0.34
0.26
0.29
0.31
*0.
140.
010.
00-0
.12
-0.1
10.
34*
-0.0
7B
210
C-0
.75
0.00
0.65
0.45
0.06
0.24
0.65
*0.
040.
010.
00-0
.28
-0.1
60.
45*
-0.2
4B
211
A-1
.88
0.00
0.85
0.56
0.85
*0.
050.
040.
040.
010.
000.
56*
-0.3
1-0
.29
-0.2
1B
212
B-0
.47
0.00
0.58
0.33
0.05
0.58
*0.
050.
310.
010.
00-0
.24
0.33
*-0
.29
-0.0
4B
213
D-1
.83
0.00
0.85
0.54
0.06
0.05
0.04
0.85
*0.
010.
00-0
.25
-0.2
6-0
.27
0.54
*B
214
B0.
170.
000.
430.
370.
180.
43*
0.30
0.09
0.01
0.00
-0.1
30.
37*
-0.2
0-0
.05
I 2
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)C
179
A-1
.21
0.00
0.74
0.38
0.74
*0.
110.
120.
020.
010.
000.
38*
-0.2
2-0
.15
-0.1
9C
180
B-0
.86
0.00
0.67
0.37
0.11
0.67
*0.
040.
180.
010.
00-0
.26
0.37
*-0
.25
-0.0
6C
181
D-2
.18
0.00
0.88
0.57
0.02
0.04
0.04
0.88
*0.
010.
00-0
.25
-0.2
9-0
.32
0.57
*C
182
A1.
280.
000.
180.
110.
18*
0.43
0.15
0.23
0.01
0.00
0.11
*0.
10?
-0.0
9-0
.09
C18
3B
-1.4
60.
000.
790.
500.
040.
79*
0.12
0.05
0.01
0.00
-0.2
70.
50*
-0.2
4-0
.24
C18
4C
-1.2
70.
000.
750.
410.
130.
060.
75*
0.05
0.01
0.00
-0.1
1-0
.28
0.41
*-0
.25
C18
5C
-1.2
70.
000.
750.
500.
190.
040.
75*
0.01
0.01
0.00
-0.3
1-0
.26
0.50
*-0
.21
C18
6B
-0.7
90.
000.
650.
400.
130.
65*
0.02
0.19
0.01
0.00
-0.2
40.
40*
-0.2
6-0
.13
C18
7B
0.11
0.00
0.43
0.32
0.33
0.43
*0.
140.
090.
010.
00-0
.12
0.32
*-0
.11
-0.1
4C
188
B0.
150.
000.
420.
350.
160.
42*
0.32
0.09
0.01
0.00
-0.1
20.
35*
-0.1
2-0
.17
C18
9A
0.22
0.00
0.41
0.26
0.41
*0.
240.
100.
240.
010.
000.
26*
-0.1
1-0
.20
0.00
C19
0B
-0.3
50.
000.
550.
390.
300.
55*
0.06
0.09
0.01
0.00
-0.1
10.
39*
-0.2
8-0
.19
C19
1C
-2.8
40.
000.
940.
490.
020.
020.
94*
0.01
0.01
0.00
-0.2
3-0
.27
0.49
*-0
.21
C19
2C
-0.8
70.
000.
670.
510.
140.
110.
67*
0.08
0.01
0.00
-0.2
2-0
.25
0.51
*-0
.25
C19
3A
-1.1
60.
000.
730.
400.
73*
0.03
0.15
0.08
0.01
0.00
0.40
*-0
.29
-0.1
5-0
.19
C19
4B
0.34
0.00
0.38
0.32
0.41
0.38
*0.
120.
090.
010.
00-0
.12
0.32
*-0
.15
-0.0
9C
195
A-1
.45
0.00
0.79
0.47
0.79
*0.
110.
060.
030.
010.
000.
47*
-0.2
3-0
.25
-0.2
1C
196
A-1
.77
0.00
0.83
0.43
0.83
*0.
070.
030.
060.
010.
000.
43*
-0.1
8-0
.26
-0.1
9C
197
B-1
.59
0.00
0.81
0.55
0.10
0.81
*0.
060.
030.
010.
00-0
.26
0.55
*-0
.31
-0.2
4C
198
B-1
.57
0.00
0.80
0.59
0.05
0.80
*0.
080.
060.
010.
00-0
.30
0.59
*-0
.28
-0.2
8C
199
C-1
.62
0.00
0.81
0.60
0.06
0.09
0.81
*0.
030.
010.
00-0
.29
-0.3
50.
60*
-0.2
3C
200
B-1
.19
0.00
0.74
0.60
0.07
0.74
*0.
110.
070.
010.
00-0
.31
0.60
*-0
.30
-0.2
6C
201
B-1
.22
0.00
0.74
0.49
0.06
0.74
*0.
130.
060.
010.
00-0
.30
0.49
*-0
.20
-0.2
1C
202
B-1
.89
0.00
0.85
0.63
0.06
0.85
*0.
040.
050.
010.
00-0
.33
0.63
*-0
.32
-0.2
9C
203
C-1
.57
0.00
0.81
0.60
0.05
0.07
0.81
*0.
070.
010.
00-0
.30
-0.3
10.
60*
-0.2
7C
204
D-0
.34
0.00
0.55
0.47
0.06
0.11
0.28
0.55
*0.
010.
00-0
.28
-0.2
3-0
.16
0.47
*C
205
A-0
.94
0.00
0.69
0.45
0.69
*0.
200.
040.
060.
010.
000.
45*
-0.1
8-0
.29
-0.2
1C
206
D0.
240.
000.
400.
240.
140.
210.
240.
40*
0.01
0.00
-0.1
0-0
.10
-0.0
50.
24*
C20
7D
-1.2
60.
000.
750.
650.
100.
070.
080.
75*
0.01
0.00
-0.3
0-0
.33
-0.3
20.
65*
C20
8A
-0.1
20.
000.
490.
270.
49*
0.23
0.19
0.08
0.01
0.00
0.27
*-0
.11
-0.0
6-0
.14
C20
9A
-1.0
60.
000.
710.
480.
71*
0.10
0.09
0.09
0.01
0.00
0.48
*-0
.29
-0.2
3-0
.12
C21
0B
0.64
0.00
0.31
0.23
0.11
0.31
*0.
500.
080.
010.
00-0
.19
0.23
*0.
03?
-0.1
3C
211
B-1
.06
0.00
0.71
0.50
0.10
0.71
*0.
070.
110.
010.
00-0
.28
0.50
*-0
.28
-0.1
5C
212
D-1
.16
0.00
0.73
0.61
0.10
0.07
0.10
0.73
*0.
010.
00-0
.25
-0.3
2-0
.31
0.61
*C
213
B-1
.68
0.00
0.82
0.57
0.06
0.82
*0.
070.
040.
010.
00-0
.29
0.57
*-0
.30
-0.2
4C
214
B-0
.18
0.00
0.51
0.38
0.14
0.51
*0.
120.
220.
010.
00-0
.17
0.38
*-0
.14
-0.1
4
I 3
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)D
179
B0.
140.
000.
380.
210.
330.
38*
0.22
0.06
0.01
0.00
0.05
?0.
21*
-0.1
3-0
.19
D18
0D
-1.3
80.
000.
760.
420.
070.
070.
100.
76*
0.01
0.00
-0.1
6-0
.24
-0.1
90.
42*
D18
1B
-1.6
70.
000.
810.
530.
070.
81*
0.06
0.05
0.01
0.00
-0.3
20.
53*
-0.2
4-0
.21
D18
2A
-1.5
90.
000.
800.
540.
80*
0.11
0.05
0.04
0.01
0.00
0.54
*-0
.36
-0.2
6-0
.16
D18
3A
-2.0
70.
000.
870.
610.
87*
0.06
0.02
0.05
0.01
0.00
0.61
*-0
.34
-0.2
5-0
.31
D18
4B
-0.8
70.
000.
640.
400.
130.
64*
0.02
0.20
0.01
0.00
-0.2
80.
40*
-0.2
6-0
.09
D18
5C
-1.3
50.
000.
750.
440.
070.
100.
75*
0.08
0.01
0.00
-0.1
6-0
.31
0.44
*-0
.13
D18
6D
-2.2
30.
000.
890.
600.
040.
040.
030.
89*
0.01
0.00
-0.2
8-0
.32
-0.3
00.
60*
D18
7A
0.20
0.00
0.36
0.33
0.36
*0.
230.
140.
260.
010.
000.
33*
-0.0
6-0
.23
-0.0
6D
188
A-1
.95
0.00
0.85
0.48
0.85
*0.
060.
030.
050.
010.
000.
48*
-0.2
2-0
.28
-0.2
2D
189
B-0
.67
0.00
0.59
0.43
0.15
0.59
*0.
150.
100.
010.
00-0
.26
0.43
*-0
.12
-0.1
8D
190
C-2
.13
0.00
0.88
0.50
0.05
0.04
0.88
*0.
030.
010.
00-0
.21
-0.3
20.
50*
-0.2
2D
191
A-1
.67
0.00
0.81
0.57
0.81
*0.
090.
050.
040.
010.
000.
57*
-0.3
0-0
.29
-0.2
5D
192
A-1
.12
0.00
0.70
0.57
0.70
*0.
080.
120.
100.
010.
000.
57*
-0.3
0-0
.30
-0.2
1D
193
A-1
.48
0.00
0.78
0.42
0.78
*0.
070.
100.
050.
010.
000.
42*
-0.2
2-0
.17
-0.2
1D
194
D-1
.41
0.00
0.76
0.44
0.08
0.05
0.10
0.76
*0.
010.
00-0
.25
-0.2
5-0
.14
0.44
*D
195
B0.
340.
000.
330.
240.
480.
33*
0.12
0.06
0.01
0.00
-0.0
60.
24*
-0.1
1-0
.08
D19
6B
0.23
0.00
0.35
0.28
0.03
0.35
*0.
390.
220.
010.
00-0
.27
0.28
*-0
.05
-0.1
0D
197
A-1
.72
0.00
0.82
0.60
0.82
*0.
070.
050.
050.
010.
000.
60*
-0.3
1-0
.28
-0.2
8D
198
B-1
.50
0.00
0.78
0.57
0.05
0.78
*0.
080.
090.
010.
00-0
.30
0.57
*-0
.35
-0.1
9D
199
D-1
.63
0.00
0.80
0.66
0.04
0.09
0.06
0.80
*0.
010.
00-0
.28
-0.3
8-0
.31
0.66
*D
200
A-0
.71
0.00
0.60
0.38
0.60
*0.
160.
050.
180.
010.
000.
38*
-0.1
7-0
.30
-0.0
8D
201
B-1
.25
0.00
0.73
0.58
0.09
0.73
*0.
090.
080.
010.
00-0
.31
0.58
*-0
.33
-0.1
8D
202
C-1
.14
0.00
0.71
0.55
0.09
0.14
0.71
*0.
060.
010.
00-0
.24
-0.3
10.
55*
-0.2
0D
203
A-1
.70
0.00
0.82
0.65
0.82
*0.
070.
080.
030.
010.
000.
65*
-0.3
2-0
.36
-0.2
7D
204
D-1
.61
0.00
0.80
0.66
0.07
0.06
0.07
0.80
*0.
010.
00-0
.31
-0.3
5-0
.31
0.66
*D
205
B-0
.40
0.00
0.52
0.41
0.29
0.52
*0.
080.
100.
010.
00-0
.17
0.41
*-0
.27
-0.0
9D
206
D-0
.56
0.00
0.57
0.49
0.19
0.10
0.14
0.57
*0.
010.
00-0
.16
-0.2
7-0
.21
0.49
*D
207
D-0
.51
0.00
0.55
0.38
0.09
0.15
0.19
0.55
*0.
010.
00-0
.26
-0.1
6-0
.08
0.38
*D
208
D-1
.28
0.00
0.74
0.65
0.09
0.07
0.09
0.74
*0.
010.
00-0
.26
-0.3
4-0
.33
0.65
*D
209
A-1
.33
0.00
0.75
0.61
0.75
*0.
110.
080.
050.
010.
000.
61*
-0.2
8-0
.33
-0.2
8D
210
D-1
.19
0.00
0.72
0.60
0.12
0.09
0.07
0.72
*0.
010.
00-0
.27
-0.2
9-0
.28
0.60
*D
211
A-1
.70
0.00
0.82
0.67
0.82
*0.
050.
060.
060.
010.
000.
67*
-0.3
4-0
.35
-0.3
0D
212
D-0
.40
0.00
0.52
0.42
0.10
0.12
0.25
0.52
*0.
010.
00-0
.21
-0.2
2-0
.10
0.42
*D
213
A-2
.44
0.00
0.91
0.55
0.91
*0.
030.
030.
020.
010.
000.
55*
-0.2
9-0
.28
-0.2
4D
214
D-0
.58
0.00
0.57
0.35
0.08
0.26
0.08
0.57
*0.
010.
00-0
.20
-0.0
5-0
.26
0.35
*
I 4
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)E
179
C-1
.41
0.00
0.78
0.44
0.04
0.12
0.78
*0.
050.
010.
00-0
.27
-0.2
20.
44*
-0.1
6E
180
D-0
.30
0.00
0.55
0.51
0.13
0.14
0.17
0.55
*0.
010.
00-0
.22
-0.2
1-0
.24
0.51
*E
181
B0.
540.
000.
350.
270.
120.
35*
0.41
0.11
0.01
0.00
-0.1
00.
27*
-0.1
1-0
.07
E18
2C
0.13
0.00
0.45
0.29
0.45
0.05
0.45
*0.
050.
010.
00-0
.07
-0.2
40.
29*
-0.1
8E
183
B0.
240.
000.
420.
330.
380.
42*
0.07
0.12
0.01
0.00
-0.0
50.
33*
-0.2
7-0
.16
E18
4B
-1.0
40.
000.
710.
550.
130.
71*
0.09
0.05
0.01
0.00
-0.2
60.
55*
-0.2
9-0
.23
E18
5C
-1.2
20.
000.
750.
560.
080.
130.
75*
0.03
0.01
0.00
-0.3
1-0
.30
0.56
*-0
.23
E18
6B
-1.1
10.
000.
730.
550.
160.
73*
0.05
0.06
0.01
0.00
-0.2
80.
55*
-0.2
9-0
.27
E18
7B
-1.7
80.
000.
840.
490.
030.
84*
0.07
0.06
0.01
0.00
-0.2
70.
49*
-0.2
5-0
.23
E18
8D
-1.7
40.
000.
830.
570.
040.
040.
080.
83*
0.01
0.00
-0.2
9-0
.29
-0.2
90.
57*
E18
9C
-2.1
40.
000.
880.
530.
030.
040.
88*
0.05
0.01
0.00
-0.2
7-0
.31
0.53
*-0
.24
E19
0D
-0.3
10.
000.
550.
410.
050.
250.
140.
55*
0.01
0.00
-0.2
1-0
.20
-0.1
50.
41*
E19
1D
-2.3
80.
000.
900.
500.
040.
030.
020.
90*
0.01
0.00
-0.2
4-0
.27
-0.2
40.
50*
E19
2B
-1.0
70.
000.
720.
390.
090.
72*
0.12
0.06
0.01
0.00
-0.2
50.
39*
-0.1
3-0
.17
E19
3D
-0.5
10.
000.
600.
350.
190.
170.
030.
60*
0.01
0.00
-0.1
4-0
.15
-0.2
50.
35*
E19
4A
-0.1
20.
000.
510.
360.
51*
0.07
0.24
0.18
0.01
0.00
0.36
*-0
.19
-0.1
2-0
.17
E19
5A
-0.8
60.
000.
680.
420.
68*
0.03
0.23
0.06
0.01
0.00
0.42
*-0
.27
-0.2
2-0
.18
E19
6B
-0.1
20.
000.
510.
340.
130.
51*
0.25
0.11
0.01
0.00
-0.2
00.
34*
-0.0
6-0
.20
E19
7C
-0.4
60.
000.
590.
340.
040.
310.
59*
0.05
0.01
0.00
-0.2
4-0
.11
0.34
*-0
.20
E19
8C
-0.3
00.
000.
550.
380.
080.
210.
55*
0.15
0.01
0.00
-0.2
3-0
.09
0.38
*-0
.19
E19
9A
-0.6
80.
000.
640.
510.
64*
0.10
0.21
0.05
0.01
0.00
0.51
*-0
.25
-0.2
5-0
.22
E20
0C
-1.4
40.
000.
790.
570.
070.
070.
79*
0.07
0.01
0.00
-0.2
9-0
.27
0.57
*-0
.28
E20
1C
-1.5
70.
000.
810.
620.
060.
080.
81*
0.05
0.01
0.00
-0.2
6-0
.36
0.62
*-0
.30
E20
2B
-1.6
50.
000.
820.
590.
050.
82*
0.09
0.04
0.01
0.00
-0.2
60.
59*
-0.3
5-0
.28
E20
3B
-0.7
90.
000.
660.
490.
180.
66*
0.05
0.10
0.01
0.00
-0.2
20.
49*
-0.3
0-0
.21
E20
4C
-0.9
80.
000.
700.
600.
070.
070.
70*
0.15
0.01
0.00
-0.2
8-0
.29
0.60
*-0
.30
E20
5B
-1.4
60.
000.
790.
560.
050.
79*
0.12
0.04
0.01
0.00
-0.3
00.
56*
-0.2
8-0
.26
E20
6B
0.00
0.00
0.48
0.17
0.06
0.48
*0.
080.
370.
010.
00-0
.27
0.17
*-0
.27
0.16
?E
207
A-0
.11
0.00
0.51
0.21
0.51
*0.
230.
190.
070.
010.
000.
21*
-0.0
9-0
.03
-0.1
4E
208
C0.
450.
000.
370.
250.
300.
190.
37*
0.13
0.01
0.00
-0.0
3-0
.14
0.25
*-0
.09
E20
9A
-0.2
40.
000.
540.
420.
54*
0.14
0.15
0.17
0.01
0.00
0.42
*-0
.25
-0.1
3-0
.15
E21
0B
-0.2
70.
000.
540.
420.
090.
54*
0.07
0.29
0.01
0.00
-0.1
90.
42*
-0.3
2-0
.12
E21
1B
-0.9
20.
000.
690.
490.
120.
69*
0.07
0.12
0.01
0.00
-0.2
70.
49*
-0.2
8-0
.16
E21
2B
-0.1
60.
000.
520.
420.
180.
52*
0.21
0.08
0.01
0.00
-0.2
10.
42*
-0.1
5-0
.16
E21
3A
-0.5
20.
000.
600.
470.
60*
0.20
0.12
0.08
0.01
0.00
0.47
*-0
.17
-0.2
4-0
.25
E21
4C
-0.8
30.
000.
670.
470.
080.
110.
67*
0.14
0.01
0.00
-0.2
5-0
.24
0.47
*-0
.16
I 5
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)F
179
B-1
.36
0.00
0.76
0.57
0.05
0.76
*0.
090.
100.
010.
00-0
.28
0.57
*-0
.29
-0.2
6F
180
A-1
.92
0.00
0.85
0.57
0.85
*0.
090.
030.
030.
010.
000.
57*
-0.3
5-0
.28
-0.2
3F
181
B-2
.15
0.00
0.88
0.57
0.03
0.88
*0.
060.
030.
010.
00-0
.26
0.57
*-0
.33
-0.2
8F
182
C-1
.83
0.00
0.84
0.58
0.05
0.06
0.84
*0.
060.
010.
00-0
.29
-0.2
90.
58*
-0.3
0F
183
C-1
.46
0.00
0.78
0.46
0.06
0.07
0.78
*0.
090.
010.
00-0
.31
-0.2
60.
46*
-0.1
2F
184
D-1
.20
0.00
0.73
0.55
0.06
0.14
0.07
0.73
*0.
010.
00-0
.28
-0.2
4-0
.29
0.55
*F
185
B0.
280.
000.
360.
310.
360.
36*
0.02
0.26
0.01
0.00
-0.0
30.
31*
-0.2
8-0
.17
F18
6B
-0.2
50.
000.
500.
370.
300.
50*
0.06
0.14
0.01
0.00
-0.1
10.
37*
-0.3
2-0
.11
F18
7A
-1.4
90.
000.
780.
540.
78*
0.12
0.06
0.04
0.01
0.00
0.54
*-0
.27
-0.2
7-0
.27
F18
8B
-1.8
00.
000.
830.
560.
040.
83*
0.09
0.04
0.01
0.00
-0.2
80.
56*
-0.2
6-0
.32
F18
9C
-0.3
40.
000.
520.
340.
090.
260.
52*
0.13
0.01
0.00
-0.1
9-0
.15
0.34
*-0
.09
F19
0B
-2.8
60.
000.
940.
510.
020.
94*
0.02
0.01
0.01
0.00
-0.2
50.
51*
-0.2
8-0
.22
F19
1B
0.53
0.00
0.30
0.25
0.11
0.30
*0.
52?
0.07
0.01
0.00
-0.1
80.
25*
-0.0
1-0
.13
F19
2B
-1.2
70.
000.
740.
460.
080.
74*
0.05
0.13
0.01
0.00
-0.2
50.
46*
-0.2
6-0
.17
F19
3A
-1.5
00.
000.
780.
620.
78*
0.08
0.07
0.05
0.01
0.00
0.62
*-0
.30
-0.3
3-0
.29
F19
4B
-0.1
80.
000.
480.
250.
420.
48*
0.08
0.02
0.01
0.00
0.02
?0.
25*
-0.2
8-0
.25
F19
5A
-1.7
30.
000.
820.
610.
82*
0.04
0.08
0.06
0.01
0.00
0.61
*-0
.31
-0.3
7-0
.24
F19
6D
-1.7
40.
000.
820.
610.
040.
080.
050.
82*
0.01
0.00
-0.3
0-0
.31
-0.3
10.
61*
F19
7D
-2.2
60.
000.
890.
610.
040.
040.
030.
89*
0.01
0.00
-0.3
2-0
.31
-0.2
90.
61*
F19
8B
-2.1
60.
000.
880.
600.
040.
88*
0.05
0.02
0.01
0.00
-0.2
70.
60*
-0.3
7-0
.25
F19
9B
-1.9
70.
000.
850.
560.
090.
85*
0.03
0.02
0.01
0.00
-0.2
90.
56*
-0.3
1-0
.26
F20
0B
-0.7
20.
000.
620.
340.
170.
62*
0.07
0.13
0.01
0.00
-0.1
10.
34*
-0.3
2-0
.04
F20
1B
-1.9
80.
000.
860.
510.
080.
86*
0.03
0.03
0.01
0.00
-0.2
50.
51*
-0.2
8-0
.24
F20
2B
-0.2
60.
000.
500.
290.
080.
50*
0.38
0.03
0.01
0.00
-0.2
30.
29*
-0.0
3-0
.27
F20
3A
-1.5
50.
000.
790.
480.
79*
0.14
0.03
0.03
0.01
0.00
0.48
*-0
.21
-0.3
3-0
.23
F20
4D
-2.2
30.
000.
890.
630.
040.
040.
040.
89*
0.01
0.00
-0.2
9-0
.33
-0.3
30.
63*
F20
5B
-0.4
70.
000.
550.
410.
150.
55*
0.17
0.11
0.01
0.00
-0.1
70.
41*
-0.1
4-0
.21
F20
6C
-0.4
50.
000.
550.
380.
250.
070.
55*
0.12
0.01
0.00
-0.1
0-0
.28
0.38
*-0
.16
F20
7D
-1.4
30.
000.
770.
550.
090.
050.
080.
77*
0.01
0.00
-0.2
0-0
.35
-0.2
80.
55*
F20
8D
-0.7
50.
000.
620.
450.
240.
060.
080.
62*
0.01
0.00
-0.1
1-0
.31
-0.2
80.
45*
F20
9D
-0.3
50.
000.
520.
490.
140.
180.
150.
52*
0.01
0.00
-0.2
1-0
.18
-0.2
20.
49*
F21
0C
-1.6
60.
000.
810.
380.
040.
110.
81*
0.03
0.01
0.00
-0.2
7-0
.09
0.38
*-0
.26
F21
1A
-0.3
90.
000.
530.
370.
53*
0.32
0.07
0.07
0.01
0.00
0.37
*-0
.08
-0.2
6-0
.21
F21
2B
-1.1
90.
000.
720.
530.
130.
72*
0.09
0.05
0.01
0.00
-0.2
30.
53*
-0.2
8-0
.24
F21
3B
-1.2
70.
000.
740.
500.
130.
74*
0.07
0.05
0.01
0.00
-0.2
40.
50*
-0.2
7-0
.22
F21
4B
0.10
0.00
0.40
0.29
0.23
0.40
*0.
220.
130.
010.
00-0
.06
0.29
*-0
.09
-0.1
7
I 6
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)G
179
D-0
.97
0.00
0.70
0.39
0.04
0.24
0.02
0.70
*0.
010.
00-0
.26
-0.1
7-0
.23
0.39
*G
180
D-0
.66
0.00
0.63
0.53
0.05
0.12
0.20
0.63
*0.
010.
00-0
.28
-0.2
8-0
.20
0.53
*G
181
D-1
.43
0.00
0.79
0.53
0.04
0.05
0.12
0.79
*0.
010.
00-0
.28
-0.2
6-0
.26
0.53
*G
182
D-0
.16
0.00
0.50
0.42
0.14
0.27
0.08
0.50
*0.
010.
00-0
.15
-0.1
6-0
.23
0.42
*G
183
B-2
.01
0.00
0.87
0.59
0.03
0.87
*0.
070.
030.
010.
00-0
.27
0.59
*-0
.35
-0.2
7G
184
C-1
.52
0.00
0.80
0.51
0.08
0.07
0.80
*0.
040.
010.
00-0
.29
-0.2
10.
51*
-0.2
4G
185
C-1
.15
0.00
0.73
0.53
0.07
0.12
0.73
*0.
060.
010.
00-0
.23
-0.3
00.
53*
-0.2
0G
186
A-1
.81
0.00
0.84
0.61
0.84
*0.
060.
070.
030.
010.
000.
61*
-0.3
0-0
.35
-0.2
5G
187
D-0
.64
0.00
0.62
0.54
0.16
0.08
0.13
0.62
*0.
010.
00-0
.22
-0.3
0-0
.22
0.54
*G
188
B0.
040.
000.
450.
410.
150.
45*
0.25
0.15
0.01
0.00
-0.1
00.
41*
-0.2
1-0
.14
G18
9A
-0.4
90.
000.
580.
410.
58*
0.12
0.13
0.16
0.01
0.00
0.41
*-0
.23
-0.1
4-0
.15
G19
0D
0.56
0.00
0.32
0.25
0.32
0.13
0.23
0.32
*0.
010.
000.
00?
-0.1
8-0
.08
0.25
*G
191
A0.
630.
000.
300.
300.
30*
0.18
0.21
0.30
0.01
0.00
0.30
*-0
.20
-0.0
2-0
.05
G19
2D
-1.3
70.
000.
780.
550.
090.
070.
050.
78*
0.01
0.00
-0.2
4-0
.29
-0.2
70.
55*
G19
3A
-1.6
90.
000.
830.
620.
83*
0.04
0.06
0.07
0.01
0.00
0.62
*-0
.31
-0.3
2-0
.28
G19
4B
-0.4
20.
000.
570.
410.
170.
57*
0.13
0.13
0.01
0.00
-0.1
20.
41*
-0.2
6-0
.14
G19
5C
-1.9
30.
000.
860.
540.
030.
040.
86*
0.06
0.01
0.00
-0.2
8-0
.30
0.54
*-0
.23
G19
6B
0.34
0.00
0.37
0.12
0.06
0.37
*0.
480.
080.
010.
00-0
.17
0.12
*0.
18?
-0.2
9G
197
D-2
.37
0.00
0.91
0.52
0.03
0.03
0.03
0.91
*0.
010.
00-0
.24
-0.2
7-0
.24
0.52
*G
198
C-0
.53
0.00
0.59
0.47
0.10
0.08
0.59
*0.
220.
010.
00-0
.16
-0.3
00.
47*
-0.1
8G
199
B-2
.07
0.00
0.88
0.60
0.04
0.88
*0.
050.
020.
010.
00-0
.27
0.60
*-0
.36
-0.2
5G
200
C0.
420.
000.
350.
150.
200.
090.
35*
0.34
0.01
0.00
-0.1
0-0
.16
0.15
*0.
09?
G20
1D
-1.0
40.
000.
710.
540.
150.
100.
030.
71*
0.01
0.00
-0.2
3-0
.28
-0.2
80.
54*
G20
2A
-1.5
90.
000.
810.
530.
81*
0.09
0.03
0.06
0.01
0.00
0.53
*-0
.24
-0.2
9-0
.26
G20
3A
-2.1
50.
000.
890.
550.
89*
0.04
0.03
0.04
0.01
0.00
0.55
*-0
.27
-0.2
9-0
.26
G20
4D
-2.0
40.
000.
870.
620.
040.
040.
040.
87*
0.01
0.00
-0.2
8-0
.32
-0.3
20.
62*
G20
5B
0.04
0.00
0.45
0.31
0.03
0.45
*0.
360.
150.
010.
00-0
.29
0.31
*-0
.04
-0.1
6G
206
A-0
.62
0.00
0.62
0.49
0.62
*0.
210.
140.
030.
010.
000.
49*
-0.1
9-0
.24
-0.2
8G
207
D-0
.10
0.00
0.48
0.43
0.24
0.16
0.11
0.48
*0.
010.
00-0
.12
-0.2
1-0
.19
0.43
*G
208
B-0
.94
0.00
0.69
0.43
0.08
0.69
*0.
150.
070.
010.
00-0
.23
0.43
*-0
.18
-0.1
6G
209
B-1
.42
0.00
0.78
0.51
0.14
0.78
*0.
040.
030.
010.
00-0
.23
0.51
*-0
.32
-0.2
2G
210
D-1
.56
0.00
0.81
0.62
0.10
0.05
0.04
0.81
*0.
010.
00-0
.30
-0.3
2-0
.30
0.62
*G
211
B1.
070.
000.
210.
070.
71?
0.21
*0.
030.
040.
010.
000.
21?
0.07
*-0
.29
-0.2
4G
212
D-1
.21
0.00
0.74
0.53
0.12
0.07
0.06
0.74
*0.
010.
00-0
.24
-0.2
4-0
.27
0.53
*G
213
D-0
.96
0.00
0.69
0.58
0.19
0.06
0.05
0.69
*0.
010.
00-0
.28
-0.2
8-0
.31
0.58
*G
214
A0.
180.
000.
410.
290.
41*
0.28
0.12
0.18
0.01
0.00
0.29
*-0
.08
-0.1
9-0
.05
I 7
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)H
179
D-2
.37
0.00
0.90
0.45
0.02
0.05
0.02
0.90
*0.
010.
00-0
.23
-0.2
0-0
.21
0.45
*H
180
A-1
.70
0.00
0.83
0.54
0.83
*0.
080.
040.
050.
010.
000.
54*
-0.2
8-0
.24
-0.2
6H
181
B-1
.63
0.00
0.82
0.53
0.04
0.82
*0.
090.
050.
010.
00-0
.25
0.53
*-0
.26
-0.2
6H
182
B-1
.52
0.00
0.80
0.55
0.03
0.80
*0.
070.
090.
010.
00-0
.25
0.55
*-0
.32
-0.2
3H
183
C0.
180.
000.
440.
220.
090.
080.
44*
0.38
0.01
0.00
-0.2
6-0
.35
0.22
*0.
18?
H18
4D
-0.0
20.
000.
490.
390.
290.
180.
040.
49*
0.01
0.00
-0.1
5-0
.13
-0.2
80.
39*
H18
5C
-2.5
40.
000.
910.
570.
030.
030.
91*
0.02
0.01
0.00
-0.2
9-0
.29
0.57
*-0
.25
H18
6D
-0.2
90.
000.
550.
410.
050.
100.
290.
55*
0.01
0.00
-0.2
8-0
.21
-0.1
20.
41*
H18
7A
-1.1
80.
000.
740.
470.
74*
0.16
0.03
0.06
0.01
0.00
0.47
*-0
.22
-0.2
6-0
.21
H18
8D
-0.0
20.
000.
490.
250.
350.
070.
080.
49*
0.01
0.00
0.07
?-0
.26
-0.2
40.
25*
H18
9A
0.60
0.00
0.34
0.15
0.34
*0.
53?
0.09
0.04
0.01
0.00
0.15
*0.
15?
-0.2
5-0
.23
H19
0D
-0.5
90.
000.
620.
380.
080.
140.
150.
62*
0.01
0.00
-0.2
0-0
.13
-0.1
50.
38*
H19
1C
-0.6
00.
000.
630.
430.
070.
260.
63*
0.04
0.01
0.00
-0.2
6-0
.16
0.43
*-0
.24
H19
2C
0.67
0.00
0.33
0.34
0.31
0.24
0.33
*0.
120.
010.
00-0
.07
-0.1
40.
34*
-0.1
2H
193
D-2
.08
0.00
0.87
0.55
0.03
0.04
0.05
0.87
*0.
010.
00-0
.28
-0.2
6-0
.27
0.55
*H
194
C-1
.15
0.00
0.74
0.48
0.13
0.06
0.74
*0.
070.
010.
00-0
.18
-0.3
20.
48*
-0.2
1H
195
C-1
.58
0.00
0.81
0.52
0.03
0.07
0.81
*0.
080.
010.
00-0
.28
-0.2
70.
52*
-0.2
1H
196
A0.
890.
000.
280.
290.
28*
0.04
0.33
0.34
0.01
0.00
0.29
*-0
.24
-0.0
4-0
.08
H19
7A
-1.0
10.
000.
710.
410.
71*
0.11
0.14
0.02
0.01
0.00
0.41
*-0
.20
-0.1
6-0
.21
H19
8B
-0.7
70.
000.
660.
400.
100.
66*
0.05
0.17
0.01
0.00
-0.2
80.
40*
-0.2
9-0
.03
H19
9D
-1.8
70.
000.
850.
630.
030.
060.
050.
85*
0.01
0.00
-0.2
7-0
.34
-0.3
10.
63*
H20
0A
1.41
0.00
0.19
0.09
0.19
*0.
430.
150.
220.
010.
000.
09*
0.12
?-0
.10
-0.0
6H
201
B-1
.32
0.00
0.77
0.52
0.05
0.77
*0.
120.
050.
010.
00-0
.29
0.52
*-0
.24
-0.2
3H
202
C-1
.22
0.00
0.75
0.44
0.13
0.07
0.75
*0.
040.
010.
00-0
.11
-0.3
10.
44*
-0.2
4H
203
C-1
.03
0.00
0.72
0.52
0.21
0.05
0.72
*0.
020.
010.
00-0
.28
-0.2
80.
52*
-0.2
4H
204
B-0
.69
0.00
0.65
0.41
0.13
0.65
*0.
030.
190.
010.
00-0
.23
0.41
*-0
.27
-0.1
1H
205
B0.
280.
000.
420.
310.
300.
42*
0.17
0.10
0.01
0.00
-0.0
80.
31*
-0.1
1-0
.15
H20
6B
0.26
0.00
0.42
0.34
0.17
0.42
*0.
310.
090.
010.
00-0
.10
0.34
*-0
.11
-0.1
7H
207
A0.
270.
000.
420.
290.
42*
0.23
0.10
0.24
0.01
0.00
0.29
*-0
.14
-0.2
10.
02?
H20
8B
-0.1
90.
000.
530.
400.
300.
53*
0.07
0.09
0.01
0.00
-0.1
00.
40*
-0.2
9-0
.17
H20
9C
-2.5
50.
000.
920.
550.
030.
030.
92*
0.02
0.01
0.00
-0.2
8-0
.29
0.55
*-0
.21
H21
0C
-0.6
90.
000.
650.
520.
160.
120.
65*
0.07
0.01
0.00
-0.2
2-0
.24
0.52
*-0
.23
H21
1A
-1.0
00.
000.
710.
440.
71*
0.04
0.17
0.07
0.01
0.00
0.44
*-0
.30
-0.1
6-0
.18
H21
2B
0.49
0.00
0.37
0.29
0.41
0.37
*0.
120.
090.
010.
00-0
.08
0.29
*-0
.16
-0.0
7H
213
A-1
.25
0.00
0.76
0.48
0.76
*0.
120.
080.
040.
010.
000.
48*
-0.1
9-0
.27
-0.2
3H
214
A-1
.57
0.00
0.81
0.47
0.81
*0.
080.
040.
060.
010.
000.
47*
-0.1
9-0
.28
-0.2
0
I 8
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)I
179
C-1
.48
0.00
0.79
0.50
0.04
0.10
0.79
*0.
060.
010.
00-0
.23
-0.2
90.
50*
-0.2
0I
180
C-1
.77
0.00
0.84
0.54
0.05
0.06
0.84
*0.
050.
010.
00-0
.24
-0.2
80.
54*
-0.2
7I
181
D-0
.69
0.00
0.64
0.39
0.04
0.28
0.03
0.64
*0.
010.
00-0
.29
-0.1
4-0
.27
0.39
*I
182
B-1
.51
0.00
0.80
0.44
0.03
0.80
*0.
150.
020.
010.
00-0
.22
0.44
*-0
.26
-0.2
1I
183
A-1
.38
0.00
0.78
0.54
0.78
*0.
050.
110.
060.
010.
000.
54*
-0.3
1-0
.25
-0.2
4I
184
D-0
.11
0.00
0.51
0.39
0.28
0.18
0.03
0.51
*0.
010.
00-0
.18
-0.1
3-0
.24
0.39
*I
185
A-0
.86
0.00
0.68
0.39
0.68
*0.
040.
040.
240.
010.
000.
39*
-0.3
0-0
.30
-0.1
1I
186
C-1
.26
0.00
0.76
0.59
0.06
0.07
0.76
*0.
110.
010.
00-0
.29
-0.3
00.
59*
-0.2
9I
187
A0.
720.
000.
310.
140.
31*
0.52
?0.
120.
040.
010.
000.
14*
0.17
?-0
.27
-0.2
2I
188
D-0
.43
0.00
0.58
0.33
0.28
0.06
0.07
0.58
*0.
010.
00-0
.01
-0.2
8-0
.27
0.33
*I
189
B0.
250.
000.
420.
390.
120.
42*
0.29
0.16
0.01
0.00
-0.1
10.
39*
-0.2
1-0
.11
I19
0D
0.51
0.00
0.36
0.27
0.31
0.11
0.22
0.36
*0.
010.
00-0
.02
-0.2
1-0
.09
0.27
*I
191
D-1
.95
0.00
0.86
0.55
0.03
0.05
0.06
0.86
*0.
010.
00-0
.28
-0.2
8-0
.26
0.55
*I
192
A-1
.98
0.00
0.86
0.56
0.86
*0.
050.
040.
040.
010.
000.
56*
-0.3
2-0
.30
-0.2
2I
193
A0.
820.
000.
290.
260.
29*
0.18
0.21
0.31
0.01
0.00
0.26
*-0
.20
-0.0
2-0
.01
I19
4B
-1.1
70.
000.
740.
390.
180.
74*
0.05
0.02
0.01
0.00
-0.1
20.
39*
-0.3
0-0
.26
I19
5B
0.98
0.00
0.26
0.14
0.44
0.26
*0.
150.
150.
010.
000.
14?
0.14
*-0
.25
-0.0
6I
196
A-0
.62
0.00
0.63
0.40
0.63
*0.
150.
140.
080.
010.
000.
40*
-0.2
3-0
.11
-0.2
1I
197
B0.
420.
000.
380.
230.
360.
38*
0.19
0.06
0.01
0.00
0.04
?0.
23*
-0.1
5-0
.18
I19
8D
-1.2
70.
000.
760.
500.
070.
070.
090.
76*
0.01
0.00
-0.2
2-0
.30
-0.2
10.
50*
I19
9B
-1.3
50.
000.
770.
570.
080.
77*
0.08
0.06
0.01
0.00
-0.3
00.
57*
-0.2
8-0
.23
I20
0A
-1.4
70.
000.
790.
570.
79*
0.11
0.05
0.04
0.01
0.00
0.57
*-0
.35
-0.2
7-0
.19
I20
1A
-1.7
90.
000.
840.
640.
84*
0.07
0.04
0.05
0.01
0.00
0.64
*-0
.36
-0.3
1-0
.30
I20
2B
-0.5
90.
000.
620.
380.
140.
62*
0.03
0.21
0.01
0.00
-0.2
50.
38*
-0.3
0-0
.05
I20
3C
-1.1
20.
000.
730.
460.
080.
110.
73*
0.08
0.01
0.00
-0.1
8-0
.30
0.46
*-0
.15
I20
4D
-1.9
30.
000.
860.
640.
040.
050.
040.
86*
0.01
0.00
-0.2
9-0
.34
-0.3
30.
64*
I20
5A
0.44
0.00
0.38
0.33
0.38
*0.
220.
150.
250.
010.
000.
33*
-0.0
7-0
.21
-0.0
8I
206
A-1
.67
0.00
0.82
0.52
0.82
*0.
080.
040.
050.
010.
000.
52*
-0.2
4-0
.29
-0.2
3I
207
B-0
.41
0.00
0.58
0.44
0.16
0.58
*0.
150.
100.
010.
00-0
.27
0.44
*-0
.11
-0.1
9I
208
C-1
.93
0.00
0.86
0.55
0.06
0.05
0.86
*0.
030.
010.
00-0
.25
-0.3
40.
55*
-0.2
2I
209
A-1
.50
0.00
0.80
0.56
0.80
*0.
090.
060.
050.
010.
000.
56*
-0.2
8-0
.29
-0.2
5I
210
A-0
.92
0.00
0.69
0.56
0.69
*0.
090.
120.
100.
010.
000.
56*
-0.3
1-0
.28
-0.1
9I
211
A-1
.42
0.00
0.78
0.48
0.78
*0.
070.
090.
050.
010.
000.
48*
-0.2
3-0
.23
-0.2
3I
212
D-1
.30
0.00
0.76
0.48
0.08
0.05
0.10
0.76
*0.
010.
00-0
.26
-0.2
7-0
.17
0.48
*I
213
B0.
800.
000.
290.
210.
51?
0.29
*0.
130.
060.
010.
00-0
.01
0.21
*-0
.12
-0.1
0I
214
B0.
450.
000.
370.
290.
040.
37*
0.38
0.20
0.01
0.00
-0.2
90.
29*
-0.0
3-0
.12
I 9
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)J
179
B0.
540.
000.
350.
240.
190.
35*
0.43
0.02
0.01
0.00
-0.1
40.
24*
-0.0
1-0
.17
J18
0D
-0.2
10.
000.
530.
440.
130.
250.
080.
53*
0.01
0.00
-0.1
7-0
.16
-0.2
40.
44*
J18
1B
-1.3
60.
000.
780.
580.
050.
78*
0.08
0.09
0.01
0.00
-0.2
60.
58*
-0.3
1-0
.27
J18
2B
-1.5
30.
000.
800.
560.
050.
80*
0.09
0.05
0.01
0.00
-0.2
80.
56*
-0.2
6-0
.28
J18
3A
-0.7
60.
000.
660.
510.
66*
0.20
0.09
0.05
0.01
0.00
0.51
*-0
.27
-0.2
6-0
.16
J18
4C
-0.5
90.
000.
620.
420.
040.
070.
62*
0.26
0.01
0.00
-0.2
4-0
.24
0.42
*-0
.16
J18
5B
0.44
0.00
0.37
0.35
0.38
0.37
*0.
020.
220.
010.
00-0
.06
0.35
*-0
.23
-0.1
9J
186
B-0
.78
0.00
0.66
0.45
0.06
0.66
*0.
200.
070.
010.
00-0
.18
0.45
*-0
.15
-0.3
2J
187
B-2
.85
0.00
0.94
0.46
0.02
0.94
*0.
020.
010.
010.
00-0
.21
0.46
*-0
.24
-0.1
9J
188
C-0
.24
0.00
0.53
0.36
0.09
0.23
0.53
*0.
140.
010.
00-0
.17
-0.1
40.
36*
-0.1
2J
189
A-0
.84
0.00
0.67
0.47
0.67
*0.
150.
130.
040.
010.
000.
47*
-0.2
4-0
.17
-0.2
6J
190
B-0
.23
0.00
0.53
0.21
0.06
0.53
*0.
100.
290.
010.
00-0
.25
0.21
*-0
.25
0.13
?J
191
C0.
760.
000.
300.
330.
250.
300.
30*
0.14
0.01
0.00
-0.0
9-0
.13
0.33
*-0
.08
J19
2C
-0.7
80.
000.
660.
450.
060.
240.
66*
0.03
0.01
0.00
-0.2
7-0
.20
0.45
*-0
.22
J19
3A
-2.0
50.
000.
870.
520.
87*
0.04
0.04
0.04
0.01
0.00
0.52
*-0
.28
-0.2
9-0
.18
J19
4B
-0.4
70.
000.
590.
320.
040.
59*
0.06
0.30
0.01
0.00
-0.2
00.
32*
-0.2
8-0
.05
J19
5D
-2.0
20.
000.
870.
500.
050.
040.
040.
87*
0.01
0.00
-0.2
4-0
.22
-0.2
60.
50*
J19
6B
0.16
0.00
0.44
0.37
0.17
0.44
*0.
290.
100.
010.
00-0
.14
0.37
*-0
.23
-0.0
1J
197
C-1
.35
0.00
0.77
0.47
0.05
0.12
0.77
*0.
050.
010.
00-0
.27
-0.2
30.
47*
-0.1
8J
198
D-0
.24
0.00
0.54
0.53
0.14
0.14
0.17
0.54
*0.
010.
00-0
.23
-0.2
1-0
.22
0.53
*J
199
B0.
590.
000.
340.
230.
110.
34*
0.43
0.12
0.01
0.00
-0.1
20.
23*
-0.0
3-0
.10
J20
0C
0.14
0.00
0.44
0.32
0.43
0.06
0.44
*0.
060.
010.
00-0
.05
-0.2
50.
32*
-0.1
9J
201
B0.
350.
000.
390.
310.
390.
39*
0.09
0.12
0.01
0.00
0.00
?0.
31*
-0.2
5-0
.17
J20
2B
-0.9
60.
000.
700.
560.
130.
70*
0.11
0.05
0.01
0.00
-0.2
50.
56*
-0.3
0-0
.23
J20
3C
-1.1
50.
000.
740.
570.
080.
140.
74*
0.04
0.01
0.00
-0.2
7-0
.29
0.57
*-0
.25
J20
4B
-1.0
20.
000.
710.
570.
160.
71*
0.06
0.06
0.01
0.00
-0.2
60.
57*
-0.3
0-0
.27
J20
5B
-1.5
90.
000.
810.
510.
030.
81*
0.08
0.06
0.01
0.00
-0.2
60.
51*
-0.2
6-0
.23
J20
6D
-1.5
80.
000.
810.
580.
050.
050.
090.
81*
0.01
0.00
-0.2
9-0
.29
-0.2
80.
58*
J20
7C
-1.8
40.
000.
850.
560.
050.
050.
85*
0.05
0.01
0.00
-0.3
0-0
.31
0.56
*-0
.21
J20
8D
-0.2
40.
000.
540.
420.
050.
270.
140.
54*
0.01
0.00
-0.1
9-0
.20
-0.1
60.
42*
J20
9D
-2.1
50.
000.
880.
520.
050.
030.
030.
88*
0.01
0.00
-0.2
4-0
.29
-0.2
40.
52*
J21
0B
-0.9
90.
000.
710.
400.
090.
71*
0.13
0.07
0.01
0.00
-0.2
40.
40*
-0.1
5-0
.16
J21
1D
-0.4
10.
000.
580.
380.
200.
170.
040.
58*
0.01
0.00
-0.1
3-0
.16
-0.2
50.
38*
J21
2A
-0.1
00.
000.
500.
360.
50*
0.08
0.25
0.16
0.01
0.00
0.36
*-0
.20
-0.1
0-0
.14
J21
3A
-0.8
30.
000.
670.
450.
67*
0.04
0.22
0.07
0.01
0.00
0.45
*-0
.28
-0.2
1-0
.17
J21
4B
-0.0
70.
000.
490.
350.
140.
49*
0.25
0.10
0.01
0.00
-0.1
80.
35*
-0.0
5-0
.21
I 10
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)W
74A
-0.1
40.
000.
550.
120.
55*
0.24
0.15
0.05
0.00
0.00
0.12
*0.
05?
-0.1
0-0
.22
W75
D-0
.89
0.00
0.68
0.47
0.15
0.09
0.08
0.68
*0.
000.
00-0
.25
-0.2
5-0
.22
0.47
*W
76C
0.26
0.00
0.47
0.32
0.36
0.12
0.47
*0.
050.
000.
00-0
.13
-0.1
50.
32*
-0.2
1W
77B
-0.3
50.
000.
590.
420.
160.
59*
0.14
0.11
0.00
0.00
-0.1
40.
42*
-0.2
7-0
.20
W78
A-2
.27
0.00
0.86
0.48
0.86
*0.
040.
050.
050.
000.
000.
48*
-0.2
8-0
.28
-0.2
3W
79A
-0.3
40.
000.
590.
370.
59*
0.07
0.22
0.12
0.00
0.00
0.37
*-0
.23
-0.1
5-0
.17
W80
B-1
.48
0.00
0.77
0.43
0.03
0.77
*0.
080.
130.
000.
00-0
.28
0.43
*-0
.24
-0.2
2W
81D
-0.9
00.
000.
680.
480.
110.
050.
150.
68*
0.00
0.00
-0.3
2-0
.24
-0.1
80.
48*
W82
B-0
.44
0.00
0.60
0.39
0.30
0.60
*0.
060.
040.
000.
00-0
.20
0.39
*-0
.26
-0.2
2W
83A
-2.6
00.
000.
890.
420.
89*
0.06
0.04
0.02
0.00
0.00
0.42
*-0
.23
-0.2
6-0
.22
W84
D0.
530.
000.
420.
280.
130.
110.
330.
42*
0.01
0.00
-0.0
6-0
.20
-0.1
10.
28*
W85
C-1
.54
0.00
0.78
0.47
0.09
0.06
0.78
*0.
080.
000.
00-0
.20
-0.2
60.
47*
-0.2
9W
86C
-1.0
00.
000.
700.
360.
050.
030.
70*
0.22
0.00
0.00
-0.2
7-0
.24
0.36
*-0
.15
W87
B-1
.22
0.00
0.73
0.41
0.13
0.73
*0.
090.
050.
000.
00-0
.20
0.41
*-0
.23
-0.2
3W
88B
-1.0
90.
000.
710.
510.
070.
71*
0.15
0.06
0.00
0.00
-0.3
10.
51*
-0.2
8-0
.19
W89
D-1
.78
0.00
0.81
0.46
0.05
0.05
0.09
0.81
*0.
000.
00-0
.26
-0.2
8-0
.20
0.46
*W
90C
-1.3
10.
000.
750.
480.
030.
110.
75*
0.11
0.00
0.00
-0.2
4-0
.30
0.48
*-0
.22
W91
A-1
.79
0.00
0.81
0.53
0.81
*0.
120.
040.
040.
000.
000.
53*
-0.3
3-0
.29
-0.2
5W
92A
-1.1
90.
000.
730.
260.
73*
0.24
0.02
0.01
0.00
0.00
0.26
*-0
.15
-0.2
3-0
.18
W93
B-0
.58
0.00
0.63
0.34
0.13
0.63
*0.
200.
040.
000.
00-0
.20
0.34
*-0
.10
-0.2
7W
94C
-0.4
70.
000.
610.
360.
290.
020.
61*
0.08
0.00
0.00
-0.2
2-0
.25
0.36
*-0
.15
W95
A-0
.77
0.00
0.66
0.34
0.66
*0.
050.
200.
080.
000.
000.
34*
-0.2
6-0
.10
-0.2
3W
96C
-2.0
50.
000.
840.
360.
090.
030.
84*
0.04
0.00
0.00
-0.1
9-0
.26
0.36
*-0
.17
W97
D0.
010.
000.
520.
390.
160.
180.
140.
52*
0.00
0.00
-0.0
9-0
.26
-0.1
70.
39*
W98
C0.
590.
000.
410.
130.
54?
0.03
0.41
*0.
020.
000.
000.
03?
-0.2
60.
13*
-0.2
1W
99B
-0.6
40.
000.
640.
330.
130.
64*
0.17
0.05
0.00
0.00
-0.2
00.
33*
-0.1
2-0
.20
W10
0D
0.94
0.00
0.35
0.20
0.21
0.24
0.20
0.35
*0.
000.
00-0
.28
-0.0
30.
08?
0.20
*W
101
B-0
.38
0.00
0.59
0.32
0.10
0.59
*0.
060.
250.
000.
00-0
.20
0.32
*-0
.21
-0.1
0W
102
A-1
.49
0.00
0.77
0.30
0.77
*0.
080.
030.
110.
000.
000.
30*
-0.2
6-0
.25
-0.0
2W
103
A-2
.19
0.00
0.85
0.47
0.85
*0.
090.
030.
020.
000.
000.
47*
-0.3
0-0
.26
-0.2
2W
104
B-0
.13
0.00
0.55
0.34
0.26
0.55
*0.
100.
100.
000.
00-0
.08
0.34
*-0
.26
-0.1
7W
105
D-0
.37
0.00
0.59
0.37
0.09
0.26
0.06
0.59
*0.
000.
00-0
.22
-0.1
3-0
.26
0.37
*W
106
A0.
650.
000.
400.
210.
40*
0.07
0.06
0.47
0.00
0.00
0.21
*-0
.24
-0.2
90.
06?
W10
7B
-1.3
90.
000.
760.
290.
170.
76*
0.04
0.04
0.00
0.00
-0.0
90.
29*
-0.2
7-0
.20
W10
8B
-1.4
00.
000.
760.
440.
040.
76*
0.13
0.08
0.00
0.00
-0.2
70.
44*
-0.2
6-0
.17
W10
9C
-0.4
80.
000.
610.
470.
070.
060.
61*
0.25
0.01
0.00
-0.2
4-0
.25
0.47
*-0
.23
I 11
Ap
pen
dix
I: 2
001
PS
SA
Gra
de
Eig
ht
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
(RB
)R
(C)
R(D
)W
111
A-0
.62
0.00
0.64
0.31
0.64
*0.
040.
090.
220.
000.
000.
31*
-0.2
6-0
.21
-0.0
8W
112
D-0
.79
0.00
0.66
0.46
0.14
0.12
0.08
0.66
*0.
000.
00-0
.26
-0.2
3-0
.20
0.46
*W
113
D0.
210.
000.
480.
230.
270.
080.
170.
48*
0.00
0.00
0.14
?-0
.14
-0.3
60.
23*
W11
4C
-2.3
10.
000.
860.
510.
010.
090.
86*
0.04
0.00
0.00
-0.1
9-0
.41
0.51
*-0
.21
W11
5A
-1.7
80.
000.
810.
400.
81*
0.07
0.02
0.10
0.00
0.00
0.40
*-0
.16
-0.2
1-0
.29
W11
6C
-1.2
80.
000.
740.
310.
060.
090.
74*
0.10
0.00
0.00
-0.2
4-0
.11
0.31
*-0
.15
W11
7B
-2.5
10.
000.
880.
370.
020.
88*
0.03
0.07
0.00
0.00
-0.2
40.
37*
-0.2
0-0
.20
W11
8A
0.53
0.00
0.42
0.28
0.42
*0.
070.
120.
390.
000.
000.
28*
-0.2
6-0
.23
0.00
W11
9D
-0.9
20.
000.
690.
560.
160.
080.
080.
69*
0.00
0.00
-0.3
2-0
.34
-0.1
90.
56*
W12
0C
-1.3
90.
000.
760.
460.
110.
050.
76*
0.08
0.00
0.00
-0.3
1-0
.24
0.46
*-0
.17
W12
1B
-1.0
30.
000.
700.
380.
200.
70*
0.03
0.07
0.00
0.00
-0.2
30.
38*
-0.2
6-0
.15
W12
2B
0.30
0.00
0.47
0.39
0.20
0.47
*0.
170.
170.
000.
00-0
.10
0.39
*-0
.06
-0.3
5W
123
C0.
780.
000.
380.
270.
400.
090.
38*
0.14
0.00
0.00
-0.1
1-0
.20
0.27
*-0
.07
W12
4C
-1.9
60.
000.
830.
510.
070.
040.
83*
0.06
0.00
0.00
-0.3
4-0
.23
0.51
*-0
.24
W12
5D
0.47
0.00
0.44
0.21
0.18
0.35
0.04
0.44
*0.
000.
00-0
.20
0.06
?-0
.29
0.21
*W
126
A0.
600.
000.
410.
060.
41*
0.25
0.08
0.26
0.00
0.00
0.06
*0.
10?
-0.2
1-0
.03
W12
7B
-1.4
00.
000.
760.
310.
160.
76*
0.05
0.04
0.00
0.00
-0.1
60.
31*
-0.2
3-0
.13
W12
8C
-1.1
20.
000.
720.
470.
090.
060.
72*
0.13
0.00
0.00
-0.2
8-0
.26
0.47
*-0
.21
W12
9B
-0.1
40.
000.
550.
400.
050.
55*
0.05
0.35
0.00
0.00
-0.2
90.
40*
-0.2
8-0
.14
W13
0A
-1.0
80.
000.
710.
350.
71*
0.13
0.11
0.04
0.00
0.00
0.35
*-0
.11
-0.2
3-0
.21
W13
1C
-0.8
30.
000.
670.
430.
170.
110.
67*
0.05
0.00
0.00
-0.1
4-0
.28
0.43
*-0
.27
W13
2C
-0.3
40.
000.
590.
360.
260.
050.
59*
0.11
0.00
0.00
-0.2
5-0
.24
0.36
*-0
.05
W13
3A
-1.2
20.
000.
730.
550.
73*
0.15
0.07
0.04
0.00
0.00
0.55
*-0
.30
-0.3
2-0
.25
W13
4C
-0.1
80.
000.
560.
420.
050.
280.
56*
0.11
0.00
0.00
-0.2
7-0
.21
0.42
*-0
.16
W13
5B
-0.0
70.
000.
540.
320.
150.
54*
0.17
0.13
0.00
0.00
-0.1
40.
32*
-0.1
9-0
.10
W13
6A
-2.0
70.
000.
840.
560.
84*
0.05
0.07
0.04
0.00
0.00
0.56
*-0
.32
-0.3
4-0
.25
W13
7D
0.61
0.00
0.41
0.30
0.09
0.35
0.15
0.41
*0.
010.
00-0
.11
-0.0
8-0
.22
0.30
*W
138
C-0
.36
0.00
0.59
0.43
0.09
0.15
0.59
*0.
170.
000.
00-0
.25
-0.2
20.
43*
-0.1
5W
139
D0.
790.
000.
380.
230.
250.
320.
060.
38*
0.00
0.00
-0.1
80.
07?
-0.2
50.
23*
W14
0A
-0.0
30.
000.
530.
260.
53*
0.09
0.19
0.19
0.00
0.00
0.26
*-0
.27
-0.1
40.
02?
W14
1D
-0.9
60.
000.
690.
450.
090.
110.
110.
69*
0.00
0.00
-0.2
1-0
.20
-0.2
60.
45*
W14
2A
1.18
0.00
0.31
0.11
0.31
*0.
410.
110.
180.
000.
000.
11*
0.11
?-0
.21
-0.0
9W
143
D0.
620.
000.
410.
140.
270.
140.
180.
41*
0.00
0.00
-0.1
3-0
.15
0.12
?0.
14*
W14
4D
-0.6
10.
000.
630.
550.
210.
080.
070.
63*
0.00
0.00
-0.2
6-0
.31
-0.2
60.
55*
W14
5B
-0.1
10.
000.
540.
310.
230.
54*
0.16
0.06
0.00
0.00
0.02
?0.
31*
-0.2
8-0
.24
W14
6B
-1.0
20.
000.
700.
410.
100.
70*
0.07
0.13
0.00
0.00
-0.2
60.
41*
-0.2
4-0
.13
I 12
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)A
189
A0.
680.
000.
310.
110.
31*
0.47
0.04
0.18
0.01
0.00
0.11
*0.
16?
-0.2
3-0
.13
A19
0C
0.34
0.00
0.39
0.15
0.03
0.09
0.39
*0.
480.
010.
00-0
.23
-0.2
50.
15*
0.16
?A
191
C-0
.31
0.00
0.56
0.51
0.16
0.20
0.56
*0.
070.
010.
00-0
.25
-0.2
40.
51*
-0.0
9A
192
C-0
.59
0.00
0.63
0.50
0.10
0.10
0.63
*0.
170.
010.
00-0
.22
-0.2
60.
50*
-0.1
7A
193
B-0
.11
0.00
0.50
0.31
0.09
0.50
*0.
200.
200.
010.
00-0
.27
0.31
*-0
.16
0.06
?A
194
A0.
020.
000.
470.
400.
47*
0.26
0.16
0.10
0.01
0.00
0.40
*-0
.06
-0.1
9-0
.22
A19
5B
-0.4
70.
000.
600.
460.
190.
60*
0.11
0.09
0.01
0.00
-0.1
40.
46*
-0.2
8-0
.14
A19
6B
-0.8
80.
000.
690.
540.
090.
69*
0.13
0.08
0.01
0.00
-0.2
70.
54*
-0.2
3-0
.21
A19
7B
0.04
0.00
0.47
0.30
0.15
0.47
*0.
090.
280.
010.
00-0
.08
0.30
*-0
.22
-0.0
4A
198
B-1
.52
0.00
0.81
0.61
0.06
0.81
*0.
070.
050.
010.
00-0
.27
0.61
*-0
.31
-0.2
7A
199
D0.
600.
000.
320.
280.
340.
230.
090.
32*
0.01
0.00
0.02
?-0
.08
-0.2
20.
28*
A20
0B
-1.6
20.
000.
830.
610.
050.
83*
0.06
0.05
0.01
0.00
-0.2
90.
61*
-0.2
9-0
.27
A20
1A
-1.6
30.
000.
830.
600.
83*
0.05
0.07
0.04
0.01
0.00
0.60
*-0
.32
-0.2
7-0
.23
A20
2D
-1.3
50.
000.
780.
560.
050.
060.
100.
78*
0.01
0.00
-0.2
5-0
.31
-0.2
10.
56*
A20
3B
-0.8
90.
000.
690.
540.
090.
69*
0.13
0.07
0.01
0.00
-0.2
20.
54*
-0.2
5-0
.24
A20
4A
-0.4
80.
000.
600.
440.
60*
0.15
0.11
0.13
0.01
0.00
0.44
*-0
.21
-0.2
1-0
.11
A20
5A
0.55
0.00
0.34
0.18
0.34
*0.
440.
080.
130.
010.
000.
18*
0.07
?-0
.21
-0.0
7A
206
A-1
.52
0.00
0.81
0.52
0.81
*0.
070.
070.
040.
010.
000.
52*
-0.2
6-0
.22
-0.2
2A
207
B-0
.80
0.00
0.67
0.29
0.12
0.67
*0.
080.
120.
010.
00-0
.07
0.29
*-0
.30
0.02
?A
208
C0.
650.
000.
310.
240.
420.
060.
31*
0.19
0.01
0.00
0.10
?-0
.29
0.24
*-0
.13
A20
9B
-1.1
00.
000.
740.
530.
070.
74*
0.14
0.04
0.02
0.00
-0.2
40.
53*
-0.2
6-0
.20
A21
0B
-1.7
00.
000.
840.
570.
090.
84*
0.03
0.03
0.02
0.00
-0.2
50.
57*
-0.2
8-0
.27
A21
1A
1.15
0.00
0.21
0.11
0.21
*0.
320.
380.
080.
020.
000.
11*
0.01
?0.
09?
-0.1
9A
212
A-0
.70
0.00
0.65
0.43
0.65
*0.
170.
060.
120.
020.
000.
43*
-0.2
1-0
.26
-0.0
7A
213
B-0
.08
0.00
0.50
0.29
0.16
0.50
*0.
100.
230.
020.
00-0
.14
0.29
*-0
.24
0.06
?A
214
D-1
.76
0.00
0.85
0.63
0.05
0.04
0.06
0.85
*0.
010.
00-0
.28
-0.3
1-0
.29
0.63
*A
215
D-1
.39
0.00
0.79
0.63
0.08
0.07
0.05
0.79
*0.
010.
00-0
.29
-0.3
0-0
.28
0.63
*A
216
A-1
.89
0.00
0.86
0.62
0.86
*0.
040.
050.
030.
020.
000.
62*
-0.2
9-0
.31
-0.2
5A
217
A-0
.73
0.00
0.66
0.52
0.66
*0.
070.
140.
130.
020.
000.
52*
-0.3
0-0
.21
-0.1
7A
218
D-0
.42
0.00
0.58
0.53
0.17
0.07
0.16
0.58
*0.
020.
00-0
.16
-0.3
1-0
.23
0.53
*A
219
C-0
.55
0.00
0.62
0.48
0.13
0.09
0.62
*0.
160.
020.
00-0
.22
-0.2
80.
48*
-0.1
0A
220
A-0
.68
0.00
0.65
0.51
0.65
*0.
130.
080.
130.
020.
000.
51*
-0.1
9-0
.22
-0.2
3A
221
B-1
.54
0.00
0.81
0.62
0.09
0.81
*0.
050.
040.
020.
00-0
.34
0.62
*-0
.29
-0.2
2A
222
B-1
.60
0.00
0.82
0.55
0.07
0.82
*0.
070.
030.
020.
00-0
.21
0.55
*-0
.31
-0.2
4A
223
D-1
.08
0.00
0.73
0.66
0.11
0.06
0.09
0.73
*0.
020.
00-0
.31
-0.3
0-0
.29
0.66
*A
224
D-0
.13
0.00
0.51
0.54
0.18
0.09
0.21
0.51
*0.
020.
00-0
.18
-0.2
7-0
.19
0.54
*A
225
B0.
390.
000.
380.
340.
140.
38*
0.17
0.30
0.02
0.00
-0.1
50.
34*
-0.1
4-0
.04
A22
6A
0.06
0.00
0.46
0.31
0.46
*0.
250.
170.
110.
020.
000.
31*
-0.1
2-0
.11
-0.0
6A
227
B-1
.02
0.00
0.72
0.49
0.12
0.72
*0.
050.
100.
020.
00-0
.23
0.49
*-0
.31
-0.1
2A
228
A-1
.76
0.00
0.85
0.61
0.85
*0.
050.
050.
040.
020.
000.
61*
-0.2
9-0
.30
-0.2
6
J 1
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)B
189
B-1
.04
0.00
0.70
0.45
0.11
0.70
*0.
150.
030.
010.
00-0
.23
0.45
*-0
.18
-0.1
9B
190
A-1
.59
0.00
0.81
0.47
0.81
*0.
100.
040.
040.
010.
000.
47*
-0.1
4-0
.31
-0.2
2B
191
A-1
.69
0.00
0.82
0.46
0.82
*0.
070.
040.
060.
010.
000.
46*
-0.2
5-0
.25
-0.1
2B
192
C-0
.55
0.00
0.59
0.19
0.05
0.06
0.59
*0.
290.
010.
00-0
.18
-0.2
60.
19*
0.11
?B
193
B-1
.26
0.00
0.75
0.54
0.07
0.75
*0.
130.
050.
010.
00-0
.26
0.54
*-0
.23
-0.2
6B
194
A-2
.15
0.00
0.88
0.60
0.88
*0.
040.
040.
020.
010.
000.
60*
-0.3
1-0
.27
-0.2
6B
195
A-1
.45
0.00
0.78
0.63
0.78
*0.
080.
090.
040.
010.
000.
63*
-0.3
1-0
.33
-0.2
2B
196
A-1
.07
0.00
0.71
0.56
0.71
*0.
120.
100.
060.
010.
000.
56*
-0.2
3-0
.28
-0.2
4B
197
C-0
.88
0.00
0.67
0.49
0.08
0.16
0.67
*0.
080.
010.
00-0
.18
-0.2
30.
49*
-0.2
1B
198
D0.
070.
000.
420.
320.
090.
340.
140.
42*
0.01
0.00
-0.0
9-0
.07
-0.1
70.
32*
B19
9C
-0.8
30.
000.
650.
520.
100.
150.
65*
0.08
0.01
0.00
-0.2
0-0
.23
0.52
*-0
.24
B20
0A
-0.9
90.
000.
690.
470.
69*
0.12
0.09
0.09
0.01
0.00
0.47
*-0
.20
-0.2
2-0
.18
B20
1C
-1.6
50.
000.
820.
630.
070.
090.
82*
0.02
0.01
0.00
-0.3
4-0
.31
0.63
*-0
.23
B20
2B
0.31
0.00
0.36
0.14
0.27
0.36
*0.
210.
150.
010.
00-0
.03
0.14
*-0
.11
0.09
?B
203
C-1
.09
0.00
0.71
0.44
0.08
0.08
0.71
*0.
120.
010.
00-0
.24
-0.2
40.
44*
-0.1
0B
204
B-1
.07
0.00
0.71
0.44
0.19
0.71
*0.
060.
030.
010.
00-0
.16
0.44
*-0
.22
-0.2
8B
205
C-1
.35
0.00
0.76
0.50
0.04
0.08
0.76
*0.
100.
010.
00-0
.31
-0.2
60.
50*
-0.1
3B
206
A-0
.47
0.00
0.57
0.50
0.57
*0.
260.
090.
070.
010.
000.
50*
-0.1
8-0
.29
-0.1
8B
207
B-1
.51
0.00
0.79
0.59
0.06
0.79
*0.
070.
060.
010.
00-0
.30
0.59
*-0
.29
-0.2
1B
208
A-1
.25
0.00
0.74
0.58
0.74
*0.
090.
090.
060.
010.
000.
58*
-0.2
7-0
.27
-0.2
5B
209
B-0
.65
0.00
0.61
0.36
0.05
0.61
*0.
080.
250.
010.
00-0
.26
0.36
*-0
.24
-0.0
4B
210
C-2
.03
0.00
0.87
0.63
0.04
0.05
0.87
*0.
030.
010.
00-0
.29
-0.3
20.
63*
-0.2
8B
211
D-1
.50
0.00
0.79
0.64
0.09
0.06
0.05
0.79
*0.
010.
00-0
.31
-0.3
2-0
.25
0.64
*B
212
C-1
.52
0.00
0.79
0.54
0.05
0.10
0.79
*0.
040.
010.
00-0
.25
-0.2
30.
54*
-0.2
6B
213
B-1
.45
0.00
0.78
0.49
0.05
0.78
*0.
080.
080.
010.
00-0
.30
0.49
*-0
.19
-0.1
6B
214
C0.
370.
000.
340.
170.
050.
050.
34*
0.55
?0.
010.
00-0
.31
-0.3
20.
17*
0.19
?B
215
A-1
.03
0.00
0.70
0.52
0.70
*0.
100.
090.
100.
010.
000.
52*
-0.2
6-0
.24
-0.1
6B
216
B-1
.21
0.00
0.74
0.51
0.08
0.74
*0.
080.
090.
010.
00-0
.28
0.51
*-0
.25
-0.1
4B
217
C-2
.01
0.00
0.87
0.66
0.04
0.05
0.87
*0.
040.
010.
00-0
.34
-0.3
20.
66*
-0.2
8B
218
A-0
.30
0.00
0.52
0.38
0.52
*0.
070.
070.
320.
010.
000.
38*
-0.2
9-0
.28
0.00
B21
9D
-0.8
20.
000.
650.
560.
130.
110.
100.
65*
0.01
0.00
-0.2
3-0
.20
-0.2
90.
56*
B22
0B
-0.3
80.
000.
540.
450.
200.
54*
0.16
0.08
0.02
0.00
-0.1
00.
45*
-0.2
4-0
.19
B22
1A
-0.2
70.
000.
510.
240.
51*
0.18
0.24
0.05
0.02
0.00
0.24
*-0
.15
0.03
?-0
.14
B22
2B
-0.3
40.
000.
530.
330.
330.
53*
0.09
0.05
0.01
0.00
-0.0
10.
33*
-0.2
8-0
.20
B22
3B
-0.5
30.
000.
580.
390.
180.
58*
0.09
0.14
0.02
0.00
-0.1
00.
39*
-0.3
0-0
.09
B22
4C
-1.0
10.
000.
700.
560.
170.
070.
70*
0.05
0.02
0.00
-0.2
3-0
.29
0.56
*-0
.26
B22
5A
-1.8
30.
000.
840.
650.
84*
0.05
0.05
0.05
0.01
0.00
0.65
*-0
.34
-0.3
5-0
.23
B22
6C
-1.4
30.
000.
780.
630.
080.
080.
78*
0.04
0.01
0.00
-0.2
9-0
.29
0.63
*-0
.28
B22
7A
-1.6
90.
000.
820.
650.
82*
0.08
0.05
0.03
0.01
0.00
0.65
*-0
.32
-0.3
5-0
.25
B22
8D
-1.3
90.
000.
770.
600.
050.
050.
100.
77*
0.02
0.00
-0.3
3-0
.27
-0.2
40.
60*
J 2
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)C
189
B-1
.68
0.00
0.84
0.48
0.05
0.84
*0.
070.
030.
020.
00-0
.21
0.48
*-0
.25
-0.1
7C
190
B-0
.44
0.00
0.59
0.48
0.25
0.59
*0.
070.
070.
020.
00-0
.18
0.48
*-0
.21
-0.2
4C
191
D-0
.01
0.00
0.48
0.48
0.09
0.23
0.19
0.48
*0.
020.
00-0
.23
-0.0
9-0
.24
0.48
*C
192
D-1
.44
0.00
0.80
0.59
0.06
0.08
0.05
0.80
*0.
010.
00-0
.26
-0.2
7-0
.29
0.59
*C
193
D-0
.72
0.00
0.66
0.56
0.10
0.13
0.10
0.66
*0.
010.
00-0
.21
-0.2
6-0
.25
0.56
*C
194
B-1
.32
0.00
0.78
0.61
0.08
0.78
*0.
070.
060.
010.
00-0
.30
0.61
*-0
.29
-0.2
5C
195
A-0
.68
0.00
0.65
0.49
0.65
*0.
100.
190.
050.
010.
000.
49*
-0.2
0-0
.21
-0.2
3C
196
C-0
.86
0.00
0.69
0.58
0.17
0.08
0.69
*0.
060.
020.
00-0
.27
-0.2
60.
58*
-0.2
5C
197
A-0
.89
0.00
0.69
0.54
0.69
*0.
110.
080.
100.
010.
000.
54*
-0.2
4-0
.28
-0.1
8C
198
A0.
770.
000.
280.
180.
28*
0.24
0.36
0.11
0.02
0.00
0.18
*-0
.03
0.01
?-0
.11
C19
9B
-0.1
80.
000.
520.
360.
200.
52*
0.12
0.14
0.02
0.00
-0.1
20.
36*
-0.1
6-0
.11
C20
0A
0.46
0.00
0.35
0.34
0.35
*0.
350.
140.
150.
020.
000.
34*
-0.0
4-0
.23
-0.0
7C
201
A-0
.36
0.00
0.57
0.40
0.57
*0.
170.
120.
140.
010.
000.
40*
-0.2
2-0
.18
-0.0
5C
202
B0.
120.
000.
440.
360.
320.
44*
0.09
0.13
0.01
0.00
-0.0
70.
36*
-0.2
9-0
.07
C20
3D
0.14
0.00
0.44
0.26
0.11
0.17
0.27
0.44
*0.
020.
00-0
.07
-0.1
3-0
.04
0.26
*C
204
A-1
.82
0.00
0.86
0.57
0.86
*0.
060.
040.
030.
010.
000.
57*
-0.2
5-0
.29
-0.2
4C
205
B0.
290.
000.
400.
340.
330.
40*
0.09
0.17
0.01
0.00
0.01
?0.
34*
-0.3
3-0
.11
C20
6C
-1.2
10.
000.
760.
520.
050.
080.
76*
0.10
0.01
0.00
-0.3
0-0
.29
0.52
*-0
.14
C20
7B
-0.2
80.
000.
550.
450.
230.
55*
0.17
0.04
0.01
0.00
-0.2
10.
45*
-0.1
2-0
.25
C20
8C
-1.1
60.
000.
750.
480.
140.
060.
75*
0.04
0.01
0.00
-0.1
7-0
.27
0.48
*-0
.24
C20
9D
-1.2
70.
000.
770.
570.
110.
050.
050.
77*
0.02
0.00
-0.2
2-0
.30
-0.2
70.
57*
C21
0B
-1.6
40.
000.
830.
580.
040.
83*
0.08
0.04
0.02
0.00
-0.2
90.
58*
-0.2
6-0
.25
C21
1A
0.34
0.00
0.38
0.33
0.38
*0.
470.
080.
050.
020.
000.
33*
-0.0
4-0
.21
-0.1
7C
212
C-2
.09
0.00
0.89
0.60
0.03
0.04
0.89
*0.
020.
020.
00-0
.29
-0.3
00.
60*
-0.2
3C
213
B-0
.13
0.00
0.51
0.25
0.39
0.51
*0.
060.
030.
020.
000.
03?
0.25
*-0
.23
-0.2
3C
214
D-0
.80
0.00
0.68
0.47
0.09
0.15
0.07
0.68
*0.
020.
00-0
.15
-0.1
7-0
.29
0.47
*C
215
A-1
.42
0.00
0.80
0.57
0.80
*0.
080.
060.
050.
020.
000.
57*
-0.2
8-0
.27
-0.2
2C
216
A0.
430.
000.
360.
180.
36*
0.20
0.22
0.20
0.02
0.00
0.18
*-0
.08
-0.0
90.
08?
C21
7B
0.02
0.00
0.47
0.40
0.09
0.47
*0.
270.
160.
020.
00-0
.29
0.40
*-0
.05
-0.1
5C
218
B0.
000.
000.
470.
330.
130.
47*
0.30
0.09
0.02
0.00
-0.1
40.
33*
-0.0
8-0
.14
C21
9C
-0.8
50.
000.
680.
450.
180.
060.
68*
0.06
0.02
0.00
-0.1
2-0
.28
0.45
*-0
.23
C22
0A
0.06
0.00
0.46
0.34
0.46
*0.
100.
210.
220.
020.
000.
34*
-0.2
0-0
.07
-0.0
9C
221
D-0
.73
0.00
0.66
0.66
0.13
0.08
0.12
0.66
*0.
020.
00-0
.32
-0.2
9-0
.25
0.66
*C
222
C-0
.43
0.00
0.59
0.40
0.05
0.29
0.59
*0.
050.
020.
00-0
.26
-0.1
10.
40*
-0.2
0C
223
C-0
.62
0.00
0.63
0.52
0.17
0.07
0.63
*0.
110.
020.
00-0
.19
-0.2
90.
52*
-0.1
9C
224
C0.
790.
000.
280.
140.
290.
310.
28*
0.10
0.02
0.00
0.01
?0.
07?
0.14
*-0
.19
C22
5A
-1.5
40.
000.
820.
640.
82*
0.08
0.05
0.03
0.02
0.00
0.64
*-0
.30
-0.3
3-0
.24
C22
6D
-1.3
00.
000.
780.
620.
080.
060.
070.
78*
0.02
0.00
-0.2
5-0
.29
-0.3
10.
62*
C22
7B
-1.2
90.
000.
780.
590.
070.
78*
0.06
0.08
0.02
0.00
-0.3
10.
59*
-0.3
0-0
.19
C22
8D
-1.1
20.
000.
740.
580.
060.
060.
130.
74*
0.02
0.00
-0.3
0-0
.30
-0.2
10.
58*
J 3
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)D
189
B-1
.04
0.00
0.73
0.46
0.10
0.73
*0.
130.
020.
010.
00-0
.22
0.46
*-0
.20
-0.2
1D
190
D-0
.20
0.00
0.55
0.50
0.11
0.07
0.26
0.55
*0.
020.
00-0
.24
-0.2
1-0
.18
0.50
*D
191
C-0
.49
0.00
0.62
0.27
0.07
0.07
0.62
*0.
230.
010.
00-0
.22
-0.2
60.
27*
0.07
?D
192
C0.
570.
000.
370.
120.
030.
070.
37*
0.51
?0.
010.
00-0
.25
-0.2
80.
12*
0.20
?D
193
B-0
.54
0.00
0.63
0.53
0.18
0.63
*0.
140.
040.
010.
00-0
.28
0.53
*-0
.20
-0.2
1D
194
C-1
.17
0.00
0.75
0.55
0.08
0.08
0.75
*0.
080.
010.
00-0
.21
-0.2
90.
55*
-0.2
4D
195
D-1
.10
0.00
0.74
0.54
0.06
0.08
0.11
0.74
*0.
010.
00-0
.30
-0.2
5-0
.17
0.54
*D
196
A-1
.96
0.00
0.86
0.59
0.86
*0.
050.
050.
030.
010.
000.
59*
-0.3
1-0
.26
-0.2
5D
197
A-0
.46
0.00
0.61
0.36
0.61
*0.
040.
180.
160.
010.
000.
36*
-0.2
8-0
.11
-0.1
1D
198
B-1
.70
0.00
0.83
0.62
0.05
0.83
*0.
060.
040.
010.
00-0
.27
0.62
*-0
.31
-0.2
8D
199
C-1
.99
0.00
0.87
0.59
0.05
0.04
0.87
*0.
030.
010.
00-0
.27
-0.3
10.
59*
-0.2
3D
200
A-0
.92
0.00
0.71
0.47
0.71
*0.
100.
100.
080.
010.
000.
47*
-0.2
3-0
.18
-0.1
8D
201
A-1
.01
0.00
0.72
0.58
0.72
*0.
100.
080.
090.
010.
000.
58*
-0.2
5-0
.30
-0.2
2D
202
B-0
.05
0.00
0.52
0.36
0.15
0.52
*0.
170.
140.
010.
00-0
.14
0.36
*-0
.18
-0.0
7D
203
A0.
910.
000.
300.
210.
30*
0.28
0.04
0.36
0.01
0.00
0.21
*0.
02?
-0.2
6-0
.02
D20
4D
-0.5
50.
000.
630.
550.
080.
140.
130.
63*
0.01
0.00
-0.2
5-0
.29
-0.1
60.
55*
D20
5A
0.71
0.00
0.34
0.20
0.34
*0.
470.
070.
100.
010.
000.
20*
0.05
?-0
.20
-0.1
0D
206
B-0
.26
0.00
0.57
0.47
0.20
0.57
*0.
090.
130.
010.
00-0
.15
0.47
*-0
.31
-0.1
2D
207
B-0
.56
0.00
0.63
0.45
0.11
0.63
*0.
110.
140.
010.
00-0
.21
0.45
*-0
.19
-0.1
5D
208
A1.
190.
000.
250.
170.
25*
0.17
0.06
0.51
?0.
010.
000.
17*
-0.1
4-0
.26
0.16
?D
209
B0.
490.
000.
390.
280.
120.
39*
0.38
0.10
0.02
0.00
-0.0
80.
28*
-0.0
4-0
.16
D21
0D
0.44
0.00
0.40
0.43
0.15
0.10
0.33
0.40
*0.
020.
00-0
.21
-0.2
2-0
.06
0.43
*D
211
B0.
380.
000.
420.
250.
140.
42*
0.37
0.05
0.02
0.00
-0.1
30.
25*
0.02
?-0
.19
D21
2C
0.73
0.00
0.34
0.12
0.10
0.46
0.34
*0.
080.
010.
00-0
.18
0.13
?0.
12*
-0.0
9D
213
B-1
.15
0.00
0.75
0.59
0.09
0.75
*0.
050.
100.
010.
00-0
.30
0.59
*-0
.29
-0.2
2D
214
D-0
.18
0.00
0.55
0.37
0.08
0.15
0.21
0.55
*0.
010.
00-0
.18
-0.1
6-0
.09
0.37
*D
215
A-1
.88
0.00
0.85
0.59
0.85
*0.
050.
060.
030.
010.
000.
59*
-0.2
7-0
.29
-0.2
5D
216
C-0
.88
0.00
0.70
0.52
0.05
0.12
0.70
*0.
120.
010.
00-0
.22
-0.2
70.
52*
-0.1
9D
217
B-0
.70
0.00
0.66
0.37
0.08
0.66
*0.
210.
030.
010.
00-0
.18
0.37
*-0
.11
-0.2
4D
218
B-0
.47
0.00
0.61
0.40
0.08
0.61
*0.
120.
180.
020.
00-0
.20
0.40
*-0
.11
-0.1
7D
219
A-0
.23
0.00
0.56
0.45
0.56
*0.
280.
090.
050.
010.
000.
45*
-0.1
4-0
.25
-0.2
0D
220
B-1
.10
0.00
0.74
0.53
0.09
0.74
*0.
050.
100.
020.
00-0
.22
0.53
*-0
.28
-0.2
0D
221
C-1
.37
0.00
0.79
0.60
0.11
0.06
0.79
*0.
040.
020.
00-0
.32
-0.2
70.
60*
-0.2
3D
222
A1.
640.
000.
170.
010.
17*
0.24
0.53
?0.
040.
020.
000.
01*
0.03
?0.
12?
-0.1
7D
223
B0.
330.
000.
430.
230.
230.
43*
0.08
0.24
0.02
0.00
-0.1
50.
23*
-0.1
90.
10?
D22
4B
-0.2
90.
000.
570.
340.
090.
57*
0.18
0.14
0.02
0.00
-0.2
00.
34*
-0.1
4-0
.05
D22
5A
0.22
0.00
0.45
0.31
0.45
*0.
190.
100.
240.
020.
000.
31*
-0.2
0-0
.27
0.11
?D
226
C0.
490.
000.
390.
360.
360.
170.
39*
0.07
0.01
0.00
-0.0
6-0
.15
0.36
*-0
.18
D22
7C
0.56
0.00
0.38
0.10
0.09
0.05
0.38
*0.
470.
010.
00-0
.21
-0.2
70.
10*
0.23
?D
228
B1.
110.
000.
260.
190.
300.
26*
0.39
0.04
0.02
0.00
-0.0
40.
19*
0.04
?-0
.22
J 4
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)E
189
A-0
.94
0.00
0.72
0.52
0.72
*0.
070.
040.
160.
020.
000.
52*
-0.2
7-0
.24
-0.2
0E
190
A0.
910.
000.
290.
130.
29*
0.46
0.04
0.19
0.02
0.00
0.13
*0.
21?
-0.2
8-0
.14
E19
1D
0.16
0.00
0.46
0.48
0.08
0.24
0.20
0.46
*0.
020.
00-0
.23
-0.1
0-0
.22
0.48
*E
192
B-0
.69
0.00
0.66
0.47
0.11
0.66
*0.
180.
030.
020.
00-0
.20
0.47
*-0
.18
-0.2
4E
193
C-1
.59
0.00
0.82
0.61
0.04
0.08
0.82
*0.
050.
020.
00-0
.28
-0.3
20.
61*
-0.2
3E
194
B-1
.36
0.00
0.79
0.61
0.07
0.79
*0.
060.
070.
020.
00-0
.29
0.61
*-0
.28
-0.2
6E
195
B-0
.66
0.00
0.66
0.56
0.17
0.66
*0.
100.
060.
020.
00-0
.21
0.56
*-0
.31
-0.2
2E
196
D-0
.92
0.00
0.71
0.59
0.09
0.11
0.08
0.71
*0.
020.
00-0
.21
-0.2
7-0
.29
0.59
*E
197
B-1
.73
0.00
0.84
0.64
0.05
0.84
*0.
050.
040.
020.
00-0
.31
0.64
*-0
.31
-0.2
6E
198
A0.
760.
000.
320.
180.
32*
0.23
0.34
0.10
0.02
0.00
0.18
*0.
00-0
.02
-0.1
1E
199
B0.
150.
000.
470.
310.
150.
47*
0.08
0.29
0.02
0.00
-0.0
90.
31*
-0.2
4-0
.02
E20
0B
0.41
0.00
0.40
0.27
0.17
0.40
*0.
080.
340.
020.
00-0
.13
0.27
*-0
.26
0.07
?E
201
B-1
.27
0.00
0.78
0.58
0.05
0.78
*0.
120.
040.
020.
00-0
.33
0.58
*-0
.22
-0.2
6E
202
A-0
.99
0.00
0.73
0.61
0.73
*0.
080.
080.
100.
020.
000.
61*
-0.2
8-0
.32
-0.2
1E
203
A-1
.89
0.00
0.86
0.58
0.86
*0.
060.
040.
030.
020.
000.
58*
-0.2
5-0
.31
-0.2
3E
204
C-0
.97
0.00
0.72
0.44
0.06
0.07
0.72
*0.
140.
020.
00-0
.27
-0.2
20.
44*
-0.0
9E
205
A0.
550.
000.
370.
210.
37*
0.44
0.07
0.11
0.02
0.00
0.21
*0.
05?
-0.2
1-0
.10
E20
6B
0.36
0.00
0.41
0.34
0.29
0.41
*0.
110.
170.
020.
000.
000.
34*
-0.2
8-0
.09
E20
7C
1.31
0.00
0.21
0.09
0.30
0.41
0.21
*0.
070.
020.
00-0
.12
0.22
?0.
09*
-0.1
9E
208
D-1
.31
0.00
0.78
0.54
0.12
0.04
0.04
0.78
*0.
020.
00-0
.20
-0.2
7-0
.30
0.54
*E
209
A-0
.82
0.00
0.69
0.56
0.69
*0.
070.
140.
080.
020.
000.
56*
-0.3
0-0
.21
-0.2
3E
210
A-1
.47
0.00
0.81
0.63
0.81
*0.
060.
070.
050.
020.
000.
63*
-0.2
9-0
.30
-0.2
7E
211
B-0
.64
0.00
0.65
0.46
0.18
0.65
*0.
090.
060.
020.
00-0
.23
0.46
*-0
.18
-0.1
4E
212
A-0
.73
0.00
0.67
0.40
0.67
*0.
050.
150.
110.
020.
000.
40*
-0.2
6-0
.18
-0.0
7E
213
A-0
.64
0.00
0.65
0.43
0.65
*0.
060.
090.
180.
020.
000.
43*
-0.3
1-0
.27
-0.0
2E
214
A0.
630.
000.
350.
220.
35*
0.10
0.48
0.06
0.02
0.00
0.22
*-0
.22
0.09
?-0
.17
E21
5D
0.87
0.00
0.29
0.23
0.29
0.31
0.09
0.29
*0.
020.
00-0
.04
0.04
?-0
.19
0.23
*E
216
A0.
600.
000.
360.
180.
36*
0.15
0.38
0.09
0.02
0.00
0.18
*-0
.13
0.07
?-0
.09
E21
7B
0.04
0.00
0.49
0.39
0.08
0.49
*0.
340.
080.
020.
00-0
.23
0.39
*-0
.07
-0.2
0E
218
D-0
.07
0.00
0.52
0.46
0.21
0.09
0.16
0.52
*0.
020.
00-0
.12
-0.2
9-0
.14
0.46
*E
219
A-0
.45
0.00
0.61
0.42
0.61
*0.
090.
110.
170.
020.
000.
42*
-0.2
3-0
.24
-0.0
4E
220
B-1
.05
0.00
0.74
0.58
0.11
0.74
*0.
070.
070.
020.
00-0
.27
0.58
*-0
.28
-0.2
0E
221
B-1
.50
0.00
0.81
0.61
0.10
0.81
*0.
050.
030.
020.
00-0
.31
0.61
*-0
.27
-0.2
3E
222
A0.
560.
000.
360.
160.
36*
0.09
0.08
0.45
0.02
0.00
0.16
*-0
.21
-0.2
50.
20?
E22
3D
-0.9
20.
000.
710.
640.
110.
070.
090.
71*
0.02
0.00
-0.2
9-0
.29
-0.2
70.
64*
E22
4D
0.41
0.00
0.40
0.33
0.24
0.23
0.12
0.40
*0.
020.
00-0
.03
-0.1
3-0
.14
0.33
*E
225
D-0
.02
0.00
0.51
0.39
0.06
0.20
0.22
0.51
*0.
020.
00-0
.26
-0.0
8-0
.12
0.39
*E
226
B0.
970.
000.
270.
060.
050.
27*
0.08
0.58
?0.
020.
00-0
.27
0.06
*-0
.25
0.30
?E
227
C-0
.58
0.00
0.64
0.37
0.05
0.26
0.64
*0.
030.
020.
00-0
.29
-0.0
50.
37*
-0.2
3E
228
C0.
440.
000.
390.
230.
080.
460.
39*
0.05
0.02
0.00
-0.2
60.
12?
0.23
*-0
.26
J 5
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)F
189
B-0
.18
0.00
0.54
0.40
0.07
0.54
*0.
310.
070.
020.
00-0
.13
0.40
*-0
.18
-0.1
7F
190
D0.
140.
000.
460.
270.
270.
070.
190.
46*
0.02
0.00
0.03
?-0
.21
-0.1
50.
27*
F19
1C
-1.9
10.
000.
860.
540.
050.
050.
86*
0.03
0.01
0.00
-0.2
8-0
.26
0.54
*-0
.21
F19
2C
0.98
0.00
0.27
0.13
0.08
0.35
0.27
*0.
290.
020.
00-0
.11
0.02
?0.
13*
-0.0
1F
193
A-0
.99
0.00
0.72
0.58
0.72
*0.
110.
080.
080.
010.
000.
58*
-0.3
0-0
.27
-0.2
1F
194
B-0
.19
0.00
0.54
0.40
0.30
0.54
*0.
100.
050.
010.
00-0
.09
0.40
*-0
.25
-0.2
3F
195
D-1
.04
0.00
0.73
0.46
0.09
0.10
0.07
0.73
*0.
010.
00-0
.16
-0.2
1-0
.24
0.46
*F
196
B-0
.98
0.00
0.72
0.50
0.11
0.72
*0.
050.
110.
010.
00-0
.24
0.50
*-0
.25
-0.1
9F
197
C-0
.96
0.00
0.72
0.54
0.07
0.10
0.72
*0.
110.
010.
00-0
.26
-0.2
70.
54*
-0.2
1F
198
A-0
.22
0.00
0.55
0.49
0.55
*0.
120.
130.
190.
020.
000.
49*
-0.2
4-0
.27
-0.1
0F
199
A-0
.28
0.00
0.56
0.33
0.56
*0.
160.
220.
050.
020.
000.
33*
-0.1
0-0
.09
-0.2
3F
200
A0.
300.
000.
420.
240.
42*
0.10
0.11
0.36
0.01
0.00
0.24
*-0
.22
-0.2
90.
16?
F20
1C
-0.6
20.
000.
640.
550.
110.
160.
64*
0.08
0.02
0.00
-0.2
4-0
.29
0.55
*-0
.17
F20
2C
0.66
0.00
0.33
0.21
0.26
0.28
0.33
*0.
110.
010.
00-0
.03
0.01
?0.
21*
-0.1
6F
203
D0.
250.
000.
430.
360.
240.
200.
120.
43*
0.02
0.00
-0.0
5-0
.18
-0.1
50.
36*
F20
4B
-0.4
60.
000.
610.
410.
260.
61*
0.07
0.05
0.01
0.00
-0.1
50.
41*
-0.2
3-0
.18
F20
5D
-0.6
90.
000.
660.
490.
070.
150.
110.
66*
0.01
0.00
-0.2
6-0
.17
-0.2
10.
49*
F20
6D
-1.2
20.
000.
760.
510.
060.
050.
120.
76*
0.01
0.00
-0.2
5-0
.30
-0.1
80.
51*
F20
7C
-1.6
00.
000.
820.
620.
030.
070.
82*
0.06
0.01
0.00
-0.2
7-0
.33
0.62
*-0
.27
F20
8C
-0.1
10.
000.
520.
320.
110.
300.
52*
0.06
0.01
0.00
-0.2
3-0
.01
0.32
*-0
.18
F20
9C
-0.5
30.
000.
620.
520.
100.
110.
62*
0.15
0.02
0.00
-0.2
4-0
.26
0.52
*-0
.16
F21
0D
-1.3
40.
000.
780.
610.
070.
080.
050.
78*
0.02
0.00
-0.2
9-0
.29
-0.2
70.
61*
F21
1A
-0.9
50.
000.
710.
540.
71*
0.10
0.11
0.07
0.01
0.00
0.54
*-0
.28
-0.2
7-0
.14
F21
2C
-0.3
70.
000.
580.
260.
070.
080.
58*
0.25
0.01
0.00
-0.2
1-0
.28
0.26
*0.
10?
F21
3C
-1.1
10.
000.
740.
600.
120.
080.
74*
0.05
0.01
0.00
-0.2
9-0
.30
0.60
*-0
.23
F21
4A
-1.1
00.
000.
740.
590.
74*
0.10
0.09
0.06
0.02
0.00
0.59
*-0
.30
-0.2
7-0
.23
F21
5A
-0.7
50.
000.
670.
570.
67*
0.13
0.12
0.07
0.02
0.00
0.57
*-0
.24
-0.2
8-0
.22
F21
6C
0.63
0.00
0.34
0.17
0.05
0.52
?0.
34*
0.07
0.02
0.00
-0.2
80.
14?
0.17
*-0
.20
F21
7C
-0.4
60.
000.
610.
490.
120.
150.
61*
0.11
0.02
0.00
-0.1
5-0
.25
0.49
*-0
.19
F21
8B
0.11
0.00
0.47
0.35
0.20
0.47
*0.
180.
140.
020.
00-0
.12
0.35
*-0
.17
-0.0
6F
219
A0.
750.
000.
310.
320.
31*
0.39
0.12
0.16
0.02
0.00
0.32
*0.
00-0
.24
-0.0
8F
220
D0.
770.
000.
310.
280.
340.
230.
110.
31*
0.02
0.00
0.01
?-0
.06
-0.2
10.
28*
F22
1C
-1.0
00.
000.
720.
570.
180.
060.
72*
0.03
0.01
0.00
-0.2
9-0
.31
0.57
*-0
.19
F22
2D
-0.4
60.
000.
610.
560.
100.
150.
130.
61*
0.02
0.00
-0.2
3-0
.30
-0.1
80.
56*
F22
3B
0.01
0.00
0.49
0.35
0.16
0.49
*0.
190.
140.
020.
00-0
.10
0.35
*-0
.16
-0.1
0F
224
A-0
.16
0.00
0.53
0.46
0.53
*0.
180.
110.
160.
020.
000.
46*
-0.2
1-0
.22
-0.1
0F
225
B-1
.15
0.00
0.75
0.44
0.08
0.75
*0.
070.
080.
020.
00-0
.18
0.44
*-0
.31
-0.0
7F
226
C0.
940.
000.
280.
220.
420.
080.
28*
0.21
0.02
0.00
0.12
?-0
.29
0.22
*-0
.09
F22
7B
-0.5
00.
000.
620.
480.
110.
62*
0.12
0.14
0.02
0.00
-0.2
50.
48*
-0.2
0-0
.14
F22
8A
-0.2
90.
000.
560.
520.
56*
0.24
0.12
0.06
0.02
0.00
0.52
*-0
.18
-0.2
9-0
.21
J 6
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)G
189
A-1
.11
0.00
0.71
0.45
0.71
*0.
050.
180.
040.
020.
000.
45*
-0.2
8-0
.20
-0.1
3G
190
C-1
.63
0.00
0.82
0.49
0.03
0.03
0.82
*0.
110.
020.
00-0
.27
-0.2
70.
49*
-0.1
8G
191
C-0
.88
0.00
0.66
0.40
0.07
0.23
0.66
*0.
020.
010.
00-0
.28
-0.1
10.
40*
-0.2
0G
192
B-1
.69
0.00
0.83
0.51
0.04
0.83
*0.
030.
080.
010.
00-0
.27
0.51
*-0
.25
-0.1
9G
193
B-1
.10
0.00
0.71
0.50
0.15
0.71
*0.
050.
070.
010.
00-0
.20
0.50
*-0
.29
-0.2
0G
194
B-0
.33
0.00
0.51
0.27
0.11
0.51
*0.
080.
290.
020.
00-0
.15
0.27
*-0
.24
0.05
?G
195
C-1
.17
0.00
0.73
0.39
0.19
0.04
0.73
*0.
030.
010.
00-0
.12
-0.2
40.
39*
-0.2
3G
196
D-1
.72
0.00
0.83
0.58
0.06
0.05
0.04
0.83
*0.
010.
00-0
.27
-0.2
9-0
.23
0.58
*G
197
D-0
.03
0.00
0.42
0.45
0.29
0.17
0.11
0.42
*0.
020.
00-0
.20
-0.1
4-0
.12
0.45
*G
198
C-1
.05
0.00
0.70
0.48
0.13
0.10
0.70
*0.
060.
020.
00-0
.16
-0.2
70.
48*
-0.2
0G
199
D-0
.75
0.00
0.62
0.51
0.20
0.08
0.08
0.62
*0.
020.
00-0
.19
-0.2
6-0
.21
0.51
*G
200
A-0
.37
0.00
0.52
0.46
0.52
*0.
240.
080.
150.
020.
000.
46*
-0.1
3-0
.24
-0.1
9G
201
C-1
.25
0.00
0.74
0.55
0.17
0.05
0.74
*0.
030.
020.
00-0
.28
-0.2
80.
55*
-0.2
1G
202
A-1
.36
0.00
0.77
0.51
0.77
*0.
070.
040.
110.
010.
000.
51*
-0.3
0-0
.30
-0.1
2G
203
C-1
.77
0.00
0.84
0.60
0.07
0.04
0.84
*0.
040.
010.
00-0
.28
-0.2
90.
60*
-0.2
7G
204
B-0
.37
0.00
0.52
0.32
0.15
0.52
*0.
050.
270.
020.
00-0
.17
0.32
*-0
.27
0.00
G20
5A
-0.8
80.
000.
660.
510.
66*
0.06
0.19
0.08
0.02
0.00
0.51
*-0
.31
-0.1
9-0
.20
G20
6B
-1.6
50.
000.
820.
580.
050.
82*
0.05
0.07
0.01
0.00
-0.3
00.
58*
-0.2
8-0
.22
G20
7B
-0.7
40.
000.
620.
470.
120.
62*
0.10
0.14
0.02
0.00
-0.2
00.
47*
-0.2
2-0
.16
G20
8C
-0.9
10.
000.
660.
520.
120.
140.
66*
0.06
0.01
0.00
-0.2
9-0
.20
0.52
*-0
.16
G20
9B
-1.9
80.
000.
870.
520.
030.
87*
0.06
0.03
0.02
0.00
-0.2
20.
52*
-0.2
6-0
.20
G21
0D
-0.6
60.
000.
600.
530.
130.
060.
200.
60*
0.02
0.00
-0.2
5-0
.23
-0.1
90.
53*
G21
1B
-1.6
60.
000.
820.
560.
050.
82*
0.08
0.03
0.02
0.00
-0.2
80.
56*
-0.2
6-0
.22
G21
2B
-0.9
00.
000.
660.
500.
100.
66*
0.19
0.04
0.01
0.00
-0.2
30.
50*
-0.2
0-0
.23
G21
3A
-0.0
30.
000.
420.
370.
42*
0.27
0.18
0.11
0.02
0.00
0.37
*-0
.01
-0.1
7-0
.20
G21
4D
-0.7
20.
000.
610.
490.
240.
060.
070.
61*
0.02
0.00
-0.1
1-0
.31
-0.2
70.
49*
G21
5D
-1.1
70.
000.
730.
560.
050.
090.
110.
73*
0.02
0.00
-0.3
0-0
.27
-0.1
90.
56*
G21
6B
-0.6
50.
000.
600.
480.
170.
60*
0.16
0.05
0.02
0.00
-0.2
00.
48*
-0.1
7-0
.22
G21
7B
-1.5
90.
000.
810.
630.
060.
81*
0.07
0.05
0.02
0.00
-0.3
00.
63*
-0.3
0-0
.27
G21
8D
0.03
0.00
0.41
0.30
0.10
0.29
0.18
0.41
*0.
020.
00-0
.10
-0.0
4-0
.15
0.30
*G
219
D-0
.62
0.00
0.59
0.55
0.17
0.10
0.12
0.59
*0.
020.
00-0
.19
-0.2
7-0
.22
0.55
*G
220
C-1
.66
0.00
0.82
0.64
0.06
0.06
0.82
*0.
050.
020.
00-0
.28
-0.3
20.
64*
-0.2
8G
221
B-0
.98
0.00
0.68
0.54
0.11
0.68
*0.
130.
060.
020.
00-0
.28
0.54
*-0
.20
-0.2
1G
222
B-1
.36
0.00
0.77
0.60
0.05
0.77
*0.
120.
050.
020.
00-0
.31
0.60
*-0
.25
-0.2
7G
223
D-0
.18
0.00
0.47
0.35
0.13
0.13
0.26
0.47
*0.
020.
00-0
.10
-0.1
6-0
.10
0.35
*G
224
D-1
.43
0.00
0.78
0.61
0.06
0.06
0.08
0.78
*0.
020.
00-0
.30
-0.3
1-0
.22
0.61
*G
225
C-1
.26
0.00
0.75
0.55
0.05
0.10
0.75
*0.
090.
020.
00-0
.29
-0.2
90.
55*
-0.1
4G
226
B-0
.33
0.00
0.51
0.42
0.26
0.51
*0.
180.
050.
020.
00-0
.17
0.42
*-0
.10
-0.2
7G
227
D-1
.40
0.00
0.77
0.61
0.09
0.06
0.06
0.77
*0.
020.
00-0
.25
-0.2
5-0
.32
0.61
*G
228
B-1
.49
0.00
0.79
0.59
0.07
0.79
*0.
070.
050.
020.
00-0
.29
0.59
*-0
.28
-0.2
2
J 7
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)H
189
C2.
450.
000.
09-0
.17
0.08
0.58
?0.
09*
0.24
0.02
0.00
-0.1
30.
34?
-0.1
7*
-0.1
0H
190
A-0
.79
0.00
0.68
0.36
0.68
*0.
080.
030.
190.
010.
000.
36*
-0.1
4-0
.21
-0.1
3H
191
D1.
070.
000.
280.
310.
140.
280.
280.
28*
0.02
0.00
-0.2
3-0
.10
0.06
?0.
31*
H19
2B
-0.7
00.
000.
670.
390.
130.
67*
0.12
0.06
0.01
0.00
-0.2
20.
39*
-0.1
2-0
.13
H19
3B
-1.0
60.
000.
730.
520.
110.
73*
0.05
0.09
0.01
0.00
-0.2
40.
52*
-0.2
5-0
.19
H19
4A
1.82
0.00
0.16
-0.0
90.
16*
0.04
0.70
?0.
090.
010.
00-0
.09
*-0
.25
0.39
?-0
.20
H19
5D
0.19
0.00
0.47
0.35
0.08
0.22
0.22
0.47
*0.
010.
00-0
.12
-0.1
4-0
.10
0.35
*H
196
D1.
020.
000.
290.
200.
300.
320.
080.
29*
0.01
0.00
-0.0
20.
01?
-0.1
70.
20*
H19
7C
1.55
0.00
0.19
0.01
0.56
?0.
160.
19*
0.07
0.01
0.00
0.22
?-0
.07
0.01
*-0
.19
H19
8D
0.36
0.00
0.43
0.36
0.14
0.12
0.30
0.43
*0.
010.
00-0
.16
-0.2
1-0
.03
0.36
*H
199
C-0
.30
0.00
0.58
0.43
0.20
0.17
0.58
*0.
040.
010.
00-0
.15
-0.1
70.
43*
-0.2
3H
200
B-1
.16
0.00
0.75
0.54
0.07
0.75
*0.
090.
070.
020.
00-0
.21
0.54
*-0
.25
-0.2
5H
201
A-0
.04
0.00
0.52
0.25
0.52
*0.
180.
240.
040.
010.
000.
25*
-0.1
50.
01?
-0.1
5H
202
A1.
430.
000.
210.
050.
21*
0.28
0.46
0.04
0.02
0.00
0.05
*0.
12?
-0.0
1-0
.14
H20
3A
0.49
0.00
0.40
0.15
0.40
*0.
100.
080.
420.
010.
000.
15*
-0.1
8-0
.19
0.14
?H
204
B-0
.39
0.00
0.60
0.28
0.10
0.60
*0.
150.
140.
010.
00-0
.17
0.28
*-0
.10
-0.0
3H
205
C-1
.55
0.00
0.81
0.58
0.04
0.06
0.81
*0.
070.
010.
00-0
.27
-0.2
90.
58*
-0.2
3H
206
B0.
030.
000.
500.
450.
310.
50*
0.07
0.11
0.01
0.00
-0.1
60.
45*
-0.2
7-0
.13
H20
7B
0.83
0.00
0.32
0.07
0.04
0.32
*0.
300.
320.
010.
00-0
.27
0.07
*-0
.07
0.21
?H
208
A0.
180.
000.
470.
370.
47*
0.21
0.10
0.21
0.01
0.00
0.37
*-0
.19
-0.2
50.
03?
H20
9B
0.60
0.00
0.37
0.33
0.35
0.37
*0.
150.
110.
020.
00-0
.08
0.33
*-0
.13
-0.1
0H
210
C0.
730.
000.
350.
180.
040.
100.
35*
0.50
?0.
020.
00-0
.26
-0.2
70.
18*
0.18
?H
211
D-1
.29
0.00
0.77
0.62
0.07
0.10
0.05
0.77
*0.
010.
00-0
.29
-0.3
0-0
.25
0.62
*H
212
C-0
.40
0.00
0.60
0.52
0.11
0.12
0.60
*0.
160.
010.
00-0
.23
-0.2
40.
52*
-0.1
7H
213
C-0
.99
0.00
0.72
0.56
0.09
0.09
0.72
*0.
080.
010.
00-0
.21
-0.3
20.
56*
-0.2
1H
214
B-1
.22
0.00
0.76
0.61
0.08
0.76
*0.
080.
070.
010.
00-0
.27
0.61
*-0
.29
-0.2
6H
215
B-0
.61
0.00
0.65
0.57
0.11
0.65
*0.
130.
100.
020.
00-0
.28
0.57
*-0
.23
-0.2
1H
216
B-0
.68
0.00
0.66
0.51
0.07
0.66
*0.
190.
060.
020.
00-0
.22
0.51
*-0
.21
-0.2
4H
217
A0.
040.
000.
500.
360.
50*
0.06
0.25
0.18
0.02
0.00
0.36
*-0
.31
-0.0
9-0
.06
H21
8B
0.64
0.00
0.37
0.26
0.12
0.37
*0.
290.
210.
020.
00-0
.14
0.26
*-0
.05
-0.0
3H
219
C-0
.55
0.00
0.63
0.55
0.12
0.16
0.63
*0.
080.
020.
00-0
.21
-0.2
60.
55*
-0.2
1H
220
A-0
.88
0.00
0.70
0.53
0.70
*0.
110.
100.
070.
020.
000.
53*
-0.2
1-0
.25
-0.2
2H
221
C-1
.30
0.00
0.77
0.62
0.10
0.09
0.77
*0.
020.
020.
00-0
.32
-0.3
10.
62*
-0.1
9H
222
B-1
.02
0.00
0.73
0.47
0.16
0.73
*0.
070.
030.
020.
00-0
.20
0.47
*-0
.22
-0.2
2H
223
B0.
440.
000.
410.
360.
310.
41*
0.11
0.15
0.02
0.00
-0.0
50.
36*
-0.2
8-0
.05
H22
4B
0.87
0.00
0.32
0.12
0.28
0.32
*0.
240.
150.
020.
00-0
.02
0.12
*-0
.06
0.06
?H
225
B-1
.25
0.00
0.77
0.46
0.08
0.77
*0.
070.
070.
020.
00-0
.17
0.46
*-0
.30
-0.1
1H
226
C1.
100.
000.
270.
210.
460.
080.
27*
0.18
0.02
0.00
0.12
?-0
.29
0.21
*-0
.09
H22
7B
-0.4
90.
000.
620.
480.
110.
62*
0.12
0.14
0.02
0.00
-0.2
20.
48*
-0.2
1-0
.15
H22
8A
-0.9
10.
000.
710.
560.
71*
0.10
0.10
0.07
0.02
0.00
0.56
*-0
.27
-0.2
4-0
.23
J 8
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)I
189
B-1
.27
0.00
0.77
0.48
0.06
0.77
*0.
130.
030.
010.
00-0
.23
0.48
*-0
.22
-0.1
9I
190
B-1
.96
0.00
0.87
0.52
0.07
0.87
*0.
020.
020.
010.
00-0
.26
0.52
*-0
.24
-0.2
2I
191
A1.
160.
000.
200.
120.
20*
0.30
0.40
0.08
0.01
0.00
0.12
*0.
000.
09?
-0.2
0I
192
A-0
.66
0.00
0.64
0.38
0.64
*0.
170.
050.
120.
010.
000.
38*
-0.1
9-0
.26
-0.0
4I
193
B-0
.12
0.00
0.50
0.25
0.16
0.50
*0.
090.
240.
020.
00-0
.12
0.25
*-0
.24
0.06
?I
194
D-2
.09
0.00
0.88
0.57
0.04
0.03
0.04
0.88
*0.
010.
00-0
.25
-0.2
9-0
.25
0.57
*I
195
D-1
.61
0.00
0.82
0.57
0.07
0.06
0.04
0.82
*0.
010.
00-0
.28
-0.2
8-0
.23
0.57
*I
196
A-2
.20
0.00
0.90
0.57
0.90
*0.
030.
040.
020.
010.
000.
57*
-0.2
8-0
.27
-0.2
4I
197
A-0
.83
0.00
0.68
0.48
0.68
*0.
050.
130.
120.
010.
000.
48*
-0.2
8-0
.19
-0.1
8I
198
D-0
.47
0.00
0.59
0.52
0.18
0.06
0.16
0.59
*0.
010.
00-0
.16
-0.2
9-0
.23
0.52
*I
199
C-0
.68
0.00
0.64
0.47
0.12
0.07
0.64
*0.
160.
010.
00-0
.20
-0.2
60.
47*
-0.1
5I
200
A-0
.81
0.00
0.67
0.48
0.67
*0.
120.
070.
120.
020.
000.
48*
-0.1
8-0
.21
-0.2
3I
201
B-1
.69
0.00
0.84
0.59
0.08
0.84
*0.
040.
030.
010.
00-0
.31
0.59
*-0
.29
-0.2
3I
202
B-1
.79
0.00
0.85
0.52
0.06
0.85
*0.
060.
020.
010.
00-0
.22
0.52
*-0
.27
-0.2
4I
203
D-1
.32
0.00
0.77
0.64
0.09
0.05
0.07
0.77
*0.
010.
00-0
.33
-0.2
8-0
.28
0.64
*I
204
D-0
.24
0.00
0.53
0.55
0.17
0.07
0.21
0.53
*0.
020.
00-0
.21
-0.2
5-0
.22
0.55
*I
205
B0.
270.
000.
400.
370.
140.
40*
0.15
0.29
0.01
0.00
-0.1
70.
37*
-0.1
5-0
.06
I20
6A
-0.0
40.
000.
480.
270.
48*
0.24
0.17
0.10
0.01
0.00
0.27
*-0
.11
-0.0
9-0
.05
I20
7B
-1.2
40.
000.
760.
480.
100.
76*
0.04
0.09
0.01
0.00
-0.2
30.
48*
-0.3
1-0
.12
I20
8A
-2.0
70.
000.
880.
600.
88*
0.04
0.04
0.02
0.01
0.00
0.60
*-0
.28
-0.3
1-0
.25
I20
9A
0.63
0.00
0.31
0.15
0.31
*0.
440.
050.
180.
010.
000.
15*
0.17
?-0
.28
-0.1
3I
210
C0.
270.
000.
400.
210.
040.
090.
40*
0.45
0.02
0.00
-0.2
9-0
.27
0.21
*0.
14?
I21
1B
-0.8
90.
000.
690.
520.
110.
69*
0.16
0.03
0.01
0.00
-0.2
70.
52*
-0.2
1-0
.23
I21
2C
-0.5
80.
000.
620.
520.
110.
100.
62*
0.16
0.01
0.00
-0.2
4-0
.26
0.52
*-0
.16
I21
3B
-0.1
40.
000.
510.
330.
090.
51*
0.20
0.19
0.01
0.00
-0.2
70.
33*
-0.1
40.
02?
I21
4A
0.15
0.00
0.43
0.38
0.43
*0.
280.
160.
110.
020.
000.
38*
-0.0
4-0
.18
-0.1
9I
215
B-0
.64
0.00
0.63
0.54
0.17
0.63
*0.
110.
080.
020.
00-0
.20
0.54
*-0
.28
-0.2
0I
216
B-0
.84
0.00
0.68
0.53
0.10
0.68
*0.
130.
080.
020.
00-0
.25
0.53
*-0
.22
-0.2
1I
217
B0.
020.
000.
470.
340.
140.
47*
0.10
0.27
0.02
0.00
-0.1
20.
34*
-0.2
2-0
.04
I21
8B
-1.4
00.
000.
790.
630.
070.
79*
0.08
0.05
0.02
0.00
-0.2
70.
63*
-0.3
1-0
.27
I21
9D
0.61
0.00
0.32
0.30
0.34
0.23
0.10
0.32
*0.
020.
000.
02?
-0.0
9-0
.22
0.30
*I
220
B-1
.46
0.00
0.80
0.62
0.06
0.80
*0.
070.
060.
020.
00-0
.28
0.62
*-0
.29
-0.2
7I
221
A-1
.57
0.00
0.82
0.60
0.82
*0.
070.
070.
040.
020.
000.
60*
-0.3
4-0
.26
-0.2
1I
222
D-1
.28
0.00
0.77
0.59
0.05
0.07
0.10
0.77
*0.
020.
00-0
.28
-0.3
2-0
.22
0.59
*I
223
B-0
.84
0.00
0.68
0.54
0.11
0.68
*0.
130.
070.
010.
00-0
.26
0.54
*-0
.22
-0.2
1I
224
A-0
.53
0.00
0.61
0.49
0.61
*0.
150.
120.
110.
020.
000.
49*
-0.2
2-0
.22
-0.1
5I
225
A0.
660.
000.
310.
160.
31*
0.47
0.08
0.13
0.02
0.00
0.16
*0.
12?
-0.2
1-0
.09
I22
6A
-1.4
10.
000.
790.
530.
79*
0.08
0.07
0.05
0.02
0.00
0.53
*-0
.27
-0.2
1-0
.22
I22
7B
-0.8
10.
000.
670.
320.
120.
67*
0.07
0.12
0.02
0.00
-0.1
00.
32*
-0.3
00.
01?
I22
8C
0.70
0.00
0.30
0.24
0.43
0.07
0.30
*0.
190.
020.
000.
09?
-0.2
70.
24*
-0.1
1
J 9
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)J
189
B-0
.77
0.00
0.64
0.33
0.03
0.64
*0.
060.
250.
010.
00-0
.23
0.33
*-0
.24
-0.0
4J
190
C-2
.30
0.00
0.90
0.58
0.03
0.04
0.90
*0.
020.
010.
00-0
.27
-0.2
70.
58*
-0.2
5J
191
D-1
.67
0.00
0.82
0.60
0.07
0.05
0.05
0.82
*0.
010.
00-0
.30
-0.2
9-0
.23
0.60
*J
192
C-1
.59
0.00
0.81
0.52
0.05
0.09
0.81
*0.
040.
010.
00-0
.22
-0.2
30.
52*
-0.2
5J
193
B-1
.64
0.00
0.82
0.45
0.04
0.82
*0.
060.
070.
010.
00-0
.29
0.45
*-0
.16
-0.1
5J
194
C0.
580.
000.
290.
110.
040.
040.
29*
0.62
?0.
010.
00-0
.30
-0.2
70.
11*
0.20
?J
195
A-1
.07
0.00
0.71
0.48
0.71
*0.
100.
090.
090.
010.
000.
48*
-0.2
5-0
.22
-0.1
3J
196
B-1
.23
0.00
0.74
0.48
0.08
0.74
*0.
070.
100.
010.
00-0
.30
0.48
*-0
.20
-0.1
2J
197
C-2
.25
0.00
0.89
0.64
0.03
0.04
0.89
*0.
030.
010.
00-0
.33
-0.3
10.
64*
-0.2
5J
198
A-0
.36
0.00
0.54
0.37
0.54
*0.
070.
060.
320.
010.
000.
37*
-0.2
8-0
.25
-0.0
2J
199
D-1
.04
0.00
0.70
0.56
0.11
0.10
0.08
0.70
*0.
010.
00-0
.25
-0.2
1-0
.28
0.56
*J
200
B-0
.43
0.00
0.55
0.43
0.20
0.55
*0.
150.
080.
020.
00-0
.10
0.43
*-0
.24
-0.1
7J
201
A-0
.33
0.00
0.53
0.26
0.53
*0.
170.
240.
050.
020.
000.
26*
-0.1
50.
00-0
.14
J20
2B
-0.4
40.
000.
560.
350.
310.
56*
0.07
0.05
0.01
0.00
-0.0
60.
35*
-0.2
7-0
.16
J20
3B
-0.4
80.
000.
570.
360.
200.
57*
0.07
0.15
0.02
0.00
-0.0
70.
36*
-0.2
8-0
.10
J20
4C
-1.1
40.
000.
730.
550.
150.
060.
73*
0.05
0.01
0.00
-0.2
3-0
.27
0.55
*-0
.26
J20
5A
-2.0
20.
000.
870.
610.
87*
0.03
0.03
0.05
0.01
0.00
0.61
*-0
.32
-0.3
3-0
.22
J20
6C
-1.6
00.
000.
810.
620.
070.
070.
81*
0.03
0.01
0.00
-0.3
1-0
.28
0.62
*-0
.26
J20
7A
-1.8
90.
000.
850.
640.
85*
0.07
0.04
0.03
0.01
0.00
0.64
*-0
.30
-0.3
4-0
.26
J20
8D
-1.5
10.
000.
800.
600.
040.
050.
100.
80*
0.01
0.00
-0.3
0-0
.31
-0.2
30.
60*
J20
9B
-0.9
80.
000.
690.
470.
110.
69*
0.16
0.03
0.02
0.00
-0.2
20.
47*
-0.1
8-0
.23
J21
0A
-1.4
20.
000.
780.
520.
78*
0.11
0.05
0.04
0.02
0.00
0.52
*-0
.16
-0.3
1-0
.24
J21
1A
-1.4
90.
000.
790.
500.
79*
0.08
0.05
0.07
0.01
0.00
0.50
*-0
.26
-0.2
7-0
.13
J21
2C
-0.5
10.
000.
570.
230.
070.
080.
57*
0.27
0.02
0.00
-0.1
8-0
.29
0.23
*0.
12?
J21
3B
-1.1
70.
000.
730.
550.
070.
73*
0.13
0.06
0.01
0.00
-0.2
60.
55*
-0.2
3-0
.25
J21
4A
-1.9
30.
000.
860.
640.
86*
0.05
0.04
0.04
0.01
0.00
0.64
*-0
.29
-0.2
8-0
.31
J21
5A
-1.1
80.
000.
730.
610.
73*
0.10
0.11
0.04
0.01
0.00
0.61
*-0
.31
-0.2
9-0
.20
J21
6A
-0.9
70.
000.
690.
580.
69*
0.13
0.11
0.06
0.02
0.00
0.58
*-0
.25
-0.2
6-0
.24
J21
7C
-0.8
20.
000.
650.
520.
090.
160.
65*
0.09
0.02
0.00
-0.2
2-0
.22
0.52
*-0
.22
J21
8D
0.17
0.00
0.39
0.31
0.10
0.35
0.15
0.39
*0.
020.
00-0
.12
-0.0
2-0
.16
0.31
*J
219
C-0
.80
0.00
0.65
0.54
0.11
0.17
0.65
*0.
060.
020.
00-0
.23
-0.2
10.
54*
-0.2
5J
220
A-0
.81
0.00
0.65
0.48
0.65
*0.
120.
110.
100.
020.
000.
48*
-0.1
9-0
.21
-0.1
8J
221
C-1
.44
0.00
0.78
0.66
0.09
0.10
0.78
*0.
020.
010.
00-0
.35
-0.3
20.
66*
-0.2
2J
222
B0.
240.
000.
370.
160.
260.
37*
0.21
0.14
0.02
0.00
-0.0
20.
16*
-0.1
10.
06?
J22
3C
-0.9
80.
000.
690.
480.
090.
080.
69*
0.13
0.02
0.00
-0.2
7-0
.29
0.48
*-0
.07
J22
4B
-0.9
40.
000.
680.
470.
200.
68*
0.07
0.04
0.02
0.00
-0.1
50.
47*
-0.2
4-0
.29
J22
5C
-1.2
10.
000.
740.
530.
060.
090.
74*
0.10
0.02
0.00
-0.3
1-0
.27
0.53
*-0
.14
J22
6A
-0.4
30.
000.
550.
490.
55*
0.26
0.10
0.07
0.02
0.00
0.49
*-0
.14
-0.2
9-0
.20
J22
7B
-1.3
20.
000.
760.
580.
070.
76*
0.09
0.07
0.02
0.00
-0.3
20.
58*
-0.2
7-0
.18
J22
8A
-1.1
50.
000.
730.
560.
73*
0.09
0.10
0.07
0.02
0.00
0.56
*-0
.24
-0.2
6-0
.24
J 10
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)W
74C
-1.5
50.
000.
780.
390.
030.
060.
78*
0.14
0.00
0.00
-0.2
3-0
.29
0.39
*-0
.16
W75
D0.
780.
000.
370.
270.
190.
300.
130.
37*
0.01
0.00
0.01
?-0
.12
-0.2
40.
27*
W76
C-0
.41
0.00
0.59
0.37
0.06
0.16
0.59
*0.
180.
000.
00-0
.27
-0.2
60.
37*
-0.0
5W
77B
-0.8
50.
000.
670.
490.
160.
67*
0.04
0.13
0.00
0.00
-0.2
80.
49*
-0.2
7-0
.22
W78
A-1
.25
0.00
0.74
0.42
0.74
*0.
060.
090.
110.
010.
000.
42*
-0.2
6-0
.17
-0.2
4W
79A
-1.7
20.
000.
800.
420.
80*
0.06
0.07
0.07
0.00
0.00
0.42
*-0
.26
-0.1
9-0
.22
W80
C-0
.27
0.00
0.57
0.39
0.06
0.16
0.57
*0.
200.
010.
00-0
.19
-0.2
90.
39*
-0.1
0W
81A
-1.0
10.
000.
700.
420.
70*
0.16
0.11
0.04
0.00
0.00
0.42
*-0
.34
-0.0
8-0
.22
W82
C-1
.10
0.00
0.71
0.26
0.03
0.13
0.71
*0.
130.
000.
00-0
.20
-0.0
40.
26*
-0.2
0W
83D
-0.6
40.
000.
640.
330.
050.
070.
240.
64*
0.00
0.00
-0.3
0-0
.35
0.01
?0.
33*
W84
B0.
710.
000.
390.
190.
340.
39*
0.03
0.24
0.00
0.00
-0.0
80.
19*
-0.2
7-0
.02
W85
A-0
.87
0.00
0.67
0.33
0.67
*0.
250.
040.
040.
000.
000.
33*
-0.1
2-0
.27
-0.2
6W
86D
-2.2
20.
000.
860.
550.
030.
040.
080.
86*
0.00
0.00
-0.2
7-0
.30
-0.3
30.
55*
W87
B-1
.21
0.00
0.73
0.38
0.08
0.73
*0.
120.
070.
000.
00-0
.27
0.38
*-0
.07
-0.2
8W
88B
-0.1
70.
000.
550.
370.
240.
55*
0.07
0.13
0.00
0.00
-0.2
40.
37*
-0.3
00.
00W
89D
-1.8
40.
000.
810.
500.
030.
070.
090.
81*
0.00
0.00
-0.2
9-0
.21
-0.3
20.
50*
W90
D-0
.33
0.00
0.58
0.43
0.23
0.07
0.12
0.58
*0.
000.
00-0
.22
-0.2
6-0
.17
0.43
*W
91A
-1.1
20.
000.
720.
480.
72*
0.11
0.11
0.06
0.00
0.00
0.48
*-0
.27
-0.2
6-0
.21
W92
C-0
.72
0.00
0.65
0.41
0.15
0.12
0.65
*0.
080.
000.
00-0
.21
-0.2
50.
41*
-0.1
4W
93B
0.20
0.00
0.48
0.25
0.10
0.48
*0.
370.
050.
000.
00-0
.21
0.25
*-0
.04
-0.1
9W
94C
0.14
0.00
0.49
0.28
0.22
0.24
0.49
*0.
050.
010.
00-0
.19
-0.0
40.
28*
-0.1
9W
95D
-0.7
30.
000.
650.
150.
230.
050.
060.
65*
0.00
0.00
0.15
?-0
.31
-0.2
50.
15*
W96
B-0
.45
0.00
0.60
0.22
0.22
0.60
*0.
150.
030.
000.
00-0
.04
0.22
*-0
.14
-0.2
4W
97A
-1.3
10.
000.
740.
440.
74*
0.07
0.06
0.12
0.00
0.00
0.44
*-0
.27
-0.3
3-0
.12
W98
D-0
.09
0.00
0.54
0.33
0.06
0.16
0.24
0.54
*0.
000.
00-0
.24
-0.1
6-0
.10
0.33
*W
99B
0.42
0.00
0.44
0.28
0.20
0.44
*0.
280.
080.
000.
00-0
.16
0.28
*-0
.04
-0.1
9W
100
C-0
.02
0.00
0.52
0.31
0.27
0.14
0.52
*0.
060.
010.
00-0
.08
-0.2
10.
31*
-0.1
9W
101
A0.
640.
000.
400.
310.
40*
0.11
0.16
0.32
0.00
0.00
0.31
*-0
.22
-0.1
7-0
.03
W10
2B
-0.2
30.
000.
560.
280.
150.
56*
0.12
0.17
0.00
0.00
-0.1
70.
28*
-0.1
8-0
.05
W10
3C
-0.9
30.
000.
680.
540.
040.
160.
68*
0.12
0.00
0.00
-0.2
9-0
.36
0.54
*-0
.19
W10
4A
-2.0
00.
000.
830.
570.
83*
0.06
0.06
0.05
0.00
0.00
0.57
*-0
.32
-0.3
3-0
.27
W10
5C
-1.6
90.
000.
800.
530.
060.
060.
80*
0.09
0.00
0.00
-0.2
9-0
.32
0.53
*-0
.23
W10
6C
-0.9
50.
000.
690.
350.
210.
060.
69*
0.04
0.00
0.00
-0.1
3-0
.24
0.35
*-0
.25
W10
7A
-1.0
30.
000.
700.
420.
70*
0.05
0.13
0.12
0.00
0.00
0.42
*-0
.30
-0.2
2-0
.16
W10
8A
-0.8
90.
000.
680.
440.
68*
0.05
0.11
0.16
0.00
0.00
0.44
*-0
.30
-0.1
5-0
.24
W10
9D
-0.1
50.
000.
550.
510.
200.
130.
120.
55*
0.01
0.00
-0.2
1-0
.29
-0.2
20.
51*
W11
0B
-0.2
40.
000.
560.
290.
260.
56*
0.09
0.09
0.00
0.00
-0.0
60.
29*
-0.2
7-0
.14
W11
1C
0.14
0.00
0.49
0.40
0.33
0.09
0.49
*0.
080.
000.
00-0
.14
-0.2
20.
40*
-0.2
4W
112
B-1
.42
0.00
0.76
0.45
0.04
0.76
*0.
070.
130.
000.
00-0
.29
0.45
*-0
.28
-0.1
7W
113
D-1
.84
0.00
0.81
0.51
0.09
0.05
0.05
0.81
*0.
000.
00-0
.25
-0.2
9-0
.27
0.51
*
J 11
Ap
pen
dix
J:
2001
Gra
de
Ele
ven
Item
An
alys
isM
ult
iple
Ch
oic
e It
ems
for
Rea
din
g
Fo
rmS
equ
ence
Key
Lo
git
SE
CP
-Val
ue
PtB
is C
orr
%A
%B
%C
%D
Bla
nk
Inva
lidR
(A)
R(B
)R
(C)
R(D
)W
115
D0.
010.
000.
520.
190.
110.
050.
330.
52*
0.00
0.00
-0.1
8-0
.28
0.05
?0.
19*
W11
6C
0.08
0.00
0.50
0.32
0.10
0.25
0.50
*0.
140.
010.
00-0
.19
-0.2
50.
32*
0.02
?W
117
D-1
.22
0.00
0.73
0.31
0.11
0.11
0.05
0.73
*0.
000.
00-0
.17
-0.1
2-0
.22
0.31
*W
118
A0.
730.
000.
380.
320.
38*
0.33
0.16
0.13
0.00
0.00
0.32
*-0
.10
-0.2
2-0
.07
W11
9D
0.04
0.00
0.51
0.36
0.14
0.17
0.17
0.51
*0.
000.
00-0
.19
-0.1
4-0
.17
0.36
*W
120
C-0
.66
0.00
0.64
0.35
0.07
0.09
0.64
*0.
190.
000.
00-0
.29
-0.2
40.
35*
-0.0
5W
121
A0.
240.
000.
470.
200.
47*
0.27
0.21
0.05
0.00
0.00
0.20
*0.
06?
-0.1
9-0
.21
W12
2B
-0.3
10.
000.
580.
360.
190.
58*
0.12
0.12
0.00
0.00
-0.0
60.
36*
-0.3
6-0
.12
W12
3A
-0.1
30.
000.
540.
290.
54*
0.34
0.08
0.04
0.00
0.00
0.29
*-0
.12
-0.1
9-0
.19
W12
4A
-0.6
90.
000.
640.
510.
64*
0.09
0.15
0.11
0.00
0.00
0.51
*-0
.29
-0.2
7-0
.19
W12
5A
-2.1
20.
000.
850.
520.
85*
0.06
0.07
0.03
0.00
0.00
0.52
*-0
.28
-0.3
2-0
.24
W12
6B
0.65
0.00
0.40
0.10
0.21
0.40
*0.
290.
100.
000.
00-0
.05
0.10
*0.
08?
-0.2
0W
127
C-0
.12
0.00
0.54
0.27
0.24
0.11
0.54
*0.
110.
000.
00-0
.09
-0.2
10.
27*
-0.0
9W
128
A0.
120.
000.
500.
360.
50*
0.20
0.17
0.13
0.00
0.00
0.36
*-0
.10
-0.2
6-0
.12
W12
9B
-1.2
80.
000.
740.
430.
030.
74*
0.14
0.09
0.00
0.00
-0.2
70.
43*
-0.2
2-0
.22
W13
0D
-1.8
30.
000.
810.
570.
080.
040.
070.
81*
0.00
0.00
-0.3
4-0
.31
-0.2
70.
57*
W13
1B
-1.6
90.
000.
800.
460.
060.
80*
0.10
0.05
0.00
0.00
-0.3
00.
46*
-0.2
7-0
.17
W13
2B
-0.3
40.
000.
580.
260.
230.
58*
0.14
0.04
0.00
0.00
-0.0
90.
26*
-0.1
3-0
.21
W13
3D
-0.9
80.
000.
690.
420.
100.
090.
110.
69*
0.00
0.00
-0.1
9-0
.24
-0.2
00.
42*
W13
4C
0.06
0.00
0.51
0.21
0.10
0.20
0.51
*0.
190.
000.
00-0
.20
-0.1
10.
21*
0.00
?W
135
D-0
.65
0.00
0.64
0.58
0.11
0.16
0.09
0.64
*0.
000.
00-0
.24
-0.3
6-0
.24
0.58
*W
136
D1.
150.
000.
310.
020.
500.
120.
070.
31*
0.00
0.00
0.13
?-0
.09
-0.1
60.
02*
W13
7C
-0.6
20.
000.
630.
480.
090.
160.
63*
0.12
0.00
0.00
-0.2
3-0
.20
0.48
*-0
.28
W13
8A
-0.4
10.
000.
600.
490.
60*
0.20
0.08
0.12
0.00
0.00
0.49
*-0
.26
-0.2
6-0
.19
W13
9B
-0.9
30.
000.
690.
520.
070.
69*
0.09
0.15
0.00
0.00
-0.2
80.
52*
-0.3
0-0
.23
W14
0C
0.43
0.00
0.44
0.18
0.10
0.31
0.44
*0.
150.
000.
00-0
.25
0.06
?0.
18*
-0.1
0W
141
B0.
360.
000.
450.
340.
080.
45*
0.16
0.30
0.01
0.00
-0.3
00.
34*
-0.0
9-0
.11
W14
2D
0.16
0.00
0.49
0.28
0.22
0.24
0.05
0.49
*0.
000.
00-0
.19
0.01
?-0
.30
0.28
*W
143
C-0
.35
0.00
0.58
0.28
0.07
0.16
0.58
*0.
180.
000.
00-0
.22
-0.2
10.
28*
0.00
?W
144
A-1
.16
0.00
0.72
0.50
0.72
*0.
050.
050.
170.
000.
000.
50*
-0.2
8-0
.25
-0.2
7W
145
B-0
.04
0.00
0.53
0.32
0.34
0.53
*0.
080.
050.
000.
00-0
.09
0.32
*-0
.22
-0.2
5W
146
A-0
.57
0.00
0.62
0.46
0.62
*0.
280.
050.
050.
000.
000.
46*
-0.2
1-0
.31
-0.2
6W
147
B-0
.50
0.00
0.61
0.35
0.09
0.61
*0.
270.
030.
000.
00-0
.32
0.35
*-0
.09
-0.2
2W
148
D-0
.31
0.00
0.58
0.47
0.10
0.23
0.09
0.58
*0.
000.
00-0
.26
-0.1
6-0
.29
0.47
*W
149
C-1
.22
0.00
0.73
0.46
0.06
0.14
0.73
*0.
070.
000.
00-0
.29
-0.2
20.
46*
-0.2
1W
150
B0.
460.
000.
430.
230.
080.
43*
0.07
0.42
0.00
0.00
-0.2
20.
23*
-0.2
50.
03?
W15
1B
-1.3
20.
000.
750.
460.
160.
75*
0.06
0.03
0.00
0.00
-0.2
10.
46*
-0.3
0-0
.26
W15
2C
-0.7
30.
000.
650.
460.
100.
120.
65*
0.13
0.00
0.00
-0.3
0-0
.20
0.46
*-0
.18
W15
3D
-0.0
40.
000.
530.
470.
100.
170.
210.
53*
0.00
0.00
-0.2
8-0
.17
-0.2
10.
47*
W15
4A
0.18
0.00
0.48
0.21
0.48
*0.
080.
070.
360.
010.
000.
21*
-0.3
1-0
.32
0.14
?
J 12
Ap
pen
dix
K:
2001
PS
SA
Gra
de
Fiv
e T
ask
An
alys
isO
pen
En
ded
Tas
ks f
or
Rea
din
g
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Z
ero
%
On
e%
T
wo
%
Th
ree
%
Fo
ur
R(0
)R
(1)
R(2
)R
(3)
R(4
)A
185
1-2
.89
2.01
0.58
0.04
0.20
0.49
0.23
0.03
-0.2
9-0
.37
0.07
0.35
0.19
2-1
.13
31.
054
2.77
B18
51
-3.3
01.
910.
510.
030.
240.
520.
180.
02-0
.28
-0.3
40.
140.
290.
132
-0.9
73
1.42
43.
27C
185
1-3
.74
1.94
0.52
0.02
0.27
0.46
0.23
0.02
-0.2
5-0
.37
0.11
0.32
0.14
2-0
.76
31.
074
3.39
D18
51
-2.8
92.
000.
550.
040.
200.
500.
230.
03-0
.30
-0.3
50.
080.
330.
162
-1.1
43
1.11
42.
91E
185
1-3
.25
1.92
0.53
0.03
0.25
0.50
0.19
0.02
-0.2
8-0
.37
0.15
0.31
0.14
2-0
.91
31.
304
3.15
F18
51
-3.6
42.
050.
580.
020.
170.
560.
240.
02-0
.26
-0.4
60.
110.
340.
132
-1.4
83
1.17
43.
69G
185
1-3
.07
2.15
0.60
0.03
0.11
0.54
0.30
0.02
-0.3
1-0
.42
0.01
0.38
0.12
2-1
.85
30.
824
3.82
H18
51
-3.6
32.
070.
560.
020.
150.
580.
240.
01-0
.26
-0.4
40.
090.
330.
122
-1.6
73
1.13
43.
80
K 1
Ap
pen
dix
K:
2001
PS
SA
Gra
de
Fiv
e T
ask
An
alys
isO
pen
En
ded
Tas
ks f
or
Rea
din
g
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Z
ero
%
On
e%
T
wo
%
Th
ree
%
Fo
ur
R(0
)R
(1)
R(2
)R
(3)
R(4
)
I185
1-2
.92
2.09
0.61
0.04
0.13
0.54
0.28
0.01
-0.3
2-0
.44
0.07
0.38
0.11
2-1
.65
30.
924
4.30
J185
1-3
.52
2.07
0.59
0.02
0.15
0.56
0.25
0.01
-0.2
8-0
.47
0.11
0.34
0.11
2-1
.61
31.
074
3.66
W10
01
-3.6
91.
870.
540.
020.
280.
520.
180.
01-0
.27
-0.4
10.
180.
330.
112
-0.8
43
1.47
43.
99W
127
1-3
.40
1.79
0.57
0.03
0.33
0.47
0.17
0.01
-0.3
1-0
.41
0.22
0.35
0.10
2-0
.53
31.
484
4.25
K 2
Ap
pen
dix
L:
2001
PS
SA
Gra
de
Eig
ht
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r R
ead
ing
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Z
ero
%
On
e%
T
wo
%
Th
ree
%
Fo
ur
R(0
)R
(1)
R(2
)R
(3)
R(4
)A
215
1-1
.63
1.69
0.68
0.12
0.26
0.43
0.17
0.02
-0.5
4-0
.24
0.28
0.36
0.14
2-0
.46
31.
524
3.65
B21
51
-1.0
81.
490.
700.
170.
290.
400.
120.
01-0
.56
-0.1
80.
370.
350.
122
-0.1
93
1.88
43.
92C
215
1-1
.69
1.70
0.68
0.11
0.26
0.44
0.17
0.02
-0.5
3-0
.24
0.28
0.35
0.15
2-0
.48
31.
554
3.52
D21
51
-1.2
11.
510.
700.
170.
290.
400.
130.
01-0
.56
-0.1
80.
370.
340.
112
-0.2
03
1.80
43.
75E
215
1-1
.60
1.70
0.69
0.12
0.25
0.43
0.18
0.01
-0.5
4-0
.24
0.27
0.38
0.13
2-0
.55
31.
504
3.82
F21
51
-1.7
31.
510.
620.
120.
360.
380.
120.
01-0
.47
-0.2
00.
310.
310.
102
0.06
31.
864
3.97
G21
51
-1.8
51.
710.
640.
100.
260.
470.
150.
01-0
.45
-0.2
90.
280.
340.
132
-0.5
93
1.70
43.
48H
215
1-1
.77
1.48
0.61
0.12
0.39
0.38
0.11
0.01
-0.4
5-0
.21
0.34
0.30
0.09
20.
183
2.09
44.
31
L 3
Ap
pen
dix
L:
2001
PS
SA
Gra
de
Eig
ht
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r R
ead
ing
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Z
ero
%
On
e%
T
wo
%
Th
ree
%
Fo
ur
R(0
)R
(1)
R(2
)R
(3)
R(4
)
I215
1-1
.93
1.75
0.65
0.09
0.25
0.47
0.17
0.02
-0.4
7-0
.30
0.27
0.35
0.14
2-0
.64
31.
644
3.49
J215
1-1
.79
1.50
0.61
0.12
0.38
0.38
0.11
0.01
-0.4
5-0
.20
0.31
0.31
0.09
20.
123
1.99
44.
18W
110
1-2
.94
1.98
0.60
0.05
0.18
0.53
0.23
0.02
-0.3
8-0
.37
0.11
0.36
0.14
2-1
.25
31.
334
3.79
W14
71
-1.7
41.
730.
660.
120.
270.
400.
200.
02-0
.49
-0.3
00.
220.
400.
142
-0.3
83
1.25
43.
75
L 4
Ap
pen
dix
M:
2001
PS
SA
Gra
de
Ele
ven
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r R
ead
ing
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Z
ero
%
On
e%
T
wo
%
Th
ree
%
Fo
ur
R(0
)R
(1)
R(2
)R
(3)
R(4
)A
229
1-0
.96
1.78
0.66
0.16
0.18
0.39
0.23
0.03
-0.4
8-0
.22
0.16
0.40
0.19
2-0
.73
30.
994
3.07
B22
91
-1.0
31.
760.
700.
160.
210.
340.
230.
04-0
.54
-0.2
10.
190.
400.
222
-0.4
53
0.91
42.
70C
229
1-1
.18
1.94
0.68
0.12
0.15
0.38
0.29
0.04
-0.4
7-0
.26
0.08
0.43
0.21
2-1
.01
30.
654
3.15
D22
91
-0.9
41.
760.
670.
160.
190.
380.
230.
03-0
.49
-0.2
30.
170.
400.
202
-0.6
83
1.07
43.
17E
229
1-0
.87
1.79
0.70
0.16
0.19
0.36
0.24
0.05
-0.5
4-0
.19
0.17
0.40
0.23
2-0
.62
30.
904
2.74
F22
91
-1.7
51.
800.
630.
100.
220.
460.
190.
03-0
.40
-0.3
00.
190.
360.
182
-0.8
33
1.49
43.
13G
229
1-0
.97
1.60
0.65
0.18
0.25
0.34
0.19
0.03
-0.4
6-0
.21
0.24
0.37
0.19
2-0
.21
31.
204
3.03
H22
91
-1.5
61.
830.
640.
110.
200.
460.
200.
03-0
.43
-0.3
10.
200.
350.
182
-0.9
13
1.39
43.
09
M 5
Ap
pen
dix
M:
2001
PS
SA
Gra
de
Ele
ven
Tas
k A
nal
ysis
Op
en E
nd
ed T
asks
fo
r R
ead
ing
Po
siti
on
Ste
pL
og
itT
ask
Mea
nC
orr
e-la
tio
n%
Z
ero
%
On
e%
T
wo
%
Th
ree
%
Fo
ur
R(0
)R
(1)
R(2
)R
(3)
R(4
)
I229
1-0
.84
1.48
0.63
0.20
0.28
0.34
0.15
0.02
-0.4
8-0
.15
0.29
0.34
0.16
2-0
.06
31.
514
3.30
J229
1-1
.65
1.85
0.65
0.10
0.20
0.46
0.20
0.03
-0.4
4-0
.30
0.21
0.34
0.20
2-0
.93
31.
384
2.82
W11
41
-1.6
52.
220.
680.
090.
120.
330.
400.
06-0
.42
-0.3
7-0
.09
0.46
0.25
2-1
.25
30.
034
2.77
W15
51
-2.0
22.
100.
630.
080.
140.
450.
280.
06-0
.42
-0.3
40.
020.
360.
232
-1.3
83
0.80
42.
56
M 6
Ap
pen
dix
N:
2001
PS
SA
Gra
de
Fiv
e A
cro
ss Y
ear
Lin
kin
g
Gra
de
5 R
ead
ing
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ceP
20
00P
20
01L
og
it*
2001
Item
20
0120
00
log
it20
01
log
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
G13
3-1
.94
-1.9
5-0
.73
0.90
0.87
-1.2
1A
155
-1.5
8-1
.99
-0.3
50.
870.
85-1
.23
E14
1-1
.14
-1.2
8-0
.60
0.81
0.74
-0.5
4C
161
-0.9
8-1
.69
-0.0
50.
810.
81-0
.93
I127
-1.8
8-2
.08
-0.5
40.
890.
88-1
.34
D16
4-0
.94
-1.3
2-0
.38
0.81
0.75
-0.5
6G
134
-0.9
0-1
.12
-0.5
20.
770.
72-0
.38
A15
4-0
.85
-1.2
8-0
.33
0.78
0.75
-0.5
2B
131
-1.9
7-2
.20
-0.5
10.
900.
89-1
.46
A15
8-0
.71
-1.3
6-0
.11
0.76
0.76
-0.6
0B
140
-0.5
7-0
.80
-0.5
10.
710.
65-0
.06
A17
9-0
.57
-1.5
90.
260.
730.
79-0
.83
J139
-0.9
3-1
.18
-0.4
90.
780.
72-0
.44
C17
3-0
.48
-1.3
00.
060.
740.
75-0
.54
F12
7-1
.25
-1.5
1-0
.48
0.82
0.78
-0.7
7A
178
-0.4
3-1
.22
0.03
0.71
0.74
-0.4
6D
129
-1.2
7-1
.54
-0.4
70.
820.
81-0
.80
C17
5-0
.42
-1.4
70.
290.
730.
78-0
.71
I136
0.20
-0.0
9-0
.45
0.57
0.46
0.65
B15
8-0
.41
-0.8
6-0
.31
0.73
0.67
-0.1
0I1
370.
820.
50-0
.42
0.44
0.35
1.24
D15
9-0
.24
-1.1
80.
180.
700.
73-0
.42
J128
-2.3
4-2
.67
-0.4
10.
930.
92-1
.93
B17
5-0
.20
-0.7
5-0
.21
0.69
0.65
0.01
A13
4-0
.61
-0.9
8-0
.37
0.72
0.68
-0.2
4C
163
-0.1
3-0
.92
0.03
0.68
0.68
-0.1
6J1
29-0
.30
-0.7
0-0
.34
0.67
0.62
0.04
B18
2-0
.12
-0.6
6-0
.22
0.68
0.63
0.10
D12
7-1
.16
-1.5
7-0
.33
0.80
0.81
-0.8
3C
171
-0.1
2-0
.69
-0.1
90.
680.
640.
07F
134
-1.2
1-1
.64
-0.3
10.
810.
80-0
.90
D17
1-0
.10
-1.1
10.
250.
670.
72-0
.35
E13
1-1
.23
-1.6
7-0
.30
0.82
0.83
-0.9
3D
183
0.06
-0.6
0-0
.10
0.64
0.62
0.16
A13
1-1
.22
-1.6
7-0
.29
0.81
0.82
-0.9
3C
176
0.16
-0.8
50.
250.
630.
67-0
.09
D13
0-0
.78
-1.2
4-0
.28
0.75
0.75
-0.5
0A
156
0.18
-0.3
0-0
.28
0.60
0.56
0.46
B13
5-0
.92
-1.3
9-0
.27
0.77
0.76
-0.6
5C
174
0.25
-0.6
80.
170.
610.
640.
08H
134
-0.7
9-1
.26
-0.2
70.
760.
74-0
.52
D16
60.
29-0
.47
0.00
0.60
0.59
0.29
E13
0-0
.82
-1.3
2-0
.24
0.76
0.77
-0.5
8C
160
0.72
-0.2
40.
200.
510.
550.
52C
129
-0.2
3-0
.74
-0.2
30.
660.
630.
00A
181
1.00
0.39
-0.1
50.
430.
411.
15E
129
-0.8
8-1
.40
-0.2
20.
770.
78-0
.66
B16
51.
120.
120.
240.
420.
470.
88C
130
-0.4
4-0
.96
-0.2
20.
700.
68-0
.22
B18
01.
600.
560.
280.
330.
381.
32E
127
0.00
-0.5
2-0
.22
0.61
0.58
0.22
A16
21.
970.
880.
330.
250.
311.
64
E13
3-0
.39
-0.9
2-0
.21
0.69
0.68
-0.1
8C
133
-1.3
5-1
.90
-0.1
90.
840.
84-1
.16
D12
8-0
.18
-0.7
3-0
.19
0.64
0.63
0.01
D13
1-2
.07
-2.6
2-0
.19
0.90
0.92
-1.8
8
Gra
de
5 M
ath
N 1
Ap
pen
dix
N:
2001
PS
SA
Gra
de
Fiv
e A
cro
ss Y
ear
Lin
kin
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ceP
20
00P
20
01L
og
it*
2001
Item
20
0120
00
log
it20
01
log
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
G13
0-0
.60
-1.1
6-0
.18
0.72
0.73
-0.4
2F
137
0.24
-0.3
3-0
.17
0.56
0.54
0.41
A12
9-0
.51
-1.0
8-0
.17
0.70
0.70
-0.3
4I1
33-1
.88
-2.4
7-0
.15
0.89
0.91
-1.7
3B
137
-0.7
3-1
.33
-0.1
40.
740.
75-0
.59
J131
-0.4
5-1
.06
-0.1
30.
700.
70-0
.32
W06
6-0
.68
-1.3
0-0
.12
0.73
0.75
-0.5
6H
137
-0.5
3-1
.16
-0.1
10.
710.
71-0
.42
C14
00.
22-0
.41
-0.1
10.
570.
560.
33J1
350.
23-0
.40
-0.1
10.
570.
560.
34G
127
-0.5
4-1
.18
-0.1
00.
710.
73-0
.44
G13
50.
05-0
.59
-0.1
00.
600.
580.
15J1
30-0
.85
-1.5
0-0
.09
0.77
0.78
-0.7
6G
140
0.84
0.18
-0.0
80.
440.
420.
92E
128
-0.0
7-0
.73
-0.0
80.
620.
630.
01G
128
-0.4
2-1
.08
-0.0
80.
690.
71-0
.34
A13
0-0
.73
-1.4
0-0
.07
0.74
0.76
-0.6
6C
135
-0.4
8-1
.15
-0.0
70.
700.
71-0
.41
A13
2-0
.04
-0.7
1-0
.07
0.61
0.63
0.03
F13
50.
10-0
.58
-0.0
60.
590.
560.
16B
129
-1.1
8-1
.86
-0.0
60.
810.
84-1
.12
D13
20.
43-0
.26
-0.0
50.
510.
520.
48H
132
-0.1
3-0
.83
-0.0
40.
640.
63-0
.09
H13
60.
13-0
.57
-0.0
40.
590.
590.
17E
132
0.24
-0.4
8-0
.02
0.56
0.56
0.26
F13
2-0
.01
-0.7
3-0
.02
0.61
0.60
0.01
D13
70.
46-0
.26
-0.0
20.
510.
500.
48E
135
1.15
0.41
0.00
0.37
0.34
1.15
G13
1-0
.43
-1.1
70.
000.
690.
73-0
.43
G12
9-0
.60
-1.3
40.
000.
720.
77-0
.60
E13
8-0
.27
-1.0
20.
010.
660.
69-0
.28
N 2
Ap
pen
dix
N:
2001
PS
SA
Gra
de
Fiv
e A
cro
ss Y
ear
Lin
kin
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ceP
20
00P
20
01L
og
it*
2001
Item
20
0120
00
log
it20
01
log
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
B13
20.
06-0
.70
0.02
0.59
0.58
0.04
D13
90.
41-0
.35
0.02
0.52
0.53
0.39
I129
-0.2
2-0
.98
0.02
0.65
0.67
-0.2
4D
135
0.58
-0.1
80.
020.
480.
500.
56G
132
0.43
-0.3
30.
020.
520.
510.
41H
130
-0.5
3-1
.29
0.02
0.71
0.74
-0.5
5I1
391.
460.
700.
020.
310.
311.
44F
136
-0.1
1-0
.88
0.03
0.63
0.66
-0.1
4H
140
0.05
-0.7
30.
040.
600.
610.
01D
134
0.68
-0.1
10.
050.
460.
490.
63H
131
-1.2
1-2
.01
0.06
0.82
0.86
-1.2
7F
129
-1.5
9-2
.39
0.06
0.86
0.90
-1.6
5F
133
0.49
-0.3
10.
060.
510.
480.
43C
136
0.04
-0.7
90.
090.
610.
62-0
.05
C13
90.
78-0
.06
0.10
0.45
0.48
0.68
G13
60.
890.
050.
100.
430.
450.
79B
138
0.80
-0.0
40.
100.
440.
470.
70H
127
-0.4
5-1
.30
0.11
0.70
0.75
-0.5
6F
128
-0.1
3-0
.99
0.12
0.63
0.67
-0.2
5D
136
1.11
0.21
0.16
0.38
0.38
0.95
B12
70.
19-0
.72
0.17
0.57
0.63
0.02
B13
6-0
.05
-0.9
60.
170.
610.
65-0
.22
B13
40.
04-0
.87
0.17
0.59
0.62
-0.1
3A
140
0.43
-0.5
00.
190.
510.
580.
24J1
34-0
.61
-1.5
40.
190.
730.
80-0
.80
C12
7-1
.04
-2.0
10.
230.
800.
86-1
.27
J132
-0.2
3-1
.20
0.23
0.66
0.73
-0.4
6F
131
0.68
-0.2
90.
230.
460.
480.
45I1
28-0
.17
-1.1
50.
240.
640.
71-0
.41
F14
10.
75-0
.23
0.24
0.45
0.52
0.51
B14
10.
93-0
.06
0.25
0.41
0.40
0.68
N 3
Ap
pen
dix
N:
2001
PS
SA
Gra
de
Fiv
e A
cro
ss Y
ear
Lin
kin
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ceP
20
00P
20
01L
og
it*
2001
Item
20
0120
00
log
it20
01
log
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
C13
40.
75-0
.26
0.27
0.46
0.47
0.48
I135
0.35
-0.6
60.
270.
540.
590.
08W
020
0.82
-0.2
10.
290.
440.
460.
53A
135
0.59
-0.4
40.
290.
480.
540.
30H
139
-0.1
8-1
.21
0.29
0.65
0.73
-0.4
7C
137
0.75
-0.2
80.
290.
460.
480.
46E
140
1.42
0.37
0.31
0.32
0.35
1.11
C13
80.
76-0
.30
0.32
0.46
0.48
0.44
J140
0.15
-0.9
20.
330.
590.
67-0
.18
D14
10.
65-0
.43
0.34
0.47
0.55
0.31
W06
10.
27-0
.85
0.38
0.56
0.64
-0.1
1J1
371.
16-0
.01
0.43
0.38
0.41
0.73
G13
90.
24-0
.94
0.44
0.56
0.67
-0.2
0F
140
1.77
0.57
0.46
0.26
0.28
1.31
J141
0.07
-1.2
30.
560.
600.
73-0
.49
B13
3-0
.04
-1.3
60.
580.
610.
74-0
.62
A13
70.
99-0
.40
0.65
0.39
0.53
0.34
I138
0.46
-0.9
80.
700.
510.
56-0
.24
A13
60.
92-0
.60
0.78
0.41
0.60
0.14
J138
1.40
-0.1
30.
790.
330.
440.
61C
128
-0.9
8-2
.69
0.97
0.79
0.92
-1.9
5
N 4
Ap
pen
dix
O:
2001
PS
SA
Gra
de
Eig
ht
Acr
oss
Yea
r L
inki
ng
Gra
de
8 M
ath
emat
ics
G
rad
e 8
Rea
din
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
C13
4-0
.83
-0.4
0-0
.43
0.72
0.57
-0.4
0B
181
-1.3
6-2
.07
0.71
0.86
0.84
-2.0
7H
141
-1.2
2-0
.88
-0.3
40.
780.
69-0
.88
C16
0-1
.28
-2.1
90.
910.
840.
85-2
.19
A13
0-0
.75
-0.4
6-0
.29
0.70
0.59
-0.4
6A
161
-1.0
9-2
.05
0.96
0.82
0.84
-2.0
5A
139
-1.5
0-1
.40
-0.1
00.
820.
80-1
.40
B17
2-1
.01
-1.2
20.
210.
820.
73-1
.22
F13
9-0
.61
-0.5
1-0
.10
0.68
0.56
-0.5
1C
158
-0.7
5-1
.49
0.74
0.77
0.77
-1.4
9B
127
-1.3
1-1
.27
-0.0
40.
790.
78-1
.27
D15
4-0
.72
-1.4
00.
680.
770.
76-1
.40
E12
80.
050.
06-0
.01
0.55
0.45
0.06
C16
5-0
.57
-1.3
90.
820.
740.
76-1
.39
W04
7-0
.56
-0.5
60.
000.
670.
61-0
.56
A15
5-0
.53
-1.1
90.
660.
740.
73-1
.19
H12
8-1
.54
-1.5
40.
000.
820.
82-1
.54
A17
4-0
.37
-1.0
20.
650.
710.
70-1
.02
W01
2-0
.33
-0.3
70.
040.
630.
57-0
.37
D18
3-0
.37
-1.0
80.
710.
710.
71-1
.08
E13
50.
440.
400.
040.
470.
370.
40A
160
-0.3
4-0
.77
0.43
0.71
0.66
-0.7
7W
017
-0.2
3-0
.30
0.07
0.61
0.53
-0.3
0C
180
-0.3
4-0
.96
0.62
0.70
0.69
-0.9
6W
037
-1.2
2-1
.33
0.11
0.78
0.78
-1.3
3C
171
-0.2
8-0
.36
0.08
0.69
0.59
-0.3
6W
011
-1.5
8-1
.70
0.12
0.83
0.85
-1.7
0B
178
-0.2
4-0
.07
-0.1
70.
700.
54-0
.07
E13
1-0
.74
-0.8
60.
120.
700.
69-0
.86
A17
5-0
.18
-0.8
30.
650.
680.
67-0
.83
W01
5-1
.12
-1.2
50.
130.
770.
77-1
.25
D18
0-0
.15
-0.6
10.
460.
670.
63-0
.61
F13
4-1
.72
-1.8
50.
130.
850.
87-1
.85
A15
8-0
.09
-0.4
70.
380.
660.
61-0
.47
W01
6-0
.75
-0.9
00.
150.
700.
67-0
.90
D16
6-0
.05
-0.4
80.
430.
650.
61-0
.48
H12
9-0
.89
-1.0
40.
150.
730.
71-1
.04
B15
60.
03-0
.64
0.67
0.65
0.64
-0.6
4W
013
-0.9
3-1
.09
0.16
0.74
0.72
-1.0
9A
157
0.04
-0.5
80.
620.
640.
63-0
.58
C13
9-0
.66
-0.8
30.
170.
690.
68-0
.83
C15
50.
24-0
.38
0.62
0.58
0.59
-0.3
8C
136
-0.3
0-0
.47
0.17
0.63
0.59
-0.4
7C
163
0.34
-0.3
70.
710.
560.
59-0
.37
A12
8-0
.47
-0.6
40.
170.
650.
63-0
.64
A17
90.
41-0
.34
0.75
0.56
0.59
-0.3
4G
138
-0.8
9-1
.06
0.17
0.74
0.73
-1.0
6D
182
0.49
-0.1
10.
600.
540.
54-0
.11
E13
6-1
.52
-1.7
00.
180.
820.
85-1
.70
C17
80.
51-0
.03
0.54
0.53
0.53
-0.0
3I1
27-1
.20
-1.3
90.
190.
790.
77-1
.39
A17
20.
55-0
.14
0.69
0.53
0.55
-0.1
4G
140
-0.3
2-0
.51
0.19
0.63
0.58
-0.5
1C
162
0.60
-0.1
30.
730.
510.
55-0
.13
J130
-0.9
0-1
.11
0.21
0.74
0.72
-1.1
1A
162
0.68
0.01
0.67
0.51
0.52
0.01
W00
9-0
.27
-0.4
90.
220.
620.
59-0
.49
B17
50.
82-0
.18
1.00
0.49
0.56
-0.1
8J1
32-0
.65
-0.8
70.
220.
700.
67-0
.87
A16
50.
860.
590.
270.
470.
410.
59E
129
-0.2
8-0
.51
0.23
0.62
0.60
-0.5
1C
172
1.05
0.79
0.26
0.41
0.38
0.79
O 5
Ap
pen
dix
O:
2001
PS
SA
Gra
de
Eig
ht
Acr
oss
Yea
r L
inki
ng
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
W03
10.
310.
070.
240.
500.
450.
07D
177
1.16
0.62
0.54
0.39
0.41
0.62
H13
7-1
.01
-1.2
50.
240.
740.
76-1
.25
D17
41.
231.
180.
050.
380.
311.
18W
062
-0.1
0-0
.34
0.24
0.59
0.56
-0.3
4B
183
1.25
0.65
0.60
0.37
0.40
0.65
E13
4-1
.80
-2.0
40.
240.
850.
87-2
.04
C16
41.
250.
610.
640.
400.
410.
61E
133
-0.4
2-0
.69
0.27
0.64
0.64
-0.6
9B
163
1.84
0.94
0.90
0.28
0.35
0.94
J131
-0.2
4-0
.51
0.27
0.62
0.57
-0.5
1F
127
-0.3
2-0
.60
0.28
0.63
0.59
-0.6
0W
022
0.10
-0.1
80.
280.
540.
49-0
.18
A13
10.
01-0
.27
0.28
0.56
0.53
-0.2
7J1
37-0
.59
-0.8
70.
280.
690.
67-0
.87
F13
8-0
.42
-0.7
10.
290.
650.
63-0
.71
G13
4-0
.73
-1.0
20.
290.
710.
69-1
.02
E13
90.
26-0
.04
0.30
0.51
0.47
-0.0
4D
141
-0.6
1-0
.91
0.30
0.68
0.68
-0.9
1J1
27-0
.51
-0.8
10.
300.
670.
65-0
.81
I130
-1.4
1-1
.72
0.31
0.81
0.82
-1.7
2A
141
0.09
-0.2
30.
320.
540.
51-0
.23
B13
3-1
.14
-1.4
60.
320.
770.
78-1
.46
W04
8-0
.85
-1.1
80.
330.
720.
73-1
.18
G13
7-0
.94
-1.2
70.
330.
740.
77-1
.27
W03
0-0
.65
-0.9
90.
340.
690.
70-0
.99
D13
3-0
.08
-0.4
20.
340.
580.
56-0
.42
F12
9-0
.42
-0.7
60.
340.
650.
64-0
.76
F13
6-1
.33
-1.6
80.
350.
800.
82-1
.68
F13
3-0
.38
-0.7
30.
350.
640.
63-0
.73
G13
9-0
.26
-0.6
10.
350.
620.
61-0
.61
H13
00.
530.
180.
350.
460.
370.
18W
008
-0.5
8-0
.94
0.36
0.68
0.69
-0.9
4D
132
-0.8
7-1
.23
0.36
0.73
0.75
-1.2
3F
132
-0.0
7-0
.43
0.36
0.58
0.56
-0.4
3I1
36-0
.45
-0.8
10.
360.
660.
65-0
.81
F13
5-1
.05
-1.4
20.
370.
760.
79-1
.42
O 6
Ap
pen
dix
O:
2001
PS
SA
Gra
de
Eig
ht
Acr
oss
Yea
r L
inki
ng
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
H13
1-0
.20
-0.5
80.
380.
600.
58-0
.58
H13
6-0
.21
-0.5
90.
380.
600.
59-0
.59
B13
2-0
.26
-0.6
40.
380.
610.
63-0
.64
H12
7-0
.38
-0.7
60.
380.
640.
63-0
.76
I133
-0.9
2-1
.30
0.38
0.74
0.75
-1.3
0W
035
-0.1
7-0
.55
0.38
0.60
0.61
-0.5
5W
036
-0.1
7-0
.55
0.38
0.60
0.61
-0.5
5D
136
-0.6
9-1
.07
0.38
0.70
0.72
-1.0
7B
135
-1.2
0-1
.58
0.38
0.78
0.80
-1.5
8C
138
-0.3
3-0
.72
0.39
0.63
0.63
-0.7
2G
136
-0.6
2-1
.01
0.39
0.69
0.69
-1.0
1B
130
0.19
-0.2
20.
410.
530.
51-0
.22
H13
9-0
.02
-0.4
50.
430.
570.
57-0
.45
D13
9-0
.36
-0.7
90.
430.
640.
65-0
.79
E13
7-0
.25
-0.6
90.
440.
610.
62-0
.69
I140
-0.7
9-1
.23
0.44
0.72
0.74
-1.2
3I1
39-0
.03
-0.4
70.
440.
580.
57-0
.47
W02
10.
21-0
.23
0.44
0.52
0.51
-0.2
3H
140
-0.7
4-1
.19
0.45
0.70
0.73
-1.1
9C
130
0.08
-0.3
70.
450.
550.
55-0
.37
D12
9-0
.11
-0.5
60.
450.
590.
59-0
.56
A12
9-0
.21
-0.6
70.
460.
600.
64-0
.67
B13
8-0
.74
-1.2
10.
470.
700.
73-1
.21
B12
90.
24-0
.23
0.47
0.52
0.51
-0.2
3D
127
-0.8
7-1
.34
0.47
0.73
0.76
-1.3
4C
141
0.92
0.44
0.48
0.39
0.36
0.44
E13
80.
740.
260.
480.
410.
390.
26H
138
-0.0
6-0
.54
0.48
0.57
0.57
-0.5
4D
134
-0.9
4-1
.42
0.48
0.74
0.77
-1.4
2G
133
-0.0
1-0
.50
0.49
0.57
0.58
-0.5
0A
127
0.32
-0.1
70.
490.
500.
51-0
.17
I141
-1.3
4-1
.83
0.49
0.80
0.84
-1.8
3
O 7
Ap
pen
dix
O:
2001
PS
SA
Gra
de
Eig
ht
Acr
oss
Yea
r L
inki
ng
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
J141
-0.6
1-1
.10
0.49
0.69
0.71
-1.1
0B
136
-0.9
3-1
.43
0.50
0.73
0.77
-1.4
3C
132
-0.2
6-0
.76
0.50
0.62
0.64
-0.7
6A
137
-0.4
4-0
.95
0.51
0.65
0.68
-0.9
5G
132
-0.6
4-1
.16
0.52
0.69
0.72
-1.1
6A
140
0.22
-0.3
00.
520.
520.
53-0
.30
G14
10.
01-0
.51
0.52
0.57
0.58
-0.5
1W
040
-0.6
7-1
.20
0.53
0.69
0.76
-1.2
0G
127
-0.1
8-0
.71
0.53
0.61
0.63
-0.7
1D
130
-0.1
0-0
.63
0.53
0.59
0.61
-0.6
3B
131
0.53
0.00
0.53
0.46
0.45
0.00
F12
8-0
.25
-0.7
80.
530.
620.
64-0
.78
E14
1-1
.80
-2.3
40.
540.
850.
90-2
.34
A13
20.
12-0
.42
0.54
0.54
0.58
-0.4
2D
135
-1.0
2-1
.57
0.55
0.75
0.80
-1.5
7J1
280.
41-0
.14
0.55
0.49
0.47
-0.1
4H
132
0.39
-0.1
70.
560.
480.
46-0
.17
F13
10.
00-0
.56
0.56
0.57
0.58
-0.5
6E
130
-0.0
2-0
.59
0.57
0.56
0.60
-0.5
9B
137
0.40
-0.1
70.
570.
490.
50-0
.17
I138
0.34
-0.2
40.
580.
510.
52-0
.24
I137
-0.8
8-1
.47
0.59
0.74
0.78
-1.4
7F
141
0.40
-0.1
90.
590.
490.
50-0
.19
F13
70.
700.
090.
610.
430.
440.
09G
130
0.14
-0.4
70.
610.
540.
57-0
.47
W06
90.
830.
210.
620.
400.
390.
21C
135
0.64
0.02
0.62
0.44
0.46
0.02
G12
90.
25-0
.37
0.62
0.52
0.54
-0.3
7D
138
0.04
-0.5
90.
630.
560.
60-0
.59
B12
80.
690.
050.
640.
430.
430.
05G
131
-0.0
7-0
.71
0.64
0.59
0.63
-0.7
1A
136
-0.2
5-0
.90
0.65
0.61
0.67
-0.9
0
O 8
Ap
pen
dix
O:
2001
PS
SA
Gra
de
Eig
ht
Acr
oss
Yea
r L
inki
ng
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
I129
0.32
-0.3
30.
650.
510.
54-0
.33
A13
5-0
.77
-1.4
30.
660.
710.
81-1
.43
W06
60.
44-0
.22
0.66
0.48
0.53
-0.2
2C
137
-0.2
1-0
.87
0.66
0.61
0.66
-0.8
7F
140
0.25
-0.4
20.
670.
520.
53-0
.42
H13
30.
38-0
.29
0.67
0.49
0.54
-0.2
9I1
280.
64-0
.05
0.69
0.45
0.47
-0.0
5J1
330.
29-0
.41
0.70
0.52
0.54
-0.4
1G
135
0.64
-0.0
70.
710.
440.
46-0
.07
E14
00.
61-0
.11
0.72
0.44
0.48
-0.1
1I1
31-0
.02
-0.7
40.
720.
580.
63-0
.74
C14
00.
41-0
.33
0.74
0.49
0.54
-0.3
3I1
350.
810.
070.
740.
410.
440.
07E
132
1.07
0.33
0.74
0.35
0.38
0.33
F13
00.
13-0
.64
0.77
0.54
0.60
-0.6
4J1
290.
61-0
.16
0.77
0.45
0.47
-0.1
6B
141
0.10
-0.6
90.
790.
540.
62-0
.69
D12
80.
19-0
.69
0.88
0.53
0.62
-0.6
9I1
340.
63-0
.30
0.93
0.45
0.53
-0.3
0I1
32-0
.01
-0.9
50.
940.
580.
68-0
.95
G12
8-0
.15
-1.3
51.
200.
600.
79-1
.35
D13
10.
16-1
.10
1.26
0.54
0.71
-1.1
0H
134
0.52
-1.0
91.
610.
460.
50-1
.09
O 9
Ap
pen
dix
P:
2001
PS
SA
Gra
de
11 A
cro
ss Y
ear
Lin
kin
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce 2
000
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
W00
2-2
.22
-1.2
7-0
.95
0.89
0.75
-1.2
7B
188
-1.2
5-2
.00
0.26
0.84
0.83
-1.5
1B
143
-2.1
0-1
.89
-0.2
10.
870.
87-1
.89
B18
9-1
.13
-1.6
90.
070.
820.
80-1
.20
B13
7-0
.69
-0.4
8-0
.21
0.67
0.61
-0.4
8D
193
-1.0
8-1
.84
0.27
0.82
0.81
-1.3
5J1
41-0
.82
-0.6
5-0
.17
0.69
0.66
-0.6
5D
176
-0.7
5-1
.32
0.08
0.77
0.75
-0.8
3D
148
-1.8
2-1
.68
-0.1
40.
850.
87-1
.68
D18
3-0
.71
-1.4
20.
220.
760.
76-0
.93
I147
-0.0
10.
11-0
.12
0.53
0.45
0.11
C18
3-0
.65
-1.3
10.
170.
760.
74-0
.82
E14
8-1
.09
-1.0
0-0
.09
0.74
0.73
-1.0
0B
168
-0.5
3-0
.73
-0.2
90.
720.
65-0
.24
G13
9-1
.13
-1.0
4-0
.09
0.75
0.70
-1.0
4D
172
-0.5
0-1
.22
0.23
0.73
0.73
-0.7
3D
146
0.01
0.09
-0.0
80.
540.
450.
09B
191
-0.4
7-0
.95
-0.0
10.
710.
69-0
.46
A14
0-0
.93
-0.8
7-0
.06
0.72
0.70
-0.8
7B
187
-0.4
1-0
.93
0.03
0.70
0.68
-0.4
4H
148
-1.7
8-1
.72
-0.0
60.
840.
87-1
.72
A17
1-0
.31
-0.9
30.
130.
690.
69-0
.44
E13
5-1
.15
-1.0
9-0
.06
0.75
0.76
-1.0
9D
165
-0.3
0-0
.50
-0.2
90.
690.
61-0
.01
A14
7-1
.05
-1.0
0-0
.05
0.74
0.74
-1.0
0B
176
-0.2
0-0
.35
-0.3
40.
660.
580.
14G
140
-0.1
0-0
.07
-0.0
30.
560.
49-0
.07
C18
2-0
.19
-1.0
30.
350.
670.
70-0
.54
E13
8-0
.88
-0.8
80.
000.
710.
72-0
.88
A18
4-0
.15
-0.4
5-0
.19
0.65
0.60
0.04
H14
9-0
.54
-0.5
40.
000.
640.
60-0
.54
C16
4-0
.13
-1.1
60.
540.
660.
72-0
.67
J142
-0.0
5-0
.05
0.00
0.54
0.48
-0.0
5A
164
-0.0
2-0
.65
0.14
0.63
0.64
-0.1
6C
139
-0.3
7-0
.39
0.02
0.61
0.59
-0.3
9A
167
0.00
-0.6
20.
130.
620.
63-0
.13
J135
-0.0
8-0
.10
0.02
0.55
0.51
-0.1
0C
186
0.01
-0.3
1-0
.17
0.62
0.58
0.18
F13
6-0
.70
-0.7
30.
030.
670.
67-0
.73
D17
10.
01-0
.89
0.41
0.63
0.68
-0.4
0C
137
-0.8
1-0
.85
0.04
0.69
0.71
-0.8
5C
169
0.03
-0.0
4-0
.42
0.62
0.53
0.45
G13
6-1
.12
-1.1
70.
050.
750.
77-1
.17
A18
30.
08-0
.73
0.32
0.60
0.65
-0.2
4F
140
-0.6
4-0
.69
0.05
0.66
0.66
-0.6
9C
192
0.15
-0.2
4-0
.10
0.60
0.56
0.25
J140
-0.8
2-0
.87
0.05
0.69
0.71
-0.8
7C
170
0.16
-0.5
70.
240.
590.
62-0
.08
J138
-0.5
5-0
.61
0.06
0.64
0.65
-0.6
1A
168
0.18
-0.4
10.
100.
580.
600.
08A
148
-0.1
6-0
.22
0.06
0.57
0.55
-0.2
2C
188
0.33
-0.1
5-0
.01
0.55
0.55
0.34
D14
20.
450.
390.
060.
450.
380.
39A
192
0.36
-0.0
9-0
.04
0.54
0.54
0.40
C14
21.
000.
940.
060.
340.
270.
94C
166
0.37
-0.0
4-0
.08
0.54
0.53
0.45
I142
-0.8
3-0
.89
0.06
0.69
0.67
-0.8
9B
185
0.43
-0.2
30.
170.
520.
560.
26I1
44-0
.45
-0.5
20.
070.
620.
62-0
.52
B18
30.
47-0
.02
0.00
0.51
0.52
0.47
F13
8-0
.57
-0.6
40.
070.
640.
65-0
.64
B17
30.
500.
16-0
.15
0.50
0.49
0.65
E13
6-1
.72
-1.8
00.
080.
830.
85-1
.80
B16
50.
600.
36-0
.25
0.48
0.45
0.85
Gra
de
11 R
ead
ing
G
rad
e 11
Mat
hem
atic
s
P 1
0
Ap
pen
dix
P:
2001
PS
SA
Gra
de
11 A
cro
ss Y
ear
Lin
kin
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce 2
000
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
E14
0-0
.52
-0.6
10.
090.
640.
65-0
.61
B18
40.
620.
64-0
.51
0.47
0.40
1.13
B13
8-0
.36
-0.4
50.
090.
600.
61-0
.45
A18
20.
640.
140.
010.
470.
490.
63E
137
-0.4
1-0
.51
0.10
0.62
0.62
-0.5
1A
165
0.66
1.15
-0.9
80.
470.
311.
64F
145
0.15
0.04
0.11
0.50
0.46
0.04
B18
20.
700.
42-0
.21
0.45
0.44
0.91
C14
1-0
.27
-0.3
90.
120.
590.
59-0
.39
C19
30.
700.
140.
070.
470.
490.
63A
146
-0.1
5-0
.27
0.12
0.57
0.54
-0.2
7A
176
0.77
0.18
0.10
0.44
0.48
0.67
F13
90.
170.
030.
140.
500.
470.
03A
174
0.78
0.43
-0.1
40.
440.
440.
92F
149
0.16
0.02
0.14
0.50
0.47
0.02
E13
9-0
.29
-0.4
30.
140.
600.
60-0
.43
F13
50.
04-0
.10
0.14
0.52
0.51
-0.1
0F
137
-0.8
7-1
.01
0.14
0.70
0.74
-1.0
1I1
450.
810.
670.
140.
370.
330.
67C
149
0.23
0.09
0.14
0.49
0.47
0.09
C13
5-0
.94
-1.1
10.
170.
720.
77-1
.11
C13
8-0
.06
-0.2
40.
180.
550.
53-0
.24
G13
5-0
.35
-0.5
40.
190.
610.
63-0
.54
E14
1-0
.20
-0.4
00.
200.
580.
59-0
.40
F14
80.
740.
530.
210.
380.
360.
53G
146
1.00
0.78
0.22
0.34
0.31
0.78
D14
4-0
.90
-1.1
20.
220.
720.
76-1
.12
B13
60.
410.
180.
230.
450.
430.
18J1
360.
09-0
.14
0.23
0.51
0.53
-0.1
4I1
38-0
.29
-0.5
20.
230.
590.
61-0
.52
A13
5-0
.28
-0.5
30.
250.
600.
59-0
.53
A14
90.
800.
550.
250.
380.
350.
55F
144
-0.2
0-0
.45
0.25
0.57
0.60
-0.4
5H
135
-1.3
5-1
.60
0.25
0.78
0.81
-1.6
0B
141
0.17
-0.0
80.
250.
500.
51-0
.08
H14
4-0
.91
-1.1
70.
260.
710.
73-1
.17
A13
8-0
.54
-0.8
10.
270.
650.
66-0
.81
D13
9-1
.87
-2.1
40.
270.
860.
90-2
.14
B14
5-0
.64
-0.9
30.
290.
660.
68-0
.93
G14
20.
740.
440.
300.
390.
390.
44
P 1
1
Ap
pen
dix
P:
2001
PS
SA
Gra
de
11 A
cro
ss Y
ear
Lin
kin
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce 2
000
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
H14
10.
19-0
.12
0.31
0.50
0.50
-0.1
2A
136
-0.5
8-0
.89
0.31
0.66
0.67
-0.8
9J1
370.
29-0
.03
0.32
0.47
0.50
-0.0
3B
146
0.17
-0.1
50.
320.
500.
51-0
.15
G14
80.
430.
110.
320.
450.
450.
11J1
390.
550.
230.
320.
420.
430.
23G
143
0.18
-0.1
50.
330.
500.
51-0
.15
G14
1-0
.30
-0.6
40.
340.
600.
62-0
.64
A13
9-1
.53
-1.8
80.
350.
810.
85-1
.88
A14
20.
430.
080.
350.
460.
460.
08C
146
0.47
0.12
0.35
0.44
0.45
0.12
F14
1-0
.67
-1.0
20.
350.
660.
74-1
.02
F14
20.
06-0
.29
0.35
0.52
0.54
-0.2
9I1
46-1
.57
-1.9
30.
360.
810.
85-1
.93
G13
70.
13-0
.23
0.36
0.51
0.52
-0.2
3C
140
0.91
0.54
0.37
0.36
0.35
0.54
E14
4-0
.22
-0.6
00.
380.
580.
61-0
.60
G14
7-0
.43
-0.8
10.
380.
620.
65-0
.81
D13
81.
130.
740.
390.
320.
310.
74B
139
0.19
-0.2
00.
390.
490.
54-0
.20
G13
8-1
.65
-2.0
40.
390.
830.
87-2
.04
H14
60.
420.
020.
400.
450.
470.
02C
144
0.73
0.32
0.41
0.39
0.40
0.32
H14
7-0
.54
-0.9
70.
430.
640.
69-0
.97
J145
-1.2
9-1
.72
0.43
0.77
0.82
-1.7
2B
135
0.89
0.46
0.43
0.36
0.36
0.46
B14
00.
990.
550.
440.
340.
340.
55H
136
0.79
0.32
0.47
0.38
0.40
0.32
D13
7-1
.63
-2.1
00.
470.
830.
87-2
.10
W01
7-0
.92
-1.4
00.
480.
710.
77-1
.40
D14
00.
09-0
.41
0.50
0.52
0.57
-0.4
1E
149
-0.6
6-1
.17
0.51
0.67
0.73
-1.1
7I1
370.
41-0
.11
0.52
0.45
0.51
-0.1
1
P 1
2
Ap
pen
dix
P:
2001
PS
SA
Gra
de
11 A
cro
ss Y
ear
Lin
kin
g
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce 2
000
P20
01
PL
og
it*
2001
Item
20
0120
00
Lo
git
2001
L
og
itD
iffe
r-en
ce20
00
P20
01
PL
og
it*
2001
H14
0-0
.71
-1.2
50.
540.
670.
75-1
.25
H13
80.
650.
110.
550.
400.
440.
11G
145
0.37
-0.1
80.
550.
460.
51-0
.18
A14
5-0
.13
-0.7
30.
600.
570.
64-0
.73
E14
6-0
.11
-0.7
10.
600.
560.
63-0
.71
W01
10.
11-0
.50
0.61
0.51
0.59
-0.5
0H
139
0.44
-0.1
80.
620.
440.
51-0
.18
A13
70.
47-0
.18
0.65
0.45
0.51
-0.1
8I1
40-0
.57
-1.4
10.
840.
640.
77-1
.41
B14
20.
79-0
.10
0.89
0.38
0.50
-0.1
0W
047
-0.6
4-1
.57
0.93
0.66
0.80
-1.5
7D
141
0.69
-0.3
31.
020.
400.
55-0
.33
P 1
3
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 A 128 2 1 8 64.89 8.11 1.40 -0.8 A-5 A 129 2 1 8 32.79 4.10 0.97 0.1 A+5 A 130 2 1 8 18.23 2.28 1.01 0.0 A-5 A 131 2 1 8 21.48 2.68 1.03 -0.1 A-5 A 132 2 1 8 29.79 3.72 1.12 -0.3 A-5 A 133 2 1 8 163.29 20.41 0.74 0.7 A+5 A 134 2 1 8 42.57 5.32 0.85 0.4 A+5 A 135 2 1 8 14.33 1.79 1.07 -0.2 A-5 A 136 2 1 8 13.07 1.63 0.96 0.1 A+5 A 137 2 1 8 30.92 3.87 0.97 0.1 A+5 A 138 2 1 8 122.14 15.27 0.75 0.7 A+5 A 139 2 1 8 23.30 2.91 1.06 -0.1 A-5 A 140 2 1 8 46.72 5.84 1.12 -0.3 A-5 A 141 2 1 8 52.98 6.62 1.23 -0.5 A-5 A 142 2 1 8 44.76 5.60 0.90 0.3 A+5 B 128 2 1 8 215.61 26.95 0.60 1.2 B+5 B 129 2 1 8 22.24 2.78 1.17 -0.4 A-5 B 130 2 1 8 31.92 3.99 1.13 -0.3 A-5 B 131 2 1 8 34.10 4.26 1.07 -0.2 A-5 B 132 2 1 8 45.28 5.66 1.18 -0.4 A-5 B 133 2 1 8 17.95 2.24 1.08 -0.2 A-5 B 134 2 1 8 28.89 3.61 0.91 0.2 A+5 B 135 2 1 8 447.43 55.93 2.13 -1.8 C-5 B 136 2 1 8 333.89 41.74 1.50 -1.0 A-5 B 137 2 1 8 62.72 7.84 1.01 0.0 A-5 B 138 2 1 8 19.12 2.39 1.14 -0.3 A-5 B 139 2 1 8 82.61 10.33 1.37 -0.7 A-5 B 140 2 1 8 73.73 9.22 0.95 0.1 A+5 B 141 2 1 8 29.62 3.70 1.06 -0.1 A-5 B 142 2 1 8 16.80 2.10 1.04 -0.1 A-5 C 128 2 1 8 153.31 19.16 1.49 -0.9 A-5 C 129 2 1 8 20.12 2.52 0.94 0.2 A+5 C 130 2 1 8 21.54 2.69 1.08 -0.2 A-5 C 131 2 1 8 27.98 3.50 1.13 -0.3 A-5 C 132 2 1 8 76.82 9.60 1.24 -0.5 A-5 C 133 2 1 8 262.58 32.82 1.54 -1.0 B-5 C 134 2 1 8 49.90 6.24 0.84 0.4 A+5 C 135 2 1 8 17.78 2.22 1.01 0.0 A-5 C 136 2 1 8 15.81 1.98 0.98 0.1 A+5 C 137 2 1 8 18.87 2.36 0.93 0.2 A+5 C 138 2 1 8 135.71 16.96 0.78 0.6 A+5 C 139 2 1 8 25.57 3.20 1.11 -0.2 A-5 C 140 2 1 8 30.14 3.77 1.14 -0.3 A-5 C 141 2 1 8 68.21 8.53 0.80 0.5 A+5 C 142 2 1 8 32.95 4.12 1.11 -0.3 A-
Q 1
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 D 128 2 1 8 16.09 2.01 0.92 0.2 A+5 D 129 2 1 8 88.73 11.09 0.80 0.5 A+5 D 130 2 1 8 7.16 0.90 1.03 -0.1 A-5 D 131 2 1 8 47.76 5.97 1.05 -0.1 A-5 D 132 2 1 8 50.20 6.27 1.17 -0.4 A-5 D 133 2 1 8 19.59 2.45 1.05 -0.1 A-5 D 134 2 1 8 21.72 2.72 1.05 -0.1 A-5 D 135 2 1 8 85.33 10.67 1.23 -0.5 A-5 D 136 2 1 8 28.11 3.51 0.92 0.2 A+5 D 137 2 1 8 102.59 12.82 0.81 0.5 A+5 D 138 2 1 8 417.36 52.17 0.58 1.3 B+5 D 139 2 1 8 53.80 6.72 1.16 -0.4 A-5 D 140 2 1 8 63.07 7.88 0.98 0.0 A+5 D 141 2 1 8 29.74 3.72 0.90 0.2 A+5 D 142 2 1 8 115.93 14.49 0.78 0.6 A+5 E 128 2 1 8 19.52 2.44 0.91 0.2 A+5 E 129 2 1 8 110.04 13.76 1.07 -0.2 A-5 E 130 2 1 8 20.19 2.52 1.00 0.0 A+5 E 131 2 1 8 36.43 4.55 0.86 0.3 A+5 E 132 2 1 8 159.02 19.88 1.50 -1.0 A-5 E 133 2 1 8 29.49 3.69 0.90 0.2 A+5 E 134 2 1 8 30.66 3.83 1.07 -0.2 A-5 E 135 2 1 8 29.55 3.69 0.90 0.2 A+5 E 136 2 1 8 79.88 9.99 1.21 -0.5 A-5 E 137 2 1 8 47.29 5.91 1.16 -0.4 A-5 E 138 2 1 8 182.67 22.83 0.71 0.8 A+5 E 139 2 1 8 60.67 7.58 1.22 -0.5 A-5 E 140 2 1 8 15.71 1.96 1.10 -0.2 A-5 E 141 2 1 8 10.26 1.28 0.96 0.1 A+5 E 142 2 1 8 49.96 6.25 1.17 -0.4 A-5 F 128 2 1 8 62.21 7.78 1.46 -0.9 A-5 F 129 2 1 8 73.10 9.14 0.81 0.5 A+5 F 130 2 1 8 10.20 1.28 0.99 0.0 A+5 F 131 2 1 8 40.68 5.09 0.85 0.4 A+5 F 132 2 1 8 89.06 11.13 1.34 -0.7 A-5 F 133 2 1 8 101.32 12.66 0.77 0.6 A+5 F 134 2 1 8 4.48 0.56 1.02 0.0 A-5 F 135 2 1 8 114.90 14.36 1.25 -0.5 A-5 F 136 2 1 8 52.26 6.53 1.17 -0.4 A-5 F 137 2 1 8 48.98 6.12 0.83 0.4 A+5 F 138 2 1 8 59.89 7.49 1.18 -0.4 A-5 F 139 2 1 8 40.61 5.08 0.86 0.4 A+5 F 140 2 1 8 140.28 17.54 0.73 0.7 A+5 F 141 2 1 8 72.28 9.03 0.80 0.5 A+5 F 142 2 1 8 15.08 1.89 0.99 0.0 A+
Q 2
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 G 128 2 1 8 38.20 4.78 0.86 0.3 A+5 G 129 2 1 8 14.84 1.85 1.00 0.0 A5 G 130 2 1 8 38.26 4.78 1.18 -0.4 A-5 G 131 2 1 8 64.11 8.01 1.22 -0.5 A-5 G 132 2 1 8 231.11 28.89 0.60 1.2 B+5 G 133 2 1 8 19.03 2.38 1.00 0.0 A+5 G 134 2 1 8 79.91 9.99 1.35 -0.7 A-5 G 135 2 1 8 51.81 6.48 1.22 -0.5 A-5 G 136 2 1 8 114.57 14.32 0.74 0.7 A+5 G 137 2 1 8 45.12 5.64 0.88 0.3 A+5 G 138 2 1 8 30.66 3.83 0.87 0.3 A+5 G 139 2 1 8 38.82 4.85 0.95 0.1 A+5 G 140 2 1 8 28.58 3.57 0.89 0.3 A+5 G 141 2 1 8 34.33 4.29 0.92 0.2 A+5 G 142 2 1 8 18.66 2.33 1.02 0.0 A-5 H 128 2 1 8 105.80 13.23 1.28 -0.6 A-5 H 129 2 1 8 118.01 14.75 0.62 1.1 B+5 H 130 2 1 8 44.01 5.50 1.06 -0.1 A-5 H 131 2 1 8 51.75 6.47 1.10 -0.2 A-5 H 132 2 1 8 32.25 4.03 0.94 0.2 A+5 H 133 2 1 8 9.38 1.17 1.00 0.0 A-5 H 134 2 1 8 110.75 13.84 1.52 -1.0 A-5 H 135 2 1 8 148.37 18.55 0.74 0.7 A+5 H 136 2 1 8 242.28 30.28 0.68 0.9 A+5 H 137 2 1 8 52.98 6.62 0.96 0.1 A+5 H 138 2 1 8 35.72 4.46 0.97 0.1 A+5 H 139 2 1 8 802.16 100.27 0.48 1.7 C+5 H 140 2 1 8 298.97 37.37 0.61 1.1 B+5 H 141 2 1 8 131.86 16.48 0.75 0.7 A+5 H 142 2 1 8 33.57 4.20 1.11 -0.2 A-5 I 128 2 1 8 47.18 5.90 0.83 0.4 A+5 I 129 2 1 8 14.83 1.85 1.08 -0.2 A-5 I 130 2 1 8 219.45 27.43 0.65 1.0 B+5 I 131 2 1 8 42.88 5.36 1.26 -0.5 A-5 I 132 2 1 8 19.51 2.44 1.07 -0.2 A-5 I 133 2 1 8 53.49 6.69 1.12 -0.3 A-5 I 134 2 1 8 56.40 7.05 0.84 0.4 A+5 I 135 2 1 8 128.97 16.12 0.75 0.7 A+5 I 136 2 1 8 289.01 36.13 1.49 -0.9 A-5 I 137 2 1 8 62.62 7.83 1.08 -0.2 A-5 I 138 2 1 8 63.08 7.88 0.81 0.5 A+5 I 139 2 1 8 115.31 14.41 1.31 -0.6 A-5 I 140 2 1 8 37.83 4.73 0.88 0.3 A+5 I 141 2 1 8 266.64 33.33 1.48 -0.9 A-5 I 142 2 1 8 46.64 5.83 0.93 0.2 A+
Q 3
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 J 128 2 1 8 79.19 9.90 1.25 -0.5 A-5 J 129 2 1 8 133.49 16.69 1.35 -0.7 A-5 J 130 2 1 8 74.11 9.26 1.46 -0.9 A-5 J 131 2 1 8 140.23 17.53 0.77 0.6 A+5 J 132 2 1 8 18.14 2.27 0.91 0.2 A+5 J 133 2 1 8 142.74 17.84 0.70 0.8 A+5 J 134 2 1 8 24.34 3.04 1.00 0.0 A-5 J 135 2 1 8 92.86 11.61 0.77 0.6 A+5 J 136 2 1 8 34.15 4.27 1.10 -0.2 A-5 J 137 2 1 8 9.41 1.18 1.00 0.0 A-5 J 138 2 1 8 256.99 32.12 1.54 -1.0 B-5 J 139 2 1 8 16.06 2.01 0.97 0.1 A+5 J 140 2 1 8 77.41 9.68 1.34 -0.7 A-5 J 141 2 1 8 10.25 1.28 1.03 -0.1 A-5 J 142 2 1 8 169.74 21.22 0.83 0.4 A+5 W 1 2 1 8 176.27 22.03 1.15 -0.3 A-5 W 2 2 1 8 224.02 28.00 1.11 -0.3 A-5 W 3 2 1 8 970.11 121.26 1.31 -0.6 A-5 W 4 2 1 8 580.32 72.54 1.27 -0.6 A-5 W 5 2 1 8 230.02 28.75 0.88 0.3 A+5 W 6 2 1 8 979.62 122.45 1.34 -0.7 A-5 W 7 2 1 8 190.94 23.87 0.90 0.2 A+5 W 8 2 1 8 25.79 3.22 1.00 0.0 A-5 W 9 2 1 8 42.10 5.26 0.96 0.1 A+5 W 10 2 1 8 195.38 24.42 0.85 0.4 A+5 W 11 2 1 8 416.86 52.11 1.34 -0.7 A-5 W 12 2 1 8 243.05 30.38 1.13 -0.3 A-5 W 13 2 1 8 93.53 11.69 0.99 0.0 A+5 W 14 2 1 8 524.86 65.61 1.06 -0.1 A-5 W 15 2 1 8 2207.12 275.89 1.48 -0.9 A-5 W 16 2 1 8 514.19 64.27 1.37 -0.7 A-5 W 17 2 1 8 887.72 110.97 0.77 0.6 A+5 W 18 2 1 8 1311.89 163.99 0.66 1.0 A+5 W 19 2 1 8 139.20 17.40 1.11 -0.2 A-5 W 20 2 1 8 147.45 18.43 1.07 -0.2 A-5 W 21 2 1 8 278.98 34.87 1.10 -0.2 A-5 W 22 2 1 8 596.09 74.51 0.81 0.5 A+5 W 23 2 1 8 352.19 44.02 0.86 0.3 A+5 W 24 2 1 8 19.93 2.49 0.99 0.0 A+5 W 26 2 1 8 130.90 16.36 1.18 -0.4 A-5 W 27 2 1 8 138.04 17.26 1.09 -0.2 A-5 W 28 2 1 8 148.07 18.51 0.92 0.2 A+5 W 29 2 1 8 20.83 2.60 0.99 0.0 A+5 W 30 2 1 8 116.89 14.61 0.98 0.0 A+5 W 31 2 1 8 109.97 13.75 1.13 -0.3 A-5 W 32 2 1 8 757.95 94.74 0.78 0.6 A+5 W 33 2 1 8 509.01 63.63 0.82 0.5 A+5 W 34 2 1 8 63.45 7.93 0.99 0.0 A+
Q 4
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 W 35 2 1 8 59.08 7.38 1.05 -0.1 A-5 W 36 2 1 8 366.75 45.84 1.13 -0.3 A-5 W 37 2 1 8 63.74 7.97 1.07 -0.2 A-5 W 38 2 1 8 106.49 13.31 1.09 -0.2 A-5 W 39 2 1 8 441.63 55.20 0.85 0.4 A+5 W 40 2 1 8 66.24 8.28 1.04 -0.1 A-5 W 41 2 1 8 73.38 9.17 0.98 0.1 A+5 W 42 2 1 8 123.13 15.39 0.96 0.1 A+5 W 43 2 1 8 60.81 7.60 1.00 0.0 A+5 W 44 2 1 8 54.29 6.79 1.00 0.0 A+5 W 45 2 1 8 189.62 23.70 1.07 -0.2 A-5 W 46 2 1 8 100.72 12.59 0.95 0.1 A+5 W 47 2 1 8 775.59 96.95 0.76 0.6 A+5 W 48 2 1 8 452.40 56.55 1.24 -0.5 A-5 W 49 2 1 8 210.51 26.31 1.11 -0.2 A-5 W 51 2 1 8 1409.83 176.23 0.73 0.7 A+5 W 52 2 1 8 106.21 13.28 1.14 -0.3 A-5 W 53 2 1 8 390.15 48.77 1.15 -0.3 A-5 W 54 2 1 8 270.74 33.84 1.10 -0.2 A-5 W 55 2 1 8 27.22 3.40 0.99 0.0 A+5 W 56 2 1 8 34.67 4.33 1.04 -0.1 A-5 W 57 2 1 8 53.91 6.74 0.99 0.0 A+5 W 58 2 1 8 1073.11 134.14 0.76 0.6 A+5 W 59 2 1 8 1049.77 131.22 1.29 -0.6 A-5 W 60 2 1 8 66.00 8.25 1.06 -0.1 A-5 W 61 2 1 8 61.60 7.70 1.00 0.0 A-5 W 62 2 1 8 627.82 78.48 0.80 0.5 A+5 W 63 2 1 8 1559.91 194.99 0.71 0.8 A+5 W 64 2 1 8 396.34 49.54 0.87 0.3 A+5 W 65 2 1 8 188.83 23.60 0.93 0.2 A+5 W 66 2 1 8 52.44 6.55 0.95 0.1 A+5 W 67 2 1 8 145.13 18.14 0.91 0.2 A+5 W 68 2 1 8 496.45 62.06 0.87 0.3 A+5 W 69 2 1 8 360.34 45.04 1.20 -0.4 A-5 W 70 2 1 8 78.08 9.76 0.99 0.0 A+5 W 71 2 1 8 483.24 60.40 1.20 -0.4 A-5 W 72 2 1 8 1188.55 148.57 0.74 0.7 A+
Q 5
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 A 148 2 1 8 28.72 3.59 0.99 0.0 A+8 A 149 2 1 8 63.32 7.92 1.23 -0.5 A-8 A 150 2 1 8 37.30 4.66 0.96 0.1 A+8 A 151 2 1 8 75.02 9.38 1.23 -0.5 A-8 A 152 2 1 8 69.41 8.68 1.16 -0.4 A-8 A 153 2 1 8 55.87 6.98 0.84 0.4 A+8 A 154 2 1 8 56.14 7.02 1.20 -0.4 A-8 A 155 2 1 8 25.73 3.22 1.08 -0.2 A-8 A 156 2 1 8 56.11 7.01 1.22 -0.5 A-8 A 157 2 1 8 328.00 41.00 1.75 -1.3 B-8 A 158 2 1 8 71.84 8.98 1.16 -0.3 A-8 A 159 2 1 8 42.47 5.31 1.13 -0.3 A-8 A 160 2 1 8 8.55 1.07 0.99 0.0 A+8 A 161 2 1 8 59.06 7.38 0.87 0.3 A+8 A 162 2 1 8 64.92 8.11 0.83 0.4 A+8 B 148 2 1 8 141.12 17.64 0.73 0.8 A+8 B 149 2 1 8 45.32 5.67 1.14 -0.3 A-8 B 150 2 1 8 21.19 2.65 1.06 -0.1 A-8 B 151 2 1 8 157.77 19.72 1.33 -0.7 A-8 B 152 2 1 8 18.18 2.27 0.97 0.1 A+8 B 153 2 1 8 153.87 19.23 0.78 0.6 A+8 B 154 2 1 8 200.65 25.08 1.43 -0.8 A-8 B 155 2 1 8 13.20 1.65 1.04 -0.1 A-8 B 156 2 1 8 745.45 93.18 0.43 2.0 C+8 B 157 2 1 8 76.83 9.60 1.29 -0.6 A-8 B 158 2 1 8 12.81 1.60 1.03 -0.1 A-8 B 159 2 1 8 175.31 21.91 0.67 0.9 A+8 B 160 2 1 8 235.80 29.47 0.66 1.0 A+8 B 161 2 1 8 18.67 2.33 0.96 0.1 A+8 B 162 2 1 8 71.14 8.89 1.20 -0.4 A-8 C 148 2 1 8 67.60 8.45 1.17 -0.4 A-8 C 149 2 1 8 13.98 1.75 0.95 0.1 A+8 C 150 2 1 8 344.73 43.09 0.62 1.1 B+8 C 151 2 1 8 25.90 3.24 1.05 -0.1 A-8 C 152 2 1 8 38.00 4.75 1.16 -0.4 A-8 C 153 2 1 8 116.84 14.61 1.23 -0.5 A-8 C 154 2 1 8 145.87 18.23 0.72 0.8 A+8 C 155 2 1 8 75.94 9.49 0.80 0.5 A+8 C 156 2 1 8 247.88 30.98 1.43 -0.8 A-8 C 157 2 1 8 31.52 3.94 0.93 0.2 A+8 C 158 2 1 8 22.11 2.76 0.96 0.1 A+8 C 159 2 1 8 53.73 6.72 1.11 -0.3 A-8 C 160 2 1 8 54.48 6.81 0.85 0.4 A+8 C 161 2 1 8 101.99 12.75 0.79 0.6 A+8 C 162 2 1 8 32.74 4.09 0.96 0.1 A+
Q 6
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 D 148 2 1 8 56.70 7.09 1.01 0.0 A-8 D 149 2 1 8 79.97 10.00 0.74 0.7 A+8 D 150 2 1 8 8.11 1.01 1.02 0.0 A-8 D 151 2 1 8 177.30 22.16 1.42 -0.8 A-8 D 152 2 1 8 24.63 3.08 1.11 -0.2 A-8 D 153 2 1 8 444.83 55.60 0.57 1.3 B+8 D 154 2 1 8 18.27 2.28 1.02 0.0 A-8 D 155 2 1 8 22.96 2.87 1.08 -0.2 A-8 D 156 2 1 8 291.89 36.49 1.63 -1.2 B-8 D 157 2 1 8 37.96 4.75 0.94 0.1 A+8 D 158 2 1 8 45.84 5.73 0.92 0.2 A+8 D 159 2 1 8 35.28 4.41 1.08 -0.2 A-8 D 160 2 1 8 39.15 4.89 0.91 0.2 A+8 D 161 2 1 8 113.38 14.17 1.29 -0.6 A-8 D 162 2 1 8 22.83 2.85 1.04 -0.1 A-8 E 148 2 1 8 1134.49 141.81 0.37 2.3 C+8 E 149 2 1 8 24.60 3.07 1.05 -0.1 A-8 E 150 2 1 8 24.14 3.02 0.95 0.1 A+8 E 151 2 1 8 240.34 30.04 1.51 -1.0 A-8 E 152 2 1 8 22.80 2.85 0.92 0.2 A+8 E 153 2 1 8 40.36 5.04 0.88 0.3 A+8 E 154 2 1 8 29.33 3.67 1.04 -0.1 A-8 E 155 2 1 8 51.24 6.40 0.97 0.1 A+8 E 156 2 1 8 32.57 4.07 1.10 -0.2 A-8 E 157 2 1 8 107.53 13.44 0.91 0.2 A+8 E 158 2 1 8 39.08 4.89 1.12 -0.3 A-8 E 159 2 1 8 46.00 5.75 1.17 -0.4 A-8 E 160 2 1 8 107.67 13.46 1.21 -0.5 A-8 E 161 2 1 8 41.88 5.24 1.09 -0.2 A-8 E 162 2 1 8 44.86 5.61 0.90 0.2 A+8 F 148 2 1 8 396.69 49.59 0.61 1.2 B+8 F 149 2 1 8 105.51 13.19 0.78 0.6 A+8 F 150 2 1 8 95.30 11.91 0.79 0.5 A+8 F 151 2 1 8 34.31 4.29 0.86 0.4 A+8 F 152 2 1 8 12.24 1.53 0.96 0.1 A+8 F 153 2 1 8 34.60 4.32 1.08 -0.2 A-8 F 154 2 1 8 24.24 3.03 1.05 -0.1 A-8 F 155 2 1 8 82.13 10.27 1.08 -0.2 A-8 F 156 2 1 8 47.18 5.90 0.91 0.2 A+8 F 157 2 1 8 68.12 8.51 1.24 -0.5 A-8 F 158 2 1 8 168.93 21.12 1.46 -0.9 A-8 F 159 2 1 8 21.51 2.69 0.94 0.2 A+8 F 160 2 1 8 37.05 4.63 1.09 -0.2 A-8 F 161 2 1 8 51.82 6.48 0.85 0.4 A+8 F 162 2 1 8 132.67 16.58 1.56 -1.0 B-
Q 7
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 G 148 2 1 8 22.48 2.81 1.06 -0.1 A-8 G 149 2 1 8 89.31 11.16 1.22 -0.5 A-8 G 150 2 1 8 40.94 5.12 1.09 -0.2 A-8 G 151 2 1 8 67.84 8.48 1.12 -0.3 A-8 G 152 2 1 8 102.99 12.87 1.22 -0.5 A-8 G 153 2 1 8 220.99 27.62 0.68 0.9 A+8 G 154 2 1 8 122.56 15.32 1.36 -0.7 A-8 G 155 2 1 8 146.54 18.32 1.31 -0.6 A-8 G 156 2 1 8 54.42 6.80 0.83 0.4 A+8 G 157 2 1 8 11.55 1.44 1.07 -0.2 A-8 G 158 2 1 8 195.43 24.43 0.72 0.8 A+8 G 159 2 1 8 27.41 3.43 1.00 0.0 A+8 G 160 2 1 8 217.22 27.15 0.67 0.9 A+8 G 161 2 1 8 51.63 6.45 0.84 0.4 A+8 G 162 2 1 8 56.54 7.07 0.81 0.5 A+8 H 148 2 1 8 37.18 4.65 0.87 0.3 A+8 H 149 2 1 8 120.35 15.04 0.74 0.7 A+8 H 150 2 1 8 87.75 10.97 1.26 -0.5 A-8 H 151 2 1 8 107.76 13.47 0.75 0.7 A+8 H 152 2 1 8 63.17 7.90 1.18 -0.4 A-8 H 153 2 1 8 76.04 9.51 0.81 0.5 A+8 H 154 2 1 8 140.41 17.55 1.38 -0.8 A-8 H 155 2 1 8 37.68 4.71 0.94 0.1 A+8 H 156 2 1 8 33.66 4.21 1.04 -0.1 A-8 H 157 2 1 8 95.57 11.95 1.27 -0.6 A-8 H 158 2 1 8 34.05 4.26 0.90 0.3 A+8 H 159 2 1 8 65.11 8.14 1.23 -0.5 A-8 H 160 2 1 8 36.20 4.52 0.88 0.3 A+8 H 161 2 1 8 29.27 3.66 1.00 0.0 A+8 H 162 2 1 8 20.36 2.54 1.04 -0.1 A-8 I 148 2 1 8 12.08 1.51 0.98 0.0 A+8 I 149 2 1 8 90.59 11.32 0.92 0.2 A+8 I 150 2 1 8 59.19 7.40 0.76 0.6 A+8 I 151 2 1 8 127.45 15.93 0.74 0.7 A+8 I 152 2 1 8 65.63 8.20 0.81 0.5 A+8 I 153 2 1 8 85.06 10.63 0.81 0.5 A+8 I 154 2 1 8 39.73 4.97 0.97 0.1 A+8 I 155 2 1 8 7.36 0.92 1.00 0.0 A+8 I 156 2 1 8 89.87 11.23 1.23 -0.5 A-8 I 157 2 1 8 14.51 1.81 1.06 -0.1 A-8 I 158 2 1 8 24.66 3.08 1.11 -0.2 A-8 I 159 2 1 8 115.95 14.49 1.38 -0.8 A-8 I 160 2 1 8 81.17 10.15 1.32 -0.7 A-8 I 161 2 1 8 49.54 6.19 0.92 0.2 A+8 I 162 2 1 8 111.15 13.89 1.28 -0.6 A-
Q 8
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 J 148 2 1 8 33.29 4.16 0.89 0.3 A+8 J 149 2 1 8 72.80 9.10 0.91 0.2 A+8 J 150 2 1 8 32.87 4.11 1.12 -0.3 A-8 J 151 2 1 8 17.53 2.19 1.00 0.0 A8 J 152 2 1 8 107.75 13.47 1.28 -0.6 A-8 J 153 2 1 8 53.62 6.70 0.85 0.4 A+8 J 154 2 1 8 67.76 8.47 1.20 -0.4 A-8 J 155 2 1 8 35.68 4.46 0.88 0.3 A+8 J 156 2 1 8 68.94 8.62 1.20 -0.4 A-8 J 157 2 1 8 87.02 10.88 1.06 -0.1 A-8 J 158 2 1 8 54.00 6.75 1.21 -0.5 A-8 J 159 2 1 8 179.19 22.40 1.39 -0.8 A-8 J 160 2 1 8 76.09 9.51 1.06 -0.1 A-8 J 161 2 1 8 22.80 2.85 0.92 0.2 A+8 J 162 2 1 8 67.72 8.47 0.77 0.6 A+8 W 1 2 1 8 535.36 66.92 1.29 -0.6 A-8 W 2 2 1 8 83.52 10.44 0.94 0.2 A+8 W 3 2 1 8 633.42 79.18 1.21 -0.5 A-8 W 4 2 1 8 239.96 30.00 0.92 0.2 A+8 W 5 2 1 8 1368.94 171.12 0.71 0.8 A+8 W 6 2 1 8 164.86 20.61 1.13 -0.3 A-8 W 7 2 1 8 944.54 118.07 1.27 -0.6 A-8 W 8 2 1 8 31.69 3.96 1.00 0.0 A-8 W 9 2 1 8 405.19 50.65 1.22 -0.5 A-8 W 10 2 1 8 506.86 63.36 1.23 -0.5 A-8 W 11 2 1 8 677.85 84.73 0.74 0.7 A+8 W 12 2 1 8 313.95 39.24 1.13 -0.3 A-8 W 13 2 1 8 105.25 13.16 1.07 -0.2 A-8 W 14 2 1 8 361.99 45.25 0.83 0.4 A+8 W 15 2 1 8 805.75 100.72 0.79 0.6 A+8 W 16 2 1 8 447.39 55.92 0.85 0.4 A+8 W 17 2 1 8 852.11 106.51 0.74 0.7 A+8 W 18 2 1 8 281.55 35.19 1.06 -0.1 A-8 W 19 2 1 8 150.74 18.84 0.95 0.1 A+8 W 20 2 1 8 310.67 38.83 0.93 0.2 A+8 W 21 2 1 8 189.14 23.64 1.07 -0.2 A-8 W 22 2 1 8 769.64 96.20 0.78 0.6 A+8 W 23 2 1 8 252.74 31.59 0.89 0.3 A+8 W 24 2 1 8 970.28 121.28 1.30 -0.6 A-8 W 26 2 1 8 456.04 57.00 0.81 0.5 A+8 W 27 2 1 8 275.47 34.43 0.89 0.3 A+8 W 28 2 1 8 267.98 33.50 1.13 -0.3 A-8 W 29 2 1 8 497.46 62.18 0.84 0.4 A+8 W 30 2 1 8 48.20 6.02 0.97 0.1 A+8 W 31 2 1 8 792.97 99.12 1.28 -0.6 A-8 W 32 2 1 8 53.40 6.68 0.98 0.1 A+8 W 33 2 1 8 999.16 124.89 0.74 0.7 A+8 W 34 2 1 8 734.50 91.81 0.84 0.4 A+
Q 9
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 W 35 2 1 8 116.42 14.55 1.01 0.0 A-8 W 36 2 1 8 401.76 50.22 1.20 -0.4 A-8 W 37 2 1 8 625.18 78.15 0.81 0.5 A+8 W 38 2 1 8 619.14 77.39 0.82 0.5 A+8 W 39 2 1 8 92.05 11.51 1.00 0.0 A-8 W 40 2 1 8 698.25 87.28 0.82 0.5 A+8 W 41 2 1 8 3759.01 469.88 0.57 1.3 B+8 W 42 2 1 8 141.79 17.72 1.01 0.0 A-8 W 43 2 1 8 737.34 92.17 1.31 -0.6 A-8 W 44 2 1 8 1675.18 209.40 0.68 0.9 A+8 W 45 2 1 8 934.27 116.78 0.75 0.7 A+8 W 46 2 1 8 200.18 25.02 1.16 -0.4 A-8 W 47 2 1 8 37.84 4.73 1.03 -0.1 A-8 W 48 2 1 8 37.71 4.71 1.05 -0.1 A-8 W 49 2 1 8 90.35 11.29 1.09 -0.2 A-8 W 51 2 1 8 77.82 9.73 1.07 -0.2 A-8 W 52 2 1 8 878.69 109.84 1.25 -0.5 A-8 W 53 2 1 8 534.31 66.79 1.26 -0.5 A-8 W 54 2 1 8 146.89 18.36 0.97 0.1 A+8 W 55 2 1 8 1952.94 244.12 0.69 0.9 A+8 W 56 2 1 8 620.57 77.57 0.79 0.6 A+8 W 57 2 1 8 215.59 26.95 0.89 0.3 A+8 W 58 2 1 8 190.57 23.82 0.89 0.3 A+8 W 59 2 1 8 126.32 15.79 1.05 -0.1 A-8 W 60 2 1 8 152.01 19.00 0.93 0.2 A+8 W 61 2 1 8 570.63 71.33 1.21 -0.5 A-8 W 62 2 1 8 1346.65 168.33 1.38 -0.7 A-8 W 63 2 1 8 460.32 57.54 0.84 0.4 A+8 W 64 2 1 8 100.24 12.53 1.01 0.0 A-8 W 65 2 1 8 71.83 8.98 0.97 0.1 A+8 W 66 2 1 8 895.45 111.93 0.78 0.6 A+8 W 67 2 1 8 209.85 26.23 1.06 -0.1 A-8 W 68 2 1 8 386.85 48.36 0.93 0.2 A+8 W 69 2 1 8 173.71 21.71 0.97 0.1 A+8 W 70 2 1 8 1474.17 184.27 0.71 0.8 A+8 W 71 2 1 8 112.70 14.09 0.95 0.1 A+8 W 72 2 1 8 1117.33 139.67 1.31 -0.6 A-
Q 10
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 A 156 2 1 8 53.61 6.70 1.18 -0.4 A-11 A 157 2 1 8 30.57 3.82 1.07 -0.2 A-11 A 158 2 1 8 119.37 14.92 1.32 -0.7 A-11 A 159 2 1 8 12.55 1.57 1.03 -0.1 A-11 A 160 2 1 8 21.26 2.66 1.03 -0.1 A-11 A 161 2 1 8 88.46 11.06 1.30 -0.6 A-11 A 162 2 1 8 36.92 4.61 1.01 0.0 A-11 A 163 2 1 8 25.55 3.19 0.97 0.1 A+11 A 164 2 1 8 13.62 1.70 0.94 0.1 A+11 A 165 2 1 8 31.26 3.91 0.97 0.1 A+11 A 166 2 1 8 34.24 4.28 1.10 -0.2 A-11 A 167 2 1 8 57.53 7.19 0.83 0.4 A+11 A 168 2 1 8 153.26 19.16 0.72 0.8 A+11 A 169 2 1 8 31.48 3.93 0.93 0.2 A+11 A 170 2 1 8 28.96 3.62 0.94 0.1 A+11 B 156 2 1 8 58.96 7.37 1.14 -0.3 A-11 B 157 2 1 8 48.39 6.05 0.85 0.4 A+11 B 158 2 1 8 90.31 11.29 0.80 0.5 A+11 B 159 2 1 8 85.33 10.67 0.76 0.6 A+11 B 160 2 1 8 457.21 57.15 0.53 1.5 C+11 B 161 2 1 8 118.97 14.87 0.75 0.7 A+11 B 162 2 1 8 27.22 3.40 0.95 0.1 A+11 B 163 2 1 8 18.20 2.28 0.99 0.0 A+11 B 164 2 1 8 39.67 4.96 1.11 -0.2 A-11 B 165 2 1 8 127.26 15.91 0.70 0.8 A+11 B 166 2 1 8 48.60 6.07 0.85 0.4 A+11 B 167 2 1 8 49.92 6.24 0.85 0.4 A+11 B 168 2 1 8 88.48 11.06 1.26 -0.6 A-11 B 169 2 1 8 9.21 1.15 0.97 0.1 A+11 B 170 2 1 8 25.13 3.14 0.92 0.2 A+11 C 156 2 1 8 303.58 37.95 1.68 -1.2 B-11 C 157 2 1 8 36.39 4.55 1.20 -0.4 A-11 C 158 2 1 8 22.93 2.87 1.13 -0.3 A-11 C 159 2 1 8 72.56 9.07 1.28 -0.6 A-11 C 160 2 1 8 18.29 2.29 1.01 0.0 A-11 C 161 2 1 8 18.36 2.29 0.96 0.1 A+11 C 162 2 1 8 27.88 3.48 1.00 0.0 A-11 C 163 2 1 8 131.24 16.41 0.74 0.7 A+11 C 164 2 1 8 69.31 8.66 0.86 0.4 A+11 C 165 2 1 8 11.69 1.46 1.02 -0.1 A-11 C 166 2 1 8 24.25 3.03 1.03 -0.1 A-11 C 167 2 1 8 18.77 2.35 1.00 0.0 A-11 C 168 2 1 8 39.98 5.00 0.88 0.3 A+11 C 169 2 1 8 919.87 114.98 0.44 1.9 C+11 C 170 2 1 8 36.09 4.51 0.93 0.2 A+
Q 11
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 D 156 2 1 8 53.74 6.72 1.20 -0.4 A-11 D 157 2 1 8 62.71 7.84 0.76 0.6 A+11 D 158 2 1 8 66.89 8.36 1.28 -0.6 A-11 D 159 2 1 8 86.46 10.81 1.20 -0.4 A-11 D 160 2 1 8 45.41 5.68 1.07 -0.2 A-11 D 161 2 1 8 26.65 3.33 0.91 0.2 A+11 D 162 2 1 8 55.26 6.91 1.17 -0.4 A-11 D 163 2 1 8 38.80 4.85 0.89 0.3 A+11 D 164 2 1 8 35.13 4.39 0.99 0.0 A+11 D 165 2 1 8 73.08 9.14 0.76 0.6 A+11 D 166 2 1 8 198.09 24.76 1.54 -1.0 B-11 D 167 2 1 8 229.29 28.66 0.65 1.0 B+11 D 168 2 1 8 26.60 3.33 1.00 0.0 A-11 D 169 2 1 8 18.52 2.31 1.02 -0.1 A-11 D 170 2 1 8 121.43 15.18 1.33 -0.7 A-11 E 156 2 1 8 11.95 1.49 1.10 -0.2 A-11 E 157 2 1 8 130.65 16.33 1.40 -0.8 A-11 E 158 2 1 8 30.71 3.84 0.91 0.2 A+11 E 159 2 1 8 34.96 4.37 0.93 0.2 A+11 E 160 2 1 8 72.82 9.10 1.26 -0.6 A-11 E 161 2 1 8 10.22 1.28 0.93 0.2 A+11 E 162 2 1 8 30.32 3.79 0.88 0.3 A+11 E 163 2 1 8 57.87 7.23 0.85 0.4 A+11 E 164 2 1 8 30.41 3.80 1.12 -0.3 A-11 E 165 2 1 8 59.74 7.47 1.23 -0.5 A-11 E 166 2 1 8 74.16 9.27 1.25 -0.5 A-11 E 167 2 1 8 41.85 5.23 0.86 0.4 A+11 E 168 2 1 8 23.38 2.92 0.97 0.1 A+11 E 169 2 1 8 30.26 3.78 1.03 -0.1 A-11 E 170 2 1 8 36.75 4.59 0.95 0.1 A+11 F 156 2 1 8 32.76 4.09 1.03 -0.1 A-11 F 157 2 1 8 33.79 4.22 1.17 -0.4 A-11 F 158 2 1 8 101.68 12.71 0.80 0.5 A+11 F 159 2 1 8 13.95 1.74 0.89 0.3 A+11 F 160 2 1 8 55.99 7.00 0.88 0.3 A+11 F 161 2 1 8 35.39 4.42 1.11 -0.2 A-11 F 162 2 1 8 30.12 3.77 0.87 0.3 A+11 F 163 2 1 8 8.34 1.04 1.03 -0.1 A-11 F 164 2 1 8 34.31 4.29 0.85 0.4 A+11 F 165 2 1 8 66.73 8.34 0.84 0.4 A+11 F 166 2 1 8 22.38 2.80 0.93 0.2 A+11 F 167 2 1 8 33.48 4.19 1.00 0.0 A+11 F 168 2 1 8 26.73 3.34 1.00 0.0 A-11 F 169 2 1 8 45.62 5.70 1.02 -0.1 A-11 F 170 2 1 8 41.32 5.16 1.04 -0.1 A-
Q 12
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 G 156 2 1 8 57.56 7.20 1.23 -0.5 A-11 G 157 2 1 8 22.66 2.83 1.11 -0.2 A-11 G 158 2 1 8 10.01 1.25 1.02 -0.1 A-11 G 159 2 1 8 110.10 13.76 0.77 0.6 A+11 G 160 2 1 8 23.93 2.99 0.99 0.0 A+11 G 161 2 1 8 183.11 22.89 1.40 -0.8 A-11 G 162 2 1 8 45.70 5.71 1.18 -0.4 A-11 G 163 2 1 8 117.19 14.65 1.36 -0.7 A-11 G 164 2 1 8 172.89 21.61 1.38 -0.8 A-11 G 165 2 1 8 21.25 2.66 1.12 -0.3 A-11 G 166 2 1 8 19.96 2.50 0.95 0.1 A+11 G 167 2 1 8 22.39 2.80 0.92 0.2 A+11 G 168 2 1 8 48.01 6.00 0.92 0.2 A+11 G 169 2 1 8 9.09 1.14 1.01 0.0 A-11 G 170 2 1 8 24.24 3.03 1.00 0.0 A-11 H 156 2 1 8 46.41 5.80 0.80 0.5 A+11 H 157 2 1 8 82.98 10.37 0.73 0.7 A+11 H 158 2 1 8 13.15 1.64 0.99 0.0 A+11 H 159 2 1 8 16.02 2.00 0.92 0.2 A+11 H 160 2 1 8 71.70 8.96 1.29 -0.6 A-11 H 161 2 1 8 25.50 3.19 1.13 -0.3 A-11 H 162 2 1 8 21.73 2.72 0.91 0.2 A+11 H 163 2 1 8 22.55 2.82 0.96 0.1 A+11 H 164 2 1 8 178.74 22.34 0.69 0.9 A+11 H 165 2 1 8 27.35 3.42 0.97 0.1 A+11 H 166 2 1 8 131.18 16.40 0.78 0.6 A+11 H 167 2 1 8 68.23 8.53 0.86 0.3 A+11 H 168 2 1 8 31.88 3.99 1.13 -0.3 A-11 H 169 2 1 8 28.67 3.58 0.88 0.3 A+11 H 170 2 1 8 83.21 10.40 0.78 0.6 A+11 I 156 2 1 8 95.78 11.97 1.55 -1.0 B-11 I 157 2 1 8 44.99 5.62 0.79 0.6 A+11 I 158 2 1 8 5.26 0.66 0.98 0.0 A+11 I 159 2 1 8 43.26 5.41 0.88 0.3 A+11 I 160 2 1 8 130.33 16.29 1.35 -0.7 A-11 I 161 2 1 8 138.79 17.35 1.40 -0.8 A-11 I 162 2 1 8 73.81 9.23 1.25 -0.5 A-11 I 163 2 1 8 10.62 1.33 0.94 0.1 A+11 I 164 2 1 8 14.88 1.86 1.04 -0.1 A-11 I 165 2 1 8 22.77 2.85 1.13 -0.3 A-11 I 166 2 1 8 65.48 8.18 1.21 -0.5 A-11 I 167 2 1 8 32.83 4.10 0.86 0.4 A+11 I 168 2 1 8 25.06 3.13 1.06 -0.1 A-11 I 169 2 1 8 69.33 8.67 1.16 -0.3 A-11 I 170 2 1 8 245.49 30.69 0.65 1.0 B+
Q 13
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 J 156 2 1 8 67.24 8.41 0.85 0.4 A+11 J 157 2 1 8 38.16 4.77 1.08 -0.2 A-11 J 158 2 1 8 38.04 4.76 0.96 0.1 A+11 J 159 2 1 8 9.70 1.21 0.95 0.1 A+11 J 160 2 1 8 19.61 2.45 0.93 0.2 A+11 J 161 2 1 8 216.39 27.05 1.56 -1.0 B-11 J 162 2 1 8 68.85 8.61 0.90 0.3 A+11 J 163 2 1 8 64.57 8.07 1.20 -0.4 A-11 J 164 2 1 8 16.87 2.11 0.97 0.1 A+11 J 165 2 1 8 67.13 8.39 0.85 0.4 A+11 J 166 2 1 8 44.85 5.61 0.91 0.2 A+11 J 167 2 1 8 83.92 10.49 1.20 -0.4 A-11 J 168 2 1 8 12.53 1.57 0.95 0.1 A+11 J 169 2 1 8 64.35 8.04 0.87 0.3 A+11 J 170 2 1 8 151.82 18.98 1.41 -0.8 A-11 W 1 2 1 8 27.32 3.41 1.02 0.0 A-11 W 2 2 1 8 785.80 98.22 0.76 0.6 A+11 W 3 2 1 8 199.36 24.92 1.03 -0.1 A-11 W 4 2 1 8 3950.28 493.78 0.54 1.4 B+11 W 5 2 1 8 229.48 28.69 1.23 -0.5 A-11 W 6 2 1 8 121.71 15.21 0.86 0.3 A+11 W 7 2 1 8 117.53 14.69 0.91 0.2 A+11 W 8 2 1 8 165.80 20.72 1.16 -0.3 A-11 W 9 2 1 8 233.38 29.17 0.87 0.3 A+11 W 10 2 1 8 174.97 21.87 0.93 0.2 A+11 W 11 2 1 8 141.50 17.69 0.87 0.3 A+11 W 12 2 1 8 149.32 18.67 0.88 0.3 A+11 W 13 2 1 8 86.28 10.79 1.07 -0.2 A-11 W 14 2 1 8 378.55 47.32 1.15 -0.3 A-11 W 15 2 1 8 213.47 26.68 0.88 0.3 A+11 W 16 2 1 8 680.05 85.01 0.79 0.6 A+11 W 17 2 1 8 81.37 10.17 1.04 -0.1 A-11 W 18 2 1 8 317.25 39.66 1.13 -0.3 A-11 W 19 2 1 8 1473.30 184.16 0.68 0.9 A+11 W 20 2 1 8 340.10 42.51 1.15 -0.3 A-11 W 21 2 1 8 799.34 99.92 1.30 -0.6 A-11 W 22 2 1 8 300.61 37.58 0.91 0.2 A+11 W 23 2 1 8 259.10 32.39 0.92 0.2 A+11 W 24 2 1 8 421.75 52.72 1.16 -0.3 A-11 W 26 2 1 8 692.64 86.58 0.66 1.0 A+11 W 27 2 1 8 3513.46 439.18 0.50 1.6 C+11 W 28 2 1 8 214.86 26.86 1.17 -0.4 A-11 W 29 2 1 8 438.17 54.77 1.25 -0.5 A-11 W 30 2 1 8 886.13 110.77 0.72 0.8 A+11 W 31 2 1 8 647.62 80.95 0.85 0.4 A+11 W 32 2 1 8 1132.93 141.62 0.77 0.6 A+11 W 33 2 1 8 2117.85 264.73 0.69 0.9 A+11 W 34 2 1 8 184.02 23.00 1.13 -0.3 A-
Q 14
Appendix Q: 2001 PSSA DIF AnalysisMultiple Choice Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 W 35 2 1 8 2991.80 373.97 0.60 1.2 B+11 W 36 2 1 8 594.97 74.37 1.34 -0.7 A-11 W 37 2 1 8 16.65 2.08 1.00 0.0 A+11 W 38 2 1 8 1817.52 227.19 0.66 1.0 A+11 W 39 2 1 8 85.47 10.68 1.08 -0.2 A-11 W 40 2 1 8 276.25 34.53 1.16 -0.3 A-11 W 41 2 1 8 349.56 43.70 0.86 0.4 A+11 W 42 2 1 8 1284.16 160.52 1.45 -0.9 A-11 W 43 2 1 8 422.89 52.86 1.24 -0.5 A-11 W 44 2 1 8 487.62 60.95 1.22 -0.5 A-11 W 45 2 1 8 1197.43 149.68 0.72 0.8 A+11 W 46 2 1 8 420.11 52.51 1.21 -0.5 A-11 W 47 2 1 8 110.07 13.76 1.04 -0.1 A-11 W 48 2 1 8 1675.16 209.39 0.72 0.8 A+11 W 49 2 1 8 781.81 97.73 0.78 0.6 A+11 W 51 2 1 8 373.90 46.74 1.28 -0.6 A-11 W 52 2 1 8 506.20 63.28 1.30 -0.6 A-11 W 53 2 1 8 178.22 22.28 1.17 -0.4 A-11 W 54 2 1 8 843.49 105.44 0.72 0.8 A+11 W 55 2 1 8 506.99 63.37 1.14 -0.3 A-11 W 56 2 1 8 446.23 55.78 1.16 -0.4 A-11 W 57 2 1 8 252.77 31.60 0.86 0.3 A+11 W 58 2 1 8 651.69 81.46 0.82 0.5 A+11 W 59 2 1 8 62.87 7.86 1.02 0.0 A-11 W 60 2 1 8 1403.30 175.41 1.57 -1.1 B-11 W 61 2 1 8 1539.32 192.42 0.69 0.9 A+11 W 62 2 1 8 160.99 20.12 1.07 -0.1 A-11 W 63 2 1 8 961.52 120.19 1.32 -0.7 A-11 W 64 2 1 8 37.13 4.64 1.04 -0.1 A-11 W 65 2 1 8 36.05 4.51 0.99 0.0 A+11 W 66 2 1 8 283.61 35.45 0.87 0.3 A+11 W 67 2 1 8 162.05 20.26 1.07 -0.2 A-11 W 68 2 1 8 515.32 64.42 0.81 0.5 A+11 W 69 2 1 8 95.22 11.90 1.03 -0.1 A-11 W 70 2 1 8 221.14 27.64 1.02 0.0 A-11 W 71 2 1 8 241.02 30.13 0.91 0.2 A+11 W 72 2 1 8 967.81 120.98 1.31 -0.6 A-
Q 15
Appendix R: 2001 PSSA DIF AnalysisOpen Ended Mathematics Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 A 150 2 1 8 5 -0.10 0.02 -5.1 C-5 B 150 2 1 8 5 -0.06 0.02 -2.9 B-5 C 150 2 1 8 5 -0.05 0.02 -2.8 B-5 D 150 2 1 8 5 -0.23 0.02 -10.2 C-5 E 150 2 1 8 5 -0.12 0.02 -6.1 C-5 F 150 2 1 8 5 -0.18 0.02 -10.1 C-5 G 150 2 1 8 5 -0.07 0.02 -4.1 B-5 H 150 2 1 8 5 -0.12 0.02 -8.0 C-5 I 150 2 1 8 5 0.00 0.02 0.0 A+5 J 150 2 1 8 5 -0.11 0.02 -5.8 C-5 W 25 2 1 8 5 -0.01 0.01 -2.5 B-5 W 50 2 1 8 5 -0.06 0.01 -10.6 C-5 W 73 2 1 8 5 -0.10 0.01 -17.5 C-8 A 170 2 1 8 5 -0.25 0.02 -14.8 C-8 B 170 2 1 8 5 -0.36 0.02 -20.3 C-8 C 170 2 1 8 5 -0.24 0.02 -12.6 C-8 D 170 2 1 8 5 -0.31 0.02 -14.5 C-8 E 170 2 1 8 5 -0.12 0.02 -6.7 C-8 F 170 2 1 8 5 -0.21 0.02 -11.2 C-8 G 170 2 1 8 5 -0.16 0.02 -8.3 C-8 H 170 2 1 8 5 -0.10 0.02 -6.0 C-8 I 170 2 1 8 5 -0.10 0.02 -5.5 C-8 J 170 2 1 8 5 -0.34 0.02 -17.6 C-8 W 25 2 1 8 5 0.00 0.01 0.6 A+8 W 50 2 1 8 5 -0.22 0.01 -41.7 C-8 W 73 2 1 8 5 -0.09 0.01 -14.2 C-11 A 180 2 1 8 5.00 -0.10 0.02 -5.4 C-11 B 180 2 1 8 5.00 -0.18 0.02 -8.9 C-11 C 180 2 1 8 5.00 0.06 0.02 4.1 B+11 D 180 2 1 8 5.00 -0.05 0.02 -2.7 B-11 E 180 2 1 8 5.00 -0.06 0.02 -3.9 B-11 F 180 2 1 8 5.00 -0.34 0.02 -15.2 C-11 G 180 2 1 8 5.00 0.03 0.02 1.8 A+11 H 180 2 1 8 5.00 -0.12 0.02 -7.7 C-11 I 180 2 1 8 5.00 0.09 0.02 5.5 C+11 J 180 2 1 8 5.00 0.01 0.02 0.7 A+11 W 25 2 1 8 5.00 -0.08 0.01 -12.3 C-11 W 50 2 1 8 5.00 -0.16 0.01 -30.7 C-11 W 73 2 1 8 5.00 -0.29 0.01 -50.1 C-
R 16
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 1
Grade 5 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code A 150 2 1 8 5 -0.097 0.019 -5.1 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.68 1067 3.78 805| | -* | 3.17 922 3.34 840| | -* | 2.76 837 2.91 819| --* | 2.43 902 2.56 907| --* | | 2.00 808 2.19 844| -* | | 1.69 915 1.78 942| *+ | | 1.39 882 1.30 868| * | | 0.66 871 0.70 7370_________1_________2_________3_________4_________5 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code B 135 2 1 8 447.43 55.93 2.13 -1.8 C-0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+ 1.00 928 0.99 761| | -* 0.98 962 0.99 870| | -*| 0.96 871 0.98 814| | * | 0.96 892 0.97 920| | --* | 0.93 922 0.95 882| | ---* | 0.86 881 0.92 923| | -------* | 0.75 881 0.88 896| -----------* | 0.45 901 0.65 7870____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code D 150 2 1 8 5 -0.227 0.022 -10.2 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 4.44 948 4.54 762| | --* | 3.94 907 4.09 793| | ---* | 3.33 930 3.59 865| | ----* | 2.82 936 3.23 967| ----* | 2.34 839 2.70 874| --* | | 1.87 895 2.06 891| --* | | 1.25 863 1.45 860| --* | | 0.61 896 0.76 8000_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code E 150 2 1 8 5 -0.124 0.020 -6.1 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.05 952 3.20 897| -* | | 1.97 888 2.15 811| -* | | 1.46 930 1.61 962| --* | | 1.04 884 1.22 901| -* | | 0.82 889 0.92 877| -* | | 0.59 876 0.65 900| -* | | 0.36 820 0.53 782| * | | 0.17 881 0.17 7700_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 2
Grade 5 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code F 150 2 1 8 5 -0.183 0.018 -10.1 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.57 957 3.75 771| | --* | 2.86 912 3.12 782| ----* | 2.32 962 2.69 898| --* | | 2.04 935 2.15 881| --* | | 1.61 815 1.78 887| -* | | 1.37 839 1.54 834| -* | | 1.01 873 1.13 911| -* | | 0.60 927 0.70 7860_________1_________2_________3_________4_________5 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code H 139 2 1 8 802.16 100.27 0.48 1.7 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *++ | 0.96 1005 0.92 805| | *+++++ | 0.90 954 0.80 865| | *++++++ | 0.79 996 0.65 907| *++++++++++++ | 0.69 903 0.46 925| *+++++++++++ | 0.51 851 0.28 857| *++++++++ | | 0.34 755 0.18 920| *+++++ | | 0.22 896 0.11 886| -* | | 0.18 854 0.20 7880____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code H 150 2 1 8 5 -0.124 0.015 -8.0 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| |--* | 2.56 1005 2.75 805| --* | | 2.01 954 2.21 865| -* | | 1.73 996 1.83 906| -* | | 1.49 903 1.65 922| * | | 1.36 850 1.39 857| -* | | 1.09 754 1.23 916| -* | | 0.88 890 0.99 883| * | | 0.47 843 0.51 7790_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code J 150 2 1 8 5 -0.112 0.019 -5.8 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.27 969 3.50 749| |--* | 2.59 910 2.76 836| -* | 2.40 800 2.47 724| --* | | 2.10 778 2.26 740| -* | | 1.96 886 2.05 807| * | | 1.77 842 1.81 869| -* | | 1.41 826 1.52 813| * | | 0.93 805 0.91 6820_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 3
Grade 5 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 50 2 1 8 5 -0.055 0.005 -10.6 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.77 9830 3.88 8075| | -* | 3.22 9251 3.33 8372| | -* | 2.90 8922 2.99 8535| |-* | 2.61 8866 2.66 8981| *| | 2.35 8512 2.38 8621| * | | 2.08 8729 2.08 9082| *+ | | 1.76 8584 1.74 8585| -* | | 1.11 8943 1.16 78360_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 73 2 1 8 5 -0.097 0.006 -17.5 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.93 9830 4.04 8075| | -* | 3.36 9251 3.50 8372| | -* | 3.00 8922 3.13 8535| | -* | 2.70 8866 2.81 8981| -* | 2.44 8512 2.53 8621| * | | 2.15 8729 2.22 9082| * | | 1.85 8584 1.88 8585| * | | 1.15 8943 1.23 78360_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 4
Grade 8 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code A 170 2 1 8 5 -0.253 0.017 -14.8 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | ---* | 3.09 911 3.38 772| ---* | 2.37 954 2.74 799| ---*| | 2.07 892 2.43 828| -* | | 1.85 865 2.03 854| ---* | | 1.54 887 1.83 949| --* | | 1.17 842 1.39 862| -* | | 0.85 879 1.03 810| -* | | 0.30 865 0.42 7240_________1_________2_________3_________4_________5 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code B 156 2 1 8 745.45 93.18 0.43 2.0 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+++| 0.97 953 0.92 777| | *+++++ | 0.94 927 0.83 778| | *+++++++ | 0.89 902 0.74 902| | *+++++++++ | 0.77 901 0.57 882| *+++++++++ | 0.61 783 0.43 825| *+++++++++ | 0.50 808 0.32 871| *++++++++ | | 0.34 823 0.18 888| *+++ | | 0.19 836 0.12 7010____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code B 170 2 1 8 5 -0.356 0.018 -20.3 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.48 953 3.63 777| | ---* | 3.09 927 3.38 778| | ----* | 2.70 900 3.08 900| -----* | 2.38 899 2.87 882| -----* | 2.03 779 2.54 825| ----* | | 1.71 803 2.13 866| ----* | | 1.24 813 1.62 875| ---* | | 0.61 804 0.86 6820_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code C 170 2 1 8 5 -0.241 0.019 -12.6 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.97 904 4.17 749| | ---* | 3.28 898 3.65 762| | ----* | 2.70 838 3.05 814| ---* | 2.23 914 2.51 834| ---* | | 1.67 815 1.96 851| --* | | 1.21 798 1.43 888| --* | | 0.71 845 0.89 847| -* | | 0.22 921 0.28 8280_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 5
Grade 8 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code D 170 2 1 8 5 -0.306 0.021 -14.5 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.84 967 4.02 780| | ---* | 3.12 909 3.42 799| |-----* | 2.64 888 3.07 862| ----* | 2.19 842 2.64 809| ----* | | 1.72 862 2.10 899| ----* | | 1.15 787 1.60 901| --* | | 0.83 749 1.00 810| -* | | 0.32 857 0.44 6930_________1_________2_________3_________4_________5 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code E 148 2 1 8 1134.49 141.81 0.37 2.3 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+++| 0.97 991 0.92 806| | *+++++ | 0.92 872 0.81 813| | *++++++++++ | 0.85 922 0.67 902| | *++++++++++++ | 0.78 822 0.54 796| *+++++++++++++ | 0.71 837 0.44 883| *+++++++++++++ | 0.58 786 0.33 840| *+++++++++ | | 0.43 799 0.25 914| *+++++ | | 0.26 941 0.16 7870____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code E 170 2 1 8 5 -0.122 0.018 -6.7 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | * | 4.06 991 4.14 806| | --* | 2.98 872 3.17 812| --*| | 2.19 921 2.39 902| -* | | 1.66 820 1.80 796| -* | | 1.26 835 1.42 881| * | | 1.01 783 1.04 837| -* | | 0.68 794 0.80 910| -* | | 0.33 905 0.39 7720_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code F 170 2 1 8 5 -0.206 0.019 -11.2 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.17 936 3.43 841| ---* | 2.45 825 2.81 823| ----* | | 1.85 910 2.18 895| ---* | | 1.34 850 1.57 792| --* | | 0.77 822 1.04 961| -* | | 0.49 804 0.62 873| * | | 0.30 775 0.32 761|* | | 0.10 824 0.12 7830_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 6
Grade 8 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code G 170 2 1 8 5 -0.161 0.019 -8.3 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 4.21 918 4.44 805| | --* | 3.76 900 3.98 775| | ---* | 3.42 876 3.66 848| | ---* | 2.98 877 3.29 812| |* | 2.57 851 2.62 914| -* | | 1.93 799 2.02 846| -* | | 1.18 857 1.32 866| * | | 0.42 881 0.41 7500_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code H 170 2 1 8 5 -0.104 0.017 -6.0 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.13 940 3.23 766| --* | 2.27 892 2.48 759| -* | | 1.79 901 1.92 875| --* | | 1.34 857 1.48 813| --* | | 0.85 858 1.02 959| -* | | 0.53 856 0.61 872| * | | 0.26 820 0.28 867|* | | 0.10 822 0.09 6580_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code I 170 2 1 8 5 -0.098 0.018 -5.5 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.29 990 3.45 823| --* | 2.35 889 2.53 840| --* | | 1.75 866 1.90 859| * | | 1.25 873 1.32 853| * | | 0.90 810 0.94 849| -* | | 0.49 840 0.58 926| * | | 0.27 808 0.33 869|* | | 0.11 810 0.12 7010_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code J 170 2 1 8 5 -0.336 0.019 -17.6 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.93 970 4.12 737| | ---* | 3.28 876 3.64 801| | ------* | 2.83 849 3.38 837| ----* | 2.35 869 2.83 908| ------* | | 1.63 854 2.17 930| ----* | | 1.22 799 1.55 878| --* | | 0.73 818 0.86 790| -* | | 0.28 893 0.40 7260_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 7
Grade 8 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 50 2 1 8 5 -0.217 0.005 -41.7 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | ---* | 3.02 9480 3.30 7856| ---*| | 2.08 8943 2.37 7951| --* | | 1.57 8849 1.82 8630| --* | | 1.19 8679 1.44 8360| ---* | | 0.93 8396 1.15 9031| -* | | 0.76 8145 0.93 8787| -* | | 0.60 8222 0.74 8463| -* | | 0.37 8875 0.48 75050_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 73 2 1 8 5 -0.092 0.006 -14.2 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 4.08 9480 4.22 7856| | --* | 2.99 8943 3.18 7951| --*| | 2.22 8849 2.36 8630| * | | 1.66 8679 1.74 8360| * | | 1.19 8396 1.24 9031| -* | | 0.82 8145 0.87 8787| -* | | 0.53 8222 0.56 8463| -* | | 0.20 8875 0.25 75050_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 8
Grade 11 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code A 180 2 1 8 5 -0.097 0.018 -5.4 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.81 762 4.03 669| | -* | 3.32 708 3.42 688| | -* | 2.83 728 2.85 768| * | | 2.11 710 2.12 698| * | | 1.52 636 1.51 764| * | | 1.08 685 1.13 714| --* | | 0.73 733 0.89 731| --* | | 0.32 755 0.51 6220_________1_________2_________3_________4_________5 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code B 160 2 1 8 457.21 57.15 0.53 1.5 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+ | 0.96 749 0.93 613| | *++++ | 0.89 741 0.82 757| | *++++++ | 0.80 684 0.67 700| |*++++++++ | 0.68 663 0.51 665| *++++++++ | 0.57 715 0.40 768| *++++++++++ | | 0.42 667 0.21 714| *+++++ | | 0.25 695 0.16 764| *+ | | 0.22 756 0.19 6370____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code B 180 2 1 8 5 -0.182 0.020 -8.9 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 4.01 749 4.14 613| | ---* | 3.51 740 3.84 756| | ----* | 2.89 683 3.27 697| --* | | 2.08 661 2.27 662| ---* | | 1.07 710 1.43 762| * | | 0.66 663 0.68 707| * | | 0.30 690 0.32 749|* | | 0.08 732 0.10 6210_________1_________2_________3_________4_________5 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code C 169 2 1 8 919.87 114.98 0.44 1.9 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+++++++++++ | 0.84 748 0.62 579| *+++++++++++ | 0.63 701 0.43 665| *++++++++++++++ | 0.53 637 0.25 707| *+++++++++ | | 0.40 700 0.22 716| *+++++++++ | | 0.36 628 0.18 665| *++++ | | 0.27 708 0.19 726| *+++++ | | 0.28 615 0.17 698| *++ | | 0.22 724 0.18 6170____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 9
Grade 11 Math Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code F 180 2 1 8 5 -0.344 0.023 -15.2 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -----* | 3.35 771 3.75 609| | ---* | 2.77 762 3.06 737| ----* | 2.21 647 2.63 691| ----* | | 1.77 699 2.18 722| -----* | | 1.27 670 1.84 738| ---* | | 0.88 685 1.24 739| --* | | 0.53 675 0.72 716| -* | | 0.18 736 0.29 5650_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code H 180 2 1 8 5 -0.120 0.016 -7.7 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| --* | | 2.13 778 2.30 598| --* | | 1.16 649 1.35 701| --* | | 0.81 633 1.01 688| -* | | 0.65 725 0.75 710| -* | | 0.53 698 0.62 739| -* | | 0.42 678 0.48 757| -* | | 0.29 690 0.38 683|-* | | 0.10 655 0.16 5640_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code I 180 2 1 8 5 0.087 0.016 5.5 C+0_________1_________2_________3_________4_________5 FOCAL REFERENCE| *++| | 2.43 787 2.23 645| *+ | | 1.42 755 1.34 716| *+ | | 1.08 733 1.01 722| *+ | | 0.90 667 0.80 720| *+ | | 0.71 636 0.64 718| *+ | | 0.51 623 0.42 661| * | | 0.31 666 0.28 677|* | | 0.12 688 0.10 6420_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 25 2 1 8 5 -0.076 0.006 -12.3 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.51 7715 3.65 6258| | --* | 2.79 7277 2.98 7049| --* | | 1.93 6934 2.11 7122| -* | | 1.16 6867 1.27 7180| * | | 0.68 6542 0.72 7315| * | | 0.38 6773 0.35 7294| * | | 0.19 6819 0.17 6991*+ | | 0.06 7453 0.04 62870_________1_________2_________3_________4_________5 Right Total Right Total
Appendix S: 2001 PSSA DIF Plots for Questionable Mathematics Items
S 10
Grade 11 Math Items
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code W 27 2 1 8 3513.46 439.18 0.50 1.6 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | * 0.99 7715 0.99 6258| | *+| 0.98 7277 0.96 7049| | *++ | 0.95 6934 0.91 7122| | *+++++ | 0.90 6867 0.80 7180| | *+++++++ | 0.81 6542 0.66 7315| |*++++++++ | 0.69 6773 0.51 7294| *++++++++ | 0.54 6819 0.37 6991| *+++++++ | | 0.38 7453 0.25 62870____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 50 2 1 8 5 -0.161 0.005 -30.7 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | -* | 3.14 7715 3.17 6258| --*| | 2.24 7277 2.41 7049| --* | | 1.70 6934 1.94 7122| --* | | 1.36 6867 1.57 7180| --* | | 1.10 6542 1.28 7315| --* | | 0.89 6773 1.05 7294| -* | | 0.68 6819 0.85 6991| --* | | 0.33 7453 0.47 62870_________1_________2_________3_________4_________5 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 73 2 1 8 5 -0.292 0.006 -50.1 C-0_________1_________2_________3_________4_________5 FOCAL REFERENCE| | --* | 3.59 7715 3.83 6258| | ----* | 2.72 7277 3.07 7049| ----* | 2.35 6934 2.67 7122| ---*| | 2.08 6867 2.39 7180| ----* | | 1.84 6542 2.15 7315| ---* | | 1.61 6773 1.89 7294| ---* | | 1.23 6819 1.54 6991| --* | | 0.55 7453 0.78 62870_________1_________2_________3_________4_________5 Right Total Right Total
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 A 159 2 1 8 57.46 7.18 0.93 0.2 A+5 A 160 2 1 8 16.67 2.08 0.99 0.0 A+5 A 161 2 1 8 98.49 12.31 1.17 -0.4 A-5 A 162 2 1 8 37.23 4.65 1.16 -0.4 A-5 A 163 2 1 8 15.71 1.96 1.04 -0.1 A-5 A 164 2 1 8 136.37 17.05 1.29 -0.6 A-5 A 166 2 1 8 113.11 14.14 1.54 -1.0 B-5 A 167 2 1 8 48.92 6.12 0.93 0.2 A+5 A 168 2 1 8 227.49 28.44 0.65 1.0 B+5 A 169 2 1 8 49.53 6.19 0.83 0.4 A+5 A 170 2 1 8 66.97 8.37 0.78 0.6 A+5 A 171 2 1 8 32.30 4.04 1.06 -0.1 A-5 A 172 2 1 8 57.28 7.16 0.87 0.3 A+5 A 173 2 1 8 31.21 3.90 1.15 -0.3 A-5 A 174 2 1 8 26.01 3.25 0.89 0.3 A+5 A 175 2 1 8 123.24 15.41 0.77 0.6 A+5 A 176 2 1 8 22.15 2.77 1.05 -0.1 A-5 A 177 2 1 8 7.06 0.88 0.96 0.1 A+5 A 178 2 1 8 24.51 3.06 0.99 0.0 A+5 A 179 2 1 8 57.91 7.24 1.23 -0.5 A-5 A 180 2 1 8 30.67 3.83 0.92 0.2 A+5 A 181 2 1 8 41.99 5.25 0.91 0.2 A+5 A 182 2 1 8 15.09 1.89 0.97 0.1 A+5 A 183 2 1 8 10.28 1.28 0.95 0.1 A+5 A 184 2 1 8 48.28 6.03 0.91 0.2 A+5 B 159 2 1 8 49.79 6.22 1.29 -0.6 A-5 B 160 2 1 8 126.09 15.76 0.77 0.6 A+5 B 161 2 1 8 35.44 4.43 1.06 -0.1 A-5 B 162 2 1 8 17.29 2.16 0.99 0.0 A+5 B 163 2 1 8 24.61 3.08 0.83 0.4 A+5 B 165 2 1 8 108.97 13.62 0.83 0.4 A+5 B 166 2 1 8 23.94 2.99 1.01 0.0 A-5 B 167 2 1 8 82.61 10.33 1.48 -0.9 A-5 B 168 2 1 8 40.56 5.07 0.82 0.5 A+5 B 169 2 1 8 45.45 5.68 1.08 -0.2 A-5 B 170 2 1 8 109.47 13.68 0.73 0.7 A+5 B 171 2 1 8 21.58 2.70 0.96 0.1 A+5 B 172 2 1 8 13.35 1.67 0.94 0.1 A+5 B 173 2 1 8 17.14 2.14 1.11 -0.2 A-5 B 174 2 1 8 91.24 11.41 0.76 0.6 A+5 B 175 2 1 8 73.83 9.23 0.88 0.3 A+5 B 176 2 1 8 24.27 3.03 1.06 -0.1 A-5 B 178 2 1 8 30.40 3.80 0.88 0.3 A+5 B 179 2 1 8 52.13 6.52 1.13 -0.3 A-5 B 180 2 1 8 16.49 2.06 1.08 -0.2 A-5 B 181 2 1 8 36.79 4.60 0.94 0.1 A+5 B 182 2 1 8 21.07 2.63 0.97 0.1 A+5 B 183 2 1 8 60.78 7.60 0.84 0.4 A+5 B 184 2 1 8 12.26 1.53 1.01 0.0 A-
T 1
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 C 159 2 1 8 28.58 3.57 0.93 0.2 A+5 C 160 2 1 8 488.71 61.09 0.47 1.8 C+5 C 161 2 1 8 105.50 13.19 1.47 -0.9 A-5 C 162 2 1 8 21.62 2.70 0.95 0.1 A+5 C 163 2 1 8 29.17 3.65 0.88 0.3 A+5 C 164 2 1 8 18.01 2.25 0.99 0.0 A+5 C 165 2 1 8 23.91 2.99 1.13 -0.3 A-5 C 166 2 1 8 54.27 6.78 0.87 0.3 A+5 C 167 2 1 8 122.33 15.29 0.76 0.7 A+5 C 168 2 1 8 57.11 7.14 0.82 0.5 A+5 C 169 2 1 8 260.20 32.53 0.55 1.4 B+5 C 170 2 1 8 49.26 6.16 0.88 0.3 A+5 C 171 2 1 8 54.74 6.84 1.18 -0.4 A-5 C 172 2 1 8 10.00 1.25 0.94 0.1 A+5 C 173 2 1 8 12.76 1.60 0.92 0.2 A+5 C 174 2 1 8 79.69 9.96 0.80 0.5 A+5 C 175 2 1 8 7.33 0.92 1.08 -0.2 A-5 C 177 2 1 8 22.13 2.77 1.09 -0.2 A-5 C 178 2 1 8 19.16 2.39 0.92 0.2 A+5 C 179 2 1 8 40.83 5.10 1.19 -0.4 A-5 C 180 2 1 8 75.65 9.46 1.20 -0.4 A-5 C 181 2 1 8 62.54 7.82 1.19 -0.4 A-5 C 182 2 1 8 77.64 9.70 1.33 -0.7 A-5 C 184 2 1 8 15.07 1.88 0.97 0.1 A+5 D 159 2 1 8 17.04 2.13 1.02 0.0 A-5 D 160 2 1 8 27.01 3.38 1.04 -0.1 A-5 D 161 2 1 8 72.01 9.00 1.24 -0.5 A-5 D 162 2 1 8 16.55 2.07 1.05 -0.1 A-5 D 163 2 1 8 1.82 0.23 0.98 0.1 A+5 D 164 2 1 8 17.46 2.18 0.88 0.3 A+5 D 165 2 1 8 35.44 4.43 0.86 0.4 A+5 D 166 2 1 8 31.96 4.00 0.96 0.1 A+5 D 167 2 1 8 103.14 12.89 1.46 -0.9 A-5 D 168 2 1 8 51.59 6.45 1.07 -0.2 A-5 D 169 2 1 8 864.04 108.01 0.41 2.1 C+5 D 170 2 1 8 49.41 6.18 0.87 0.3 A+5 D 172 2 1 8 18.47 2.31 1.11 -0.2 A-5 D 173 2 1 8 42.75 5.34 1.13 -0.3 A-5 D 174 2 1 8 13.31 1.66 1.00 0.0 A5 D 175 2 1 8 49.67 6.21 1.20 -0.4 A-5 D 176 2 1 8 29.88 3.73 0.89 0.3 A+5 D 177 2 1 8 33.77 4.22 1.11 -0.3 A-5 D 178 2 1 8 207.27 25.91 1.39 -0.8 A-5 D 179 2 1 8 19.76 2.47 1.00 0.0 A-5 D 180 2 1 8 68.70 8.59 1.27 -0.6 A-5 D 181 2 1 8 136.17 17.02 0.75 0.7 A+5 D 182 2 1 8 10.44 1.31 0.99 0.0 A+5 D 183 2 1 8 40.86 5.11 1.18 -0.4 A-5 D 184 2 1 8 14.34 1.79 0.94 0.2 A+
T 2
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 E 159 2 1 8 45.86 5.73 0.95 0.1 A+5 E 160 2 1 8 131.32 16.41 1.46 -0.9 A-5 E 161 2 1 8 29.45 3.68 0.96 0.1 A+5 E 162 2 1 8 43.35 5.42 1.00 0.0 A+5 E 163 2 1 8 16.50 2.06 1.01 0.0 A-5 E 164 2 1 8 21.47 2.68 1.04 -0.1 A-5 E 165 2 1 8 139.80 17.48 1.45 -0.9 A-5 E 166 2 1 8 193.37 24.17 1.73 -1.3 B-5 E 167 2 1 8 138.80 17.35 0.74 0.7 A+5 E 169 2 1 8 873.56 109.20 0.39 2.2 C+5 E 170 2 1 8 64.53 8.07 1.11 -0.2 A-5 E 171 2 1 8 78.74 9.84 0.83 0.4 A+5 E 172 2 1 8 43.41 5.43 0.83 0.4 A+5 E 173 2 1 8 76.94 9.62 1.21 -0.5 A-5 E 174 2 1 8 21.17 2.65 1.10 -0.2 A-5 E 175 2 1 8 22.31 2.79 1.02 0.0 A-5 E 176 2 1 8 31.59 3.95 1.09 -0.2 A-5 E 177 2 1 8 100.75 12.59 1.27 -0.6 A-5 E 178 2 1 8 30.03 3.75 0.92 0.2 A+5 E 179 2 1 8 59.64 7.46 0.83 0.4 A+5 E 180 2 1 8 29.88 3.73 1.12 -0.3 A-5 E 181 2 1 8 56.34 7.04 1.28 -0.6 A-5 E 182 2 1 8 30.78 3.85 1.05 -0.1 A-5 E 183 2 1 8 14.86 1.86 0.98 0.1 A+5 E 184 2 1 8 27.18 3.40 0.91 0.2 A+5 F 159 2 1 8 79.13 9.89 0.81 0.5 A+5 F 160 2 1 8 45.58 5.70 1.03 -0.1 A-5 F 161 2 1 8 10.73 1.34 1.06 -0.1 A-5 F 162 2 1 8 161.99 20.25 0.77 0.6 A+5 F 163 2 1 8 20.38 2.55 1.09 -0.2 A-5 F 165 2 1 8 25.74 3.22 0.98 0.0 A+5 F 166 2 1 8 81.08 10.13 1.46 -0.9 A-5 F 167 2 1 8 44.94 5.62 1.31 -0.6 A-5 F 168 2 1 8 31.49 3.94 0.95 0.1 A+5 F 169 2 1 8 27.31 3.41 0.93 0.2 A+5 F 170 2 1 8 29.07 3.63 1.01 0.0 A-5 F 171 2 1 8 12.89 1.61 1.03 -0.1 A-5 F 172 2 1 8 153.34 19.17 0.75 0.7 A+5 F 173 2 1 8 22.00 2.75 0.99 0.0 A+5 F 174 2 1 8 16.58 2.07 1.09 -0.2 A-5 F 175 2 1 8 10.30 1.29 1.02 0.0 A-5 F 176 2 1 8 23.25 2.91 1.09 -0.2 A-5 F 177 2 1 8 167.10 20.89 1.31 -0.6 A-5 F 178 2 1 8 39.93 4.99 0.92 0.2 A+5 F 180 2 1 8 95.47 11.93 0.88 0.3 A+5 F 181 2 1 8 245.03 30.63 0.64 1.1 B+5 F 182 2 1 8 19.60 2.45 0.89 0.3 A+5 F 183 2 1 8 58.65 7.33 1.13 -0.3 A-5 F 184 2 1 8 152.75 19.09 0.67 1.0 A+
T 3
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 G 159 2 1 8 29.09 3.64 1.01 0.0 A-5 G 160 2 1 8 24.14 3.02 0.88 0.3 A+5 G 161 2 1 8 19.30 2.41 1.12 -0.3 A-5 G 162 2 1 8 170.46 21.31 0.72 0.8 A+5 G 164 2 1 8 14.80 1.85 0.93 0.2 A+5 G 165 2 1 8 119.12 14.89 1.32 -0.6 A-5 G 166 2 1 8 12.50 1.56 0.95 0.1 A+5 G 167 2 1 8 19.30 2.41 1.15 -0.3 A-5 G 168 2 1 8 132.90 16.61 0.75 0.7 A+5 G 169 2 1 8 36.12 4.51 1.05 -0.1 A-5 G 170 2 1 8 26.34 3.29 0.99 0.0 A+5 G 171 2 1 8 48.13 6.02 0.84 0.4 A+5 G 172 2 1 8 28.76 3.59 1.09 -0.2 A-5 G 173 2 1 8 31.21 3.90 1.07 -0.1 A-5 G 174 2 1 8 118.55 14.82 1.35 -0.7 A-5 G 175 2 1 8 19.08 2.38 1.03 -0.1 A-5 G 176 2 1 8 31.15 3.89 1.02 -0.1 A-5 G 177 2 1 8 35.29 4.41 0.92 0.2 A+5 G 178 2 1 8 61.70 7.71 1.14 -0.3 A-5 G 180 2 1 8 50.66 6.33 0.84 0.4 A+5 G 181 2 1 8 100.18 12.52 1.28 -0.6 A-5 G 182 2 1 8 889.03 111.13 0.37 2.3 C+5 G 183 2 1 8 52.38 6.55 1.29 -0.6 A-5 G 184 2 1 8 55.70 6.96 0.85 0.4 A+5 H 159 2 1 8 47.35 5.92 0.87 0.3 A+5 H 160 2 1 8 33.26 4.16 0.91 0.2 A+5 H 161 2 1 8 87.79 10.97 0.86 0.4 A+5 H 162 2 1 8 27.96 3.49 0.93 0.2 A+5 H 163 2 1 8 20.01 2.50 0.99 0.0 A+5 H 164 2 1 8 36.68 4.59 1.11 -0.2 A-5 H 165 2 1 8 61.90 7.74 0.82 0.5 A+5 H 166 2 1 8 12.54 1.57 1.05 -0.1 A-5 H 167 2 1 8 52.46 6.56 1.20 -0.4 A-5 H 168 2 1 8 32.47 4.06 1.00 0.0 A+5 H 169 2 1 8 16.29 2.04 1.06 -0.1 A-5 H 170 2 1 8 10.16 1.27 0.95 0.1 A+5 H 171 2 1 8 39.78 4.97 1.08 -0.2 A-5 H 172 2 1 8 51.84 6.48 1.28 -0.6 A-5 H 173 2 1 8 544.14 68.02 0.47 1.8 C+5 H 174 2 1 8 23.49 2.94 1.03 -0.1 A-5 H 175 2 1 8 26.25 3.28 0.95 0.1 A+5 H 176 2 1 8 30.90 3.86 0.90 0.2 A+5 H 177 2 1 8 58.26 7.28 1.10 -0.2 A-5 H 178 2 1 8 107.56 13.44 1.46 -0.9 A-5 H 179 2 1 8 134.70 16.84 1.36 -0.7 A-5 H 180 2 1 8 10.33 1.29 1.02 0.0 A-5 H 181 2 1 8 669.17 83.65 0.45 1.9 C+5 H 182 2 1 8 49.49 6.19 0.82 0.5 A+5 H 183 2 1 8 16.28 2.03 0.94 0.1 A+5 H 184 2 1 8 48.74 6.09 1.14 -0.3 A-
T 4
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 I 159 2 1 8 68.25 8.53 0.83 0.4 A+5 I 160 2 1 8 16.59 2.07 1.10 -0.2 A-5 I 161 2 1 8 20.51 2.56 0.91 0.2 A+5 I 162 2 1 8 120.19 15.02 0.76 0.6 A+5 I 163 2 1 8 15.44 1.93 0.98 0.0 A+5 I 164 2 1 8 6.26 0.78 1.02 0.0 A-5 I 165 2 1 8 22.54 2.82 0.94 0.1 A+5 I 166 2 1 8 110.41 13.80 1.31 -0.6 A-5 I 167 2 1 8 15.95 1.99 0.98 0.1 A+5 I 168 2 1 8 32.92 4.11 0.96 0.1 A+5 I 169 2 1 8 10.55 1.32 0.95 0.1 A+5 I 170 2 1 8 10.76 1.35 1.03 -0.1 A-5 I 171 2 1 8 68.02 8.50 0.86 0.4 A+5 I 172 2 1 8 29.00 3.63 1.02 0.0 A-5 I 173 2 1 8 23.81 2.98 1.03 -0.1 A-5 I 174 2 1 8 7.49 0.94 1.04 -0.1 A-5 I 175 2 1 8 1.61 0.20 1.02 0.0 A-5 I 176 2 1 8 53.30 6.66 1.19 -0.4 A-5 I 177 2 1 8 81.23 10.15 1.21 -0.4 A-5 I 179 2 1 8 158.66 19.83 1.57 -1.1 B-5 I 180 2 1 8 113.36 14.17 0.90 0.2 A+5 I 181 2 1 8 299.22 37.40 0.61 1.2 B+5 I 182 2 1 8 56.14 7.02 0.85 0.4 A+5 I 183 2 1 8 68.05 8.51 0.77 0.6 A+5 I 184 2 1 8 26.03 3.25 1.01 0.0 A-5 J 159 2 1 8 15.80 1.98 0.90 0.2 A+5 J 160 2 1 8 20.72 2.59 0.97 0.1 A+5 J 161 2 1 8 105.90 13.24 0.74 0.7 A+5 J 162 2 1 8 56.54 7.07 0.83 0.4 A+5 J 163 2 1 8 39.83 4.98 1.03 -0.1 A-5 J 165 2 1 8 63.26 7.91 0.81 0.5 A+5 J 166 2 1 8 22.60 2.83 1.10 -0.2 A-5 J 167 2 1 8 38.31 4.79 1.27 -0.6 A-5 J 168 2 1 8 56.50 7.06 0.97 0.1 A+5 J 169 2 1 8 35.82 4.48 1.00 0.0 A5 J 170 2 1 8 47.32 5.92 0.84 0.4 A+5 J 171 2 1 8 22.35 2.79 1.02 -0.1 A-5 J 172 2 1 8 31.53 3.94 1.24 -0.5 A-5 J 173 2 1 8 168.31 21.04 0.73 0.8 A+5 J 174 2 1 8 31.74 3.97 1.04 -0.1 A-5 J 175 2 1 8 24.54 3.07 0.97 0.1 A+5 J 176 2 1 8 26.42 3.30 0.89 0.3 A+5 J 178 2 1 8 100.17 12.52 0.83 0.4 A+5 J 179 2 1 8 12.15 1.52 1.01 0.0 A-5 J 180 2 1 8 35.63 4.45 1.32 -0.7 A-5 J 181 2 1 8 47.84 5.98 0.84 0.4 A+5 J 182 2 1 8 39.23 4.90 1.15 -0.3 A-5 J 183 2 1 8 49.06 6.13 0.83 0.4 A+5 J 184 2 1 8 15.01 1.88 0.88 0.3 A+
T 5
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 W 74 2 1 8 25.02 3.13 0.98 0.0 A+5 W 75 2 1 8 243.69 30.46 1.16 -0.3 A-5 W 76 2 1 8 188.35 23.54 0.93 0.2 A+5 W 77 2 1 8 222.09 27.76 0.89 0.3 A+5 W 78 2 1 8 513.05 64.13 1.23 -0.5 A-5 W 79 2 1 8 48.07 6.01 0.96 0.1 A+5 W 80 2 1 8 651.64 81.45 0.90 0.3 A+5 W 81 2 1 8 204.07 25.51 0.88 0.3 A+5 W 82 2 1 8 111.43 13.93 0.99 0.0 A+5 W 83 2 1 8 3807.50 475.94 0.60 1.2 B+5 W 84 2 1 8 137.28 17.16 1.08 -0.2 A-5 W 85 2 1 8 120.72 15.09 1.04 -0.1 A-5 W 86 2 1 8 296.28 37.04 1.12 -0.3 A-5 W 87 2 1 8 72.50 9.06 1.04 -0.1 A-5 W 88 2 1 8 499.18 62.40 1.22 -0.5 A-5 W 89 2 1 8 1025.95 128.24 1.28 -0.6 A-5 W 90 2 1 8 147.23 18.40 1.10 -0.2 A-5 W 91 2 1 8 109.19 13.65 1.08 -0.2 A-5 W 92 2 1 8 528.13 66.02 1.19 -0.4 A-5 W 93 2 1 8 143.63 17.95 1.09 -0.2 A-5 W 94 2 1 8 96.74 12.09 1.05 -0.1 A-5 W 95 2 1 8 1126.86 140.86 0.77 0.6 A+5 W 96 2 1 8 78.77 9.85 1.07 -0.2 A-5 W 97 2 1 8 84.99 10.62 1.08 -0.2 A-5 W 98 2 1 8 235.71 29.46 0.91 0.2 A+5 W 99 2 1 8 353.31 44.16 1.17 -0.4 A-5 W 101 2 1 8 22.75 2.84 0.97 0.1 A+5 W 102 2 1 8 117.60 14.70 0.91 0.2 A+5 W 103 2 1 8 17.21 2.15 1.03 -0.1 A-5 W 104 2 1 8 70.55 8.82 1.00 0.0 A+5 W 105 2 1 8 27.45 3.43 0.99 0.0 A+5 W 106 2 1 8 93.14 11.64 0.93 0.2 A+5 W 107 2 1 8 12.92 1.61 1.02 0.0 A-5 W 108 2 1 8 579.18 72.40 1.29 -0.6 A-5 W 109 2 1 8 565.49 70.69 1.21 -0.5 A-5 W 110 2 1 8 199.45 24.93 1.09 -0.2 A-5 W 111 2 1 8 2577.12 322.14 0.69 0.9 A+5 W 112 2 1 8 342.52 42.82 0.89 0.3 A+5 W 113 2 1 8 32.25 4.03 1.03 -0.1 A-5 W 114 2 1 8 297.22 37.15 1.01 0.0 A-5 W 115 2 1 8 447.30 55.91 0.77 0.6 A+5 W 116 2 1 8 502.49 62.81 1.19 -0.4 A-5 W 117 2 1 8 221.64 27.71 1.11 -0.2 A-5 W 118 2 1 8 69.72 8.72 1.06 -0.1 A-5 W 119 2 1 8 96.08 12.01 1.00 0.0 A+5 W 120 2 1 8 153.47 19.18 1.10 -0.2 A-5 W 121 2 1 8 105.35 13.17 1.07 -0.2 A-5 W 122 2 1 8 844.27 105.53 0.74 0.7 A+5 W 123 2 1 8 357.63 44.70 0.88 0.3 A+5 W 124 2 1 8 108.32 13.54 0.93 0.2 A+5 W 125 2 1 8 114.41 14.30 1.05 -0.1 A-5 W 126 2 1 8 1056.77 132.10 0.78 0.6 A+
T 6
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 A 179 2 1 8 17.78 2.22 1.10 -0.2 A-8 A 180 2 1 8 24.78 3.10 0.85 0.4 A+8 A 181 2 1 8 17.06 2.13 1.03 -0.1 A-8 A 182 2 1 8 80.15 10.02 0.81 0.5 A+8 A 183 2 1 8 32.06 4.01 1.10 -0.2 A-8 A 184 2 1 8 85.16 10.65 0.83 0.4 A+8 A 185 2 1 8 42.72 5.34 1.00 0.0 A8 A 186 2 1 8 41.84 5.23 1.31 -0.6 A-8 A 187 2 1 8 38.17 4.77 0.98 0.0 A+8 A 188 2 1 8 50.23 6.28 0.88 0.3 A+8 A 189 2 1 8 29.70 3.71 1.02 0.0 A-8 A 190 2 1 8 71.37 8.92 1.21 -0.4 A-8 A 191 2 1 8 15.44 1.93 0.93 0.2 A+8 A 192 2 1 8 282.51 35.31 1.61 -1.1 B-8 A 193 2 1 8 25.88 3.24 0.96 0.1 A+8 A 194 2 1 8 15.16 1.90 1.01 0.0 A-8 A 195 2 1 8 21.44 2.68 1.07 -0.2 A-8 A 196 2 1 8 34.28 4.29 1.12 -0.3 A-8 A 197 2 1 8 198.89 24.86 0.64 1.0 B+8 A 198 2 1 8 21.89 2.74 1.00 0.0 A-8 A 199 2 1 8 115.56 14.44 0.77 0.6 A+8 A 200 2 1 8 21.22 2.65 0.96 0.1 A+8 A 201 2 1 8 18.44 2.31 0.91 0.2 A+8 A 202 2 1 8 25.52 3.19 1.09 -0.2 A-8 A 203 2 1 8 17.96 2.25 0.99 0.0 A+8 A 204 2 1 8 199.19 24.90 0.63 1.1 B+8 A 205 2 1 8 5.89 0.74 0.96 0.1 A+8 A 206 2 1 8 68.16 8.52 1.21 -0.4 A-8 A 207 2 1 8 48.31 6.04 0.87 0.3 A+8 A 208 2 1 8 54.83 6.85 0.85 0.4 A+8 A 209 2 1 8 16.07 2.01 1.02 0.0 A-8 A 210 2 1 8 66.83 8.35 1.25 -0.5 A-8 A 211 2 1 8 602.08 75.26 0.54 1.5 B+8 A 212 2 1 8 28.47 3.56 1.05 -0.1 A-8 A 213 2 1 8 18.03 2.25 0.94 0.1 A+8 A 214 2 1 8 21.30 2.66 1.08 -0.2 A-
T 7
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 B 179 2 1 8 32.59 4.07 1.18 -0.4 A-8 B 180 2 1 8 289.77 36.22 0.62 1.1 B+8 B 181 2 1 8 25.41 3.18 0.88 0.3 A+8 B 182 2 1 8 26.50 3.31 1.11 -0.3 A-8 B 183 2 1 8 9.97 1.25 1.05 -0.1 A-8 B 184 2 1 8 17.22 2.15 1.15 -0.3 A-8 B 185 2 1 8 43.38 5.42 0.81 0.5 A+8 B 186 2 1 8 62.83 7.85 1.39 -0.8 A-8 B 187 2 1 8 94.83 11.85 0.80 0.5 A+8 B 188 2 1 8 30.47 3.81 1.13 -0.3 A-8 B 189 2 1 8 47.51 5.94 1.16 -0.3 A-8 B 190 2 1 8 80.62 10.08 1.38 -0.8 A-8 B 191 2 1 8 110.72 13.84 0.78 0.6 A+8 B 192 2 1 8 47.91 5.99 0.88 0.3 A+8 B 193 2 1 8 50.57 6.32 1.11 -0.2 A-8 B 194 2 1 8 99.93 12.49 1.11 -0.3 A-8 B 195 2 1 8 30.63 3.83 1.15 -0.3 A-8 B 196 2 1 8 34.20 4.27 0.92 0.2 A+8 B 197 2 1 8 12.77 1.60 0.96 0.1 A+8 B 198 2 1 8 186.20 23.28 0.71 0.8 A+8 B 199 2 1 8 20.41 2.55 0.91 0.2 A+8 B 200 2 1 8 157.92 19.74 0.62 1.1 B+8 B 201 2 1 8 27.01 3.38 0.88 0.3 A+8 B 202 2 1 8 315.07 39.38 0.62 1.1 B+8 B 203 2 1 8 20.26 2.53 0.99 0.0 A+8 B 204 2 1 8 67.91 8.49 1.19 -0.4 A-8 B 205 2 1 8 108.56 13.57 1.58 -1.1 B-8 B 206 2 1 8 47.07 5.88 1.13 -0.3 A-8 B 207 2 1 8 26.53 3.32 0.92 0.2 A+8 B 208 2 1 8 28.24 3.53 0.83 0.4 A+8 B 209 2 1 8 129.19 16.15 0.74 0.7 A+8 B 210 2 1 8 45.29 5.66 0.86 0.4 A+8 B 211 2 1 8 65.05 8.13 1.32 -0.6 A-8 B 212 2 1 8 175.22 21.90 0.71 0.8 A+8 B 213 2 1 8 183.99 23.00 1.65 -1.2 B-8 B 214 2 1 8 64.07 8.01 0.83 0.4 A+
T 8
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 C 179 2 1 8 74.30 9.29 1.25 -0.5 A-8 C 180 2 1 8 33.46 4.18 1.06 -0.1 A-8 C 181 2 1 8 56.85 7.11 1.07 -0.2 A-8 C 182 2 1 8 61.74 7.72 0.89 0.3 A+8 C 183 2 1 8 11.18 1.40 1.02 0.0 A-8 C 184 2 1 8 53.66 6.71 1.19 -0.4 A-8 C 185 2 1 8 51.94 6.49 1.20 -0.4 A-8 C 186 2 1 8 155.36 19.42 0.73 0.7 A+8 C 187 2 1 8 21.31 2.66 1.05 -0.1 A-8 C 188 2 1 8 29.99 3.75 1.12 -0.3 A-8 C 189 2 1 8 56.40 7.05 0.85 0.4 A+8 C 190 2 1 8 573.21 71.65 0.55 1.4 B+8 C 191 2 1 8 57.61 7.20 1.39 -0.8 A-8 C 192 2 1 8 16.61 2.08 1.09 -0.2 A-8 C 193 2 1 8 17.55 2.19 1.07 -0.2 A-8 C 194 2 1 8 43.91 5.49 0.98 0.0 A+8 C 195 2 1 8 112.06 14.01 1.36 -0.7 A-8 C 196 2 1 8 38.52 4.81 1.08 -0.2 A-8 C 197 2 1 8 96.51 12.06 0.72 0.8 A+8 C 198 2 1 8 179.92 22.49 0.61 1.2 B+8 C 199 2 1 8 166.28 20.78 0.61 1.2 B+8 C 200 2 1 8 75.12 9.39 1.15 -0.3 A-8 C 201 2 1 8 26.60 3.32 0.94 0.2 A+8 C 202 2 1 8 94.40 11.80 0.69 0.9 A+8 C 203 2 1 8 30.52 3.82 0.99 0.0 A+8 C 204 2 1 8 35.24 4.41 1.05 -0.1 A-8 C 205 2 1 8 16.07 2.01 0.94 0.2 A+8 C 206 2 1 8 40.39 5.05 1.04 -0.1 A-8 C 207 2 1 8 65.56 8.19 0.77 0.6 A+8 C 208 2 1 8 37.59 4.70 1.01 0.0 A-8 C 209 2 1 8 54.56 6.82 0.82 0.5 A+8 C 210 2 1 8 27.40 3.43 0.99 0.0 A+8 C 211 2 1 8 41.97 5.25 0.84 0.4 A+8 C 212 2 1 8 56.49 7.06 1.23 -0.5 A-8 C 213 2 1 8 42.25 5.28 0.80 0.5 A+8 C 214 2 1 8 61.80 7.73 0.86 0.4 A+
T 9
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 D 179 2 1 8 82.78 10.35 1.26 -0.5 A-8 D 180 2 1 8 128.94 16.12 1.38 -0.8 A-8 D 181 2 1 8 154.73 19.34 0.65 1.0 B+8 D 182 2 1 8 131.94 16.49 0.71 0.8 A+8 D 183 2 1 8 7.89 0.99 1.02 0.0 A-8 D 184 2 1 8 65.56 8.19 0.83 0.4 A+8 D 185 2 1 8 83.66 10.46 1.28 -0.6 A-8 D 186 2 1 8 40.26 5.03 1.22 -0.5 A-8 D 187 2 1 8 37.53 4.69 1.01 0.0 A-8 D 188 2 1 8 29.23 3.65 1.08 -0.2 A-8 D 189 2 1 8 28.33 3.54 1.02 -0.1 A-8 D 190 2 1 8 45.00 5.63 1.20 -0.4 A-8 D 191 2 1 8 50.98 6.37 0.77 0.6 A+8 D 192 2 1 8 28.43 3.55 0.86 0.3 A+8 D 193 2 1 8 6.81 0.85 1.01 0.0 A-8 D 194 2 1 8 51.63 6.45 1.10 -0.2 A-8 D 195 2 1 8 94.73 11.84 1.04 -0.1 A-8 D 196 2 1 8 33.80 4.22 0.87 0.3 A+8 D 197 2 1 8 29.47 3.68 1.02 -0.1 A-8 D 198 2 1 8 163.28 20.41 0.68 0.9 A+8 D 199 2 1 8 12.23 1.53 0.97 0.1 A+8 D 200 2 1 8 71.93 8.99 1.04 -0.1 A-8 D 201 2 1 8 254.47 31.81 0.62 1.1 B+8 D 202 2 1 8 76.01 9.50 0.78 0.6 A+8 D 203 2 1 8 38.77 4.85 0.80 0.5 A+8 D 204 2 1 8 16.41 2.05 1.13 -0.3 A-8 D 205 2 1 8 61.31 7.66 0.84 0.4 A+8 D 206 2 1 8 27.96 3.50 0.97 0.1 A+8 D 207 2 1 8 49.89 6.24 0.97 0.1 A+8 D 208 2 1 8 51.01 6.38 0.80 0.5 A+8 D 209 2 1 8 97.62 12.20 0.76 0.7 A+8 D 210 2 1 8 928.86 116.11 0.34 2.5 C+8 D 211 2 1 8 49.43 6.18 0.80 0.5 A+8 D 212 2 1 8 34.06 4.26 0.91 0.2 A+8 D 213 2 1 8 171.43 21.43 1.78 -1.4 B-8 D 214 2 1 8 105.68 13.21 1.28 -0.6 A-
T 10
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 E 179 2 1 8 23.00 2.87 1.02 -0.1 A-8 E 180 2 1 8 27.89 3.49 0.87 0.3 A+8 E 181 2 1 8 92.86 11.61 0.74 0.7 A+8 E 182 2 1 8 183.06 22.88 0.72 0.8 A+8 E 183 2 1 8 78.31 9.79 0.85 0.4 A+8 E 184 2 1 8 51.03 6.38 0.85 0.4 A+8 E 185 2 1 8 35.34 4.42 0.84 0.4 A+8 E 186 2 1 8 9.53 1.19 0.95 0.1 A+8 E 187 2 1 8 71.73 8.97 1.30 -0.6 A-8 E 188 2 1 8 31.14 3.89 0.85 0.4 A+8 E 189 2 1 8 33.92 4.24 1.17 -0.4 A-8 E 190 2 1 8 1315.17 164.40 0.39 2.2 C+8 E 191 2 1 8 13.35 1.67 0.90 0.2 A+8 E 192 2 1 8 52.34 6.54 0.90 0.2 A+8 E 193 2 1 8 13.77 1.72 0.97 0.1 A+8 E 194 2 1 8 21.61 2.70 1.05 -0.1 A-8 E 195 2 1 8 115.82 14.48 0.76 0.7 A+8 E 196 2 1 8 16.47 2.06 1.03 -0.1 A-8 E 197 2 1 8 63.03 7.88 0.88 0.3 A+8 E 198 2 1 8 86.64 10.83 1.20 -0.4 A-8 E 199 2 1 8 235.05 29.38 0.67 0.9 A+8 E 200 2 1 8 13.85 1.73 0.92 0.2 A+8 E 201 2 1 8 141.27 17.66 0.67 0.9 A+8 E 202 2 1 8 39.08 4.88 0.86 0.3 A+8 E 203 2 1 8 28.17 3.52 0.92 0.2 A+8 E 204 2 1 8 192.27 24.03 0.65 1.0 B+8 E 205 2 1 8 32.85 4.11 0.88 0.3 A+8 E 206 2 1 8 47.71 5.96 0.86 0.4 A+8 E 207 2 1 8 22.55 2.82 1.02 0.0 A-8 E 208 2 1 8 12.05 1.51 1.05 -0.1 A-8 E 209 2 1 8 202.73 25.34 0.70 0.8 A+8 E 210 2 1 8 17.39 2.17 0.93 0.2 A+8 E 211 2 1 8 25.22 3.15 0.89 0.3 A+8 E 212 2 1 8 65.67 8.21 1.22 -0.5 A-8 E 213 2 1 8 19.16 2.40 0.97 0.1 A+8 E 214 2 1 8 32.10 4.01 0.98 0.0 A+
T 11
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 F 179 2 1 8 14.68 1.83 0.91 0.2 A+8 F 180 2 1 8 131.29 16.41 0.64 1.0 B+8 F 181 2 1 8 23.68 2.96 1.08 -0.2 A-8 F 182 2 1 8 21.33 2.67 0.97 0.1 A+8 F 183 2 1 8 93.48 11.69 0.76 0.6 A+8 F 184 2 1 8 20.20 2.52 1.04 -0.1 A-8 F 185 2 1 8 25.19 3.15 0.95 0.1 A+8 F 186 2 1 8 129.87 16.23 0.77 0.6 A+8 F 187 2 1 8 25.46 3.18 1.05 -0.1 A-8 F 188 2 1 8 79.51 9.94 0.73 0.7 A+8 F 189 2 1 8 35.02 4.38 1.01 0.0 A-8 F 190 2 1 8 137.26 17.16 1.51 -1.0 A-8 F 191 2 1 8 23.06 2.88 1.16 -0.4 A-8 F 192 2 1 8 90.90 11.36 0.79 0.6 A+8 F 193 2 1 8 126.72 15.84 0.68 0.9 A+8 F 194 2 1 8 146.37 18.30 0.75 0.7 A+8 F 195 2 1 8 17.60 2.20 0.88 0.3 A+8 F 196 2 1 8 99.36 12.42 0.67 0.9 A+8 F 197 2 1 8 19.28 2.41 1.14 -0.3 A-8 F 198 2 1 8 9.18 1.15 0.94 0.1 A+8 F 199 2 1 8 17.70 2.21 1.04 -0.1 A-8 F 200 2 1 8 57.95 7.24 0.82 0.5 A+8 F 201 2 1 8 49.46 6.18 1.28 -0.6 A-8 F 202 2 1 8 118.40 14.80 0.82 0.5 A+8 F 203 2 1 8 22.61 2.83 1.09 -0.2 A-8 F 204 2 1 8 46.32 5.79 1.29 -0.6 A-8 F 205 2 1 8 19.86 2.48 1.00 0.0 A+8 F 206 2 1 8 64.54 8.07 0.87 0.3 A+8 F 207 2 1 8 43.14 5.39 1.11 -0.2 A-8 F 208 2 1 8 125.48 15.68 1.30 -0.6 A-8 F 209 2 1 8 8.04 1.01 1.00 0.0 A+8 F 210 2 1 8 352.87 44.11 1.74 -1.3 B-8 F 211 2 1 8 22.54 2.82 0.96 0.1 A+8 F 212 2 1 8 4.43 0.55 1.00 0.0 A-8 F 213 2 1 8 13.85 1.73 1.04 -0.1 A-8 F 214 2 1 8 20.15 2.52 1.10 -0.2 A-
T 12
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 G 179 2 1 8 57.86 7.23 0.87 0.3 A+8 G 180 2 1 8 23.59 2.95 0.94 0.1 A+8 G 181 2 1 8 138.44 17.31 0.68 0.9 A+8 G 182 2 1 8 232.59 29.07 0.69 0.9 A+8 G 183 2 1 8 77.04 9.63 0.77 0.6 A+8 G 184 2 1 8 36.70 4.59 1.15 -0.3 A-8 G 185 2 1 8 48.92 6.11 0.84 0.4 A+8 G 186 2 1 8 103.28 12.91 0.65 1.0 B+8 G 187 2 1 8 10.74 1.34 0.97 0.1 A+8 G 188 2 1 8 8.20 1.03 0.95 0.1 A+8 G 189 2 1 8 181.82 22.73 0.71 0.8 A+8 G 190 2 1 8 80.65 10.08 0.82 0.5 A+8 G 191 2 1 8 499.74 62.47 0.57 1.3 B+8 G 192 2 1 8 573.86 71.73 0.42 2.0 C+8 G 193 2 1 8 125.40 15.68 0.70 0.8 A+8 G 194 2 1 8 232.86 29.11 0.69 0.9 A+8 G 195 2 1 8 22.40 2.80 1.00 0.0 A-8 G 196 2 1 8 66.83 8.35 0.70 0.8 A+8 G 197 2 1 8 64.08 8.01 1.33 -0.7 A-8 G 198 2 1 8 211.33 26.42 0.70 0.9 A+8 G 199 2 1 8 14.84 1.86 1.06 -0.1 A-8 G 200 2 1 8 27.69 3.46 1.10 -0.2 A-8 G 201 2 1 8 28.01 3.50 1.04 -0.1 A-8 G 202 2 1 8 41.67 5.21 1.19 -0.4 A-8 G 203 2 1 8 45.69 5.71 1.10 -0.2 A-8 G 204 2 1 8 102.99 12.87 1.40 -0.8 A-8 G 205 2 1 8 58.37 7.30 0.83 0.4 A+8 G 206 2 1 8 35.33 4.42 1.08 -0.2 A-8 G 207 2 1 8 77.93 9.74 1.21 -0.4 A-8 G 208 2 1 8 60.50 7.56 1.36 -0.7 A-8 G 209 2 1 8 96.13 12.02 0.88 0.3 A+8 G 210 2 1 8 19.79 2.47 0.86 0.3 A+8 G 211 2 1 8 44.22 5.53 1.14 -0.3 A-8 G 212 2 1 8 117.62 14.70 1.27 -0.6 A-8 G 213 2 1 8 35.53 4.44 1.13 -0.3 A-8 G 214 2 1 8 28.48 3.56 0.96 0.1 A+
T 13
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 H 179 2 1 8 20.48 2.56 1.08 -0.2 A-8 H 180 2 1 8 84.80 10.60 0.72 0.8 A+8 H 181 2 1 8 346.51 43.31 0.49 1.7 C+8 H 182 2 1 8 314.58 39.32 0.52 1.6 C+8 H 183 2 1 8 295.86 36.98 0.66 1.0 A+8 H 184 2 1 8 49.43 6.18 1.17 -0.4 A-8 H 185 2 1 8 11.44 1.43 0.91 0.2 A+8 H 186 2 1 8 16.18 2.02 0.97 0.1 A+8 H 187 2 1 8 33.32 4.16 0.86 0.3 A+8 H 188 2 1 8 197.06 24.63 1.39 -0.8 A-8 H 189 2 1 8 22.04 2.75 0.99 0.0 A+8 H 190 2 1 8 41.93 5.24 0.93 0.2 A+8 H 191 2 1 8 65.57 8.20 0.81 0.5 A+8 H 192 2 1 8 136.75 17.09 0.72 0.8 A+8 H 193 2 1 8 24.23 3.03 0.89 0.3 A+8 H 194 2 1 8 17.29 2.16 1.05 -0.1 A-8 H 195 2 1 8 14.01 1.75 1.01 0.0 A-8 H 196 2 1 8 40.59 5.07 0.90 0.3 A+8 H 197 2 1 8 203.97 25.50 1.43 -0.8 A-8 H 198 2 1 8 42.32 5.29 1.07 -0.2 A-8 H 199 2 1 8 3.46 0.43 0.95 0.1 A+8 H 200 2 1 8 26.85 3.36 0.94 0.1 A+8 H 201 2 1 8 29.70 3.71 1.06 -0.1 A-8 H 202 2 1 8 15.47 1.93 1.10 -0.2 A-8 H 203 2 1 8 212.09 26.51 1.33 -0.7 A-8 H 204 2 1 8 77.84 9.73 0.80 0.5 A+8 H 205 2 1 8 15.09 1.89 1.04 -0.1 A-8 H 206 2 1 8 8.74 1.09 1.05 -0.1 A-8 H 207 2 1 8 29.32 3.66 0.95 0.1 A+8 H 208 2 1 8 391.06 48.88 0.60 1.2 B+8 H 209 2 1 8 86.84 10.86 1.49 -0.9 A-8 H 210 2 1 8 22.19 2.77 1.08 -0.2 A-8 H 211 2 1 8 26.18 3.27 1.11 -0.2 A-8 H 212 2 1 8 37.68 4.71 1.04 -0.1 A-8 H 213 2 1 8 137.68 17.21 1.31 -0.6 A-8 H 214 2 1 8 97.03 12.13 1.25 -0.5 A-
T 14
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 I 179 2 1 8 127.42 15.93 0.71 0.8 A+8 I 180 2 1 8 19.58 2.45 0.89 0.3 A+8 I 181 2 1 8 44.29 5.54 0.86 0.3 A+8 I 182 2 1 8 12.94 1.62 1.03 -0.1 A-8 I 183 2 1 8 27.81 3.48 0.91 0.2 A+8 I 184 2 1 8 47.88 5.98 1.14 -0.3 A-8 I 185 2 1 8 45.64 5.70 0.92 0.2 A+8 I 186 2 1 8 221.27 27.66 0.60 1.2 B+8 I 187 2 1 8 5.81 0.73 1.01 0.0 A-8 I 188 2 1 8 90.37 11.30 1.24 -0.5 A-8 I 189 2 1 8 40.91 5.11 0.86 0.4 A+8 I 190 2 1 8 83.86 10.48 0.81 0.5 A+8 I 191 2 1 8 9.03 1.13 1.05 -0.1 A-8 I 192 2 1 8 30.46 3.81 1.06 -0.1 A-8 I 193 2 1 8 470.68 58.84 0.58 1.3 B+8 I 194 2 1 8 18.16 2.27 1.03 -0.1 A-8 I 195 2 1 8 44.24 5.53 0.87 0.3 A+8 I 196 2 1 8 16.68 2.08 1.07 -0.2 A-8 I 197 2 1 8 187.41 23.43 1.35 -0.7 A-8 I 198 2 1 8 154.16 19.27 1.41 -0.8 A-8 I 199 2 1 8 236.51 29.56 0.62 1.1 B+8 I 200 2 1 8 60.52 7.57 0.78 0.6 A+8 I 201 2 1 8 49.71 6.21 1.14 -0.3 A-8 I 202 2 1 8 95.49 11.94 0.80 0.5 A+8 I 203 2 1 8 45.98 5.75 1.18 -0.4 A-8 I 204 2 1 8 56.45 7.06 1.30 -0.6 A-8 I 205 2 1 8 19.15 2.39 0.98 0.0 A+8 I 206 2 1 8 42.34 5.29 1.03 -0.1 A-8 I 207 2 1 8 14.47 1.81 0.97 0.1 A+8 I 208 2 1 8 38.17 4.77 1.23 -0.5 A-8 I 209 2 1 8 85.80 10.72 0.76 0.6 A+8 I 210 2 1 8 18.46 2.31 0.91 0.2 A+8 I 211 2 1 8 26.70 3.34 1.04 -0.1 A-8 I 212 2 1 8 37.49 4.69 1.10 -0.2 A-8 I 213 2 1 8 93.97 11.75 1.10 -0.2 A-8 I 214 2 1 8 68.00 8.50 0.82 0.5 A+
T 15
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 J 179 2 1 8 39.39 4.92 0.94 0.2 A+8 J 180 2 1 8 223.62 27.95 0.68 0.9 A+8 J 181 2 1 8 39.19 4.90 0.94 0.2 A+8 J 182 2 1 8 207.51 25.94 0.59 1.3 B+8 J 183 2 1 8 14.14 1.77 0.91 0.2 A+8 J 184 2 1 8 324.07 40.51 0.62 1.1 B+8 J 185 2 1 8 34.71 4.34 0.93 0.2 A+8 J 186 2 1 8 77.24 9.66 1.22 -0.5 A-8 J 187 2 1 8 76.66 9.58 1.49 -0.9 A-8 J 188 2 1 8 18.01 2.25 1.09 -0.2 A-8 J 189 2 1 8 23.69 2.96 0.95 0.1 A+8 J 190 2 1 8 10.62 1.33 0.90 0.3 A+8 J 191 2 1 8 161.17 20.15 0.72 0.8 A+8 J 192 2 1 8 42.85 5.36 0.86 0.3 A+8 J 193 2 1 8 42.26 5.28 1.16 -0.3 A-8 J 194 2 1 8 187.36 23.42 0.72 0.8 A+8 J 195 2 1 8 203.40 25.42 1.57 -1.1 B-8 J 196 2 1 8 57.63 7.20 0.86 0.4 A+8 J 197 2 1 8 38.49 4.81 1.06 -0.1 A-8 J 198 2 1 8 55.13 6.89 0.84 0.4 A+8 J 199 2 1 8 160.84 20.11 0.71 0.8 A+8 J 200 2 1 8 191.61 23.95 0.71 0.8 A+8 J 201 2 1 8 84.52 10.56 0.82 0.5 A+8 J 202 2 1 8 46.62 5.83 0.83 0.4 A+8 J 203 2 1 8 19.09 2.39 0.93 0.2 A+8 J 204 2 1 8 48.51 6.06 0.89 0.3 A+8 J 205 2 1 8 110.76 13.84 1.39 -0.8 A-8 J 206 2 1 8 19.08 2.39 0.89 0.3 A+8 J 207 2 1 8 81.11 10.14 1.34 -0.7 A-8 J 208 2 1 8 1471.17 183.90 0.37 2.4 C+8 J 209 2 1 8 18.45 2.31 1.10 -0.2 A-8 J 210 2 1 8 12.24 1.53 0.94 0.1 A+8 J 211 2 1 8 19.55 2.44 0.97 0.1 A+8 J 212 2 1 8 16.02 2.00 1.04 -0.1 A-8 J 213 2 1 8 71.12 8.89 0.81 0.5 A+8 J 214 2 1 8 28.32 3.54 1.05 -0.1 A-
T 16
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 W 74 2 1 8 2139.01 267.38 1.41 -0.8 A-8 W 75 2 1 8 136.67 17.08 0.97 0.1 A+8 W 76 2 1 8 6086.68 760.84 0.54 1.4 B+8 W 77 2 1 8 228.51 28.56 0.90 0.2 A+8 W 78 2 1 8 107.34 13.42 0.97 0.1 A+8 W 79 2 1 8 217.65 27.21 0.92 0.2 A+8 W 80 2 1 8 21.57 2.70 0.99 0.0 A+8 W 81 2 1 8 85.94 10.74 1.08 -0.2 A-8 W 82 2 1 8 573.38 71.67 0.82 0.5 A+8 W 83 2 1 8 614.12 76.77 1.33 -0.7 A-8 W 84 2 1 8 311.55 38.94 1.13 -0.3 A-8 W 85 2 1 8 696.00 87.00 0.79 0.5 A+8 W 86 2 1 8 215.09 26.89 1.01 0.0 A-8 W 87 2 1 8 368.86 46.11 1.19 -0.4 A-8 W 88 2 1 8 1692.36 211.55 0.67 0.9 A+8 W 89 2 1 8 53.68 6.71 1.03 -0.1 A-8 W 90 2 1 8 363.34 45.42 1.15 -0.3 A-8 W 91 2 1 8 280.11 35.01 1.18 -0.4 A-8 W 92 2 1 8 326.24 40.78 1.12 -0.3 A-8 W 93 2 1 8 113.73 14.22 0.92 0.2 A+8 W 94 2 1 8 276.25 34.53 0.89 0.3 A+8 W 95 2 1 8 84.06 10.51 1.06 -0.1 A-8 W 96 2 1 8 833.53 104.19 1.30 -0.6 A-8 W 97 2 1 8 483.29 60.41 0.87 0.3 A+8 W 98 2 1 8 333.55 41.69 0.87 0.3 A+8 W 99 2 1 8 149.53 18.69 1.05 -0.1 A-8 W 100 2 1 8 40.08 5.01 0.99 0.0 A+8 W 101 2 1 8 104.28 13.04 1.04 -0.1 A-8 W 102 2 1 8 402.34 50.29 1.17 -0.4 A-8 W 103 2 1 8 33.84 4.23 1.02 0.0 A-8 W 104 2 1 8 43.56 5.45 1.00 0.0 A+8 W 105 2 1 8 212.46 26.56 1.03 -0.1 A-8 W 106 2 1 8 183.24 22.91 1.08 -0.2 A-8 W 107 2 1 8 295.78 36.97 1.11 -0.2 A-8 W 108 2 1 8 449.99 56.25 0.87 0.3 A+8 W 109 2 1 8 440.27 55.03 1.13 -0.3 A-8 W 111 2 1 8 259.64 32.46 0.90 0.3 A+8 W 112 2 1 8 1743.44 217.93 0.69 0.9 A+8 W 113 2 1 8 86.86 10.86 0.99 0.0 A+8 W 114 2 1 8 323.40 40.42 0.80 0.5 A+8 W 115 2 1 8 277.99 34.75 1.12 -0.3 A-8 W 116 2 1 8 110.83 13.85 0.92 0.2 A+8 W 117 2 1 8 666.94 83.37 1.18 -0.4 A-8 W 118 2 1 8 1068.94 133.62 1.28 -0.6 A-8 W 119 2 1 8 412.45 51.56 1.20 -0.4 A-8 W 120 2 1 8 1025.33 128.17 0.74 0.7 A+8 W 121 2 1 8 339.14 42.39 0.87 0.3 A+8 W 122 2 1 8 359.17 44.90 1.13 -0.3 A-8 W 123 2 1 8 470.00 58.75 1.04 -0.1 A-8 W 124 2 1 8 375.47 46.93 0.80 0.5 A+8 W 125 2 1 8 60.88 7.61 0.98 0.1 A+8 W 126 2 1 8 204.14 25.52 0.98 0.0 A+8 W 127 2 1 8 973.72 121.72 1.28 -0.6 A-
T 17
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code8 W 128 2 1 8 79.85 9.98 1.07 -0.2 A-8 W 129 2 1 8 1077.57 134.70 0.77 0.6 A+8 W 130 2 1 8 754.90 94.36 1.25 -0.5 A-8 W 131 2 1 8 96.91 12.11 1.06 -0.1 A-8 W 132 2 1 8 352.91 44.11 1.16 -0.3 A-8 W 133 2 1 8 563.62 70.45 0.84 0.4 A+8 W 134 2 1 8 798.36 99.80 1.24 -0.5 A-8 W 135 2 1 8 2374.57 296.82 1.46 -0.9 A-8 W 136 2 1 8 14.13 1.77 0.98 0.1 A+8 W 137 2 1 8 210.54 26.32 1.08 -0.2 A-8 W 138 2 1 8 1494.91 186.86 1.34 -0.7 A-8 W 139 2 1 8 174.59 21.82 1.08 -0.2 A-8 W 140 2 1 8 160.11 20.01 1.02 -0.1 A-8 W 141 2 1 8 173.38 21.67 1.06 -0.1 A-8 W 142 2 1 8 194.45 24.31 0.90 0.3 A+8 W 143 2 1 8 697.29 87.16 1.21 -0.5 A-8 W 144 2 1 8 193.44 24.18 0.88 0.3 A+8 W 145 2 1 8 210.35 26.29 1.08 -0.2 A-8 W 146 2 1 8 427.33 53.42 1.16 -0.4 A-
T 18
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 A 191 2 1 8 44.01 5.50 0.82 0.5 A+11 A 192 2 1 8 244.48 30.56 0.62 1.1 B+11 A 193 2 1 8 18.08 2.26 1.05 -0.1 A-11 A 194 2 1 8 17.21 2.15 0.91 0.2 A+11 A 195 2 1 8 65.91 8.24 0.86 0.4 A+11 A 196 2 1 8 36.90 4.61 1.07 -0.2 A-11 A 197 2 1 8 11.78 1.47 0.94 0.2 A+11 A 198 2 1 8 94.00 11.75 1.35 -0.7 A-11 A 199 2 1 8 1914.94 239.37 0.38 2.3 C+11 A 200 2 1 8 43.12 5.39 1.17 -0.4 A-11 A 201 2 1 8 10.56 1.32 1.02 0.0 A-11 A 202 2 1 8 27.27 3.41 0.94 0.1 A+11 A 203 2 1 8 13.49 1.69 1.04 -0.1 A-11 A 204 2 1 8 14.10 1.76 1.00 0.0 A+11 A 206 2 1 8 81.57 10.20 1.32 -0.7 A-11 A 207 2 1 8 16.20 2.03 1.09 -0.2 A-11 A 209 2 1 8 23.50 2.94 0.93 0.2 A+11 A 210 2 1 8 183.99 23.00 1.51 -1.0 A-11 A 212 2 1 8 94.56 11.82 0.76 0.6 A+11 A 213 2 1 8 24.95 3.12 0.89 0.3 A+11 A 214 2 1 8 118.38 14.80 1.37 -0.7 A-11 A 215 2 1 8 143.39 17.92 1.47 -0.9 A-11 A 216 2 1 8 130.31 16.29 1.53 -1.0 A-11 A 217 2 1 8 50.16 6.27 1.17 -0.4 A-11 A 218 2 1 8 70.03 8.75 1.21 -0.5 A-11 A 219 2 1 8 16.65 2.08 1.10 -0.2 A-11 A 220 2 1 8 17.34 2.17 1.06 -0.1 A-11 A 221 2 1 8 11.98 1.50 1.05 -0.1 A-11 A 222 2 1 8 81.95 10.24 1.26 -0.5 A-11 A 223 2 1 8 20.20 2.53 0.94 0.2 A+11 A 224 2 1 8 59.69 7.46 0.97 0.1 A+11 A 225 2 1 8 108.85 13.61 0.76 0.7 A+11 A 226 2 1 8 6.63 0.83 1.02 0.0 A-11 A 227 2 1 8 41.68 5.21 0.92 0.2 A+11 A 228 2 1 8 125.77 15.72 1.47 -0.9 A-
T 19
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 B 189 2 1 8 35.10 4.39 0.86 0.4 A+11 B 190 2 1 8 22.50 2.81 1.09 -0.2 A-11 B 191 2 1 8 55.36 6.92 0.82 0.5 A+11 B 192 2 1 8 142.46 17.81 1.31 -0.6 A-11 B 193 2 1 8 76.81 9.60 0.74 0.7 A+11 B 194 2 1 8 26.28 3.28 1.09 -0.2 A-11 B 195 2 1 8 18.04 2.26 0.99 0.0 A+11 B 196 2 1 8 47.55 5.94 0.90 0.3 A+11 B 197 2 1 8 30.23 3.78 0.86 0.4 A+11 B 198 2 1 8 23.98 3.00 1.06 -0.1 A-11 B 199 2 1 8 116.74 14.59 0.70 0.8 A+11 B 200 2 1 8 45.60 5.70 1.09 -0.2 A-11 B 201 2 1 8 72.50 9.06 0.71 0.8 A+11 B 202 2 1 8 16.99 2.12 0.98 0.0 A+11 B 203 2 1 8 10.21 1.28 0.99 0.0 A+11 B 204 2 1 8 277.35 34.67 0.61 1.2 B+11 B 205 2 1 8 18.11 2.26 0.93 0.2 A+11 B 206 2 1 8 147.69 18.46 0.70 0.8 A+11 B 207 2 1 8 21.16 2.65 1.09 -0.2 A-11 B 208 2 1 8 24.09 3.01 0.99 0.0 A+11 B 209 2 1 8 29.11 3.64 1.10 -0.2 A-11 B 210 2 1 8 123.93 15.49 1.15 -0.3 A-11 B 211 2 1 8 15.49 1.94 1.08 -0.2 A-11 B 212 2 1 8 46.16 5.77 1.18 -0.4 A-11 B 213 2 1 8 21.45 2.68 1.04 -0.1 A-11 B 215 2 1 8 19.74 2.47 0.95 0.1 A+11 B 216 2 1 8 38.47 4.81 1.13 -0.3 A-11 B 217 2 1 8 240.79 30.10 1.75 -1.3 B-11 B 218 2 1 8 12.60 1.57 1.05 -0.1 A-11 B 219 2 1 8 49.30 6.16 0.90 0.2 A+11 B 220 2 1 8 40.85 5.11 1.17 -0.4 A-11 B 221 2 1 8 427.50 53.44 1.73 -1.3 B-11 B 222 2 1 8 50.88 6.36 0.86 0.4 A+11 B 223 2 1 8 21.78 2.72 0.92 0.2 A+11 B 224 2 1 8 115.11 14.39 0.70 0.8 A+11 B 225 2 1 8 139.24 17.40 1.48 -0.9 A-11 B 226 2 1 8 13.90 1.74 1.10 -0.2 A-11 B 227 2 1 8 55.21 6.90 1.23 -0.5 A-11 B 228 2 1 8 253.21 31.65 1.73 -1.3 B-
T 20
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 C 189 2 1 8 8.52 1.06 1.01 0.0 A-11 C 190 2 1 8 29.55 3.69 0.99 0.0 A+11 C 191 2 1 8 82.24 10.28 0.82 0.5 A+11 C 192 2 1 8 14.62 1.83 1.04 -0.1 A-11 C 193 2 1 8 34.12 4.27 0.88 0.3 A+11 C 194 2 1 8 31.21 3.90 0.97 0.1 A+11 C 195 2 1 8 4.98 0.62 0.94 0.1 A+11 C 196 2 1 8 7.00 0.88 0.95 0.1 A+11 C 197 2 1 8 21.57 2.70 1.06 -0.1 A-11 C 199 2 1 8 9.95 1.24 1.01 0.0 A-11 C 200 2 1 8 8.57 1.07 0.98 0.1 A+11 C 201 2 1 8 9.02 1.13 0.99 0.0 A+11 C 202 2 1 8 30.02 3.75 1.05 -0.1 A-11 C 203 2 1 8 67.12 8.39 1.18 -0.4 A-11 C 204 2 1 8 38.70 4.84 1.11 -0.2 A-11 C 205 2 1 8 176.11 22.01 0.70 0.8 A+11 C 206 2 1 8 11.31 1.41 0.90 0.2 A+11 C 207 2 1 8 21.35 2.67 0.99 0.0 A+11 C 208 2 1 8 18.14 2.27 1.09 -0.2 A-11 C 209 2 1 8 32.16 4.02 0.89 0.3 A+11 C 210 2 1 8 52.36 6.54 1.27 -0.6 A-11 C 211 2 1 8 113.41 14.18 1.13 -0.3 A-11 C 212 2 1 8 18.82 2.35 1.19 -0.4 A-11 C 213 2 1 8 62.18 7.77 0.93 0.2 A+11 C 214 2 1 8 65.44 8.18 1.25 -0.5 A-11 C 215 2 1 8 42.45 5.31 1.19 -0.4 A-11 C 216 2 1 8 67.91 8.49 1.22 -0.5 A-11 C 217 2 1 8 16.58 2.07 0.93 0.2 A+11 C 218 2 1 8 27.72 3.47 1.05 -0.1 A-11 C 219 2 1 8 63.00 7.88 1.22 -0.5 A-11 C 220 2 1 8 36.70 4.59 1.00 0.0 A-11 C 221 2 1 8 18.31 2.29 0.92 0.2 A+11 C 222 2 1 8 46.38 5.80 1.06 -0.1 A-11 C 223 2 1 8 47.09 5.89 0.81 0.5 A+11 C 225 2 1 8 60.31 7.54 1.25 -0.5 A-11 C 226 2 1 8 34.79 4.35 1.09 -0.2 A-11 C 227 2 1 8 150.34 18.79 1.50 -1.0 A-11 C 228 2 1 8 160.01 20.00 1.51 -1.0 A-
T 21
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 D 189 2 1 8 45.44 5.68 1.17 -0.4 A-11 D 190 2 1 8 28.38 3.55 0.91 0.2 A+11 D 191 2 1 8 113.35 14.17 1.30 -0.6 A-11 D 193 2 1 8 83.64 10.46 0.75 0.7 A+11 D 194 2 1 8 52.83 6.60 1.18 -0.4 A-11 D 195 2 1 8 71.92 8.99 1.31 -0.6 A-11 D 196 2 1 8 32.75 4.09 1.13 -0.3 A-11 D 197 2 1 8 49.78 6.22 0.85 0.4 A+11 D 198 2 1 8 46.04 5.75 1.27 -0.6 A-11 D 199 2 1 8 70.92 8.87 1.35 -0.7 A-11 D 200 2 1 8 36.75 4.59 0.87 0.3 A+11 D 201 2 1 8 14.38 1.80 0.92 0.2 A+11 D 202 2 1 8 72.28 9.04 0.80 0.5 A+11 D 203 2 1 8 37.94 4.74 0.96 0.1 A+11 D 204 2 1 8 53.37 6.67 0.81 0.5 A+11 D 206 2 1 8 111.66 13.96 0.77 0.6 A+11 D 207 2 1 8 30.99 3.87 1.06 -0.1 A-11 D 209 2 1 8 21.73 2.72 0.99 0.0 A+11 D 210 2 1 8 66.56 8.32 1.04 -0.1 A-11 D 211 2 1 8 273.75 34.22 0.67 0.9 A+11 D 213 2 1 8 34.24 4.28 1.13 -0.3 A-11 D 214 2 1 8 27.79 3.47 1.13 -0.3 A-11 D 215 2 1 8 149.26 18.66 1.61 -1.1 B-11 D 216 2 1 8 19.72 2.47 1.08 -0.2 A-11 D 217 2 1 8 200.43 25.05 1.42 -0.8 A-11 D 218 2 1 8 109.12 13.64 1.32 -0.6 A-11 D 219 2 1 8 71.33 8.92 1.23 -0.5 A-11 D 220 2 1 8 154.25 19.28 1.47 -0.9 A-11 D 221 2 1 8 23.63 2.95 0.94 0.1 A+11 D 223 2 1 8 32.10 4.01 1.00 0.0 A-11 D 224 2 1 8 94.04 11.76 0.85 0.4 A+11 D 225 2 1 8 15.25 1.91 0.94 0.1 A+11 D 226 2 1 8 132.93 16.62 0.73 0.7 A+
T 22
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 E 189 2 1 8 56.15 7.02 0.80 0.5 A+11 E 191 2 1 8 45.90 5.74 0.83 0.4 A+11 E 192 2 1 8 25.14 3.14 1.08 -0.2 A-11 E 193 2 1 8 26.04 3.26 0.98 0.0 A+11 E 194 2 1 8 35.13 4.39 0.99 0.0 A+11 E 195 2 1 8 135.95 16.99 0.68 0.9 A+11 E 196 2 1 8 50.81 6.35 0.95 0.1 A+11 E 197 2 1 8 86.62 10.83 1.36 -0.7 A-11 E 199 2 1 8 25.91 3.24 0.88 0.3 A+11 E 200 2 1 8 18.01 2.25 1.08 -0.2 A-11 E 201 2 1 8 47.26 5.91 0.83 0.4 A+11 E 202 2 1 8 37.47 4.68 1.06 -0.1 A-11 E 203 2 1 8 87.20 10.90 1.44 -0.9 A-11 E 204 2 1 8 26.10 3.26 1.04 -0.1 A-11 E 206 2 1 8 111.82 13.98 0.78 0.6 A+11 E 208 2 1 8 67.85 8.48 1.25 -0.5 A-11 E 209 2 1 8 55.59 6.95 1.23 -0.5 A-11 E 210 2 1 8 18.69 2.34 0.88 0.3 A+11 E 211 2 1 8 46.23 5.78 1.15 -0.3 A-11 E 212 2 1 8 34.73 4.34 1.12 -0.3 A-11 E 213 2 1 8 33.96 4.25 1.18 -0.4 A-11 E 217 2 1 8 12.33 1.54 0.96 0.1 A+11 E 218 2 1 8 102.68 12.84 1.34 -0.7 A-11 E 219 2 1 8 37.06 4.63 0.94 0.1 A+11 E 220 2 1 8 10.61 1.33 1.02 -0.1 A-11 E 221 2 1 8 21.04 2.63 1.05 -0.1 A-11 E 223 2 1 8 25.63 3.20 0.90 0.2 A+11 E 224 2 1 8 25.71 3.21 1.06 -0.1 A-11 E 225 2 1 8 105.43 13.18 1.30 -0.6 A-11 E 227 2 1 8 79.50 9.94 1.25 -0.5 A-11 E 228 2 1 8 10.06 1.26 1.04 -0.1 A-
T 23
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 F 189 2 1 8 13.64 1.71 1.09 -0.2 A-11 F 190 2 1 8 25.33 3.17 0.97 0.1 A+11 F 191 2 1 8 23.19 2.90 1.18 -0.4 A-11 F 193 2 1 8 98.66 12.33 0.69 0.9 A+11 F 194 2 1 8 17.12 2.14 0.94 0.1 A+11 F 195 2 1 8 128.34 16.04 1.38 -0.7 A-11 F 196 2 1 8 9.65 1.21 0.99 0.0 A+11 F 197 2 1 8 117.24 14.65 1.35 -0.7 A-11 F 198 2 1 8 16.89 2.11 0.99 0.0 A+11 F 199 2 1 8 7.15 0.89 1.02 0.0 A-11 F 200 2 1 8 46.79 5.85 0.89 0.3 A+11 F 201 2 1 8 36.07 4.51 1.13 -0.3 A-11 F 203 2 1 8 77.45 9.68 1.15 -0.3 A-11 F 204 2 1 8 42.94 5.37 0.95 0.1 A+11 F 205 2 1 8 141.09 17.64 0.72 0.8 A+11 F 206 2 1 8 82.70 10.34 1.06 -0.1 A-11 F 207 2 1 8 30.78 3.85 0.88 0.3 A+11 F 208 2 1 8 35.59 4.45 1.08 -0.2 A-11 F 209 2 1 8 240.27 30.03 0.62 1.1 B+11 F 210 2 1 8 12.40 1.55 1.09 -0.2 A-11 F 211 2 1 8 13.38 1.67 1.06 -0.1 A-11 F 212 2 1 8 95.09 11.89 1.27 -0.6 A-11 F 213 2 1 8 53.55 6.69 1.23 -0.5 A-11 F 214 2 1 8 39.43 4.93 1.22 -0.5 A-11 F 215 2 1 8 20.20 2.52 0.99 0.0 A+11 F 217 2 1 8 23.42 2.93 1.00 0.0 A+11 F 218 2 1 8 63.11 7.89 1.23 -0.5 A-11 F 219 2 1 8 40.34 5.04 1.00 0.0 A11 F 220 2 1 8 1677.73 209.72 0.40 2.2 C+11 F 221 2 1 8 44.72 5.59 1.08 -0.2 A-11 F 222 2 1 8 85.61 10.70 0.78 0.6 A+11 F 223 2 1 8 112.60 14.08 0.76 0.6 A+11 F 224 2 1 8 45.61 5.70 1.00 0.0 A11 F 225 2 1 8 41.60 5.20 1.18 -0.4 A-11 F 227 2 1 8 24.32 3.04 1.12 -0.3 A-11 F 228 2 1 8 122.33 15.29 0.72 0.8 A+
T 24
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 G 189 2 1 8 22.61 2.83 0.94 0.2 A+11 G 190 2 1 8 41.98 5.25 0.88 0.3 A+11 G 191 2 1 8 19.45 2.43 1.05 -0.1 A-11 G 192 2 1 8 38.99 4.87 0.88 0.3 A+11 G 193 2 1 8 70.49 8.81 0.81 0.5 A+11 G 194 2 1 8 32.71 4.09 0.90 0.2 A+11 G 195 2 1 8 253.01 31.63 1.45 -0.9 A-11 G 196 2 1 8 35.02 4.38 1.13 -0.3 A-11 G 197 2 1 8 125.38 15.67 1.27 -0.6 A-11 G 198 2 1 8 14.71 1.84 1.05 -0.1 A-11 G 199 2 1 8 13.02 1.63 0.93 0.2 A+11 G 200 2 1 8 74.58 9.32 1.23 -0.5 A-11 G 201 2 1 8 211.89 26.49 0.61 1.2 B+11 G 202 2 1 8 49.81 6.23 1.13 -0.3 A-11 G 203 2 1 8 36.49 4.56 1.00 0.0 A-11 G 204 2 1 8 86.31 10.79 0.79 0.6 A+11 G 205 2 1 8 185.69 23.21 0.64 1.0 B+11 G 206 2 1 8 152.20 19.03 1.55 -1.0 B-11 G 207 2 1 8 46.85 5.86 1.11 -0.2 A-11 G 208 2 1 8 312.02 39.00 0.55 1.4 B+11 G 209 2 1 8 59.61 7.45 1.18 -0.4 A-11 G 210 2 1 8 18.04 2.25 1.05 -0.1 A-11 G 211 2 1 8 32.34 4.04 1.15 -0.3 A-11 G 212 2 1 8 44.95 5.62 0.90 0.2 A+11 G 213 2 1 8 53.24 6.65 0.82 0.5 A+11 G 214 2 1 8 39.90 4.99 0.85 0.4 A+11 G 215 2 1 8 80.49 10.06 1.30 -0.6 A-11 G 216 2 1 8 96.05 12.01 0.76 0.7 A+11 G 217 2 1 8 42.64 5.33 1.27 -0.6 A-11 G 218 2 1 8 36.05 4.51 1.15 -0.3 A-11 G 219 2 1 8 87.31 10.91 1.25 -0.5 A-11 G 220 2 1 8 111.92 13.99 1.47 -0.9 A-11 G 221 2 1 8 27.54 3.44 1.17 -0.4 A-11 G 222 2 1 8 29.42 3.68 0.90 0.3 A+11 G 223 2 1 8 44.86 5.61 1.14 -0.3 A-11 G 224 2 1 8 24.39 3.05 1.08 -0.2 A-11 G 225 2 1 8 27.13 3.39 0.95 0.1 A+11 G 226 2 1 8 37.35 4.67 1.09 -0.2 A-11 G 227 2 1 8 49.59 6.20 1.21 -0.5 A-11 G 228 2 1 8 22.92 2.86 1.16 -0.4 A-
T 25
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 H 189 2 1 8 18.60 2.32 1.04 -0.1 A-11 H 190 2 1 8 315.72 39.46 1.65 -1.2 B-11 H 192 2 1 8 10.53 1.32 0.98 0.0 A+11 H 193 2 1 8 34.25 4.28 1.10 -0.2 A-11 H 194 2 1 8 19.18 2.40 1.08 -0.2 A-11 H 195 2 1 8 14.36 1.79 1.05 -0.1 A-11 H 198 2 1 8 31.82 3.98 1.00 0.0 A-11 H 199 2 1 8 59.47 7.43 1.14 -0.3 A-11 H 200 2 1 8 230.54 28.82 1.64 -1.2 B-11 H 201 2 1 8 449.46 56.18 1.75 -1.3 B-11 H 204 2 1 8 111.83 13.98 0.86 0.4 A+11 H 205 2 1 8 22.05 2.76 0.94 0.2 A+11 H 206 2 1 8 28.20 3.53 0.89 0.3 A+11 H 208 2 1 8 13.44 1.68 0.94 0.1 A+11 H 209 2 1 8 359.51 44.94 0.57 1.3 B+11 H 211 2 1 8 51.41 6.43 1.27 -0.6 A-11 H 212 2 1 8 281.24 35.16 0.59 1.2 B+11 H 213 2 1 8 66.34 8.29 1.26 -0.5 A-11 H 214 2 1 8 10.21 1.28 1.08 -0.2 A-11 H 215 2 1 8 38.07 4.76 1.01 0.0 A-11 H 216 2 1 8 70.57 8.82 0.79 0.6 A+11 H 217 2 1 8 151.05 18.88 0.71 0.8 A+11 H 218 2 1 8 19.26 2.41 0.97 0.1 A+11 H 219 2 1 8 112.74 14.09 0.71 0.8 A+11 H 220 2 1 8 27.24 3.41 0.85 0.4 A+11 H 221 2 1 8 41.13 5.14 0.83 0.4 A+11 H 222 2 1 8 246.46 30.81 0.59 1.2 B+11 H 223 2 1 8 8.90 1.11 0.97 0.1 A+11 H 224 2 1 8 14.09 1.76 1.04 -0.1 A-11 H 225 2 1 8 35.53 4.44 1.16 -0.4 A-11 H 227 2 1 8 14.51 1.81 1.06 -0.1 A-11 H 228 2 1 8 62.26 7.78 1.10 -0.2 A-
T 26
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 I 189 2 1 8 19.11 2.39 0.90 0.3 A+11 I 190 2 1 8 200.48 25.06 1.43 -0.8 A-11 I 192 2 1 8 172.38 21.55 0.68 0.9 A+11 I 193 2 1 8 31.59 3.95 0.89 0.3 A+11 I 194 2 1 8 38.98 4.87 1.14 -0.3 A-11 I 195 2 1 8 66.65 8.33 1.35 -0.7 A-11 I 196 2 1 8 64.55 8.07 1.35 -0.7 A-11 I 197 2 1 8 12.93 1.62 1.10 -0.2 A-11 I 198 2 1 8 102.01 12.75 1.16 -0.3 A-11 I 199 2 1 8 3.13 0.39 1.03 -0.1 A-11 I 200 2 1 8 12.77 1.60 1.06 -0.1 A-11 I 201 2 1 8 34.52 4.32 0.88 0.3 A+11 I 202 2 1 8 40.28 5.03 1.14 -0.3 A-11 I 203 2 1 8 54.45 6.81 0.80 0.5 A+11 I 204 2 1 8 45.51 5.69 0.86 0.4 A+11 I 205 2 1 8 111.52 13.94 0.73 0.7 A+11 I 206 2 1 8 7.18 0.90 0.98 0.0 A+11 I 207 2 1 8 24.12 3.01 0.89 0.3 A+11 I 208 2 1 8 61.60 7.70 1.30 -0.6 A-11 I 211 2 1 8 37.14 4.64 0.84 0.4 A+11 I 212 2 1 8 169.06 21.13 0.65 1.0 A+11 I 213 2 1 8 34.09 4.26 0.91 0.2 A+11 I 214 2 1 8 27.21 3.40 0.93 0.2 A+11 I 215 2 1 8 28.34 3.54 0.88 0.3 A+11 I 216 2 1 8 17.82 2.23 1.07 -0.2 A-11 I 217 2 1 8 16.80 2.10 1.05 -0.1 A-11 I 218 2 1 8 67.67 8.46 1.31 -0.6 A-11 I 219 2 1 8 1628.90 203.61 0.40 2.2 C+11 I 220 2 1 8 115.36 14.42 1.47 -0.9 A-11 I 221 2 1 8 13.28 1.66 1.10 -0.2 A-11 I 222 2 1 8 31.00 3.87 1.10 -0.2 A-11 I 223 2 1 8 53.64 6.71 1.10 -0.2 A-11 I 224 2 1 8 50.30 6.29 1.17 -0.4 A-11 I 226 2 1 8 120.80 15.10 1.43 -0.8 A-11 I 227 2 1 8 41.55 5.19 1.17 -0.4 A-
T 27
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 J 189 2 1 8 6.85 0.86 1.00 0.0 A+11 J 190 2 1 8 24.80 3.10 1.11 -0.2 A-11 J 191 2 1 8 20.55 2.57 0.94 0.2 A+11 J 192 2 1 8 38.74 4.84 1.07 -0.2 A-11 J 193 2 1 8 50.26 6.28 0.98 0.1 A+11 J 195 2 1 8 34.88 4.36 0.88 0.3 A+11 J 196 2 1 8 20.84 2.60 1.07 -0.1 A-11 J 197 2 1 8 171.22 21.40 1.78 -1.4 B-11 J 198 2 1 8 16.39 2.05 0.98 0.0 A+11 J 199 2 1 8 32.19 4.02 0.87 0.3 A+11 J 200 2 1 8 58.96 7.37 1.15 -0.3 A-11 J 201 2 1 8 472.81 59.10 1.75 -1.3 B-11 J 202 2 1 8 74.16 9.27 0.97 0.1 A+11 J 203 2 1 8 35.29 4.41 0.92 0.2 A+11 J 204 2 1 8 120.49 15.06 0.67 0.9 A+11 J 205 2 1 8 132.13 16.52 1.48 -0.9 A-11 J 206 2 1 8 29.04 3.63 1.01 0.0 A-11 J 207 2 1 8 18.64 2.33 1.15 -0.3 A-11 J 208 2 1 8 263.07 32.88 1.77 -1.3 B-11 J 209 2 1 8 22.44 2.81 0.93 0.2 A+11 J 210 2 1 8 77.56 9.69 1.26 -0.5 A-11 J 211 2 1 8 42.40 5.30 0.87 0.3 A+11 J 212 2 1 8 123.33 15.42 1.33 -0.7 A-11 J 213 2 1 8 28.26 3.53 0.87 0.3 A+11 J 214 2 1 8 157.62 19.70 1.48 -0.9 A-11 J 215 2 1 8 23.09 2.89 1.08 -0.2 A-11 J 216 2 1 8 44.06 5.51 1.06 -0.1 A-11 J 217 2 1 8 9.62 1.20 0.99 0.0 A+11 J 218 2 1 8 27.09 3.39 1.08 -0.2 A-11 J 219 2 1 8 79.69 9.96 0.75 0.7 A+11 J 220 2 1 8 54.61 6.83 1.22 -0.5 A-11 J 221 2 1 8 50.95 6.37 0.85 0.4 A+11 J 222 2 1 8 13.62 1.70 1.03 -0.1 A-11 J 223 2 1 8 25.89 3.24 1.05 -0.1 A-11 J 224 2 1 8 148.89 18.61 0.74 0.7 A+11 J 225 2 1 8 45.93 5.74 1.03 -0.1 A-11 J 226 2 1 8 138.04 17.25 0.69 0.9 A+11 J 227 2 1 8 23.09 2.89 1.09 -0.2 A-11 J 228 2 1 8 77.94 9.74 1.08 -0.2 A-
T 28
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 W 74 2 1 8 121.67 15.21 1.08 -0.2 A-11 W 75 2 1 8 681.01 85.13 0.80 0.5 A+11 W 76 2 1 8 882.63 110.33 0.77 0.6 A+11 W 77 2 1 8 159.73 19.97 0.97 0.1 A+11 W 78 2 1 8 60.13 7.52 1.04 -0.1 A-11 W 79 2 1 8 394.53 49.32 0.80 0.5 A+11 W 80 2 1 8 71.53 8.94 1.05 -0.1 A-11 W 81 2 1 8 810.38 101.30 0.92 0.2 A+11 W 82 2 1 8 774.40 96.80 1.20 -0.4 A-11 W 83 2 1 8 946.33 118.29 1.24 -0.5 A-11 W 84 2 1 8 1041.41 130.18 0.76 0.7 A+11 W 85 2 1 8 2000.51 250.06 0.67 0.9 A+11 W 86 2 1 8 199.08 24.88 0.97 0.1 A+11 W 87 2 1 8 248.33 31.04 0.88 0.3 A+11 W 88 2 1 8 175.87 21.98 0.94 0.2 A+11 W 89 2 1 8 59.53 7.44 0.97 0.1 A+11 W 90 2 1 8 197.80 24.72 1.11 -0.2 A-11 W 91 2 1 8 36.75 4.59 1.00 0.0 A+11 W 92 2 1 8 441.89 55.24 0.82 0.5 A+11 W 93 2 1 8 725.86 90.73 0.79 0.5 A+11 W 94 2 1 8 915.28 114.41 0.78 0.6 A+11 W 95 2 1 8 254.26 31.78 1.14 -0.3 A-11 W 96 2 1 8 92.99 11.62 0.93 0.2 A+11 W 97 2 1 8 364.50 45.56 1.20 -0.4 A-11 W 98 2 1 8 182.91 22.86 1.06 -0.1 A-11 W 99 2 1 8 1182.36 147.80 0.75 0.7 A+11 W 100 2 1 8 258.39 32.30 0.89 0.3 A+11 W 101 2 1 8 2044.72 255.59 1.46 -0.9 A-11 W 102 2 1 8 259.01 32.38 0.89 0.3 A+11 W 103 2 1 8 95.88 11.99 0.95 0.1 A+11 W 104 2 1 8 124.92 15.61 1.14 -0.3 A-11 W 105 2 1 8 415.40 51.92 0.78 0.6 A+11 W 106 2 1 8 1455.98 182.00 1.41 -0.8 A-11 W 107 2 1 8 107.33 13.42 1.07 -0.2 A-11 W 108 2 1 8 360.27 45.03 0.83 0.4 A+11 W 109 2 1 8 81.45 10.18 0.92 0.2 A+11 W 110 2 1 8 303.14 37.89 1.14 -0.3 A-11 W 111 2 1 8 1114.10 139.26 0.73 0.7 A+11 W 112 2 1 8 272.56 34.07 0.89 0.3 A+11 W 113 2 1 8 327.29 40.91 1.21 -0.4 A-11 W 115 2 1 8 779.92 97.49 1.24 -0.5 A-11 W 116 2 1 8 440.63 55.08 1.18 -0.4 A-11 W 117 2 1 8 199.92 24.99 1.05 -0.1 A-11 W 118 2 1 8 423.78 52.97 0.85 0.4 A+11 W 119 2 1 8 2953.18 369.15 1.61 -1.1 B-11 W 120 2 1 8 138.96 17.37 0.95 0.1 A+11 W 121 2 1 8 171.02 21.38 1.12 -0.3 A-11 W 122 2 1 8 2845.21 355.65 0.61 1.2 B+11 W 123 2 1 8 61.07 7.63 0.94 0.1 A+11 W 124 2 1 8 474.04 59.26 0.80 0.5 A+11 W 125 2 1 8 563.36 70.42 1.35 -0.7 A-11 W 126 2 1 8 196.99 24.62 1.03 -0.1 A-11 W 127 2 1 8 171.60 21.45 0.90 0.2 A+
T 29
Appendix T: 2001 PSSA DIF AnalysisMultiple Choice Reading Items
Grade Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code11 W 128 2 1 8 60.94 7.62 1.03 -0.1 A-11 W 129 2 1 8 378.10 47.26 1.19 -0.4 A-11 W 130 2 1 8 86.97 10.87 0.99 0.0 A+11 W 131 2 1 8 195.28 24.41 1.14 -0.3 A-11 W 132 2 1 8 267.75 33.47 0.90 0.3 A+11 W 133 2 1 8 459.93 57.49 1.20 -0.4 A-11 W 134 2 1 8 56.53 7.07 0.96 0.1 A+11 W 135 2 1 8 518.24 64.78 0.79 0.6 A+11 W 136 2 1 8 240.27 30.03 0.91 0.2 A+11 W 137 2 1 8 61.41 7.68 0.93 0.2 A+11 W 138 2 1 8 507.40 63.42 0.80 0.5 A+11 W 139 2 1 8 576.63 72.08 0.78 0.6 A+11 W 140 2 1 8 1592.58 199.07 1.24 -0.5 A-11 W 141 2 1 8 1428.37 178.55 0.71 0.8 A+11 W 142 2 1 8 299.41 37.43 0.91 0.2 A+11 W 143 2 1 8 88.11 11.01 1.05 -0.1 A-11 W 144 2 1 8 143.36 17.92 1.13 -0.3 A-11 W 145 2 1 8 1010.08 126.26 1.29 -0.6 A-11 W 146 2 1 8 55.25 6.91 0.96 0.1 A+11 W 147 2 1 8 3874.29 484.29 1.73 -1.3 B-11 W 148 2 1 8 614.69 76.84 1.25 -0.5 A-11 W 149 2 1 8 213.73 26.72 1.16 -0.3 A-11 W 150 2 1 8 473.85 59.23 0.83 0.4 A+11 W 151 2 1 8 392.81 49.10 0.92 0.2 A+11 W 152 2 1 8 550.97 68.87 1.16 -0.3 A-11 W 153 2 1 8 1222.66 152.83 0.71 0.8 A+11 W 154 2 1 8 277.95 34.74 0.93 0.2 A+
T 30
Appendix U: 2001 PSSA DIF AnalysisOpen Ended Reading Items
Grade Form Sequence Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code5 A 185 2 1 8 4 -0.17 0.01 -14.0 C-5 B 185 2 1 8 4 -0.18 0.01 -15.1 C-5 C 185 2 1 8 4 -0.17 0.01 -14.1 C-5 D 185 2 1 8 4 -0.16 0.01 -13.3 C-5 E 185 2 1 8 4 -0.17 0.01 -14.0 C-5 F 185 2 1 8 4 -0.12 0.01 -11.4 C-5 G 185 2 1 8 4 -0.11 0.01 -10.3 C-5 H 185 2 1 8 4 -0.10 0.01 -9.7 C-5 I 185 2 1 8 4 -0.15 0.01 -13.4 C-5 J 185 2 1 8 4 -0.11 0.01 -10.5 C-5 W 100 2 1 8 4 -0.16 0.00 -46.4 C-5 W 127 2 1 8 4 -0.11 0.00 -32.9 C-8 A 215 2 1 8 4 -0.11 0.01 -8.8 C-8 B 215 2 1 8 4 0.03 0.01 2.2 B+8 C 215 2 1 8 4 -0.10 0.01 -8.1 C-8 D 215 2 1 8 4 0.01 0.01 1.1 A+8 E 215 2 1 8 4 -0.14 0.01 11.6 C-8 F 215 2 1 8 4 -0.15 0.01 12.4 C-8 G 215 2 1 8 4 -0.13 0.01 11.0 C-8 H 215 2 1 8 4 -0.15 0.01 12.1 C-8 I 215 2 1 8 4 -0.11 0.01 -9.4 C-8 J 215 2 1 8 4 -0.15 0.01 12.7 C-8 W 110 2 1 8 4 -0.18 0.00 48.7 C-8 W 147 2 1 8 4 -0.17 0.00 41.7 C-11 A 229 2 1 8 4 -0.20 0.02 -12.6 C-11 B 229 2 1 8 4 -0.28 0.02 -18.0 C-11 C 229 2 1 8 4 -0.14 0.02 -8.6 C-11 D 229 2 1 8 4 -0.17 0.02 -10.9 C-11 E 229 2 1 8 4 -0.28 0.02 -17.6 C-11 F 229 2 1 8 4 -0.19 0.02 -12.8 C-11 G 229 2 1 8 4 -0.25 0.02 -15.9 C-11 H 229 2 1 8 4 -0.17 0.02 -11.7 C-11 I 229 2 1 8 4 -0.23 0.02 -14.7 C-11 J 229 2 1 8 4 -0.19 0.02 -12.4 C-11 W 114 2 1 8 4 -0.20 0.01 -40.7 C-11 W 155 2 1 8 4 -0.26 0.01 -53.6 C-
U 31
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 1
Grade 5 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code A 185 2 1 8 4 -0.171 0.012 -14.0 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ---* | 2.67 753 2.90 913| | ---* | 2.33 815 2.59 805| | ---* | 2.16 873 2.40 962| ---* | 2.04 818 2.26 850| -* | 1.92 1015 2.04 937| -* | | 1.76 959 1.87 914| -* | | 1.53 951 1.63 757| -* | | 1.11 1038 1.24 6380____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code B 185 2 1 8 4 -0.175 0.012 -15.1 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ---* | 2.40 828 2.62 1020| |---* | 2.11 853 2.34 936| ---* | 1.97 923 2.23 913| ---* | 1.88 833 2.07 843| --* | 1.81 880 1.99 793| --*| | 1.73 894 1.88 826| --* | | 1.55 1004 1.69 834| * | | 1.17 1001 1.21 6740____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code C 160 2 1 8 488.71 61.09 0.47 1.8 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *| 0.98 731 0.98 1001| | *++| 0.98 836 0.94 923| | *++ | 0.94 932 0.89 916| | *+++++ | 0.93 846 0.83 843| | *++++++ | 0.88 865 0.75 887| | *+++++++++ | 0.79 994 0.60 885| *+++++++++ | 0.58 937 0.41 841| *+++++ | | 0.32 1067 0.23 6910____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code C 185 2 1 8 4 -0.167 0.012 -14.1 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.49 731 2.67 1001| | --* | 2.22 836 2.41 923| |--* | 2.08 932 2.25 916| ---* | 1.95 846 2.16 843| --* | 1.82 865 2.00 886| -* | | 1.73 992 1.84 884| --* | | 1.50 929 1.72 837| -* | | 1.20 1041 1.30 6730____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 2
Grade 5 Reading Items
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code D 169 2 1 8 864.04 108.01 0.41 2.1 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *++| 0.98 766 0.94 1050| | *++++++ | 0.96 903 0.84 914| | *+++++++ | 0.89 956 0.76 947| | *+++++++++ | 0.82 815 0.64 819| *++++++++++ | 0.69 906 0.47 820| *++++++++++ | 0.55 909 0.33 838| *+++++++++ | | 0.40 902 0.23 795| *+ | | 0.18 1079 0.15 6600____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code D 185 2 1 8 4 -0.164 0.012 -13.3 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ---* | 2.57 766 2.80 1050| | ---* | 2.27 903 2.49 914| | ---* | 2.15 956 2.37 947| |-* | 2.04 815 2.15 819| --* | 1.91 906 2.06 820| -* | | 1.74 909 1.84 837| ---* | | 1.56 899 1.72 790| --* | | 1.11 1060 1.24 6430____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code E 169 2 1 8 873.56 109.20 0.39 2.2 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *++ 0.99 769 0.95 1043| | *+++ | 0.96 795 0.90 908| | *+++++ | 0.95 883 0.84 933| | *++++++++ | 0.88 807 0.73 814| | *+++++++++++ | 0.84 832 0.61 838| *++++++++++ | 0.69 921 0.48 855| *++++++++++++ | 0.55 1005 0.31 777| *++++ | | 0.25 1121 0.18 7540____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code E 185 2 1 8 4 -0.165 0.012 -14.0 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ----* | 2.39 769 2.68 1043| | --* | 2.20 795 2.36 908| |--* | 2.04 883 2.22 933| ---* | 1.94 807 2.13 814| --* | 1.82 832 1.97 838| --* | | 1.71 920 1.87 855| --* | | 1.53 1001 1.66 772| -* | | 1.13 1098 1.23 7390____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 3
Grade 5 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code F 185 2 1 8 4 -0.120 0.010 -11.4 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.52 877 2.68 1028| | --* | 2.32 866 2.48 869| | -* | 2.21 891 2.34 909| | -* | 2.14 818 2.24 811| --* | 2.02 890 2.15 782| -* | 1.92 853 1.99 889| -* | | 1.73 965 1.80 789| --* | | 1.16 1058 1.29 6760____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code G 182 2 1 8 889.03 111.13 0.37 2.3 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+ 0.99 735 0.98 906| | *++| 0.98 781 0.94 923| | *++++ | 0.96 878 0.88 921| | *+++++++++ | 0.94 858 0.76 835| | *+++++++++ | 0.83 898 0.65 904| *++++++++++++ | 0.71 933 0.48 908| *++++++++++++| | 0.48 969 0.25 810| *+++ | | 0.22 1107 0.16 7430____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code G 185 2 1 8 4 -0.111 0.011 -10.3 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.68 735 2.80 906| | -* | 2.46 781 2.59 923| | --* | 2.32 878 2.44 921| | --* | 2.23 858 2.39 835| | --* | 2.15 898 2.31 904| |* | 2.07 933 2.12 908| -*| | 1.81 965 1.90 806| -* | | 1.22 1086 1.31 7160____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code H 173 2 1 8 544.14 68.02 0.47 1.8 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *| 0.98 725 0.98 940| | *+ | 0.96 800 0.94 815| | *++++ | 0.95 853 0.89 894| | *++++ | 0.92 866 0.83 801| | *++++++ | 0.86 926 0.74 873| | *++++++++++ | 0.80 936 0.60 917| *+++++++++++ | 0.64 980 0.41 963| *++++ | | 0.31 1134 0.25 7600____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 4
Grade 5 Reading Items
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code H 181 2 1 8 669.17 83.65 0.45 1.9 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+| 0.98 725 0.96 940| | *++++| 0.97 800 0.91 815| | *+++++ | 0.92 853 0.81 894| | *++++++ | 0.83 866 0.72 801| | *+++++++++ | 0.77 926 0.59 873| *+++++++++++++ | 0.65 936 0.40 917| *+++++++ | | 0.41 980 0.26 963| *++ | | 0.16 1134 0.12 7600____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code H 185 2 1 8 4 -0.100 0.010 -9.7 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.55 725 2.68 940| | -* | 2.36 800 2.48 815| | -* | 2.21 853 2.35 894| | -* | 2.16 866 2.24 801| |-* | 2.07 926 2.20 873| -* | 1.97 936 2.09 917| -* | | 1.80 979 1.87 957| * | | 1.28 1110 1.32 7460____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code I 185 2 1 8 4 -0.145 0.011 -13.4 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.59 782 2.76 968| | --* | 2.39 789 2.55 848| | --* | 2.25 927 2.42 905| | ---* | 2.18 859 2.37 825| |--* | 2.10 874 2.24 877| --* | 1.93 939 2.08 880| -* | | 1.73 926 1.83 884| -* | | 1.08 1022 1.19 6350____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code J 185 2 1 8 4 -0.112 0.011 -10.5 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.58 639 2.67 847| | --* | 2.34 832 2.50 804| | --* | 2.26 907 2.40 837| | --* | 2.18 816 2.31 736| |-* | 2.08 821 2.18 774| -* | 1.99 906 2.07 777| -* | | 1.74 942 1.84 810| --* | | 1.15 953 1.25 6340____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 5
Grade 5 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 100 2 1 8 4 -0.158 0.003 -46.4 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.38 7605 2.57 9716| |---* | 2.11 8270 2.29 8745| --* | 1.99 9023 2.15 9137| --* | 1.89 8336 2.05 8177| --*| | 1.79 8907 1.95 8485| --* | | 1.69 9247 1.82 8689| -* | | 1.51 9598 1.64 8276| --* | | 1.11 10700 1.25 69410____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 127 2 1 8 4 -0.114 0.003 -32.9 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.42 7605 2.57 9716| | -* | 2.12 8270 2.27 8745| -* | 1.97 9023 2.11 9137| --* | 1.85 8336 1.98 8177| -* | | 1.73 8907 1.83 8485| -* | | 1.59 9247 1.67 8689| -* | | 1.41 9598 1.48 8276| -* | | 1.01 10700 1.11 69410____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 6
Grade 8 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code A 215 2 1 8 4 -0.106 0.012 -8.8 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.54 660 2.67 943| | --* | 2.21 801 2.38 838| --* | 1.98 898 2.15 894| --* | 1.81 818 2.00 825| --* | | 1.69 956 1.83 881| -* | | 1.44 910 1.53 831| -* | | 1.15 951 1.17 751| * | | 0.51 1073 0.50 6180____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code C 215 2 1 8 4 -0.100 0.012 -8.1 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.53 672 2.70 948| | --* | 2.19 761 2.34 876| --* | 1.98 909 2.14 818| -*| | 1.86 977 1.96 923| --* | | 1.64 878 1.76 842| * | | 1.44 856 1.48 789| * | | 1.12 887 1.14 796| -* | | 0.51 975 0.58 5710____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code D 210 2 1 8 928.86 116.11 0.34 2.5 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *++ 0.99 750 0.96 974| | *+++| 0.98 775 0.93 835| | *+++++ | 0.97 854 0.85 809| | *+++++++++ | 0.94 953 0.77 845| | *++++++++++++ | 0.87 862 0.65 827| *++++++++++++++ | 0.78 860 0.50 808| *++++++++++ | 0.55 804 0.33 830| *++ | | 0.24 1025 0.20 6460____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code E 190 2 1 8 1315.17 164.40 0.39 2.2 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *++++++ | 0.90 757 0.78 920| | *+++++++++ | 0.82 857 0.63 934| | *+++++++++ | 0.77 805 0.59 819| *+++++++++++++ | 0.72 888 0.46 871| *++++++++++++++ | 0.66 843 0.37 847| *++++++++++++++ | 0.62 836 0.35 837| *++++++++++ | | 0.46 955 0.27 828| *+++ | | 0.28 989 0.23 6690____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 7
Grade 8 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code E 215 2 1 8 4 -0.139 0.012 -11.6 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.53 757 2.70 920| | --* | 2.18 857 2.34 934| --* | 2.00 805 2.16 819| --* | 1.82 888 2.02 871| ---* | | 1.63 843 1.81 847| --* | | 1.45 835 1.59 835| -* | | 1.10 944 1.17 828| -* | | 0.46 956 0.52 6430____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code F 215 2 1 8 4 -0.151 0.012 -12.4 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.31 705 2.43 1068| --* | 1.93 783 2.08 849| --* | | 1.72 867 1.87 904| --* | | 1.53 926 1.71 869| ---* | | 1.36 806 1.57 783| --* | | 1.20 790 1.33 850| --* | | 0.95 849 1.09 819| -* | | 0.53 1005 0.65 5800____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code G 192 2 1 8 573.86 71.73 0.42 2.0 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *++ 0.99 727 0.97 949| | *+++| 0.99 756 0.92 893| | *+++ | 0.96 843 0.91 888| | *+++++++ | 0.95 975 0.81 908| | *+++++++++ | 0.91 903 0.75 844| | *+++++++++ | 0.80 873 0.62 778| *++++++++ | 0.63 880 0.47 773| *+++ | | 0.37 1040 0.31 5970____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code G 215 2 1 8 4 -0.133 0.012 -11.0 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.47 727 2.62 949| |---* | 2.12 756 2.29 893| -* | 1.96 843 2.10 888| ---* | 1.78 975 1.98 908| --* | | 1.62 903 1.76 844| -* | | 1.43 872 1.55 777| -* | | 1.17 872 1.26 762| -* | | 0.65 993 0.71 5750____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 8
Grade 8 Reading Items
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code H 181 2 1 8 346.51 43.31 0.49 1.7 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+ 0.99 724 0.99 933| | *| 0.99 737 0.97 845| | *++| 0.98 873 0.94 859| | *++ | 0.97 803 0.92 830| | *+++ | 0.93 947 0.85 925| | *++++++ | 0.85 939 0.73 848| |*+++++++++ | 0.71 916 0.51 792| *+++++ | | 0.42 1040 0.32 5650____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code H 182 2 1 8 314.58 39.32 0.52 1.6 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *+ 0.99 724 0.99 933| | *+| 0.99 737 0.95 845| | *++| 0.98 873 0.93 859| | *+++ | 0.95 803 0.90 830| | *+++++ | 0.93 947 0.83 925| | *+++++++ | 0.86 939 0.71 848| *+++++++ | 0.65 916 0.50 792| *++ | | 0.36 1040 0.33 5650____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code H 215 2 1 8 4 -0.145 0.012 -12.1 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.21 724 2.40 933| -* | 1.91 737 2.04 845| --* | | 1.72 873 1.86 859| --* | | 1.53 803 1.71 830| --* | | 1.36 947 1.52 924| -* | | 1.17 936 1.30 845| -* | | 0.95 911 1.06 781| -* | | 0.54 1005 0.66 5300____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code I 215 2 1 8 4 -0.113 0.012 -9.4 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.54 666 2.62 986| | --* | 2.20 791 2.32 896| |-* | 2.07 891 2.17 989| --* | 1.85 825 2.02 782| -* | | 1.69 942 1.80 877| --* | | 1.47 896 1.59 811| -* | | 1.17 877 1.25 774| --* | | 0.64 1005 0.76 5970____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 9
Grade 8 Reading Items
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code J 208 2 1 8 1471.17 183.90 0.37 2.4 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| | *++++++ | 0.90 775 0.77 896| | *++++++++++ | 0.83 904 0.62 965| |*+++++++++++++ | 0.77 816 0.52 808| *+++++++++++++++ | 0.71 908 0.42 914| *++++++++++++++ | 0.63 848 0.36 859| *+++++++++++++ | 0.56 830 0.30 810| *++++++++++ | | 0.44 847 0.25 800| *++ | | 0.25 1009 0.20 5940____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code J 215 2 1 8 4 -0.153 0.012 -12.7 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.26 775 2.40 896| --* | 1.86 904 2.03 965| ---*| | 1.69 816 1.88 808| --* | | 1.50 908 1.72 914| --* | | 1.37 848 1.55 859| -* | | 1.22 829 1.31 807| --* | | 0.96 839 1.10 790| -* | | 0.53 969 0.63 5640____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 110 2 1 8 4 -0.177 0.004 -48.7 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.60 7206 2.75 9519| | --* | 2.31 8104 2.46 8868| | --* | 2.16 8559 2.34 8662| ---* | 2.03 8843 2.21 8576| --* | 1.89 8870 2.08 8570| --*| | 1.74 8662 1.93 8182| --* | | 1.52 8873 1.69 7989| --* | | 0.98 10295 1.15 61290____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 147 2 1 8 4 -0.167 0.004 -41.7 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ---* | 2.60 7206 2.76 9519| | --* | 2.25 8104 2.40 8868| --* | 2.01 8559 2.20 8662| --* | 1.83 8843 2.00 8576| --* | | 1.59 8870 1.79 8570| ---* | | 1.36 8662 1.56 8182| --* | | 1.07 8873 1.24 7989| -* | | 0.57 10295 0.68 61290____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 10
Grade 11 Reading Items
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code A 199 2 1 8 1914.94 239.37 0.38 2.3 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| *+++++++++++++++ | 0.80 661 0.50 817| *++++++++++++++++++ | 0.67 593 0.30 719| *++++++++++++++++ | 0.53 682 0.20 749| *+++++++++++++++ | | 0.42 682 0.13 804| *+++++++++++ | | 0.33 660 0.12 732| *++++ | | 0.24 716 0.16 774| -* | | 0.25 769 0.27 652| --* | | 0.21 995 0.24 4380____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code A 229 2 1 8 4 -0.198 0.016 -12.6 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.68 661 2.85 817| | ---* | 2.34 593 2.54 719| | --* | 2.14 682 2.30 749| ---* | 1.86 682 2.10 804| ---*| | 1.65 659 1.93 732| ---* | | 1.39 713 1.62 764| --* | | 1.03 752 1.19 639| --* | | 0.49 944 0.65 4050____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code B 229 2 1 8 4 -0.278 0.015 -18.0 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ---* | 2.72 642 2.97 843| | ---* | 2.37 614 2.67 708| -----* | 2.01 735 2.38 778| ----* | 1.80 658 2.17 741| -----*| | 1.55 606 1.89 720| ----* | | 1.30 632 1.58 732| ----* | | 0.84 753 1.10 586| -* | | 0.38 944 0.51 4120____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code C 229 2 1 8 4 -0.137 0.016 -8.6 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | -* | 2.86 614 2.95 812| | -* | 2.46 662 2.60 759| | --* | 2.24 614 2.41 664| |---* | 2.12 653 2.34 708| ---* | 1.84 630 2.08 774| --* | | 1.60 629 1.79 632| -* | | 1.27 693 1.33 567| * | | 0.61 864 0.65 3850____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 11
Grade 11 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code D 229 2 1 8 4 -0.168 0.015 -10.9 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.74 687 2.85 829| | --* | 2.30 660 2.49 713| |--* | 2.07 699 2.25 738| ---* | 1.86 684 2.06 776| ---* | | 1.58 629 1.85 727| ---* | | 1.35 723 1.58 676| --* | | 0.97 707 1.09 616| -* | | 0.45 858 0.54 3920____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code E 229 2 1 8 4 -0.276 0.016 -17.6 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ----* | 2.73 564 3.02 837| | ----* | 2.36 664 2.65 773| |----* | 2.10 647 2.38 794| -----* | 1.84 713 2.21 793| ----*| | 1.64 662 1.90 688| ----* | | 1.31 712 1.60 693| ---* | | 0.85 711 1.15 617| --* | | 0.35 836 0.51 3670____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code F 220 2 1 8 1677.73 209.72 0.40 2.2 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| *++++++++++++++++ | 0.80 665 0.47 788| *+++++++++++++++++ | 0.63 672 0.27 812| *+++++++++++++++++ | 0.51 620 0.16 705| *++++++++++ | | 0.34 700 0.14 718| *++++++++ | | 0.27 675 0.12 729| *++++ | | 0.26 693 0.18 712| --* | | 0.21 729 0.26 646| --* | | 0.20 925 0.23 4370____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code F 229 2 1 8 4 -0.186 0.015 -12.8 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.59 665 2.74 788| | --* | 2.23 672 2.41 812| ---* | 1.99 620 2.24 705| --* | 1.89 700 2.09 718| ---*| | 1.67 673 1.92 729| ---* | | 1.47 688 1.64 700| --* | | 1.17 714 1.39 628| -* | | 0.73 878 0.83 4010____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 12
Grade 11 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code G 229 2 1 8 4 -0.248 0.016 -15.9 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.55 595 2.75 807| | ---* | 2.13 709 2.41 810| -----* | 1.84 585 2.21 713| ---*| | 1.66 670 1.94 710| ----* | | 1.37 695 1.70 748| ---* | | 1.13 693 1.38 673| --* | | 0.79 761 0.98 597| -* | | 0.44 896 0.57 4610____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code H 229 2 1 8 4 -0.174 0.015 -11.7 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.62 561 2.79 744| | --* | 2.29 644 2.50 718| |---* | 2.07 625 2.28 786| --* | 1.94 669 2.09 770| --*| | 1.73 693 1.96 675| --* | | 1.53 645 1.72 743| -* | | 1.26 730 1.33 571| --* | | 0.64 892 0.83 4010____________1___________2____________3___________4 Right Total Right Total
Selected Response Form Seq Ref Focal d.f. ChiSq M.S. OddsRatio Effect Code I 219 2 1 8 1628.90 203.61 0.40 2.2 C+0____1____2____3____4____5____6____7____8____9____0 FOCAL REFERENCE| *+++++++++++++++++ | 0.85 643 0.51 746| *+++++++++++++++++ | 0.64 593 0.30 698| *+++++++++++++++++ | 0.52 694 0.19 765| *+++++++++++++ | | 0.40 658 0.15 818| *++++++++ | | 0.30 690 0.13 767| * | | 0.21 658 0.19 682| --* | | 0.20 765 0.24 624| --* | | 0.18 873 0.22 4240____1____2____3____4____5____6____7____8____9____0 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code I 229 2 1 8 4 -0.228 0.016 -14.7 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ---* | 2.34 643 2.59 746| ----* | 1.92 593 2.26 698| ----* | 1.70 694 2.03 765| ---* | | 1.62 658 1.82 818| ---* | | 1.26 690 1.55 766| ----* | | 1.00 654 1.28 678| --* | | 0.75 750 0.88 607| -* | | 0.37 830 0.45 3860____________1___________2____________3___________4 Right Total Right Total
Appendix V: 2001 PSSA DIF Plots for Questionable Reading Items
V 13
Grade 11 Reading Items
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code J 229 2 1 8 4 -0.185 0.015 -12.4 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | ---* | 2.59 607 2.81 773| | ---* | 2.33 654 2.53 703| ---* | 2.03 677 2.26 756| ---* | 1.93 668 2.13 769| ---*| | 1.72 603 1.93 679| ---* | | 1.56 629 1.79 669| --* | | 1.24 726 1.39 594| -* | | 0.66 871 0.75 3750____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 114 2 1 8 4 -0.198 0.005 -40.7 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 3.06 6239 3.18 7996| | --* | 2.77 6465 2.95 7413| | ---* | 2.55 6578 2.77 7448| | ----* | 2.35 6755 2.60 7608| |----* | 2.11 6545 2.37 7242| ---* | 1.84 6763 2.09 7040| ---* | | 1.47 7455 1.65 6203| -* | | 0.84 9291 0.97 43300____________1___________2____________3___________4 Right Total Right Total
Constructed Response Form Seq Ref Focal d.f. M SMD SE Z(SMD) Code W 155 2 1 8 4 -0.258 0.005 -53.6 C-0____________1___________2____________3___________4 FOCAL REFERENCE| | --* | 2.85 6239 3.05 7996| | ---* | 2.50 6465 2.76 7413| | ---* | 2.31 6578 2.57 7448| | ---* | 2.14 6755 2.42 7608| ----* | 1.96 6545 2.26 7242| ----* | 1.77 6763 2.06 7040| ----* | | 1.46 7455 1.73 6203| --* | | 0.84 9291 1.07 43300____________1___________2____________3___________4 Right Total Right Total
Appendix W: 2001 PSSA School LevelPercentile Ranks
PercentileRank Grade 5 Grade 8 Grade 11 Grade 5 Grade 8 Grade 11
1 732 724 722 931 848 8322 971 842 861 1021 990 9463 1016 892 902 1045 1031 9694 1045 934 939 1061 1043 9905 1063 967 954 1074 1050 10206 1075 993 988 1090 1056 10347 1090 1011 1007 1102 1071 10478 1102 1026 1018 1117 1078 10549 1114 1047 1027 1131 1085 1061
10 1125 1059 1047 1140 1093 107111 1133 1072 1055 1148 1100 107912 1143 1081 1072 1156 1108 108313 1154 1090 1079 1168 1116 109214 1172 1099 1091 1180 1127 110915 1181 1109 1103 1191 1137 111616 1188 1114 1117 1197 1142 112517 1200 1133 1134 1203 1150 113918 1208 1146 1150 1211 1155 114719 1217 1155 1164 1215 1164 115320 1225 1160 1169 1224 1172 117021 1231 1166 1177 1228 1182 117722 1236 1177 1189 1232 1191 118523 1240 1192 1193 1235 1196 119624 1248 1199 1200 1239 1203 120325 1253 1207 1205 1243 1208 120526 1257 1211 1209 1248 1212 121027 1261 1218 1217 1252 1216 121728 1264 1223 1224 1257 1221 121929 1268 1230 1229 1259 1225 122630 1270 1238 1233 1264 1230 123031 1274 1243 1238 1266 1236 123432 1277 1248 1242 1269 1239 123933 1280 1252 1245 1272 1244 124134 1283 1258 1249 1274 1248 124435 1285 1260 1250 1276 1252 124836 1288 1262 1255 1278 1256 125037 1291 1268 1258 1281 1260 125238 1295 1272 1261 1285 1263 125539 1298 1275 1263 1289 1268 125840 1300 1279 1264 1292 1271 126141 1303 1282 1268 1294 1274 126242 1305 1283 1271 1296 1277 126443 1307 1286 1275 1299 1278 126744 1309 1289 1277 1301 1282 127045 1312 1292 1279 1304 1285 127246 1314 1295 1282 1307 1286 127547 1317 1298 1283 1309 1289 127648 1318 1300 1285 1311 1292 127849 1322 1301 1287 1314 1294 128050 1324 1305 1290 1318 1297 1282
Reading Mathematics
W 1
Appendix W: 2001 PSSA School LevelPercentile Ranks
PercentileRank Grade 5 Grade 8 Grade 11 Grade 5 Grade 8 Grade 11
Reading Mathematics
50 1324 1305 1290 1318 1297 128251 1326 1308 1292 1319 1299 128352 1328 1311 1294 1321 1303 128653 1330 1313 1296 1323 1305 128754 1331 1315 1298 1325 1307 128855 1333 1318 1299 1327 1309 129156 1335 1320 1300 1330 1313 129257 1337 1323 1303 1332 1316 129458 1338 1326 1306 1334 1318 129659 1340 1328 1309 1337 1321 129860 1343 1331 1310 1339 1322 130261 1345 1333 1311 1341 1326 130462 1348 1337 1313 1343 1329 130563 1350 1339 1314 1345 1333 130764 1352 1341 1315 1347 1336 130865 1354 1342 1316 1349 1338 130966 1356 1344 1319 1352 1341 131367 1359 1347 1321 1355 1343 131468 1361 1350 1323 1358 1346 131669 1364 1351 1325 1360 1348 131870 1366 1354 1327 1362 1352 132071 1368 1357 1329 1364 1355 132372 1370 1359 1330 1367 1357 132473 1372 1361 1332 1370 1360 132874 1374 1362 1334 1373 1362 133175 1377 1365 1338 1375 1366 133376 1380 1367 1342 1378 1369 133477 1383 1371 1345 1380 1372 133678 1386 1375 1347 1383 1377 133879 1390 1380 1349 1385 1379 134180 1392 1382 1351 1389 1380 134581 1395 1385 1353 1392 1382 134982 1397 1388 1355 1394 1385 135283 1401 1391 1359 1397 1387 135684 1403 1395 1362 1402 1391 135985 1408 1400 1364 1405 1395 136286 1412 1403 1367 1408 1399 136787 1415 1407 1372 1412 1405 137188 1418 1411 1376 1416 1410 137789 1423 1416 1379 1419 1412 138090 1426 1422 1385 1426 1416 138791 1429 1428 1391 1431 1419 139592 1435 1437 1398 1436 1430 139893 1441 1443 1401 1441 1436 140494 1446 1451 1409 1446 1451 141295 1452 1459 1415 1457 1459 141896 1458 1468 1425 1465 1468 142897 1467 1480 1432 1475 1479 145098 1482 1510 1455 1485 1496 146399 1504 1553 1492 1501 1518 1516
W 2
Ap
pen
dix
X:
2001
PS
SA
Per
cen
tile
Ran
k C
on
vers
ion
Tab
les
for
Sca
led
Sco
res
Per
cen
tile
R
ank
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reP
erce
nti
le
Ran
kS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
0159
55
373
110
00
0138
12
100
010
00
0294
722
952
1892
219
0289
515
827
1982
520
0396
023
980
2093
820
0391
616
863
2185
922
0498
525
993
2195
421
0493
517
897
2389
024
0599
726
1005
2296
922
0595
418
914
2490
625
0610
2128
1018
2398
423
0697
219
930
2592
126
0710
3229
998
2407
990
2096
227
935
2708
1043
3010
3024
1012
2508
1008
2197
728
964
2909
1054
3110
4125
0999
329
978
3010
1065
3210
5326
1026
2610
1025
2210
0830
992
3111
1076
3310
6427
1039
2711
1042
2310
2331
1005
3212
1087
3412
1059
2410
3732
1019
3313
1075
2810
5328
1310
5233
1032
3414
1097
3510
8629
1066
2914
1075
2510
6734
1046
3515
1108
3615
1091
2610
8135
1058
3616
1118
3710
9730
1079
3016
1071
3717
1108
3117
1107
2710
9536
1084
3818
1129
3810
9131
1811
1037
1097
3919
1139
3911
1932
1104
3219
1123
2811
1040
2011
4940
1129
3320
1124
3821
1117
3321
1140
2911
3939
1123
4122
1160
4111
4034
2211
3642
2311
5035
1129
3423
1155
3011
5340
1148
4324
1170
4211
4135
2411
6741
2511
8043
1161
3625
1172
3111
6144
2611
5436
2611
8142
1174
4527
1190
4411
7137
2711
8832
2811
6637
2811
9643
1187
4629
1200
4511
8138
2912
0433
3012
1046
1191
3911
7838
3012
1044
1200
4731
3112
1348
3212
2147
1202
4011
9039
3212
2034
1225
45
Mat
hem
atic
sR
ead
ing
Gra
de
11G
rad
e 8
Gra
de
8G
rad
e 5
Gra
de
11G
rad
e 5
X 1
Ap
pen
dix
X:
2001
PS
SA
Per
cen
tile
Ran
k C
on
vers
ion
Tab
les
for
Sca
led
Sco
res
Per
cen
tile
R
ank
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reP
erce
nti
le
Ran
kS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
Mat
hem
atic
sR
ead
ing
Gra
de
11G
rad
e 8
Gra
de
8G
rad
e 5
Gra
de
11G
rad
e 5
3333
1225
4934
1231
4812
1241
1202
4034
1237
3535
3512
4046
1238
5036
1241
4912
2242
1214
4136
3712
3343
3712
5436
1254
4712
5251
3812
5250
1226
4238
3912
4344
3912
6948
1265
5240
1262
5112
3843
4012
7137
4112
5345
4112
7853
4212
7352
1249
4442
1285
4943
1264
4643
1288
3844
1283
5312
6145
4412
9254
4512
7447
4513
0050
4612
7346
4613
0555
4712
9454
1285
4847
1306
3948
1285
4748
1315
5149
1305
5512
9549
4913
1956
5012
9748
5013
2540
5113
1656
1306
5051
1331
5213
3357
5213
1751
1309
4952
5313
2757
5354
1328
5213
2050
5413
4341
1347
5313
4758
5613
3858
1339
5313
3251
5657
5713
6354
1361
5958
1350
5913
5054
1344
5258
1363
4260
1362
6013
6155
1356
5360
1376
6061
6113
8055
6213
7256
1368
5462
6313
7461
1380
5563
1383
4313
9161
6413
8357
6413
9756
X 2
Ap
pen
dix
X:
2001
PS
SA
Per
cen
tile
Ran
k C
on
vers
ion
Tab
les
for
Sca
led
Sco
res
Per
cen
tile
R
ank
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reP
erce
nti
le
Ran
kS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
Mat
hem
atic
sR
ead
ing
Gra
de
11G
rad
e 8
Gra
de
8G
rad
e 5
Gra
de
11G
rad
e 5
6513
8662
1392
5665
6613
9558
6614
0662
6714
0557
6714
0444
6813
9863
1406
5968
1414
5769
1417
5869
1421
6370
1411
6414
1860
7071
1430
6114
3059
7114
2645
1432
5872
1424
6572
1437
6473
1441
6214
4260
7375
1437
6614
5363
1455
6175
1449
4614
5059
1454
6577
1451
6714
6564
1469
6277
7814
8363
7814
6960
1471
6679
1466
6814
7765
7980
1490
6614
9764
8014
7347
8114
8169
8114
8867
8215
0267
1511
6582
1489
6184
1496
7015
1568
1527
6684
1499
4815
0668
8515
2869
1542
6785
1509
6286
1512
7186
1524
6987
1542
7015
5968
8788
1529
7215
5671
1576
6988
1527
4915
3063
8989
1543
7090
1547
7315
7072
1594
7090
1552
6491
1566
7415
8573
1613
7191
1557
5015
6371
9216
0174
1633
7292
9315
8675
9315
7565
1584
7294
1608
7616
1975
1655
7394
1590
5195
1637
7616
7874
9515
9966
1606
7396
1633
7716
5877
1703
7596
1627
5216
2567
1629
74
X 3
Ap
pen
dix
X:
2001
PS
SA
Per
cen
tile
Ran
k C
on
vers
ion
Tab
les
for
Sca
led
Sco
res
Per
cen
tile
R
ank
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reP
erce
nti
le
Ran
kS
cale
S
core
Raw
S
core
Sca
le
Sco
reR
aw
Sco
reS
cale
S
core
Raw
S
core
Mat
hem
atic
sR
ead
ing
Gra
de
11G
rad
e 8
Gra
de
8G
rad
e 5
Gra
de
11G
rad
e 5
9716
5978
1681
7817
3176
9716
6953
1652
6816
5375
9816
9079
1708
7917
9678
9817
1754
1681
6916
7976
9917
6981
1778
8118
3579
9917
7455
1713
7017
0777
X 4