RTI: Response RTI Assessment Tools for ELLs. ACHIEVEMENT TOOLS Measuring Response to Intervention.

Download RTI: Response RTI Assessment Tools for ELLs. ACHIEVEMENT TOOLS Measuring Response to Intervention.

Post on 05-Jan-2016




1 download

Embed Size (px)


<ul><li><p>RTI: Response</p><p>RTI Assessment Tools for ELLs</p></li><li><p>ACHIEVEMENT TOOLSMeasuring Response to Intervention</p></li><li><p>CBM ConsiderationsExtent to which curriculum is culturally representative of the student.Students previous participation in bilingual education/ ESLKnown or suspected sensory or communicative impairmentsInformation on formal former education.How often has the child moved and how often does child attend school?</p></li><li><p>CBM ConsiderationsStudents level of acculturationEnglish language proficiencyWhat skills are needed to answer the items that are not related to item performance.Experiences outside of the school setting that support or detract from academic success.</p></li><li><p>CBM: Spanish MaterialsBrigance Diagnostic Assessment of Basic Skills, SpanishK-6Readiness, Speech, Word Recognition, Oral Reading, Reading, Comp., Word Analysis, Listening, Writing, Alphabetizing, Numbers and Computation, and Measurement</p><p>DIBELS has a Spanish version that is like the English version. This can be found on the DIBELS website.</p></li><li><p>Suggestions: Non-English and Non-Spanish CBMInformal methods or CBM methods should be utilized in combination with parent/ teacher interviews, class observations, and child interviews.As very few CBM measures are available in languages other than Spanish, you may have to create your own CBM instruments.</p></li><li><p>Making Your Own CBM:Operationalize the CurriculumEstablish what is the MOST IMPORTANT in the curriculum and change these concepts into questions from the materials.Determine what is most typical for most students.Attempt to avoid floor and ceiling problems by making items too easy or too hard (best to err on too easy).</p></li><li><p>Collect, Analyze, and Describe the DataFor classroom, median is only stat needed.For larger data collection groups, organize scores by grade using Means and Standard Deviations.Use percentile ranks if N&gt;100.Normal range is that 2 out of every 3 score in that group (16th - 84th percentile).</p></li><li><p>Local Norms: ClassroomClassroom: Usually a small number of students (5-10). Only gross estimates of variability are available. Limited to screening and prioritizing student w/in class needs.Sampling:Obtain sample from class at largeOR Obtain a sample from students considered to be typical in that classroom.OR Obtain combination from class on group tasks and a smaller sample on individual tasks.Class of 40-45, sample of 5 is fine, 10 preferred.</p></li><li><p>Error AnalysisFinally, you need to analyze the errors.Determine if skills that are missing can be made up in general education mainstreaming.Determine what objectives need addressing in the intervention.</p></li><li><p>Reading AssessmentsObtain basal readers for different levels in English and in the other languageHave the child read in each language.Score fluency by marking reading end point after 1 min and 2 min.Ask the child to retell the story to indicate passage comprehension.Basic reading can be evaluated by the number of errors made while reading the passage.</p></li><li><p>Math AssessmentsBasic math: direct translation of instructions and actual items from a normative test (do not use norms).Applied math: direct translation of items from a normative test (do not use norms).Do an error analysis of types of problems and see if these carry across languages.</p></li><li><p>Written ExpressionDevelop an age appropriate writing prompt (e.g., I was walking down the street and suddenly I saw ).Have the child write a story based on this prompt.Have a translator given a similar prompt in the native language.Work with the translator to determine total number of words, grammar spelling, and understandability for BOTH language tasks.</p></li><li><p>BEHAVIORAL/ EMOTIONAL TOOLSMeasuring Positive Behavioral Supports</p></li><li><p>PBS: Data CollectionInternalized BehaviorsRating ScalesChecklistsExternalized BehaviorsTime SamplingEvent Sampling</p></li><li><p>Rating Scales &amp; ChecklistsRating Scales: Use quality judgments (e.g., good, poor, etc.) instead of concrete descriptors.Checklists: Use yes/no to describe whether or not a criteria was met.</p><p>You can use existing checklists/ rating scales but choose specific items for what you are measuring (Volpe &amp; Gadow, 2010)</p></li><li><p>Systematic ObservationsTime/event appropriateOperationally define the behaviorHave a planned recording techniqueMay want to have more than one setting.May want to have more than one observer.Generally works best for high incidence behaviors.Can take place in a planned (forced) situation or in a natural situation.</p></li><li><p>Designing an ObservationHow many times will you observe?How long will you observe?When/ where will you observe?What behaviors will you observe?How will you record the data?</p></li><li><p>Recording DataUse a specific form to collect the data.Anecdotal record form: You write the time and a description of each significant behavior following a narrative section on settings, patterns, and opportunities. Quantitative record formInterval recording (time sampling, interval sampling, &amp; interval time sampling).Event recording (event sampling)</p></li><li><p>Time Sampling: TypesPartial Interval Time SamplingRecord the behavior if it happens once during a set time period. For example, if it occurs at all during a 60 second period.Whole-Interval Time SamplingRecord the behavior if it occurs during the whole interval. For example, if it occurs lasts from the first second to the last in a 60 second interval.Other time sampling methodsOther methods are available but not often used.</p></li><li><p>Time Sampling: Example </p><p>TargetedBehaviors@10sec@20Sec@30Sec@40Sec@50Sec@60sec</p></li><li><p>Time Sampling: Example Partial-interval</p><p>TargetedBehaviors@10sec@20Sec@30Sec@40Sec@50Sec@60secOut of his seatXXXXMaking noisesXXNot workingXXXXXX</p></li><li><p>Event SamplingRecord every time the client performs a certain action.For example:</p><p>TargetedBehaviorsNumber of timesIn 3 min periodOut of his seat|||Making noises|||| |||Not working||</p></li><li><p>Observation: DataFrequency: How many X in Y minutes (e.g., 3 times per min).Duration: How long is this happening (e.g., he cried for 3 min).Duration: What percentage of time is this happening (e.g., he cried for 45% of the time).Latency: How long does it take between the stimulus and the response.(e.g., he started crying 20 seconds after his mother left)</p></li><li><p>BEYOND RTI/PBS ASSESSMENTEvaluating English Language Learners</p></li><li><p>ELL and AssessmentCognitive Assessments:Use the MAMBI to help guide your assessment plan.Use confidence intervals with normative data instead of just the score because of the reliability issues for ELL.Consider all normative data as suspect. Verify any test data against observation and interview/records review data.Even nonverbal assessments can have biased content.</p></li><li><p>ELL and AssessmentAchievement:You need language proficiency data. It needs to be current.If applicable, you need some estimate of achievement in L1 and L2YOU CANNOT HAVE SLD IN L2 AND NOT HAVE IT IN L1Sometimes good normative data is not available. You may have to change the basic structure of how you assess and diagnose.</p></li><li><p>ELL and AssessmentSocial, Emotional, Behavioral, and AdaptiveThese constructs are culturally loaded. Be careful when using translations that do not have normative changes as well.Parental and child interviews may not illicit much information unless they feel comfortable with you.For informal information, you may need a cultural ambassador to help you talk with clients and families.Keep in mind that mental illness manifests differently in different cultures.</p></li><li><p>Psychologists and SST Report WritingWhat will be in a report:Reports need to be written to include all of the data collected.Your reports will often feel more qualitative instead of qualitative in nature.You may have to go into specific tests to examine response patterns down to the item level.Language of a report:Most districts do not require a home language translation of a report or meeting notes.You may want to record the translators description of the report during the meeting for the family to review later.</p></li><li><p>Final ThoughtsMost assessments for ELL will take 2-3 times as long as their English-only equivalents.Most meetings for ELL will also take 2-3 times longer.When making a diagnostic decision, examine the preponderance of the evidence.Parents and families play a crucial role in these assessments BUT they are often unavailable, difficult to reach, and/or not comfortable with school personnel.Families across cultures are more alike than different.There is not a single cultural group that does fails to love their children. </p><p>*****</p></li></ul>