Reporting Testing Reporting Testing Irregularities OnlineIrregularities Online

Turning Challenges into Turning Challenges into OpportunitiesOpportunities

Brief History of OTISSBrief History of OTISS

System developed in 2005-06System developed in 2005-06 Phase 1 implemented in Spring Phase 1 implemented in Spring

20072007 Three LEAs reported testing Three LEAs reported testing

irregularities onlineirregularities online Grade 3 PretestGrade 3 Pretest Incorporated feedback to Incorporated feedback to

increase usability and enhance increase usability and enhance user manualuser manual

Brief History of OTISS Brief History of OTISS (Cont’d)(Cont’d)

Implemented Phase 2 in Fall 2007Implemented Phase 2 in Fall 2007 Used by 25 LEAs to report EOC Used by 25 LEAs to report EOC

testing irregularitiestesting irregularities Regional Accountability Coordinators Regional Accountability Coordinators

(RACs) trained(RACs) trained Online training sessions conductedOnline training sessions conducted Forms redesignedForms redesigned Iterative process of using feedback Iterative process of using feedback

to improve systemto improve system

Definition of OpportunityDefinition of Opportunity

op·por·tu·ni·tyop·por·tu·ni·ty   (ŏp'ər-tōō'nĭ-tē)   (ŏp'ər-tōō'nĭ-tē) noun, noun, pluralplural -ties. -ties.

a situation or condition favorable a situation or condition favorable for attainment of a goal for attainment of a goal

a good position, chance, or a good position, chance, or prospect, as for advancement or prospect, as for advancement or successsuccess

OpportunitiesOpportunities

Saves timeSaves time Less paperworkLess paperwork More secureMore secure Less faxingLess faxing Less filingLess filing Defined process eliminates Defined process eliminates

guessworkguesswork

Definition of ChallengeDefinition of Challenge

chal·lengechal·lenge (chāl'ənj) n.   (chāl'ənj) n.   A test of one's abilities or A test of one's abilities or

resources in a demanding but resources in a demanding but stimulating undertaking: stimulating undertaking: a a career that offers a challenge.career that offers a challenge.

ChallengesChallenges

Managing passwordsManaging passwords Virtual trainingVirtual training TechnophobiaTechnophobia E-mail notificationE-mail notification Testing Irregularity CategoriesTesting Irregularity Categories Updating system and user Updating system and user

manualmanual

Challenges (Cont’d)Challenges (Cont’d)

Challenges are addressed in Challenges are addressed in three waysthree ways

System modification System modification (Ex: E-mail character increase)(Ex: E-mail character increase)

Training/User Manual UpdateTraining/User Manual Update(Ex: Managing passwords)(Ex: Managing passwords)

Sometimes bothSometimes both(Ex: Student Information)(Ex: Student Information)

TestimonialsTestimonials

Bob WillBob WillDirector of Accountability & NCWISEDirector of Accountability & NCWISEWilkes County SchoolsWilkes County Schools

Donna ClellandDonna Clelland Director of Testing and Accountability Director of Testing and Accountability Asheboro City SchoolsAsheboro City Schools

Melissa MooseMelissa Moose System Testing Coordinator System Testing Coordinator

Catawba County SchoolsCatawba County Schools

Chain of CommandChain of Command

Scenario 1Scenario 1

A teacher asks a School Test A teacher asks a School Test Coordinator for information on how to Coordinator for information on how to enter an irregularity at the Basic enter an irregularity at the Basic Reporting level.Reporting level.

Scenario 2Scenario 2

A LEA Test Coordinator receives an A LEA Test Coordinator receives an e-mail from a School Test Coordinator e-mail from a School Test Coordinator requesting passwords for his/her school.requesting passwords for his/her school.

Scenario 3Scenario 3

A fire alarm disrupts a whole class A fire alarm disrupts a whole class being tested.being tested.

Scenario 4Scenario 4 A LEA Test Coordinator classifies A LEA Test Coordinator classifies

a testing irregularity and sees the a testing irregularity and sees the following message:following message:

Download the Download the attachedattached investigative checklist. investigative checklist. Conduct the investigation in accordance to the Conduct the investigation in accordance to the checklist. Additionally, click on the "Return to checklist. Additionally, click on the "Return to School" button to send the irregularity to the school School" button to send the irregularity to the school so the school can conduct an investigation. The so the school can conduct an investigation. The school will be instructed to print, sign, and return school will be instructed to print, sign, and return the irregularity to the LEA Test Coordinator for the irregularity to the LEA Test Coordinator for completing the documentation of this irregularity.completing the documentation of this irregularity.

Scenario 5Scenario 5

A School Test Coordinator A School Test Coordinator receives an irregularity in his/her receives an irregularity in his/her New/Pending box sent back New/Pending box sent back from the LEA with the following from the LEA with the following text:text:Download the Download the attachedattached investigative investigative checklist. Conduct the investigation in checklist. Conduct the investigation in accordance to the checklist. Re-submit the accordance to the checklist. Re-submit the irregularity to the LEA TC. Print the irregularity to the LEA TC. Print the irregularity, complete signatures and send irregularity, complete signatures and send to your LEA test coordinator.to your LEA test coordinator.

Fun QuestionsFun Questions

Can you name the band and/or Can you name the band and/or the name of the song playing the name of the song playing when you entered the room?when you entered the room?

How is the song related to the How is the song related to the online reporting of testing online reporting of testing irregularities?irregularities?

The Time is NowThe Time is Now

Kudos to Julien Alhour!Kudos to Julien Alhour! Many thanks to Dr. Garner for Many thanks to Dr. Garner for

working on the blueprints with TSAC!working on the blueprints with TSAC! System enhancements in processSystem enhancements in process Contact me to schedule online Contact me to schedule online

trainingtraining Brian_Swiger@ncsu.eduBrian_Swiger@ncsu.edu Thank you for attending the OTISS Thank you for attending the OTISS

presentation!presentation!