computer based testing overview march 8, 2013
DESCRIPTION
Computer Based Testing Overview March 8, 2013. Jennifer Stafford Policy Advisor Kentucky Department of Education [email protected]. Paul Shoemaker Engineer/Architect Kentucky Department of Education [email protected]. Joe Dell Brasel, Ed.D. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/1.jpg)
Computer Based TestingOverviewMarch 8, 2013
Joe Dell Brasel, Ed.D.Account ManagerACT , [email protected]
Jennifer StaffordPolicy AdvisorKentucky Department of Education [email protected]
Paul ShoemakerEngineer/ArchitectKentucky Department of Education [email protected]
04/22/2023
1
![Page 2: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/2.jpg)
Agenda• Testing Windows and Sessions• Responsibilities and Deadlines• Technical Components• Prohibited/Acceptable Materials• Online Testing• Resources
04/22/2023
2
![Page 3: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/3.jpg)
Testing Windows• Two remaining EOC test windows:
• April 15-June 15• June 16-July 15 (CBT only)
• Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions.
• Within the 10-day window, schools choose 1 day per subject Note: MC1 and MC2 must be given in order on the same day.
• May schedule multiple content tests on same day.
04/22/2023
3
![Page 4: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/4.jpg)
Two Sessions• Two separate EOC sessions
• Multiple Choice 1 (Paper or Computer)• Multiple Choice 2 (Paper or Computer)
• Sessions are 45 minutes each• Paper sessions are timed by the test administrator.• Computer sessions are timed automatically by the
computer.
04/22/2023
4
![Page 5: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/5.jpg)
Combined Testing FormatsPolicy Change: School staff may choose to combine paper and CBT for multiple choice.
Computer Testing:• Multiple testing sessions can be utilized in a single day.• New Policy: The first computer based test must begin at the same time
as the paper based test. • Note: A 10-15 minute break is allowed between test sessions.
04/22/2023
5
![Page 6: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/6.jpg)
Preparation of District and KEN Network Components• Whitelisting and Caching Configurations
• All KEN Firewall configurations include Whitelisted IP Addresses and URLs to ACT QualityCore and VanGuard/Vantage web-based resources.
• Districts that have internal firewalls or proxy/filter/caching devices must configure them to include the IP Addresses and URLs below, as Whitelisted, non cached external destinations.• qc.vantage.com: 199.7.240.100• browserhawk.vantage.com: 199.7.240.100 • qcbeta.vantage.com: 199.7.240.99
04/22/2023
6
![Page 7: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/7.jpg)
Preparations of Student Testing Devices/Workstations• Hardware Requirements
• ACT QualityCore Hardware Specifications Web Page• http://browserhawk.vantage.com/bhawk/jsp/QualityCore_Va
ntage_System_Requirements_Oct_2011.pdf
• Select Which Workstations Will Serve As Testing Stations• Install VanGuard/Vantage Software
• https://qc.vantage.com/qualitycore/do/log• Run the System Check First
04/22/2023
7
![Page 8: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/8.jpg)
VanGuard/Vantage Webpage
Click on the System Requirements Check
04/22/2023
8
![Page 9: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/9.jpg)
System Check Results Page Sample
04/22/2023
9
![Page 10: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/10.jpg)
VanGuard/Vantage System Check• Known Issues
• Bandwidth Detection – Fails on any bandwidth availability above a T-3 connection. All Kentucky school districts have a minimum connection of 10 Mbt and will most often show a failure on this part of the System Check.
• As of January 2013, IE9 and Apple OSX 10.8 still shows as failed on System Check, but is supported by ACT/QualityCore.
04/22/2023
10
![Page 11: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/11.jpg)
Install VanGuard/Vantage Software
Click on the VanGuard Install04/22/2023
11
![Page 12: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/12.jpg)
VanGuard Install Page
• Click on the appropriate download for your Workstation Device/Type/OS.
• Documentation for all of the installations are on the right side column.
04/22/2023
12
![Page 13: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/13.jpg)
VanGuard Installation• Follow the Instructions as prompted by the Setup
Program.• Once completed you may run a practice test to verify
connectivity. Your DAC will have all necessary Login account information.
04/22/2023
13
![Page 14: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/14.jpg)
Practice Online Testing• Coordination between the District Technology Coordinators
and DACs to verify workstations are ready for online testing• CBT Launch Demo PPT• QC CBT QuickStart LaunchTest
• Teachers/Students may use the Launch Demo to practice the system.
04/22/2023
14
![Page 15: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/15.jpg)
Locating Launch PPT and Testwww.act.org/stateservices/kentucky
http://www.act.org/stateservices/kentucky/ 04/22/2023
15
![Page 16: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/16.jpg)
04/22/2023
16
![Page 17: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/17.jpg)
Online User’s Guide• Online User’s Guide or CBT Manual may be accessed:
• Through the secure online system or • Kentucky EOC website http://
www.act.org/stateservices/kentucky/index.html.
• No support materials will be shipped for online testing.
04/22/2023
17
![Page 18: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/18.jpg)
Steps for Ordering• Confirm Unit Usage (DACs/Designee)• Create/Upload Users & Teachers (DACs/Designee)• Create/Upload Students (KDE/ACT, Local)• Create Class Test Rosters (Local)• Finalize Class Rosters (Local)
Note: Valuable Resources are located at: www.act.org/stateservices/kentucky
04/22/2023
18
![Page 19: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/19.jpg)
Responsibilities• District or School Administrator:
• Conduct Administration Code and Inclusion Training• Confirm Unit Usage per school
• Determine Paper or Computer Testing• Estimate Number of Students Testing
• No automatic overage. DAC/BAC should order additional tests per school.
• Determine Testing Dates• Create/Upload Students (New enrollees)
04/22/2023
19
![Page 20: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/20.jpg)
Create and Upload Students• KDE extracted from Infinite Campus (IC) students enrolled in IC at the high
school level within each district.• ACT created student accounts at the appropriate school. • Student grade levels reflect status in IC as of December 15. Accounts for
students enrolled after this date will need to be created by the school.• 2012 High School Graduates will remain in the Vantage system for one year.
Note: Middle school students taking courses for high school credit will not be included.
04/22/2023
20
![Page 21: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/21.jpg)
Responsibilities• School Administrator:
• Options for Creating Class Rosters: • Name by school, course, teacher, period
• i.e., CCHS, Algebra II, C. Greer, period 5• Name by school, course, teacher
• i.e., CCHS, Algebra II, C. Greer• Name by school, course
• i.e., CCHS, Algebra II
• Note: Separate class roster for extended time for computer based (specific timing).
04/22/2023
21
![Page 22: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/22.jpg)
Responsibilities• School Administrator or Teacher:
• Finalize Class Rosters • Verify all students to be tested are on roster.• No roster in SDRR at this time.• Print or save electronic copy to use as a reference for
accountability in SDRR at the end of school year. • Create seating chart.
04/22/2023
22
![Page 23: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/23.jpg)
Confirming/Assigning Units
04/22/2023
23
![Page 24: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/24.jpg)
Test Form Changes
Click here
04/22/2023
24
![Page 25: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/25.jpg)
Confirming/Assigning Units
Select any school from list
Click dropdown arrow
Choose No Sub-district
04/22/2023
25
![Page 26: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/26.jpg)
Confirming/Assigning Units
04/22/2023
26
![Page 27: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/27.jpg)
Accommodated TestingPaper Only
• R = Reader• A = Audio• B = Braille• LP = Large Print • Scribe
Paper and Computer• Extended Time• Paraphrasing• Manipulatives• Prompting/Cueing• Behavior Modification• Interpreter (sign
language)• Dictionaries/Thesauri
04/22/2023
27
![Page 28: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/28.jpg)
Seating Chart
04/22/2023
28
![Page 29: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/29.jpg)
MaterialsComputerProhibited
• Notes• Foreign language or English
dictionaryAllowed
• Scratch Paper – Please collect and destroy securely.
• Calculators• Reference Sheets (Algebra II)
• Pencil/PaperProhibited• Scratch paper• Notes• Foreign language or
English dictionary• Allowed• Scratch work is to be done
in the test booklet.• Calculators• Reference Sheets (Algebra
II)04/22/2023
29
![Page 30: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/30.jpg)
Resources/Manuals
04/22/2023
30
![Page 31: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/31.jpg)
Retrieve Codes from System
• Test Control Code• Vanguard Exit Code
04/22/2023
31
![Page 32: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/32.jpg)
Student Roster Information• Retrieve student login information from Test Roster section of the online
system.• Print out the Student Login page that contains each student’s QualityCore ID.• Teacher or Student will input the student’s information exactly as it is in the
online system.• QualityCore ID• First Name• Middle Initial (optional)• Last Name• Date of Birth (dropdown menu selection)
04/22/2023
32
![Page 33: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/33.jpg)
04/22/2023
33
![Page 34: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/34.jpg)
Online Testing • Student will choose their correct birthdate from the
dropdown menu and accept the User’s Agreement.
• The student has the option of completing a tutorial before beginning the test.
04/22/2023
34
![Page 35: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/35.jpg)
Student Login Page
04/22/2023
35
![Page 36: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/36.jpg)
Accept User Agreement
04/22/202336
![Page 37: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/37.jpg)
Complete Login
04/22/2023
37
![Page 38: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/38.jpg)
Choose Correct Test
04/22/2023
38
![Page 39: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/39.jpg)
Directions
04/22/202339
![Page 40: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/40.jpg)
Directions (continued)
04/22/202340
![Page 41: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/41.jpg)
Test DisplayTime Remaining
Tools
04/22/2023
41
![Page 42: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/42.jpg)
Student Prompt After Answering
04/22/2023
42
![Page 43: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/43.jpg)
Skipping a Question
04/22/2023
43
![Page 44: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/44.jpg)
Bookmark a Question
04/22/2023
44
![Page 45: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/45.jpg)
Reviewing Online Test• Before the student submits a completed test module, a
review page will display. This page will list all items on the test, the status of each item (answered, unanswered, or bookmarked), and how much time the student has left to review his/her work.
04/22/2023
45
![Page 46: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/46.jpg)
Student Review Page
04/22/2023
46
![Page 47: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/47.jpg)
04/22/2023
47
![Page 48: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/48.jpg)
Take a Break or End the Test
Break
04/22/2023
48
![Page 49: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/49.jpg)
Test Control CodeLocated Two Places• Helpful Hints for a
Smooth Administration document, http://www.act.org/stateservices/kentucky/pdf/QC-KY-CBTHelpfulHints.pdf.
• Secure online system
04/22/2023
49
![Page 50: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/50.jpg)
Test End ControlLocated Two Places• Helpful Hints for a
Smooth Administration document, http://www.act.org/stateservices/kentucky/pdf/QC-KY-CBTHelpfulHints.pdf
• Secure online system
04/22/2023
50
![Page 51: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/51.jpg)
Test Security• Recent loss of certification for Kentucky educators emphasizes a serious
issue.• Senate Bill 137 (2013 Kentucky General Assembly) an Act relating to
assessment ethics has been filed. • Authorizes prosecution of violations (a prosecuting attorney and the Attorney
General may investigate allegations of violations and prosecute violations); • Requires the Office of Education Accountability to periodically review
assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board.
04/22/2023
51
![Page 52: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/52.jpg)
Resources• Kentucky QualityCore Website
www.act.org/stateservices/kentucky
• Kentucky Department of Educationhttp://education.ky.gov/AA/distsupp/Pages/EOC.aspx
04/22/2023
52
![Page 53: Computer Based Testing Overview March 8, 2013](https://reader035.vdocuments.mx/reader035/viewer/2022062520/56815c38550346895dca275e/html5/thumbnails/53.jpg)
Contact InformationACT
• ACT Customer Services: • E-mail:
[email protected]• Phone: (866)764-7228
• Joe Dell Brasel, Ed.D.• E-mail: [email protected]
KDE• Assessment Support and Research:• E-mail: [email protected]• Phone: (502) 564-4394
• Jennifer Stafford• E-mail: [email protected]• Paul Shoemaker• E-mail:
04/22/2023
53