westest 2 online writing. writing assessment new direction operational 4 th, 7 th and 10 th writing...
TRANSCRIPT
WESTEST 2 ONLINE WRITING
Writing Assessment
•New Direction▫Operational 4th, 7th and 10th Writing
Assessment will not be administered in 2008
▫Assessing grades 3-11 Computer generated; computer scored
▫Part of WESTEST 2 Reading/Language Arts •New Name
▫WESTEST 2 Online Writing
WESTEST 2 Online Writing Field Test
•Spring 2008 -- nine-week window▫Middle schools
March 3-March 28▫High schools
March24-April 11▫Elementary schools
March 31-May 2
WESTEST 2 Online Writing Field Test
•Counties/schools voluntary basis▫All students in school
•No make-up sessions•No private/parochial schools•Reports
▫School/county/state reports▫No individual student report
Preparation
•Passages/Prompts▫Grade-level readability▫21st century content
•Teacher/CTB created•Content Review – Jan. 10•Bias Review – Jan. 11
Purpose
•Assess student performance on passages and prompts▫Use responses to train the scoring engine
•Test security of system•Test state/county/school bandwidth•Serve as a practice for the operational in
2009
Procedure
•Site codes, user names and passwords▫Delivered to County Test Coordinators by
Office of Assessment and Accountability•Security of information
▫Keep this information as secure as a test booklet
Online Computer Program
•CTB/McGraw-Hill▫Bookette – Writing Roadmap 2
•Customized▫WV student papers – field test▫WV rubric
Sandra Foster, CoordinatorOffice of Assessment and Accountability
Jason Perdue, CoordinatorOffice of Assessment and Accountability
WESTEST 2 Online Writing Demonstration
Online Security Installation and Desktop Shortcut
ActiveX Based Security System• This security application replaces the Vanguard
application previously used in the Online Writing Assessment.
• This application uses ActiveX technologies to lock-down the user’s desktop during the assessment.
• This application has already been extensively tested by the vendor to assure quality.
• For ease of test administration, the WVDE recommends that the ActiveX setting in Internet Explorer be set to ENABLE.
04/10/23West Virginia Department of
Education
Step 1:• Open Internet
Explorer (IE) and select TOOLS from IE’s menu bar.
Step 2:• Select INTERNET
OPTIONS.
Step 3:• Click on the
SECURITY tab and then choose CUSTOM LEVEL.
Step 4:• When the SECURITY
SETTINGS box opens, scroll down to Download signed ActiveX controls. CLICK the radio button beside ENABLE to allow your browser to download the security needed for the WESTEST 2 Online Writing Assessment. Click OK to make your changes.
Step 5:• Click OK on the
Internet Options window to finalize your security changes.
Desktop Shortcut• A desktop shortcut created during installation
allows students/administrators to quickly go to the WESTEST 2 Online Writing site.
• Prior to and after the testing window the shortcut will be redirected to another website.
04/10/23West Virginia Department of
Education
Step 1: • Create a folder on
your computer’s hard drive, (C:), name this folder WESTEST 2 Online Writing.
Step 2: • Copy the icon file
westestwriting.ico to the C:\WESTEST 2 Online Writing folder you created in step 1.
Step 3: • Copy the icon file
westestwriting.ico to a location on your hard drive. It is recommend the windows folder or the main root folder of your computer’s hard drive be used to store the icon file. Remember the location of the ICO file as you will need it in order to create the desktop icon.
Step 4:• RIGHT CLICK a
blank spot on your computer’s desktop. The menu depicted to the right should appear.
Step 5: • Select NEW from
this menu and then choose SHORTCUT from the fly-out menu.
Step 6:
• A window similar to the one on the left will appear on your screen. In the location of the item box, type: http://www.writingroadmap2.com/wvstudent and click NEXT.
Step 7: • Type the name for
the shortcut in the box: WESTEST 2 Online Writing and click FINISH.
Step 8: • Steps 1-7 have created a
generic internet icon on your desktop, this will need to be customized in order to match the instructions contained in the administration manual and PowerPoint provided by the West Virginia Department of Education.
• RIGHT CLICK the new icon and select PROPERTIES and click CHANGE ICON. A screen similar to the one on the right will appear.
Step 9:• Click BROWSE on the
new screen and browse the C:\WESTEST 2 Online Writing folder. This is the location where you copied the icon provided with this documentation. Select the icon and click OPEN. This will change the desktop icon to look like the state of WV with a silver ink pen across it. Select OK.
Step 10:• Click OK.• You have completed
set-up of the desktop icon for WESTEST 2 Online Writing.
Technical/Bandwidth Specifications
Technical Specifications for WESTEST 2 Online Writing
04/10/23West Virginia Department of
Education
Network Specifications
Bandwidth Consumption per pupil•Writing Roadmap 2.0 carries a minimum
bandwidth requirement of 56kbps per student. 56kbps = 0.056Mbps
1.54Mbps (full T-1)
1.54 Mbps
0.056 Mbps= 27.5 students
Most schools have a fractional T-1 = 768kbps
768 kbps
56 kbps= 13.7 students
04/10/23West Virginia Department of
Education
Frequently Asked Questions
Q: What happens if there is a power outage while students are constructing essays?
A: Every 10 minutes the system automatically saves all completed work. This means that when the system restarts, students will have lost no more than 10 minutes’ work.
04/10/23West Virginia Department of
Education
Frequently Asked Questions
Q: What if all the students in our school are testing at once? Can CTB’s system handle hundreds of users at the same time?
A: Yes. Writing Roadmap 2.0 actually has enough capacity to handle in excess of 15,000 essays administered hourly.
04/10/23West Virginia Department of
Education
Frequently Asked Questions
Q: Is the Internet secure enough for our students to write and submit essays without outside interference?
A: Yes. Important information is encrypted with industry standard Secure Socket Layers (SSL)—a protocol that permits the transmission of private documents over the Internet. SSL encrypts the data, which is further protected by two fire/virus walls.
04/10/23West Virginia Department of
Education
Quality Assurance Check
•January 14–18, 2008▫15 counties participating 1-2 schools per county
20 students per school
County Schedules
Practical Question – When do we test?
Week 1
Mar 3-7
Week 2
Mar 10-14
Week 3
Mar 17-21
Week 4
Mar 24-28
Week 5
Mar 31-Apr 4
Week 6
Apr 7 - 11
Week 7
Apr 14-18
Week 8
Apr 21-25
Week 9
Apr 28 – May 2
Middle School Window
High School Window
Elementary School Window
Schedule
•Enclosed in your packet is a schedule of county testing windows. This schedule was calculated using the following calculation.
x
days20
90
2705
m in
m in
X = Student Enrollment
Model Plan
•See Handout
MIDDLE SCHOOL SCHEDULE
•Largest middle school in county – 420 students in grades 6, 7 and 8▫9-day window▫Plan to test in a 6-day window
2 days per grade 2 morning and 2 afternoon sessions per day
▫20 students/session▫80 students/day
HIGH SCHOOL SCHEDULE
•Largest high school in county – 1321 students in grades 9, 10 and 11▫31-day window▫Plan to test in a 12-day window
4 days per grade 2 morning and 2 afternoon sessions per day
▫30 students/session▫120 students/day
ELEMENTARY SCHOOL SCHEDULE•Largest elementary school in county – 173
students in grades 3, 4 and 5▫15-day window▫Plan to test in a 6-day window
2 days per grade 1 morning and 1 afternoon session per day
▫15 students/session▫30 students/day
STUDENT LOGIN INFORMATION▫Delivery Dates
To County Test Coordinators – February 11, 2008
To schools – Two weeks prior to testing▫County Packets
Alphabetically Arranged By school By grade
STUDENT FILE
•Field Test file based on December 2007 WVEIS data▫Test only students provided with your
packets
NO ADJUSTING OF THE ROSTER FOR THE FIELD TEST
Training
• State Training▫County Test Coordinators▫County Technology Coordinators
• County Training▫Central Office Staff▫Principals▫Building Level Coordinators
• School Training ▫Examiners▫School Staff
P. 10P. 23, Appendix 1 – Testing Code of EthicsP. 30, Appendix 6 – CTC Security Agreement
COMMUNICATION• Information
▫ Schools▫ Students▫ Parents
• Schedule▫ County▫ School
• Importance ▫ Student▫ School▫ County▫ State
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Do Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Manuals▫Distribute at training▫Keep for administration
•Site codes, user names and passwords•Signed agreements
DELIVERY
•Distribution of testing materials▫Manuals – time of training
•Delivery of secure testing materials▫student login information – two weeks prior
to testing
TRAINING
•Principals and Building Level Coordinators▫Test security▫Test administration procedures
Accommodations
• IEP, Section 504 and LEP Students Directions, passages and prompts may be
read aloud by examiner screen reader
•Braille▫Scribe
Security must be followed
REPORTING
•To County Superintendent and Office of Assessment and Accountability▫Loss of materials▫Cheating▫Security breach▫Testing administration breach▫Copyright infringement
Actions Taken
•Breach of test security or copyright infringement can result in▫License suspended▫License revoked▫Suspension▫Termination
P. 10P. 23, Appendix 1 – Testing Code of EthicsP. 29, Appendix 5 – Personnel Security Agreement
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Computers – good working order▫Security updates installed▫Internet form on file
P. 11P. 23, Appendix 1 - Testing Code of EthicsP. 27, Appendix 3 - Principal Security AgreementP. 28, Appendix 4 – Building
COMMUNICATION• Information
▫ Teachers▫ Students▫ Parents
• Schedule▫ School▫ Teachers▫ Students
• Importance ▫ Student▫ School▫ County▫ State
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Manuals▫Distribute at training▫Keep for administration
•Site codes, user names and passwords•Signed agreements
DELIVERY
•Distribution of testing materials▫Manuals – time of training
•Delivery of secure testing materials▫student login information – day of testing
TRAINING
•Examiners▫Test security▫Test administration procedures
Accommodations
• IEP, Section 504 and LEP Students Directions, passages and prompts may be
read aloud by examiner screen reader
•Braille▫Scribe
Security must be followed
REPORTING
•To County Test Coordinator▫Loss of materials▫Cheating▫Security breach▫Testing administration breach▫Copyright infringement
Actions Taken
•Breach of test security or copyright infringement can result in▫License suspended▫License revoked▫Suspension▫Termination
P. 12P. 23, Appendix 1 – Testing Code of EthicsP. 26, Appendix 6 – Examiner Security Agreement
COMMUNICATION
• Information ▫Students▫Parents
• Importance ▫Student▫School▫County▫State
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Manuals▫Keep for administration
•Site codes, user names and passwords
Accommodations
• IEP, Section 504 and LEP Students Directions, passages and prompts may be
read aloud by examiner screen reader
•Braille▫Scribe
Security must be followed
REPORTING
•To Principal/Building Level Coordinator▫Loss of materials▫Cheating▫Security breach▫Testing administration breach▫Copyright infringement
Actions Taken
•Breach of test security or copyright infringement can result in▫License suspended▫License revoked▫Suspension▫Termination
Examiner Prior to Session
•Familiar with manual•Prepare students
▫Distribute Parent Guide▫Present PowerPoint to students
http://writing.k12.wv.us (File Library)•Check student logins with testing roster•Prepare classroom/lab
P. 10P. 23, Appendix 1 – Testing Code of EthicsP. 30, Appendix 6 – CTC Security Agreement
COMMUNICATION• Information
▫ Schools▫ Students▫ Parents
• Schedule▫ County▫ School
• Importance ▫ Student▫ School▫ County▫ State
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Do Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Manuals▫Distribute at training▫Keep for administration
•Site codes, user names and passwords•Signed agreements
DELIVERY
•Distribution of testing materials▫Manuals – time of training
•Delivery of secure testing materials▫student login information – two weeks prior
to testing
TRAINING
•Principals and Building Level Coordinators▫Test security▫Test administration procedures
REPORTING
•To County Superintendent and Office of Assessment and Accountability▫Loss of materials▫Cheating▫Security breach▫Testing administration breach▫Copyright infringement
Actions Taken
•Breach of test security or copyright infringement can result in▫License suspended▫License revoked▫Suspension▫Termination
P. 10P. 23, Appendix 1 – Testing Code of EthicsP. 29, Appendix 5 – Personnel Security Agreement
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Computers – good working order▫Security updates installed▫Internet form on file
P. 11P. 23, Appendix 1 - Testing Code of EthicsP. 27, Appendix 3 - Principal Security AgreementP. 28, Appendix 4 – Building
COMMUNICATION• Information
▫ Teachers▫ Students▫ Parents
• Schedule▫ School▫ Teachers▫ Students
• Importance ▫ Student▫ School▫ County▫ State
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Manuals▫Distribute at training▫Keep for administration
•Site codes, user names and passwords•Signed agreements
DELIVERY
•Distribution of testing materials▫Manuals – time of training
•Delivery of secure testing materials▫student login information – day of testing
TRAINING
•Examiners▫Test security▫Test administration procedures
Accommodations
• IEP, Section 504 and LEP Students Directions, passages and prompts may be
read aloud by examiner screen reader
•Braille▫Scribe
Security must be followed
REPORTING
•To County Test Coordinator▫Loss of materials▫Cheating▫Security breach▫Testing administration breach▫Copyright infringement
Actions Taken
•Breach of test security or copyright infringement can result in▫License suspended▫License revoked▫Suspension▫Termination
P. 12P. 23, Appendix 1 – Testing Code of EthicsP. 26, Appendix 6 – Examiner Security Agreement
COMMUNICATION
• Information ▫Students▫Parents
• Importance ▫Student▫School▫County▫State
SECURITY
•Secure Test Materials and Student Responses ▫Site Codes, User Names and Passwords
•Not Retain, Copy, Reproduce, Paraphrase, Distribute, Discuss▫Passages and Prompts▫Student Responses
MATERIALS
•Manuals▫Keep for administration
•Site codes, user names and passwords
Accommodations
• IEP, Section 504 and LEP Students Directions, passages and prompts may be
read aloud by examiner screen reader
•Braille▫Scribe
Security must be followed
REPORTING
•To Principal/Building Level Coordinator▫Loss of materials▫Cheating▫Security breach▫Testing administration breach▫Copyright infringement
Actions Taken
•Breach of test security or copyright infringement can result in▫License suspended▫License revoked▫Suspension▫Termination
Examiner Prior to Session
•Familiar with manual•Prepare students
▫Distribute Parent Guide▫Present PowerPoint to students
http://writing.k12.wv.us (File Library)•Check student logins with testing roster•Prepare classroom/lab
ExaminerBeginning of Session
•Maintain a quiet atmosphere•Prepare materials
▫Scratch paper; pencil or pen▫Reading materials
•Distribute student one-page handout•Distribute student login information
ExaminerBeginning of Session
•Maintain a quiet atmosphere•Prepare materials
▫Scratch paper; pencil or pen▫Reading materials
•Distribute student one-page handout•Distribute student login information
Examiner During Session
•Monitor for irregularities•Maintain testing atmosphere
Duties of ExaminerAfter Session
•Collect scratch paper/outlines/rough drafts•Collect student login information•Deliver to principal/building level
coordinator•Report any irregularities•Keep a copy of roster
Actions Resulting in an Investigation
•Assisting with content of the essay•Typing the essay•Calling attention to errors•Copying rough drafts or final essays
Discussion Opportunities
Panel of Experts
• Kim Block , Program Manager CTB/ McGraw-Hill
• Ron Loiacono, Owner Bookette Software
• Brenda West, Assistant DirectorOffice of Assessment/ Accountability
• Larry White, PsychometricianOffice of Assessment/ Accountability
• Sterling Beane, CoordinatorOffice of Instructional
Technology
• Sandra Foster, Coordinator Office of Assessment/
Accountability
• Jason Perdue, Coordinator Office of Assessment/
Accountability
Contact Information
•Office of Assessment /Accountability304-558-2546http://writing.k12.wv.us
•CTB/McGraw-Hill866-282-2250http://www.ctb.com