PVAAS Update
March, 2014
IU 5 Curriculum Directors
SY12-13 Scatterplots
O Due to the recent update of Keystone achievement and growth results, the SY12-13 statewide scatterplots have also been updated.
O New document containing statewide scatterplots can be found on PVAAS PDE website.O Included slides in the PPT so you can review.
O For Keystone content areas, achievement AND growth are based only on students enrolled in the Keystone-related course at the time of taking the respective Keystone exam.
SY12-13 Math, Grade 4
SY12-13 Math, Grade 5
SY12-13 Math, Grade 6
SY12-13 Math, Grade 7
SY12-13 Math, Grade 8
SY12-13 Algebra I
SY12-13 Reading, Grade 4
SY12-13 Reading, Grade 5
SY12-13 Reading, Grade 6
SY12-13 Reading, Grade 7
SY12-13 Reading, Grade 8
SY12-13 Literature
SY12-13 Science, Grade 4
SY12-13 Science, Grade 8
SY12-13 Biology
Experience with PVAAS as a Tool for Decision-Making
Admins Teachers
Expert 6% 1%
Skilled 48% 9%
Novice 38% 44%
Amateur 8% 47%
Conversations between Admins & Teachers about Reporting
88% Admins said they talked to TeachersO One-on-oneO CollaborativeO Open and honestO Discovery followed by
discussionO Encouraging and
reflectiveO Supportive and inquiry-
orientedO “We’re in this together”
55% Teachers said they talked to their Admin(s)O One-on-oneO Direct and encouragingO Positive and supportiveO Open and honestO Informal discussionO Open to suggestions and
concernsO Goal-orientedO Friendly and informativeO “How did the results make
me feel”
Admins: Were you able to answer Teachers’ questions?
Teachers: Was your Admin able to answer your questions?
Yes No No Questions0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
80%
6%
14%
62%
10%
28%
AdminsTeachers
Questions Not AnsweredO How does PVAAS measure growth for Science in grade
4?O Why is PVAAS used in teacher evaluations when it was
stated in early 2000s that it would not be?O What are the methodologies used to measure growth?O How can you show growth with students who have
perfect scores? How do you show growth for students receiving instruction above grade level?
O How is the predicted score calculated?O Why are some students included in the analyses and
others are not?O Why is attendance not used or considered?O Specific scenarios related to calculating %
Student+Teacher Enrollment and Full/Partial % of Instruction
Creating a Culture of Trust and Support about PVAAS & Other Data
AdminsO Being available for questionsO Open dialogue about growth;
two-way conversationO Share best practicesO Promote and model this is a
team effortO Non-threatening discussion, not
accusatory or judgmentalO Involve teachers in process from
the beginningO Collaborative, team approachO Focus on goal of improved
student learning and not identification of poor instruction
O Provide time for teachers to work together
TeachersO Open conversation amongst
teachers to share and improve teaching practices
O Open forum for questionsO Team planning & collaborationO Open communication between
admins and teachersO Sharing of resources and
materialsO Creating atmosphere where
teachers are not compared to each other
O Clear expectations from AdminsO Time to work with other
Teachers
PVAAS Methodologies
PVAAS MethodologiesO Sent to all IU PVAAS Contacts
February 24O Available on PVAAS Login PageO Purpose:
Guide to SY12-13 PILOT Teacher Specific Reporting
Guide to SY12-13 PILOT Teacher Specific Reporting
O Sent to all IU PVAAS Contacts February 24
O Available on PVAAS Login Page
Roster Verification:Sample Scenarios
O Purpose: To assist LEAs in understanding the total % of Instructional Responsibility for students, considering both % Student + Teacher Enrollment and Full or Partial % of Instruction
O Currently in development!O To be released in April 2014
New PVAAS Login Page
New PVAAS Admin Page
Updated Excel Files
O Updated Excel files containing existing accounts sent on March 20 to all LEAs
O April 4th, COB, is the LAST day for information in PIMS to be used for PVAAS account creationO After April 4, COB: PVAAS accounts must be
created and managed locally/manually via PVAAS system
Who Participates?O Which teachers are eligible for PVAAS Teacher
Specific Reporting?O Act 82 does NOT exclude temporary or
permanent professional employees based on how they are funded, such as Title I
O Act 82 does NOT exclude temporary or permanent professional employees based on which LEA/school students are from or where students are tested
O PVAAS teacher specific reporting is about WHICH teachers had the instructional responsibility for a tested subject/grade/course
COGNOS Report for PVAAS
O New COGNOS Reports for PVAAS in PIMSO Can help an LEA see what data will be
pre-populated in PVAASO PIMS Administrators in each LEA can and
SHOULD consider running these reports today, as PIMS Course/HQT closed March 21
O Suggest that the PIMS Administrator share and discuss these reports with District and School Admins
COGNOS Report for PVAAS
Roster Verification Timeline
IU SupportO Suggest principals run a usage report at end of
week one – include step-by-step directions
O Reminder to principals that they can start reviewing rosters that have been submitted earlyO But overclaiming and underclaiming of students may
occur until ALL teachers have submitted their rosters!
O Suggest types of data will teachers need to verifyO Student enrollment dates by rosterO Co-teaching, flexible grouping, etc.
Contact SAS EVAAS withHOW TO questions(Click on “Contact Us” link on PVAAS login page)
O Accessing & Using Roster Verification system
O Username & Password issuesO PPID errors & omissionsO Adding/removing teachersO Adding/removing rostersO Adding/removing studentsO Verifying & submitting rostersO Sending rosters back to a
teacher or School Admin
District Admin/District Verifiers ONLY Contact the PVAAS Statewide Team with Policy and Guidance questions(Email [email protected])
O Which PA teachers?O Claiming issuesO % Student + Teacher
EnrollmentO % Full/Partial InstructionO % Instructional ResponsibilityO PVAAS Teacher-Specific
Reporting
FASTEST Options forSupport and Questions
SY13-14 PVAAS Roster Verification
Creating a Usage Report
Live Help Desk
(Q&A) Sessions
Instructional Responsibility (IR) for Students
O While a student who is claimed for less than 10% overall IR will NOT be included in a teacher’s value-added analyses, teachers DO need to roster those students and accurately report the % IR for that student.
O PVAAS Team did NOT and would NOT advise anyone to move the % of IR for a student to less than 10% so that a teacher does not receive reporting!!
O ALL STUDENTS should be rostered!!!
Roster Verification Checklist
O Checklist for each Roster Verification windowO Have you…?O Full checklist for all RV windows can be found
O On the PVAAS login pageO In the Roster Verification Virtual Learning
ModuleO The smaller checklist pertaining to a specific
Roster Verification window will be attached to the reminder emails sent to users prior to each RV window opening.
Roster Verification Checklist