1

Web Based CSIP Application and the Concept of Benchmarking

Scott Trimble Workshop on Instruction and Assessment – 2008

Dena DossettTamara Lewis

Jefferson County Public Schools

Shaping the Future

2

Agenda Planning Overview

SMART Goals

Benchmarking

Web-Based Application

Lessons Learned, Next Steps

3

Planning PhilosophyPlanning can be:

A Globe

An Atlas

A Roadmap A To-Do List for the School

Plan as Globe

5

Research Summary

Why aren’t plans effective as a change agent for school improvement?

Not driven by school leadership

Not embraced by school faculty

Not fully implemented

Lack of regular monitoring process

6

Research Summary

When does it work? When are plans effective?- Faculty had greater input in the writing

- Plan discussed in weekly team meetings

- Linked to teacher growth plans

- Academic goal setting based on data at the school and classroom levels

Source: Canwell, 2004; Langer & Colton, 2005; Mintrop & MacLellan, 2002; Reddekopp, 2007, Togneri & Anderson , 2003

7

Purpose for CSIP Changes Change the content and format of the

CSIP in order to make the plan:

Simple Useful

Make it a “working” document from which schools can measure progress towards goals through benchmarks

8

Developing SMART Goals and Identifying Benchmarks

9

S.M.A.R.T. Goals

Find a Partner Write down what you think SMART stands for:

S =

M =

A =

R =

T=

10

SMART Goals Specific and Strategic

Think through the entire goal – who, what, where, when, which, why

Measurable Concrete criteria for measuring progress

Attainable Focus on priorities

Results-oriented Set realistic goals based on trends

Timebound Set specific timelines for attaining goal

Reference: Conzemius, A., O’Neill, J. (2001) Building Shared Responsibility for Student Learning, Association for Supervision and Curriculum Development, Alexandria: VA

11

SMART Goals Goals should specify improvement targets by defining

the performance level (“end-result”) you would like to accomplish.

You should have in mind the specific tools or measures that you will use to monitor progress on each goal

SMART Goal: By when, who will do what as measured by what

SMART Goal Example: By June 2007, student attendance will increase to 94.7 as

reported in JCPS pupil monthly attendance report

12

Goal Suggestions Schools should include both main goals and

subgroup goals

Main goals are centered around CATS goals and encompass strategies that apply to all students

Subgroup goals for subpopulations include strategies that target the specific subpopulation

Schools can use the goal calculator built into the web application to enter previous KCCT academic data and goals for the next school year will be automatically generated

13

SMART Goals - Main

By May 2009 our school's Reading Index will increase to 72.00 as measured on the Kentucky Core Content Test.

By May 2009, the percentage of students scoring proficient or distinguished will increase to 78.00 as measured on the Kentucky Core Content Test.

14

SMART Goals - Subgroup

By May 2010, the percentage of Free/Reduced Lunch students scoring proficient or distinguished in Reading will increase to 67 as measured on the Kentucky Core Content Test.

15

Sample School CATS Scores

Reading 2008 Index 75.0 Proficient/Distinguished 50% Novice 20% FRL Novice 40% FRL Proficient 35%

16

Activity 1: Develop SMART goal

1. Review the Data from Sample School

2. Identify the target group (Who)

3. Identify the performance level you would like to accomplish. (Calculation: Distance from 100 or 0; divide by 3; add to 2008 score) (What)

4. Identify timelines for measuring progress and attaining the target (When)

5. Write goal as a SMART goal

17

Things to Keep in Mind: Do’s and Don’ts for SMART Goals

Establishing Goals Do begin by reviewing current data trends

before establishing goals Do let your goal drive your activities. Do ensure that all goals can be quantified and

have a date and a measure associated with them Do think through the number stated in the goal.

Is it a realistic number? Does it follow the trend data?

Is your goal a SMART goal?

18

Benchmarking involves:

Frequent assessment of student performance

Assessments for Learning

Monitoring progress toward meeting goals

Coinciding with the “implementation and impact” check

Using results to improve instruction

Benchmarking

19

Summative Assessments Used to measure goals Assessments of Learning

How much a student has learned at the end of course, semester, or unit

Examples:CATS ACT SAT Final ExamsUnit Exams Projects

Assessment Overview

20

Benchmarking

Formative Assessments Used to measure progress toward goal Assessments for Learning

Helps teachers adjust instruction

Examples:Quiz Homework ObservationsChecklists Student WorkMini-CATS like tests Multiple Choice ChecksLearning Checks

21

Goal – Benchmark MappingGoal Focus Possible Benchmarks

Content Index (i.e. Reading, Math)

Classroom Assessment System (CAS)School developed scrimmage tests

% Novice or % Proficient/Dist.

Classroom Assessment System (CAS)Predictive Assessment Series (PAS)

% Proficient/Dist. for Subgroups

Classroom Assessment System (CAS)Predictive Assessment Series (PAS)

Attendance Monthly pupil attendance report

Parent Involvement Parent-teacher conferencesPTA membership Parent visits (school sign-in sheets)

Suspensions Monthly suspension report

22

Benchmarking Activity

Form a small group of 3 or 4 or 5 Round Robin and share with the

group the Benchmarking assessments you use in your school/district.

What data does the benchmark provide? (i.e. Novice levels, Index scores, percentiles, etc.)

23

CSIP Web Application

24

Web-Based Application

Change the content and format of the CSIP in order to make the plan: Simple Useful

Make it a “working” document from which schools can measure progress towards goals through benchmarks-make it a To-Do List

25

Provides built-in planning tools

Measures progress towards goals

Connects plan development & implementation

Offers greater flexibility in adjusting plan

Provides means for custom-based reports

Advantages to New CSIP Model

26

Log In Screen

Log In Screen allows users to enter into their school’s CSIP application

27

28

Maintain The District has admin access to Reporting Tools. Reporting Tools may be found on the

Maintenance Page. There is a description of each report.

29

30

Import Features The 2009/10 plan allows users to import data from your

2008/09 school plan. Users can import by action component.

Users must import before beginning a new action component.

After importing 08/09 data, users can make changes to the data that was imported or add new goals/ benchmarks/ strategies.

The executive summary can also be imported from your 2008/09 plan.

It will not import cost/funding source information for strategies.

NEW: The “other” action components can now be imported.

31

Approval Page

32

33

Priority Need and Measurable Goal

The IPA now has the Goal Calculator Built –In.

Choose the Calculator you want to use by clicking on the link.

Note: For schools who have reached 100 there is an excel version of the goal calculator that sets the goal at 140 in the “Planning Tools” link.

34

Subgroup Calculators (NCLB/SB168)

35

Benchmark The Benchmark screen is

where the user enters information on how the school will measure progress towards its goal.

The benchmark should represent a proxy measure or indicator of the goal

Schools should enter at least 2 dates for when they will measure progress

36

37

38

39

40

Print a Report (Entire CSIP)• To print the entire CSIP, click on “Print Report” from the Main

Menu and your plan will print as a PDF file

Sample School Plan – Main Goal

Sample School Plan – Subgroup Goal

43

Subgroup Goal & Benchmark

44

Web-based Application Highlights Common, easy to use format for multiple

users.

Allows for easy and continual updating CSIP can become a “To-Do List” for School I & I built in for continual monitoring/reporting

Benchmarking becomes expectation

• Can create unique sorts or queries• Printouts by funding, responsible person

45

Planning Tools

Causes & Contributing Factors Worksheet

Goal Generator

Benchmark Map

Plan Review Rubric

State and Federal Planning Requirements

Training Manual and FAQs

46

Comprehensive School Planning Tools: CSIP Fact Sheet CSIP Web Application Training Powerpoint Presentation CSIP Web Application/Improvement Planning V3.0 Training Manual Goal calculator - fall planning cycle (JCPS) Goal calculator - spring planning cycle (JCPS)

Other Information: Blank CSIP template (JCPS) Causes and Contributing Factors worksheet (JCPS - optional)

CSIP Review Rubric - JCPS Elementary SchoolsCSIP Review Rubric - JCPS Middle Schools

CSIP Review Rubric - JCPS High SchoolsCSIP/SISI Connections Matrix (KDE)

Frequently Asked Questions Mission Statement worksheet (KDE) School Plan Guide 2006 (KDE) School and District In Improvement Under NCLB Guidelines (KDE) State and Federal Planning Requirements (SB168 and NCLB)

http://www.jefferson.k12.ky.us/Departments/Planning/SchoolPlanningSite/PlanningTools.html

Web-based Application Tools

Planning Tools – Goal Generator

NEW: Users can set goal to 100 or 140.

48

Lessons Learned

Benchmarks are important

Quality strategies are even more important

Implementation is critical

49

How we use benchmarks…

50

Next Steps

Additional training on benchmarks

Plan as “To-do list”

Teacher level plans

Implementation rubric

51

Tips for Improving Implementation

Plan as “to do list” Chunk plan into meaningful time periods Review implementation and adjust on regular basis

Teacher/team Level Plans Teacher develops goals/strategies for class Team meetings to identify common

goals/strategies Common goals/strategies incorporated into school

plan Team meetings around implementation issues

52

Stakeholders contribute to all stages of planning process

SMART Goals are based on data analysis

Frequent assessment of student performance

Limited number of strategies

Strategies that are individualized

Frequent monitoring of implementation

Results are used to improve instruction

Keys for ensuring plan impacts school improvement:

53

Opportunities to Use Application

Currently, we have 366 Kentucky locations and 149 Jefferson County schools using the web-based CSIP

If you are interested in using the CSIP web program, please feel free to contact Dena Dossett phone (502) 485-6254 e-mail Dena.Dossett@jefferson.kyschools.us

JCPS web site http://www.jefferson.k12.ky.us/Departments/

Planning/SchoolPlanningSite/SchoolPlanning.html