georgia department of education teacher and leader … department of education teacher and leader...

Georgia Department of Education

Teacher and Leader Keys Effectiveness System

TLE Electronic Platform

Administering Climate Surveys for Leaders

The contents of this document were developed under a grant from the U. S. Department of

Education. However, those contents do not necessarily represent the policy of the U. S.

Department of Education, and you should not assume endorsement by the Federal

Government.

Table of Contents

INTRODUCTION .........................................................................................................................................................3

Figure 2: Example Survey Items (Principal Certified Items) ......................................................................................... 3

Figure 3: Table of Specifications for Assistant Principal Survey ................................................................................... 4

Figure 4: Example Survey Items (Assistant Principal Certified Items) .......................................................................... 4

PURPOSE OF THE SURVEY PROTOCOL .........................................................................................................................5

SURVEY SECURITY ......................................................................................................................................................5

ADMINISTRATION OF THE SURVEY .............................................................................................................................5

TECHNICAL SUPPORT .................................................................................................................................................6

ADMINISTERING THE SURVEY .....................................................................................................................................7

USE OF SURVEY DATA ................................................................................................................................................7

CLIMATE SURVEY RESULTS .........................................................................................................................................8

APPENDICES ..............................................................................................................................................................9

CLIMATE SURVEYS QUESTIONS FOR PRINCIPALS .......................................................................................................................... 10

CLIMATE SURVEYS QUESTIONS FOR ASSISTANT PRINCIPALS .......................................................................................................... 12

LEADER ROSTER .................................................................................................................................................................... 14

TLE ELECTRONIC PLATFORM SURVEY QUICK REFERENCE GUIDE- DISTRICT SUPER USERS/DISTRICT ADMINISTRATORS ........................... 15

TLE ELECTRONIC PLATFORM SURVEY QUICK REFERENCE GUIDE- TEACHER/STAFF MEMBER .............................................................. 17


Teacher & Leader Keys Effectiveness System

Climate Survey Protocol

Dr. John D. Barge, State School Superintendent

September 15, 2014 ● of 17

All Rights Reserved

Introduction

Surveys provide staff perception data regarding a leader’s performance and serve as one source of data and

documentation used by evaluators in the Leader Keys Effectiveness process. Advantages of a survey design

include the ability to collect perception data and provide feedback directly to the leader for continuous

improvement. In LKES, climate surveys are aligned to specific performance standards and are used as one data

source to inform the rating of the leader’s performance.

The survey documentation may be used by evaluators to inform the formative assessment ratings and must be

used to inform the summative assessment ratings for all eight standards. The survey data must be referenced in

the summative assessment commentary. If the evaluator’s overall summative assessment rating on any

performance standard is not consistent with the climate survey results, the evaluator is required to provide

written justification within the Summative Conference of the GaDOE TLE Electronic Platform to explain the

lack of alignment.

The climate surveys are aligned to the standards and provide staff opportunities to submit perception data

related to direct experiences with school leaders. Four versions of the climate survey are provided and include

certified and noncertified staff surveys for principals and certified and noncertified staff surveys for assistant

principals.

All staff will be provided with the opportunity to complete a climate survey for each building level principal.

The two climate surveys (certified and noncertified) are used to inform the performance of principals. The

Table of Specifications in Figure 1 illustrates the alignment between the survey items and performance standards.

An example of the principal survey items are shown in Figure 2.

Figure 1: Table of Specifications for Principal Survey

Leader Performance Standards # of Certified Survey Items # of Classified Survey Items

1 - Instructional Leadership 4 3

2 - School Climate 5 4

3 - Planning and Assessment 4 4

4 - Organizational Management 4 4

5 - Human Resources Management 4 4

6 - Teacher/Staff Evaluation 4 4

7 – Professionalism 4 4

8 - Communication and Community Relations 4 4

Figure 2: Example Survey Items (Principal Certified Items)

Please note, Classified Surveys do allow for a “Do Not Know” option.

My Principal…

Strongly

Agree Agree Disagree

Strongly

Disagree

My principal communicates a clear vision of how effective teaching and

learning should take place in this school.

My principal takes an active role in improving curriculum and instruction.






All Rights Reserved

The two climate surveys (certified and noncertified) are used to inform the performance of assistant principals.

Assistant principals have varied roles in schools and often work with different groups of staff members. The

principal or district designee will determine which staff members will complete the survey for each assistant

principal. These individuals will complete the climate survey in order to provide appropriate perception data.

Utilization of LKES for assistant principals will be at the districts’ discretion during the 2012-2013 pilot/full

implementation year. The Table of Specifications in Figure 3 illustrates the alignment between the survey items

and performance standards. Examples of Assistant Principal Survey items are shown in Figure 4.

Figure 3: Table of Specifications for Assistant Principal Survey

Leader Performance Standards # of Certified Survey Items # of Classified Survey Items

1 - Instructional Leadership 4 3

2 - School Climate 5 4

3 - Planning and Assessment 4 2

4 - Organizational Management 4 4

5 - Human Resources Management 4 4

6 - Teacher/Staff Evaluation 4 4

7 – Professionalism 4 4

8 - Communication and Community Relations 4 4

Figure 4: Example Survey Items (Assistant Principal Certified Items)

Please note, Classified Surveys do allow for a “Do Not Know” option.

My Assistant Principal…

Strongly

Agree Agree Disagree

Strongly

Disagree

My AP is an active and positive educational leader.

My AP takes an active role in improving curriculum and instruction.

Survey data will be used in multiple ways. The leader and evaluator will use the perception data to guide and

set goals for continuous improvement and to provide feedback directly to the leader for professional growth and

development opportunities. Teacher/staff surveys provide information to evaluators that may not be accurately

obtained through other types of documentation. Additionally, perception data from the climate surveys will be

used as a source of documentation by the evaluator to inform the effectiveness rating of the eight standards

included in the LAPS component.






All Rights Reserved

Purpose of the Survey Protocol

This Survey Protocol provides procedural information as well as detailed instructions for administering the

climate surveys. It is imperative that the surveys be administered according to the directions in this manual. If

you have any questions, contact your District Teacher Keys Effectiveness System Site Coordinator or your

Georgia Department of Education Evaluation System Specialist.

Uniform survey administration is needed to ensure high-quality data. To ensure this uniformity, the survey

administrator’s responsibilities are clearly outlined and detailed in this protocol. Step-by-step instructions for

administering the surveys are designed to protect the integrity and security of the survey process and must be

followed. Survey administrators must read this manual and become thoroughly familiar with all survey

administration procedures before administering the surveys.

Survey Security

Survey conditions should be designed to maximize anonymity and encourage teachers to respond honestly.

Each teacher and staff member will be instructed to take the survey independently using an individual unique

logon and password for the TLE Electronic Platform. Teachers are encouraged to independently take the survey

on a computer not assigned to a specific teacher. All instances of survey irregularities must be reported to the

building administrator immediately. If questions arise, or if any situations occur that could cause any part of the

survey administration to be compromised, the district coordinator should be notified. The appropriate district

staff should contact the GaDOE Division of Teacher and Leader Effectiveness for guidance as needed or

appropriate.

Administration of the Survey

The window for survey administration will be open from October through April. Each school staff member will

be provided with a unique access code for survey security and will be instructed to take the survey

independently within the GaDOE TLE Electronic Platform. Survey responses will be anonymous to promote

honest feedback, and there will be no option to include comments. The survey can be accessed using any

computer with internet connectivity. A read aloud option will be provided within the GaDOE TLE Electronic

Platform in late spring 2013. A district leader will ensure all teachers and staff have the opportunity to complete

the survey.

The state will provide an initial list of logons for each school and the District Super User or district designee

will distribute these to each school. If more logons are needed for staff members to access the surveys, the

District Super User will create additional logons by following the Quick Reference in the Appendices. The

District Super User or district designee will also monitor the number of surveys completed at each school site.






All Rights Reserved

Climate surveys will be administered to all full-time certified staff and classified staff as follows:

LKES Climate Survey for certified staff (for the principal).

LKES Climate Survey for noncertified staff (for the principal).

LKES Climate Survey for certified staff (for the assistant principal).

This is a district option for 2012-2013.

LKES Climate Survey for noncertified staff (for the assistant principal).

This is a district option for 2012-2013.

In school sites where there are multiple assistant principals, the principal or designated district administrator

will determine the best alignment of staff to assistant principals for survey purposes based on regular working

relationships.

To gain valid survey results, a minimum of 15 teacher and/or staff shall complete the survey for the school

leader; data cannot be disaggregated for groups smaller than 15 for confidentiality purposes related to

identifying a staff respondent. However, if a district decides to implement the surveys for less than 15

participants, the data from the survey may be used for professional learning and growth purposes.

Districts will be offered the option to use approved climate surveys other than the survey provided by the

GaDOE. Reports from approved external surveys shall be uploaded to the appropriate standards as

documentation for LAPS.

The following characteristics must be met for another survey option to be approved:

Surveys are utilized as a performance assessment.

Surveys have documented reliability and validity using accepted testing measures.

Surveys are accessible to the public for purchasing.

Surveys are aligned to the Leader Keys Effectiveness System, LAPS, and ISLLC performance

standards.

Survey reporting is in place at the individual leader, school, district, and state level.

Survey reports will be appropriate for upload into the TLE Electronic Platform.

Technical Support

Any certified staff member other than those in leadership/administrative roles (principal, assistant principal)

may assist those teachers/staff members requesting technical support. Technical support may include computer

access as well as literacy support. If teachers/staff members require a reading accommodation, survey items

must be read word for word exactly as written. The technical support provider may NOT exert any influence

regarding response choice including but not limited to voice inflection. All survey items should be read at a

normal pace and in a normal tone of voice. A read aloud option will be made available late spring 2013.






All Rights Reserved

Administering the Survey

Administration time: 20-30 minutes anticipated

NOTE: The survey is NOT timed.

Preparations Required:

Teachers/staff members will be provided with unique logons for each principal and assistant principal.

Communicate clearly with staff which logon and password is linked to each individual leader’s climate

survey.

Distribute the unique logons and passwords for each teacher/staff member to take the survey in the TLE

Electronic Platform.

Have teachers/staff members verify receipt of the logons and passwords by signing a verification form.

Anonymity of teacher/staff responses must be ensured. A blank verification roster is included in the

appendices.

Distribute the Quick Reference for Completing the Survey for Teachers/Staff Members which is

included in the appendices.

Use of Survey Data

Survey results will be reported to the evaluator and leader at the end of the survey window as a means of

feedback and perception data aligned with each performance standard. A summary of survey results for each

question will be provided. Evaluators may conduct multiple surveys as needed.

Documentation of data from the Climate Surveys is required for all related standards. Prior to the closing of the

survey window on April 30, but as soon as the administration of the survey for a particular leader is complete,

the evaluator should access the survey data report and provide a copy to the leader through the electronic

platform. At the close of the survey window, leaders will automatically receive a final report of survey results

in the GaDOE TLE Electronic Platform. If the use of an external survey is approved by GaDOE, the

documentation of that survey data must be uploaded into the document library within the GaDOE TLE

Electronic Platform immediately upon completion of the survey for a given leader.

Data from the Climate Surveys will serve as documentation used by evaluators to inform the rating of the eight

performance standards included in LAPS The use of survey data is recommended for the formative assessment

and required for the summative assessment. The survey results must be addressed through commentary related

to each standard at the summative phase. When the evaluator’s rating of a standard differs significantly from

the perception data, the evaluator is required to provide written justification within the GaDOE TLE Electronic

Platform.






All Rights Reserved

Survey results will be compiled within the GaDOE TLE Electronic Platform. Prior to administering a second

survey for a single leader, the original survey results must be uploaded as documentation to that individual’s

document library located in the GaDOE TLE Electronic Platform. The platform will only store one set of

survey results annually. Additionally, for districts that utilize climate surveys approved by the GaDOE, the

results must be uploaded in the document library and must be utilized as documentation to support annual

performance ratings.

Climate Survey Results

The Survey Results Summary Sheet will include the number of valid responses for each question, as well as the

percentages of rating for each question at each level of the response scale (Strongly Agree, Agree, Disagree,

Strongly Disagree). It will also include a mean and median score and the standard deviation. An example

Survey Results Summary Sheet for a leader is shown in Figure 3. Survey Results will also be reported as the

average mean for each Standard. An example of this report is shown in Figure 4.

Figure 3: Survey Results Summary Sheet

Survey Results Summary

Percentage of Rating

Question

# o

f V

ali

d

Resp

on

ses

Str

on

gly

Ag

ree

(3 p

ts)

Ag

ree

(2 p

ts)

Dis

ag

ree

(1 p

t)

Str

on

gly

Dis

ag

ree

(0 p

ts)

Mea

n

Med

ian

Sta

nd

ard

Dev

iati

on

My principal communicates a clear

vision of how effective teaching and

learning should take place in this

school.

60 3% 50% 47% 0% 1.57 3 0.56

My principal takes an active role in

improving curriculum and instruction. 56 0% 25% 68% 7% 1.18 2 0.54

Figure 4: Survey Results for Each Standard by Mean

1.

Instructional

Leadership

2.

School Climate

3.

Planning and

Assessment

4.

Organizational

Management

5.

Human

Resources

Management

6.

Teacher/Staff

Evaluation

7.

Professionalism

8.

Communication

and Community

Relations

1.3 2.0 1.9 2.3 0.9 2.1 3.0 1.7

Survey data will provide documentation for the Leader Assessment on Performance Standards (LAPS). This

documentation must be used to inform summative assessment ratings for those standards.






All Rights Reserved

Appendices






All Rights Reserved

Climate Surveys Questions for Principals

Principal Certified Principal Classified

Standard 1: Instructional Leadership

My principal communicates a clear vision of how

effective teaching and learning should take place in

this school.

My principal communicates a clear vision of how

effective teaching and learning should take place in

this school.

My principal takes an active role in improving

curriculum and instruction.

My principal is an active and positive educational

leader.

My principal helps faculty members understand and

use results from student assessments.

My principal's top priority is improving instruction and

learning in this school.

My principal ensures that the school schedule

maximizes instructional time.

Standard 2: School Climate

My principal creates and supports a positive academic

learning environment.

My principal sets and communicates high

expectations for students and staff.

My principal sets and communicates high expectations

for students and staff.

My principal has a positive impact on staff morale.

My principal has a positive impact on staff morale. My principal is well-respected by staff, students, and

parents.

My principal gives me the opportunity to provide input

on school matters that affect me.

I am confident that my principal can effectively

manage crisis situations if they arise.

My principal seeks out and values input from staff

when making operational and instructional decisions.

Standard 3: Planning and Assessment

My principal includes school staff in the process of

developing school improvement plans.

My principal includes school staff in the process of

developing plans for the school.

My principal bases his or her decisions on a variety of

types of information, including student achievement

data.

My principal bases his or her decisions on a variety of

types of information.

My principal promotes the importance of using student

assessment data to make instructional decisions.

My principal uses data from student assessments when

making curricular and instructional decisions.

Standard 4: Organizational Management

My principal communicates and enforces policies that

ensure a safe and orderly school.

My principal communicates and enforces policies that

ensure a safe and orderly school.

My principal manages school operations smoothly and

efficiently.

My principal is good at identifying problems and

solving them quickly and effectively.

My principal does his or her best to get me the

resources and materials that I need.

My principal does his or her best to get me the

resources and materials that I need.

My principal delegates responsibilities when

appropriate, so other staff members have opportunities

to share in leadership duties.

My principal delegates responsibilities when

appropriate, so other staff members have opportunities

to share in leadership duties.






All Rights Reserved

Standard 5: Human Resources Management

My principal assigns responsibilities to school staff in a

fair and equitable way.

My principal assigns responsibilities to school staff in

a fair and equitable way.

My principal ensures that all staff who are new to the

school receive the support they need.

My principal ensures that all staff who are new to the

school receive the support they need.

My principal provides highly-effective staff members

with opportunities for increased responsibility.

My principal provides highly-effective staff members

with opportunities for increased responsibility.

My principal shows appreciation to staff members that

are doing their jobs effectively.

My principal shows appreciation to staff members that

are doing their jobs effectively.

Standard 6: Teacher/Staff Evaluation

When evaluating my performance, the most important

consideration for my principal is my students' learning.

My principal is committed to helping me develop and

improve my performance.

My principal is committed to helping me develop and


My principal provides me with useful feedback on my

strengths, as well as on areas in which I need to

improve.

My principal provides me with useful feedback on my


improve.

My principal clearly communicates to me the criteria

he or she uses to evaluate my performance.

My principal is fair and consistent when evaluating

staff at this school.

My principal is fair and consistent when evaluating

staff at this school.

Standard 7: Professionalism

My principal treats staff, students, and parents with

respect.

My principal treats staff, students, and parents with

respect.

My principal behaves in an ethical and professional

manner.

My principal behaves in an ethical and professional

manner.

My principal has a positive and constructive attitude. My principal has a positive and constructive attitude.

My principal has a good understanding of current

educational trends, issues, and research.

My principal has a collegial and collaborative

relationship with school staff.

Standard 8: Communication and Community Relation

My principal seeks out and values the input of parents

and other community members when making

decisions.

My principal seeks out and values the input of parents

and other community members when making

decisions.

My principal communicates important information to

parents in a timely way.

My principal communicates important information to

parents in a timely way.

My principal is accessible to staff and students. My principal is accessible to staff and students.

My principal is a visible presence in our building to

both staff and students.

My principal is a visible presence in our building to

both staff and students.






All Rights Reserved

Climate Surveys Questions for Assistant Principals

AP Certified AP Classified

Standard 1: Instructional Leadership

My AP is an active and positive educational leader. My AP is an active and positive educational leader.

My AP takes an active role in improving curriculum

and instruction.

My AP's top priority is improving instruction and

learning in this school.

My AP understands and supports instructional practices

that are based in research.

My AP supports a clear vision of how teaching and

learning should take place in this school.

My AP helps faculty members understand and use

results from student assessments.

Standard 2: School Climate

My AP is well-respected by staff, students, and parents. My AP sets and communicates high expectations for

students and staff.

My AP gives me the opportunity to provide input on

school matters that affect me.

My AP has a positive impact on staff morale.

My AP has a positive impact on staff morale. My AP is well-respected by staff, students, and parents.

My AP seeks out and values input from staff when

making operational and instructional decisions.

I am confident that my AP can effectively manage crisis

situations if they arise.

My AP seeks out and values input from staff when

making operational and instructional decisions.

Standard 3: Planning and Assessment

My AP bases his or her decisions on a variety of types

of information, including student achievement data.

My AP includes school staff in the process of decision

making related to the school.

My AP promotes the importance of using student

assessment data to make instructional decisions.

My AP bases his or her decisions on a variety of types

of information.

My AP uses data from student assessments when

making curricular and instructional decisions.

My AP includes school staff in the process of decision

making related to the curriculum and school

improvement.

Standard 4: Organizational Management

My AP is good at identifying problems and solving

them quickly and effectively.

My AP is good at identifying problems and solving

them quickly and effectively.

My AP is proactive and decisive when making

important decisions.

My AP is proactive and decisive when making

important decisions.

My AP does his or her best to get me the resources and

materials that I need.

My AP does his or her best to get me the resources and

materials that I need.

My AP delegates responsibilities when appropriate, so

other staff members have opportunities to share in

leadership duties.

My AP delegates responsibilities when appropriate, so

other staff members have opportunities to share in

leadership duties.






All Rights Reserved

Standard 5: Human Resources Management

My AP assigns responsibilities to school staff in a fair

and equitable way.

My AP assigns responsibilities to school staff in a fair

and equitable way.

My AP ensures that all staff who are new to the school

receive the support they need.

My AP ensures that all staff who are new to the school

receive the support they need.

My AP does whatever he or she can to help staff do our

jobs effectively.

My AP does whatever he or she can to help staff do our

jobs effectively.

My AP shows appreciation to staff members that are

doing their jobs effectively.

My AP shows appreciation to staff members that are

doing their jobs effectively.

Standard 6: Teacher/Staff Evaluation

When evaluating my performance, the most important

consideration for my AP is my students' learning.

My AP is committed to helping me develop and


My AP is committed to helping me develop and


My AP provides me with useful feedback on my


improve.

My AP provides me with useful feedback on my


improve.

My AP clearly communicates to me the criteria he or

she uses to evaluate my performance.

My AP is fair and consistent when evaluating staff at

this school.

My AP is fair and consistent when evaluating staff at

this school.

Standard 7: Professionalism

My AP treats staff, students, and parents with respect. My AP treats staff, students, and parents with respect.

My AP behaves in an ethical and professional manner. My AP behaves in an ethical and professional manner.

My AP has a positive and constructive attitude. My AP has a positive and constructive attitude.

My AP has a good understanding of current educational

trends, issues, and research.

My AP has a collegial and collaborative relationship

with school staff.

Standard 8: Communication and Community Relations

My AP seeks out and values the input of parents and

other community members when making decisions.

My AP seeks out and values the input of parents and

other community members when making decisions.

My AP communicates important information to parents

in a timely way.

My AP communicates important information to parents

in a timely way.

My AP is accessible to staff and students. My AP is accessible to staff and students.

My AP is a visible presence in our building to both

staff and students.

My AP is a visible presence in our building to both staff

and students.






All Rights Reserved

I have received a Survey Logon for the above listed leader.

TLE Electronic Platform Survey Quick Reference Guide- District Super Users/District

Administrators

Logging In

Log in to the TLE Electronic Platform by going to: https://tle.gadoe.org.

Click the Administration tab, as seen below.

Click the Anonymous Surveys link.

Printing Leader Logons

Click on the tab, All Accounts. One Hundred leader logons were prepopulated based on the leader’s

demographic. If the number of accounts or lock out date needs adjustment, please click on the one that

needs updating and make the change.

(Please note the Lockout Date is the day you can no longer complete surveys.)

https://tle.gadoe.org/






All Rights Reserved

To print the codes, click on the Leader’s Name, under the Assessed Person column. Once the lists of

unique logins are generated, they can be exported or printed for distribution to each staff member to

complete the survey.

Survey codes can be printed for multiple leaders by clicking the box above the leader’s name to select all,

scroll to the bottom and click View Accounts. This will allow you to print the accounts for all the leaders

selected.

Creating Leader Logons

If a leader needs survey codes generated, click on the tab Select Accounts. You can select one leader or multiple

leaders to create the accounts. You can also add filters to narrow down the leaders listed. Once the leader or

leaders are selected scroll to the bottom and click Create Accounts.

Select the survey from the dropdown menu, enter the lockout date, enter the number of accounts, and click

Create Accounts. The accounts will be generated and can be printed by clickingon the tab All Accounts.






All Rights Reserved

TLE Electronic Platform Survey Quick Reference Guide- Teacher/Staff Member

The teacher/staff member logs in to the TLE Electronic Platform at https://tle.gadoe.org and clicks on

Anonymous Survey Login and enters the Survey Key and passcode for each survey needing to be

completed.

The survey will be completed by the teacher/staff member. If the teacher/staff member fails to complete all

survey items, it will prompt the teacher/staff member with the following screen. The teacher/staff member

must click Save & Mark Complete to record his/ her responses once the survey is complete.

Once the survey is complete, the teacher/staff member will receive the following notification on the screen.

Click Sign Out to exit the survey.

https://tle.gadoe.org/

georgia department of education teacher and leader … department of education teacher and leader...

Documents