Teacher Education Unit

Program Improvement Retreat

January 26, 2021

10:00-11:30am

Zoom

Primary Goals:

1) Explore data obtained from unit-level assessments disaggregated by program.

2) Use dashboards to review & analyze data to:• Update action plan statuses

• Write new action plans

Secondary Goals:

1) Share brief assessment & accreditation updates

Updates

CAEP site visit scheduled: March 13-15, 2022

Self Study Report Due: June 2021

What that means:

✓ Don’t stop collecting data

✓ Taskstream: students submit & faculty evaluate

✓ You may be asked to provide additional things to us as evidence:• related to collaboration, partnerships, advisory councils, recruitment efforts,

program level supports, equity & diversity efforts, etc.• SPAM me!

✓ Non-SPA programs- may ask you to dig a little deeper in to program data after today

✓ Update faculty contact info (link to be sent)

✓ More stuff TBD! Please don’t hit

More Updates

CAEP Revised Standards

✓Streamlined

✓Embed diversity and technology into each standard (formerly “cross cutting themes”)

What that means:

More overt/clear expectations about inclusion of these components (and subsequent evidence that must be provided).

2-minuteScavenger Hunt using 2-page revised standards:

Paste in the chat:

Any wording that emphasizes concepts of equity and diversity? What about technology (i.e., post any wording you find, expectations, or even questions you may have, etc.)

HINT: for technology (look for other terms too)

I’ll draw 2 random winners who post!

Focus on: Standards 1, 2, 3, 4 (diversity)

Standards 1,2, 3 (tech)

Note about technology preparation for online teaching:

OUR RECENT ACTION:

REVISED QUESTION IN RED:

Q26. Seeks out and employs innovative ways to improve student learning in a variety of different settings and modalities (including remote instruction).

(from Practicum/Student Teaching Evaluation)

Enough??

Standard 3.2 Monitoring and Supporting Candidate Progression

The provider creates and monitors transition points from admission through completion that indicate candidates’ developing content knowledge, pedagogical knowledge, pedagogical skills, critical dispositions, and professional responsibilities, and the ability to integrate technology effectively in their practice.

ALSO:

“technology integration”

“in different settings and modalities”

“…apply national or state approved technology standards to engage and improve learning for all students”

Examining our Data

Same DataExamined at monthly TEC Meetings (Disaggregated by Unit Level- initial/advanced)

Examined at annual TEU Program Improvement Retreats

(Disaggregated by Program Level)

This year….

(same data)but using NEW interactive data visualization program dashboard:

Features:

• Each tab has a different assessment

• Can filter & compare data by cohort

• Can filter & compareby program

• No passwords!

NYSTCE:

CST, ATS-W, EAS, etc.

edTPA

rubrics & tasks

Surveys:

Exit, Alumni (1 & 3 year)

Employer (not included)

Practicum Evaluation:

(3 sources)

Note, there are a lot of abbreviations! Codebook to the rescue!

Program Assessments

What you will need the “codebook” for…

Abbreviations for:

• Programs (Degree + Major Name)

• Exam subareas (CST & edTPA rubrics)

• Survey questions (Exit, Alumni, Employer)

• Practicum/Student Teaching Eval questions (PSTE)

• See also General Information Page

Please access your codebook for this activity

Note: if received in the mail, you have truncated version

What abbreviation is used to represent the name of one program in your area/dept?

(1st three people in to post in chatbox win)

Hint: It includes Degree + Major

Use Codebook

Looks like this!

How many subareas on the Educating All Students (EAS) Exam?

What about your CST?

Hint: Look on the NYSTCE page

Use Codebook

Looks like this!

Random CST winner –must post to win!

Oh NO! You noticed on the Dashboard that your students did very poorly on ONE item on the Practicum/Student Teaching Evaluation (PSTE) during their fieldwork.

The question is listed on Dashboard as:

IP7_Impact_Q25

What was this question?Look up the wording.Use

Codebook

Look in this section!

FYILearner & Learning (LL)

Instructional Practice (IP)

Content Knowledge (CK)

Dispositions (D)

Technology (ISTE)

IP7_Impact_Q25 Candidate’s instruction was effective in advancing learning of all students towards attainment of state standards.

The question is listed on Dashboard as:

IP7_Impact_Q25

edTPAWhat is the exact wording of what Rubric #10 evaluates on the edTPA?

Hint: It includes Degree + Major

Use Codebook

Looks like this!

Please access your Dashboard for this activity

During this activity, you may want to “notice and jot”.

You will be asked to enter some thoughts in Qualtrics Survey later.

Click through each of the tabs along the top of your dashboard just to “see” how it works.

• Try out a few filters: by cohort year, program, test, survey question, etc.

• Review how many different NYSTCEs were taken by your candidates (i.e., CST, EAS, ATS-W, Multisubject, etc.…)

Use Dashboard

Let’s look at the edTPA

In chatbox, post answer to ONE of the following:

Use Dashboard

1) Find out how many candidates from the 2019-20 completer cohort took the edTPA?

2) How many passed?

3) What was their Mean Total Score?

4) On which Task and Rubric (e.g., T1R4) did the candidates get the most “4s”? What about the most 1s and 2s?

Random winner –must post 1 answer to win!

Let’s look at the PSTE tabs….

Why 3 tabs?Questions from the evaluation are grouped by inTASC Standard “theme”

Learners & learningInstructional PracticeContent KnowledgeContent StandardsDispositionsTechnology

Why 3 colors of bars?Administered 3 times:

Early field (e.g., methods)--- not all questions used on this oneStudent teaching- by supervisorStudent teaching- by mentor

Use Dashboard

Looks like this!

Final Scavenger Hunt Question:

After spending this time exploring, what is ONE interesting, insightful, or noteworthy thing you noted in your data thus far?

Use Dashboard

Looks like this!

TODAY’S TASK: Updating Action Plan Status

and writing new ones

• Art Ed

• Business & Marketing

• Bilingual Ed

• Career & Tech Ed

• Curriculum & Instruction

• Early Childhood

• Ed Leadership

• English Ed

• Exceptional Ed

• Literacy Specialist

• Physics Ed

• Math Ed

• Social Studies Ed

• TESOL

January 2019

retreat

New Action Plans

May 2019

“mini retreat/workshop”

Status Updates

January 2020

retreat

New Action Plans & Status Updates

May 2020

virtual workshop

Status Updates

January 2021

virtual retreat

New Action Plans & Status Updates

Where did Action Plans come from?

YOU!

Julie Henry, Tiffany Fuzak, Jane Cushman, Jevon Hunter, Steve Macho, Alice Pennisi, Kerry Renzoni, Dana Serure, Joe Zawicki

No progress yet? No problem.

But Status Update still needed, please!

Today’s Task:

Action Plans

Update Existing Action Plan

(Status Update)

Add NEW Action Plan

• Action item title.

• Data sources prompting action.

• What are going to do about it?

• Who shares responsibility?

• What role will stakeholders play?

• Determine if worked? When re-evaluate?

• Current Status• Summary of

Activities To-Date• Next Steps

You have a choice today:

• Taskstream: Traditional way we’ve done it. Log in to AMS and enter it.

• Qualtrics: Type responses into a survey tool using 1 link provided

or

Time to update Action Plan Status and Write New Action Plans.

Qualtrics Survey:

https://bit.ly/3bRLQxy

NOTES:• At least 1 action plan per program.• If same action plan applies to more than

one program, please specify in survey (can fill out once but list both programs).

• Advanced and Add On programs likely need unique plans, please consider this in your planning.

Due: Today – February 8