workshop sscaaa holiday inn select, montréal december 2, 2009 partnership agreements data analysis...
TRANSCRIPT
WorkshopSSCAAA
Holiday Inn Select, MontréalDecember 2, 2009
Partnership AgreementsData Analysis for Decision
Making
IntroductionPartnership Agreement and Strategic
PlanStrategic Plans to be revised to include
the Minister’s five goals Work in progressFocus on quick results to mobilize
troopsLess is moreGood opportunity to institute a culture
of data-based decision making
OutcomesClear idea of what will be included in your Partnership Agreement
What needs to be doneData analysis and data collection
Focus on ‘Less is more’
Before we beginIndividually,
Identify your main expectation of this session
Identify a question or concern you would like this session to address
Structure of the sessionFocus on the goals for which
there is existing information (Goals 1 and 5)
indicators have to be defined (Goals 2-3-4)
Sources of relevant data: where to find
Answer questions
Goals set by the MinisterSee handout Buts de la Ministre
Goal 1: CertificationTable 1 --Focus on analysis of data What to look for:
Differences: School Board and Quebec-wide data
TrendsYouth, Adult and Vocational Gap between boys and girlsTypes of certifications and qualifications
Link to Table 1
Activity 1Goal 1: CertificationIn school board team, carry out a
preliminary analysis of the certification data
Assign Roles:Difference between school board and Quebec-wide data
Difference between boys and girlsTrends
What are the areas to focus on?
Activity 1 DebriefingIdentify strengths and weaknessesAnalysis vs. interpretation
3 words to describe the resultsSuspend judgment about the
interpretationProcess of analysis—keeping trackMain purpose is to find areas to
focus on
Goal 1: Tables 2A and 2BDefinition: ‘Exits’ without certificationWhat to look for:
Comparison with Quebec-wide dataDifference between boys and girlsTrendsBreak down
Cycle 1 SecondarySec. 4-5* (link with ‘I care about school!’)
Activity 2Goal 1: ‘Exits’ without certification
Analysis of Table 2Goals
Establish a target for your school board (8,000 by 2020)
Areas to focus onSuggestion: Convert numbers into percentages
Activity 2Debriefing Analysis and interpretationIssues awaiting answers from DRSI
Issue of undetermined % of mobility (out of province) in Anglophone sector
Issue of small numbersEx.: Number of foreign students in sec. 4
and 5?Large number of Cycle 1 students not returning
Goal 5: Vocational TrainingTable 7: Total registrationsTable 4: New registrations Provincial target to be set by Minister
Local target to be set by school board
Goal 5: Vocational TrainingFocus on:
Comparison with Quebec-wide data; Trends ; Boys and girls
18-19 year oldsWithout certification or qualification
After interruption
See Tables 7, 4
Activity 3Goal 5: Vocational TrainingAnalysis of Tables 7 & 4Focus on
Proportion of new registations in Vocational Training
Differences between boys and girlsAmong the newly registered studentsafter interruptionwithout diploma
Health break
Goals 2-3-4No target set by the MinisterNeed to establish school board benchmarks and targets
Need to establish or revisit indicators
Need to gather data
Goal 2 - LanguageNeed to identify indicators for
Reading FSLWriting FSLELA
Indicators for which levelsEnd of elementary?End of secondary?Other?
Activity 4 Case study Goal 2 : LanguageTo improve achievement in reading…
The number of students using the library?The number of teacher trained in DRA?The number of teachers applying a daily 5
approach in their classroom?The success rate on competency 1 (report card
data)?The number of students meeting the end of
cycle requirements on Cycle 3 exam?
Is this a clear goal? Will these indicators help evaluate the results?
A goal is a result to be achieved; expresses intention, engagement of the organisationa goal is measurable when there is an indicator
and a target includedCharacteristics: Contains…
an intention: To increase, to reduce, to improve etc.
an object: Graduation, registration, attendance etc.
a target clientele: Ex. students under 20 years old
A measure that allows the evaluation of the goal
Expresses the type of measurea number, rate, percentage
Measures one aspect of the objectiveGoal and indicator are linked
this is why the words are the almost the same
An objective may require more than one indicator
A good indicatorRelevance and validityFeasibilityUser-friendlinessReliabilityComparability
Activity 3 --LanguageReview strategic plan and assess if:
A) Goal needs to be adaptedB) Indicators are adequate
Decide what to include (which levels) FSL ReadingFSL WritingELA
RemarksDifference between Strategic Plan and Partnership Agreement
Focus on the results vs. the process
Number of indicatorsEase of producing the informationMonitoring results
Types of indicatorsIndicators of
Impact or effect: ResultsActivities: Means to achieve results
Intrants: Resources to achieve a goal
Context: Mediating factors to contend with
A word on sources of dataReport Card results: competences
End-of-cycle evaluation situationslocal & ministerial
Teacher observations: DRA, running records etc..
Goal 3: EHDAANo national target: school boards
need to set their own targetWhat is the current situation:
Certification or qualification special needs studentswith IEPat-risk not-coded
Goal 3: EHDAASuggested indicators
Connection with the mission of the schoolInstructionSocialization Qualification
Goal 3: EHDAA indicatorsIntegration rateCertification and qualification rates% or number of:
students in Work-Oriented Pathsstudents in Special Projects (projets particuliers)
students writing MELS examsstudents improving their level of competences in main subjects
Goal 3: EHDAAEstablish a portrait of the situation
Set a target
Expected result for a given period
Precise and quantifiableExpresses a magnitude in comparison with a benchmark
Allows the monitoring of the result at regular intervals
Establish benchmarkAnalyze historical data—trends and variation
Establish an incremental target, taking into consideration the context
Goal 4: Safe and healthy schoolsThis year : focus on Safety of Environment
Active living and Health may be postponed
Advantage: TTFM+Questions to ask in teams:
Number of participating schools—representative?
Discuss sampling strategies with P. FlanaganAssess effort required for data collection
Issue: Benchmarking
BenchmarkingDefine initial situation (baseline) on a given indicator or set of indicators
Where to find relevant information?LEARN website (TBA)To access reference documents
Violence à l’école, healthy schools etc.
To share templates and tools
Additional sources of information (handout)
SynthesisTake a few minutes to synthesize your informationWhat is the first thing that you will do at your board?
What do you need to do to accomplish that goal?
What type of support will you require from MELS?
Your questionsGoing back to your original expectations and questions…Any burning questions remaining?
New issues?Your needs?
In conclusionLink with NANS Beacon Schools and CLCs
Work in progressClarify your needs for supportWhat next?