measurable skill gains training
TRANSCRIPT
• Measurable Skill Gains (MSG) Overview
• Five Types of MSG
• Documenting MSG in the Arizona Job
Connection (AJC) System
• Questions and Answers
• Next Steps
Topics
Copyright © 2015 ARIZONA@WORK | Page 2
Which statement is true?
A. Only one MSG per participant, per period of participation, per program year is included in the MSG measure.
B. Service providers may record multiple MSG per participant in a program year in AJC.
C. Both statements are true.
D. Neither statement is true.
Copyright © 2015 ARIZONA@WORK | Page 3
Why Capturing MSG Matters
• One of six performance indicators under Sec. 116 of WIOA
• Shows value of program and its services• Facilitates evaluation of participant progress
Copyright © 2015 ARIZONA@WORK | Page 4
MSG Overview
• Measures interim progress of participants in education or training leading to a recognized postsecondary credential or employment
• Documented progress defined five ways (types)
Copyright © 2015 ARIZONA@WORK | Page 5
Types of MSG
• Educational functioning level (EFL) gain• Attainment of secondary school diploma or
equivalent• Receipt of secondary or postsecondary transcript
or report card• Progress towards training milestone• Exam passage (skills progression)
Copyright © 2015 ARIZONA@WORK | Page 6
EFL Gain
● Applies to participants receiving instruction below the postsecondary education level
● May be measured by either:○ Enrollment in postsecondary education or
training○ Comparison of initial EFL (pre-test) and
current EFL (post-test) ■ Test determined appropriate for use in the
National Reporting System for Adult Education
Copyright © 2015 ARIZONA@WORK | Page 7
EFL Gain: Pre- & Post Test
TABE 11/12 Pre-Test
Reading: 536Grade Level 6-8
EFL: High Intermediate Basic Education
TABE 11/12 Post-Test
Reading: 576Grade Level 9-10
EFL: Low Adult Secondary Education
Post-test score shows achievement of one EFL:
High Intermediate Basic Education to Low Adult Secondary Education
Reference: Test Benchmarks for NRS Educational Functioning Levels (EFL)
Copyright © 2015 ARIZONA@WORK | Page 8
Secondary School Diploma or Equivalent
• A high school diploma
• A high school equivalency (HSE) diploma through the GED Pathway, the College Credit Pathway, or the HSE PLUS Career Readiness Pathway
Copyright © 2015 ARIZONA@WORK | Page 9
Secondary or Postsecondary Transcript or Report Card
●Secondary school transcript or report card:○One semester○D- or above in all classes
●Postsecondary school transcript or report card:○ 12 or more hours per semester
○ or 12 or more hours over two semesters if enrolled part time
○D- or above in all classes
Copyright © 2015 ARIZONA@WORK | Page 10
Progress Towards Training Milestone
A report or an evaluation from an employer or training provider showing –
• Skill development or
• Satisfactory progresstowards an established training milestone This Photo by Unknown Author is licensed under CC BY-
NC-ND
Copyright © 2015 ARIZONA@WORK | Page 11
Examples of Documented Progress Towards Training Milestone
● Report showing skills acquired during OJT, customized training, or registered apprenticeship
● Report showing actual completion of OJT or customized training
● Documentation showing successful completion of one year of registered apprenticeship (or any other established timeframe)○ Shows substantive skill development
● Increase in pay as a result of skills gained, as documented by a report from the employer
Copyright © 2015 ARIZONA@WORK | Page 12
Example of OJT Progress Report
OJT Progress Report form copied from On-the-Job Training Toolkit https://ion.workforcegps.org/resources/2017/12/01/11/19/On-the-Job-Training-Toolkit
Copyright © 2015 ARIZONA@WORK | Page 13
Exam Passage (Skills Progression)
Skills progression documented by the participant’s passage of an examination that –
• Is required for a particular occupation or
• Shows progress in attaining technical or occupational skills.
Copyright © 2015 ARIZONA@WORK | Page 14
Examples of Exam Passage (Skills Progression)
● Passing scores in a related instruction exam (registered apprenticeship program)
● Certificate that shows passage of an employer-required knowledge-based exam
● Passing score in a training program’s unit test○ A unit test in a CNA program
● Copy of a credential that is earned after the passage of an exam:○ A nursing assistant certificate○ A commercial driver’s license
Copyright © 2015 ARIZONA@WORK | Page 15
Capturing MSG
● DOL reporting: one MSG counted per participant, per period of participation, per program year
● AJC: multiple MSG may be “set and attained”○ MSG with most recent date attained pulled for
DOL report● To be included in each program’s MSG measure,
participants must be in education or training fully or partially funded by each program (Adult, Dislocated Worker, or Youth)● Exception: all in-school-youth are included in the MSG
measure.● Partner-program or other WIOA-funded education or
training must also be entered in AJC.
Copyright © 2015 ARIZONA@WORK | Page 16
Out-of-School Youth (OSY) and MSG
● Per TEGL 10-16, Change 1, OSY is included in measure if in occupational skills training, secondary/postsecondary education, Title II adult education, Job Corps, or YouthBuild.
● However, due to DES reporting method and WIPS design, OSY in education or training funded by partner programs will not be included unless also enrolled in education or training funded by the Youth program.
Copyright © 2015 ARIZONA@WORK | Page 17
Example: Supplementing Education or Training
Participant is in a two-year nursing program fully paid by Pell Grant. Service provider may help enroll the participant in a medical interpreter training -- fully or partially funded by the program (Adult, Dislocated Worker, or Youth) -- to augment the participant’s nursing training and help the participant develop skills to assist patients who are limited English proficient.
Copyright © 2015 ARIZONA@WORK | Page 18
Documenting MSG in Arizona Job Connection (AJC)
1. Bring job seeker into context and select Enrollment2. Select Measurable Skill Gains
3. Select New Goal
Copyright © 2015 ARIZONA@WORK | Page 19
Setting MSG in AJC1. Fill Date Set and Program Year (July 1 - June 30)2. Select Measurable Skill Gains type
Note: On this screen, set either an MSG or a goal type, not both.
3. Select appropriate Status
Copyright © 2015 ARIZONA@WORK | Page 20
Documenting MSG Attainment1. Change status to Attained2. Enter Date Attained (consistent with
source documentation)
Copyright © 2015 ARIZONA@WORK | Page 21
Downloading and Reviewing the Report
1. Upper left of the screen, select Download
2. Select Crosstab
Copyright © 2015 ARIZONA@WORK | Page 23
Downloading and Reviewing the Report (cont’d)
3. Select format4. Compare the two detail sheets to determine who is missing from the numerator
Copyright © 2015 ARIZONA@WORK | Page 24
Next Steps
Share activities or actions you will take as a result of this training.E.g.:Create own MSG tool consistent with State guidance, DOL guidance, and regulationsPeriodically check MSG in AJCCoach staff to ensure MSG is appropriately documentedShare information with peers
Copyright © 2015 ARIZONA@WORK | Page 26
Resources
20 C.F.R. § 677.155https://www.govinfo.gov/content/pkg/CFR-2017-title20-vol4/pdf/CFR-2017-title20-vol4-part677.pdf
Training and Employment Guidance Letter 10-16, Change 1https://wdr.doleta.gov/directives/attach/TEGL/TEGL_10-16-Change1.pdf
Measurable Skill Gains Guidehttps://des.az.gov/sites/default/files/media/500A-Measurable-Skill-Gains-Guide.pdf?time=1623686123764
Measurable Skill Gains E-Learning Modulehttps://performancereporting.workforcegps.org/MediaFiles/ws/performancereporting/Folders/%7BBE3097AE-AC83-4E4A-9145-2E5DFE9B93E4%7D/637019963033576068/index.html#/
Copyright © 2015 ARIZONA@WORK | Page 27
Contacts
● For additional MSG and other policy-related questions, please email [email protected].
● For AJC-related MSG questions and other system-related questions, please email [email protected].
Copyright © 2015 ARIZONA@WORK | Page 28