welcome to the common measures webinar

WelcomeWelcometo the Common Measures to the Common Measures

WebinarWebinarPress *6 to mute your telephone

Please do not put your phone on HOLD

In the ‘chat’ box, please enter and send us your MWA or organization name,

email address, and the names of everyone participating at your location.

Thanks!! We’ll get started soon!

AGENDAAGENDA

Webinar HousekeepingIntroductions

Common Measures TEGL 17-05DLEG-BWP PI 05-41

Performance MeasuresVAPIS

MIS Changes

TEGL 17-05

Establishing Common Establishing Common MeasuresMeasures

• Effort led by OMB as part of President’s Management Agenda– Linking performance to budget– Supporting effective programs– Comparing similar programs across

agencies

• Includes six federal departments

The Common MeasuresThe Common Measures

Adult Measures

–Entered Employment

–Employment Retention

–Average Earnings*

* Average Earnings become effective PY 2006; for PY 2005, the measure is an Earnings Change.

The Common MeasuresThe Common Measures

Youth Measures

–Placement in Employment or Education

–Attainment of a Degree or Certificate

–Literacy or Numeracy Gains

Common Measures Common Measures BenefitsBenefits

Focus on the core purposes of the workforce system

Break down barriers to integrationResolve questions regarding

consistency and reliability of dataReduce confusion

PY 2005 AccountabilityPY 2005 Accountability

Accountable for specific Common Measures

–Entered Employment Rate (WIA, W-P, VETS, Trade)

–Employment Retention Rate (WIA, W-P, VETS, Trade)


Accountable for specific WIA statutory performance measures

– Adult, DW, and OY Average Earnings Gain/Replacement (WIA, W-P, VETS, Trade)

– Adult and DW Employment and Credential

– OY Entered Employment, Retention, Earnings, Credential

– YY Retention, Skill Attainment, Diploma Attainment

– Customer Satisfaction (Participants and Employers)


Accountable for reporting on specific Common Measures

– Youth Attainment of Degree/ Certificate

– Youth Placement in Employment/ Education


• Reporting recommended for Youth Literacy/Numeracy– Required beginning in PY 2006

• WIA performance accountability for PY 2005 still consists of the “17” measures– With some changed definitions

Program ReportingProgram Reporting

In general, individuals who are eligible for a program and receive any service should be reported in

participant counts

Youth Program Design Youth Program Design Implication #1Implication #1

Long-Term ParticipationLong-Term Participation

Common Measure outcomes are unlikely to be met unless youth participate for extended periods

Youth Program Design Youth Program Design Implication #2Implication #2

Network of ServicesNetwork of Services Since long-term participation is needed to

achieve outcomes, now more than ever, WIA youth must have access to a network of services, not a single

program or provider

Youth Program Design Youth Program Design Implication #3Implication #3AssessmentAssessment

• Youth friendly assessments

• Tell youth why they are being tested and how the test will be used

• Do not retest too soon

• Consider other assessments

• Remove the high-stake test pressure

QUESTIONSQUESTIONS

DLEG BWP – PI 05-41

DefinitionDefinition

of aof a

““Participant”Participant”

Required Required

DataData

to Recordto Record

ParticipantParticipant

CountsCounts

Services Services

ThatThat

CommenceCommence

ParticipationParticipation

Definition Definition

of anof an

““Exiter”Exiter”

ServicesServices

ThatThat

Extend theExtend the

Exit DateExit Date

ServicesServicesThat Do NotThat Do NotCommenceCommence

ParticipationParticipationoror

Extend ExitExtend Exit

QUESTIONSQUESTIONS

Performance MeasuresPerformance Measures

Adult Common MeasuresAdult Common Measures

Entered Employment Rate

Employment Retention Rate

Average Earnings

Programs CoveredPrograms Covered

WIA Adult

WIA Dislocated Worker

Trade Act

Wagner-Peyser

VETS

Entered Employment RateEntered Employment Rate

Definition: For those not employed at participation, the percentage employed in the 1st quarter after exit

Entered Employment RateEntered Employment Rate

• Calculation: Of those not employed at participation…

Number employed in 1st quarter after exit

Number who exit during the quarter

Highlights of Adult Entered Highlights of Adult Entered Employment RateEmployment Rate

Excludes Adults employed at participation

Employment at participation is based on information collected from the individual

Highlights of Adult Entered Highlights of Adult Entered Employment RateEmployment Rate

Those who received a notice of termination or the employer has filed a WARN or similar notice are considered not employed

Transitioning Service Members (expected to retire within 12 months) are considered not employed

Employment Retention RateEmployment Retention RateDefinition: For those employed in the 1st

quarter after exit, the percentage employed in the 2nd and 3rd quarter after exit

• Calculation: Of those employed in the first quarter after exit…

Number employed in the 2nd and 3rd quarter after exit


Highlights of Adult Highlights of Adult Employment Retention RateEmployment Retention Rate

Includes all those employed in the 1st quarter after exit regardless of employment status at participation

Positive outcome requires employment in two post-exit quarters (does not have to be with the same employer)

PY 2006 Average EarningsPY 2006 Average Earnings

Definition: For those employed in the 1st, 2nd, and 3rd quarter after exit, average six-month earnings in the 2nd and 3rd quarter after exit

PY 2006 Average EarningsPY 2006 Average Earnings

• Calculation:

Of those employed in the 1st, 2nd and 3rd quarters after exit…

Earning from the 2nd and 3rd quarter after exit


Highlights of Adult Average Highlights of Adult Average EarningsEarnings

Includes those employed in 1st, 2nd, and 3rd quarter after exit

Only allowable data source is wage records

Highlights of Adult Average Highlights of Adult Average EarningsEarnings

Those whose employment was determined based on supplemental data are excluded from the earnings measure

WIA programs will use the current Adult Earnings Change measure for PY 2005

QUESTIONSQUESTIONS

Youth Common MeasuresYouth Common Measures

• Placement in Employment or Education

• Attainment of Degree or Certificate

• Literacy/Numeracy Gains

Program CoveredProgram Covered

WIA Youth

Placement in Employment Placement in Employment or Educationor Education

Definition: Of those not in post-secondary education, employment, or the military at participation, the percentage in employment, the military or enrolled in post-secondary education and/or advance training/occupational skills training in the 1st quarter after exit.

Placement in Employment Placement in Employment or Educationor Education

Calculation: Of those not employed, in the military, or in post-secondary education at participation…

Number of youth employed, in the military, or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1st quarter after exit

Number of exiters

Highlights of Youth Placement Highlights of Youth Placement in Employment or Educationin Employment or Education Excludes youth in employment, the

military, or post-secondary education at participation

Employment, military, and education status at participation is based on information collected from the individual

Employment and military status in the 1st quarter after exit is based on wage records (supplemental data allowed)

Highlights of Youth Highlights of Youth Placement in Employment or Placement in Employment or

EducationEducation Education status in the 1st quarter

after exit is based on administrative records

Youth in secondary school at exit are included, consistent with ETA’s vision to ensure youth successfully complete their secondary education

Defining Specific TermsDefining Specific Terms

Post-Secondary Education

A program at an accredited degree-granting institution

leading to an academic degree.


Advanced

Training/Occupational

Skills Training

Attainment of Degree or Attainment of Degree or CertificateCertificate

Definition: Of those enrolled in education at or during participation, the percentage who attained a diploma, GED, or certificate by the end of the 3rd quarter after exit.

Attainment of Degree or Attainment of Degree or CertificateCertificate

• Calculation:

Of those enrolled in education at participation or any time during the program…

Number or youth who attained a diploma, GED, or certificate by the end of the 3rd quarter after exit

Number of exiters

Highlights of Youth Highlights of Youth Attainment of Degree or Attainment of Degree or

CertificateCertificateYouth in secondary school at

exit are included, which is consistent with ETA’s vision to

ensure youth successfully complete their secondary

education

Highlights of Youth Highlights of Youth Attainment of Degree or Attainment of Degree or

CertificateCertificate Diplomas, GEDs, or certificates can be

obtained during participation or at any point by the end of the 3rd quarter after exit

Work readiness certificates will not be accepted for this measure


Education

Participation in secondary or post-secondary school, adult education programs, or any other organized

program of study leading to a degree or certificate


Diploma

Any credential accepted by the State educational agency as equivalent to a HS diploma;

also includes post-secondary degrees


Certificate

Awarded in recognition of an individual’s attainment of technical

or occupational skills.

Does not include work readiness certificates or certificates awarded by local boards.

Literacy/Numeracy GainsLiteracy/Numeracy Gains

Definition: Of those out-of-school youth who are basic skills deficient, the percentage who increase one or more education functioning levels within one year of participation.

Literacy/Numeracy GainsLiteracy/Numeracy Gains

Calculation:

Of those out-of-school youth who are basic skills deficient…

Number of Youth participants who increase one or more educational functioning levels

Number of youth who completed a year of participation (based on date of 1st youth service)

Number of youth who exit before completing a year of participation

Highlights of Literacy & Highlights of Literacy & Numeracy GainsNumeracy Gains

Only common measure that is not exit-based

Excludes in-school youth and out-of-school youth who are not basic skills deficient

Includes individuals with learning disabilities

Highlights of Literacy Highlights of Literacy /Numeracy Gains/Numeracy Gains

A positive outcome means the youth must advance one or more ABE or ESL functioning levels

Gains can occur in literacy or numeracyEducational levels are consistent with

Department of Education’s National Reporting System (NRS)

Reporting begins July 1, 2006

About the AssessmentsAbout the Assessments

The same standardized assessment

must be used for

pre- and post-testing


If a youth continues to be basic skills deficient after the first 12 months of participation, they

should continue to receive training in literacy and/or numeracy skills


All out-of-school youth must be assessed in

basic reading, writing, and

math


Pre-testing must occur within 60 days of the first youth program

service; can use pre-test from up to six months prior to date of first

youth service


Must use one of the assessment tools listed in Attachment C of

TEGL 17-05


Youth should be post-tested by the end of one year of

participation and compared to pre-test results obtained during

the initial assessment


Youth should be post-tested and included in the measure at the

completion of the 2nd year if they complete two years in the

program

Exclusions from Common Exclusions from Common MeasuresMeasures

A participant in any of the following categories, may be excluded– Institutionalized– Health/Medical or Family care– Deceased– Reserve Forces Called to Active Duty– Relocated to a Mandated Program– Invalid or Missing Social Security Number

WIA Program AccountabilityWIA Program Accountability

• MWAs will continue to be held accountable for all current (17) WIA performance measures

• WIA Adult performance measures will utilize the Adult Common Measures definitions

QUESTIONSQUESTIONS

VALUE ADDED PERFORMANCEIMPROVEMENT SYSTEM

V A P I SV A P I S

VAPISVAPIS• Provides adjusted performance data

for the State and local areas.

• Predicts local area performance.

• Provides data to support identification of local area strengths and weaknesses, leading to system improvements.

Programs IncludedPrograms Included

WIA Adult

WIA Dislocated Worker

Wagner-Peyser

Common MeasuresCommon Measures

Entered Employment Rate

Employment Retention Rate

Average Earnings

Quarterly VAPIS Report by Quarterly VAPIS Report by Program MeasureProgram Measure

• Actual and Adjusted performance results.

• Prediction of future performance results.

• Measure of Value Added by local area.

QUESTIONSQUESTIONS

Common TerminologyCommon Terminology

Participant = Enrollment = Registrant

Activity = Service = Transaction

Participant CountsParticipant Counts

For new participants inWagner-Peyser,

the system will create a new participant in WIA.


For new participants in WIA,

the system will create a new participant in Wagner-Peyser.


For new participants in Trade,

the system will create a new participant in Wager-Peyser and

WIA.

Wagner-Peyser ChangesWagner-Peyser Changes

The activity “Assigned to Case Management”

will now require amanual End Date entry.

Wagner-Peyser ChangesWagner-Peyser Changes

• Exit information will be available for User Input

• All records will now have an Exit Date

WIA ChangesWIA Changes

The pre-registration screen will be altered to capture

Employment Status, Education Status,

UI Claim Data and Migrant Worker


A new section for Youth Assessment data will be added

to the system


A temporary Exit Date will be added for User input

Estimated Activity End DatesEstimated Activity End Dates

All activities that have Manual End Dates will have the Estimated End

Date pre-filled by the system

ReportsReports

A new report will be created to list those individuals who are

approaching the 90-day Exit limit.

Conversion of DataConversion of Data

All WIA pre-registration, pending Trade and

Wagner-Peyser records that are 91-days old or more will

be Exited


All other records will be checked to determine if they

can be considered a concurrent participation


All records 90-days old or less will have a new display page

showing concurrent participation and other

information pertaining to when the record will be Exited

Open Record Display Open Record Display Information 1Information 1

Latest Reg. Latest Reg. Date:Date:

01/01/200601/01/2006 Has Has Activities:Activities:

YY Latest Act End Latest Act End Date:Date:

03/04/200603/04/2006

Wagner-Wagner-Peyser?:Peyser?:

YY WIAWIA YY TAA?TAA? NN

Latest Gap Latest Gap Date:Date:

06/07/200606/07/2006 Latest Latest Future Svc:Future Svc:

---------- When Exit Will When Exit Will Occur: Occur:

06/08/200606/08/2006





03/04/200603/04/2006




Latest Latest Future Future Svc:Svc:

-------- When Exit Will When Exit Will Occur: Occur:

06/05/200606/05/2006








Latest Latest Future Svc:Future Svc:

---------- When Exit Will When Exit Will Occur: Occur:

Exited Record Display Exited Record Display InformationInformation




03/04/200603/04/2006




Latest Latest Future Future Svc:Svc:

Exit Date: Exit Date: 03/04/200603/04/2006

Exit from the SystemExit from the System

The system will

now Exit all

Records


The Exit will occur 90-days after the latest Activity has Ended

and there are no GAPs or Future Services planned.


For concurrently enrolled

participants, all records will have

the same Exit Date.


For concurrently enrolled participants, if an Exclusionary Exit

reason is recorded in any of the programs, that reason will be used

for all of the programs.

QuestionsQuestions

www.michigan.gov/bwptrainingwww.michigan.gov/bwptraining

For More Information For More Information and Q & A’sand Q & A’sPlease VisitPlease Visit

www. Michigan.gov/b

wptraining

Common Common MeasuresMeasures

welcome to the common measures webinar

Documents

wia youth

dw employment

common measureseffort

employment educationpy

common measures webinarpress

wia performance accountability

single program

earnings change