Upload
adela-mathews
View
217
Download
0
Embed Size (px)
Citation preview
Common Measures for the Workforce Investment Act (WIA)
An equal opportunity employer/program. Auxiliary aids and services are available upon request to individuals with disabilities. All voice telephone numbers on this document may be reached by persons using TTY/TDD equipment via the Florida Relay Service at
711.
Workforce Summit 2005 2
• An equal opportunity employer/program. Auxiliary aids and services are available upon request to individuals with disabilities. All voice telephone numbers on this document may be reached by persons using TTY/TDD equipment via the Florida Relay Service at 711.
44
Establishing CommonEstablishing Common MeasuresMeasures• President’s Management Agenda• Affects six agencies (29 programs)
– Department of Labor– Department of Education– Department of Health and Human Svcs.– Department of Veterans Affairs– Department of the Interior– Department of Housing and Urban Development
• TEGL 17-05 issued on February 17, 2006– Rescinds TEGLs 28-04 and 15-03– Policy applies to DOL funded programs only– July 1, 2005, implementation for W-P, VETS and
WIA; October 1, 2005, implementation for TAA
55
Benefits of Common MeasuresBenefits of Common Measures• Focus on the core purposes of the workforce
system; employment for adults and skill gain for youth
• Break down barriers to integration resulting from different definitions, data and reports for each workforce program
• Resolve questions raised by GAO and other oversight agencies regarding the consistency and reliability of data
• Reduce confusion among our customers and stakeholders who want to know about results
66
The Common MeasuresThe Common Measures• Adult measures: (Adults and DWs)
– Entered employment– Employment retention – Earnings increase (PY 05) – Average Earnings (PY 06)
• Youth and lifelong learning measures: (Ages 14-21)– Placement in employment or education– Attainment of a degree or certificate– Literacy or numeracy gains
77
The Common Measures and Revised The Common Measures and Revised Reporting Requirements forReporting Requirements for
WIA ProgramsWIA Programs
88
• Common measure outcomes will be collected through revised reports
• Common measure definitions replace existing program-specific performance measure definitions where possible
• Efficiency measures to be computed at Federal level only
Roll-Out of Common MeasuresRoll-Out of Common Measures
99
Earnings gain
Employment retention rate at
six months
WIA AdultWIA Adult Core Performance
Measures
Adult CommonAdult Common Performance
MeasuresAdult entered
employment rate
Adult employment retention rate
Adult earnings increase (PY 05)
Adult average earnings (PY 06)
Entered employment rate
Employment and credential rate
WIA Adult Program MeasuresWIA Adult Program Measures
Roll-Out of Common MeasuresRoll-Out of Common Measures
Note: Regions have negotiated performance goals for entered employment, retention, earnings gain & credential for PY05 and PY06.
Note: Regions have negotiated performance goals for entered employment, retention, earnings gain & credential for PY05 and PY06.
1010
Earnings replacement
Employment retention rate at
six months
WIA Dislocated WorkerWIA Dislocated Worker
Performance Measures
Adult CommonAdult Common Performance
MeasuresAdult entered
employment rate
Adult employment retention rate
Adult earnings increase (PY 05)
Adult average earnings (PY 06)
Entered employment rate
Employment and credential rate
WIA Dislocated Worker Program MeasuresWIA Dislocated Worker Program Measures
Roll-Out of Common MeasuresRoll-Out of Common Measures
Note: Regions have negotiated performance goals for entered employment, retention, earnings gain and credential measures for PY05 and PY06.
Note: Regions have negotiated performance goals for entered employment, retention, earnings gain and credential measures for PY05 and PY06.
1111
WIA Youth Program MeasuresWIA Youth Program Measures
Roll-Out of Common MeasuresRoll-Out of Common MeasuresYouth Common Performance MeasuresYouth Common Performance Measures
States have negotiated performance goals for WIA programs according to Federal measures for PY 2005 and PY 2006
Younger Youth Skill attainment rate Diploma attainment rate Retention rate
Older Youth Entered employment Employment retention Earnings change Employment and credential rate
1212
WIA Youth Program MeasuresWIA Youth Program Measures
Roll-Out of Common MeasuresRoll-Out of Common Measures
Youth Common Performance MeasuresYouth Common Performance Measures
• Placement in employment or education/ advanced training (PY05)• Attainment of a degree or certificate (PY05)• Literacy and Numeracy gains (PY06)
As of 06/15/2006 there has been no negotiated performance As of 06/15/2006 there has been no negotiated performance goals for the youth common measures.goals for the youth common measures.
1414
Program ParticipationProgram Participation
• A participant is a person who is determined eligible to participate in a program and receives a service funded by the program in a physical location
• The date of participation is the date of the first service after eligibility determination
• Individuals who receive services that are accessed by virtual means outside of the program’s facility need not, but may, be treated as participants
1515
Program ParticipationProgram Participation
• Generally, all participants will be taken into account when computing performance outcomes under the common measures
• Two types of participants may be excluded from the performance calculations:
• Participants who do not voluntarily disclose valid Social Security numbers
• Participants who are excluded from the calculations by law (death, health/medical, institutionalized, etc.)
1616
• At a minimum, data needed from self-service participants: social security number (SSN) employment status at the point of
participation.• Upon request of a customer’s SSN, the
customer must also be offered the opportunity to provide Equal Employment/demographic information.
Minimum Data Needed from Self-Minimum Data Needed from Self-Service ParticipantsService Participants
1717
Program ExitProgram Exit
Exit (for reporting purposes) occurs when . . .• Participant does not receive a service or partner
service for 90 consecutive calendar days;• Participant has no planned gap in service; and• Participant is not scheduled for future services
Date of exit is applied retroactively to the last day of service funded by the program or partner program
The State has the capability to track partner services in order to extend the date of exit
1818
Program ExitProgram Exit
• Days included in any planned gap in services do not count when determining the exit date
– Delay before the beginning of training– Health condition or providing care for
a family member with a health condition
– Temporary move from the area– All gaps in service must be documented
1919
Exclusions from PerformanceExclusions from Performance• Exclusions from all common measures:
– Persons institutionalized (exceptions are detained Responsible Reintegration of Youthful Offenders and disabled individuals residing in institutions)
– Persons unable to continue due to health/medical or family care reasons
– Deceased – Reservists called to active duty– Relocated to a mandated residential program (youth only)
• To be excluded from performance calculations, the event must be expected to last 90 days or more
2121
AdultAdult Entered EmploymentEntered Employment
• Employment at participation is based on information from the individual -- not wage records
• Exclude adults employed at the time of participation
• Include adults employed at the time of participation who are on layoff notice
• Supplemental data will not be used in Florida• Wage records only will be used to determine
employment in the quarter after exit
Computing
Outcomes
Number employed in quarter after exit
Number of exiters
Of those not employed at participation:
2222
YESYES Numerator
Denominator
Excluded YES
Employed in quarter after exit?
NO
Employed at participation?
AdultAdult Entered EmploymentEntered Employment
NO
2323
AdultAdult Employment RetentionEmployment Retention
• Based on those employed in quarter after exit• Employment in the 1st, 2nd and 3rd quarters after exit does
not have to be with the same employer• Must be employed in both the 2nd and 3rd quarters after
exit to count as retained• Only UI Wage records will be used• Supplemental data will not be used in Florida
Computing Outcomes
Of those employed in the quarter after exit:
Number employed in both the 2nd and 3rd quarters after exit
Number of exiters
2424
Employed in quarter after exit?
YES
Employed in 2nd and 3rd qtr. after exit?
YESYES Numerator
Denominator
ExcludedNO
AdultAdult Employment RetentionEmployment Retention
NO
2525
Adult Earnings IncreaseAdult Earnings Increase
• For program year 05-06 only• Only wage records may be used for determining
pre-program and post-program earnings• Includes same population as the adult retention measure• Likely to be negative for dislocated workers
-Number exiters
Of those employed in the quarter after exit:Earnings in 2nd
and 3rd quarter after exit
Earnings in 2nd and 3rd quarter prior to participation
Computing Outcomes
2626
Employed in qtr. after exit?
Excluded
Included
NO
YES
Adult Earnings IncreaseAdult Earnings Increase
2727
Adult Average Earnings Adult Average Earnings
• Effective July 1, 2006• Only wage records may be used for determining
average earnings• Includes same population as the adult retention measure
Number exiters
Of those employed in the first, second, and third quarters after exit:
Total earnings in the 2nd quarter plus total earnings in the 3rd quarter after exit
Computing Outcomes
2828
Employed in qtr. after exit?Excluded
Employed in 2nd qtr. after exit?
Included
NO
Employed in 3rd qtr. after exit?
YES
Adult Average EarningsAdult Average Earnings
NO
NO
NO
YES
YES
3030
Youth Measures RequirementsYouth Measures Requirements
• Reporting for Program Year ending June 2006:
– 7 current WIA youth measures (4 OY and 3 YY) – negotiate on these for accountability
– First 2 youth common measures (placement and certificate)
– Lit/Num common measure required for new youth enrolled beginning July 1, 2006
– No negotiation on Lit/Num measure in PY 05
3131
Youth Common Measures Youth Common Measures
• Placement in Employment, Education, or Training• Attainment of a Degree/Certificate• Literacy/Numeracy Gains
Note: Youth Common Measures include all youth, no longer a distinction between younger/older youth
3232
Placement In Employment or Placement In Employment or EducationEducation
Number of youth in employment, military service, enrolled in post-secondary education, advanced
training, or occupational skills training in the quarter after exit
Number of exiters
Of those who are not in post-secondary education, employment, or the military at participation:
Computing Outcomes
3333
Youth and Lifelong LearningYouth and Lifelong Learning
Placement In Employment or Placement In Employment or EducationEducation
• Excludes youth in employment, military service, or post-secondary education at participation
• Includes youth in secondary education at exit• Employment, military and education status at
participation are based on information from the youth
3434
Youth and Lifelong LearningYouth and Lifelong Learning
Placement in Employment or Placement in Employment or EducationEducation
• Employment and military service in the 1st quarter after exit is based on UI wage data
• Includes first quarter after exit only
• Currently no common measures for retention or earnings change
3535
NO
YES
YES Numerator
Denominator
NO
Did the qualifying outcome occur in the 1st quarter
after exit?
Youth and Lifelong LearningYouth and Lifelong Learning
Placement in Employment or Placement in Employment or EducationEducation
In post-secondary education, employment, or the military at
participation?ExcludedYES
3636
Attainment of Degree or CertificateAttainment of Degree or Certificate
Computing Outcomes
Of those enrolled in education at participation or any time during the program:
Number attaining a diploma, GED or certificate by the end of the 3rd
quarter after exit
Number of exiters
3737
Youth and Lifelong LearningYouth and Lifelong Learning
Attainment of Degree or CertificateAttainment of Degree or Certificate
• Education refers to secondary school, post-secondary school, adult education, or any organized program of study approved by the Florida Department of Education
• Includes youth in secondary school at exit• Outcome can be attained during participation• Diploma is any credential the Florida Department
of Education accepts as equivalent to a high school diploma
3838
Youth and Lifelong LearningYouth and Lifelong Learning
Attainment of Degree or CertificateAttainment of Degree or Certificate
– awarded in recognition of an attainment of measurable technical or occupational skills necessary to gain employment or advance within an occupation.
– Technical or occupational skills are based on standards developed or endorsed by employers.
– Recognition of generic pre-employment and/or work readiness skills are not considered certificates.
• Definition applies only to youth attainment of degree or certificate common measure
• Defining “certificate”…
Computing
Outcomes
3939
Definition of Certificate (cont.)Definition of Certificate (cont.)
• Awarding Institutions include:– A State educational agency– Institution of higher education– Professional, industry or employer organization or a
product manufacturer– Registered apprenticeship program– Public regulatory agency– A program approved by the Dept of Veterans Affairs– Office of Job Corps– Indian Tribe Higher Education Institution
4040
NO
Enrolled in education at participation or any time
during the program?ExcludedNO
YES
Attained diploma, GED or certificate by the end
of the 3rd quarter after exit?
Youth And Lifelong LearningYouth And Lifelong Learning Attainment of Degree or CertificateAttainment of Degree or Certificate
YES Numerator
Denominator
YES
4141
Youth and Lifelong LearningYouth and Lifelong Learning
Literacy or Numeracy GainsLiteracy or Numeracy Gains
Number who completed a
year of participation
Of those out-of-school youth who are basic skills deficient:
Number who increase one or more educational functioning levels
Number who exit before completing
a year of participation
+Computin
g Outcome
s
4242
Youth and Lifelong LearningYouth and Lifelong Learning
Literacy or Numeracy GainsLiteracy or Numeracy Gains
• Excludes youth who are not basic skills deficient• Excludes youth who are in-school• Includes individuals with learning disabilities • To be in the numerator, an individual must advance
one or more Adult Basic Education (ABE) or English as a Second Language (ESL) functioning levels
4343
Tests cross-walked with ABE and ESL levels include:– Comprehensive Adult Student Assessment
Instrument (CASAS)– Test of Adult Basic Education (TABE)– Adult Basic Learning Examination (ABLE)– Student Performance Levels for ESL– Basic English Skills Test (BEST) for ESL– WorkKeys (for the top 3 ABE levels)
Youth and Lifelong LearningYouth and Lifelong Learning
Literacy or Numeracy GainsLiteracy or Numeracy Gains
4444
• Individuals should be pre-tested within 60 days of the participation date or obtain a pre-test completed by a partner agency within 6 months of the participation date may be used
• Requires the use of the same standardized test for both pre and post assessments
• Individuals with disabilities should be accommodated according to guidelines associated with the assessment tool and state law or policies
• Individuals should be post-tested by the end of one year of participation and compared to pre-test results obtained during the initial assessment
Youth and Lifelong LearningYouth and Lifelong Learning
Literacy or Numeracy GainsLiteracy or Numeracy Gains
4545
• If a youth continues to be basic skills deficient after the first 12 months of participation, then s/he should continue to receive training in literacy and/or numeracy skills until they become basic skills sufficient
• Participants should be post-tested and included in the measure at the completion of the 2nd year
• Only included in measure a second time if they complete a full 2nd year in program
Youth and Lifelong LearningYouth and Lifelong Learning
Literacy or Numeracy GainsLiteracy or Numeracy Gains
Computing
Outcomes
4646
If you have questions:If you have questions:
Antonio L. CarterSenior Management Analyst SupervisorOne-Stop & Program SupportDepartment of Economic Opportunity(850)[email protected]