Absence of conflict of interest.
Citation
Highlights
- The study's objective was to examine the implementation of the Work First program, a welfare-to-work program focused on employment for Detroit, MI AFDC recipients. The program was one of 11 welfare-to-work programs evaluated as part of the National Evaluation of Welfare-to-Work Strategies (NEWWS Evaluation).
- The study authors conducted an implementation evaluation using quantitative and qualitative data from records, surveys, observations, and interviews.
- Michigan Opportunities and Skills Training (MOST) referred 41% of program members to Work First within three years. Contrary to design, some control group members (24%) were referred to Work First (only 8% participated). Contractors provided Work First case management and other services. As intended, Work First focused on employment rather than education and training.
- The data sources for evaluating the implementation of the program were clearly identified, but few details were provided on data collection and analysis. No information was available on quality assurance.
- The embedded impact study was reviewed by CLEAR in July 2022.
Intervention Examined
Work First
Features of the Intervention
- Type of organization: State agency
- Location/setting: Detroit, MI
- Population served and scale: 1,691 program group members; Aid to Families with Dependent Children (AFDC) recipients
- Industry focus: Not Included
- Intervention activities: Job search, education, and training
- Organizational partnerships: State government, non-profit and for-profit service providers
- Cost: The estimated average per month cost of Work First job search activities was $734.00 (in 1993 dollars). The estimated program-related cost per program group member (in 1993 dollars) was $133.00.
- Fidelity: Not included
Work First, an employment-focused welfare-to-work program serving adults receiving AFDC, began in October 1994 and replaced the education-focused Michigan Opportunities and Skills Training (MOST). The program was overseen by the Jobs Commission, a state cabinet-level agency. Michigan Works Agencies (MWAs) operated the program. Work First was part of the National Evaluation of Welfare-to-Work Strategies (NEWWS), funded by the U.S. Department of Education and the W.K. Kellogg Foundation. Participants were required to conduct a job search for 30 days prior to participating in other activities. After 30 days, participants were assessed and assigned to additional job search, training and education, a work experience program, or on-the-job training. Work First had contracts with private and public organizations that provided case management, participation monitoring, and job search assistance. The program provided rule enforcement and childcare assistance. Participants were mandatory Aid to Families with Dependent Children (AFDC) recipients. AFDC recipients were exempt from the program for the following reasons: had a child under age 1; was working at least 30 hours a week; was pregnant and in the second trimester; was medically excused; was living in a remote area that made program activities inaccessible; had been a resident of a mental institution within the last five years; had been using prescribed medication for mental illness; or had been enrolled in a rehabilitation program for at least 15 hours per week.
Features of the Study
Evaluators selected sites that were experienced in operating welfare-to-work programs, included a focus on Human Capital Development (education and training) activities, and had large AFDC caseloads. They also selected sites with diverse geographies, demographics, labor markets, and AFDC grant levels. Two Detroit, MI study sites (Fullerton-Jeffries and Hamtramck) were selected for the evaluation. A total of 4,459 eligible participants were randomly assigned to the MOST program (treatment) or control groups at program orientation meetings between May 1992 and June 1994. When Work First replaced MOST in October 1994, 41% of the sample was referred to Work First, and 13% participated. The sample referred was 96.7% female, 87.3% Black, and predominantly unmarried. The average age of participants was 30 years, and 21.1% had any earnings in the past year. The quantitative and qualitative data used for the study came from unemployment insurance, AFDC, and Food Stamps record data; client and staff surveys; participation records; cost data; and field research (observation and interviews with staff and participants). Detailed information on analysis methods was not provided.
Findings
Intervention activities/services
- The study found that Work First monitored attendance well.
- The study found that about 30% of Work First participants were referred to the welfare office for not maintaining a 75% attendance record. However, few participants appear to have been sanctioned.
- The study found that of the 11% of MOST and Work First members who participated in a job search activity, 39% did so through Work First.
- The study found that compared to other NEWWS programs, a large proportion (42%) of control group members participated in employment and training activities.
Cost/ROI
- The study found that the estimated average per month cost of Work First job search activities was $734.00 (in 1993 dollars). The estimated program-related cost per program group member (in 1993 dollars) was $133.00. The estimate was low because of the low participation rate of program group members but was expected to increase after two years.
Considerations for Interpreting the Findings
This study provided details on the implementation of Work First. The data sources for evaluating the implementation of the program were clearly identified, but no details were provided on how data were analyzed. No information was available on quality assurance measures or issues with data collection.