Skip to main content

Can sector strategies promote longer-term effects? Three-year impacts from the WorkAdvance demonstration (Schaberg, 2017)

Review Guidelines

Absence of conflict of interest.

Citation

Schaberg, K. (2017). Can sector strategies promote longer-term effects? Three-year impacts from the WorkAdvance demonstration. New York: MDRC. [Madison Strategies Group]

Highlights

  • The study's objective was to examine the impact of the WorkAdvance sectoral training program on year three employment and earnings outcomes. This profile focuses on the evaluation at the Madison Strategies Group site. The authors investigated questions for other sites, the profiles can be found here.
  • The study used a randomized controlled trial to compare the year three outcomes of the participants that received the WorkAdvance program at the Madison Strategies Group site and the control group that did not receive WorkAdvance services. Using Oklahoma unemployment insurance wage data, the authors compared earnings and employment outcomes between the groups.
  • The study did not find any significant differences in employment or earnings outcomes between the WorkAdvance program and control groups.
  • This study receives a high evidence rating. This means we would be confident that any estimated effects would be attributable to the WorkAdvance program at the Madison Strategies Group site, and not to other factors. However, the study did not find statistically significant effects.

Intervention Examined

WorkAdvance

Features of the Intervention

WorkAdvance was a sectoral training program that provided education and training in high-demand fields. WorkAdvance included five components: intensive prospective participant screening; preemployment and career readiness services applicable to the target sector; sectoral occupational skills training; sectoral job development and placement services; and retention and advancement support post-employment. Madison Strategies Group, a nonprofit in Tulsa, Oklahoma, implemented the program from 2011 to 2013 and focused on the transportation and manufacturing sectors. The program was intended to serve unemployed workers and low-wage workers whose household income does not exceed 200 percent of the federal poverty level.

Features of the Study

The study used a randomized controlled trial to examine the impact of the WorkAdvance program. At the Madison Strategies Group site, 353 participants were randomly assigned to the WorkAdvance program (treatment group) and 344 participants were assigned to the control group. Control group members did not have access to WorkAdvance but could independently seek out other employment or training services in the community. The Madison Strategies Group sample was primarily male (84 percent) and had an average age of 35 years. Among the participants, 58 percent had attended college, and 27 percent were currently employed. Using Oklahoma unemployment insurance wage data, the authors conducted a statistical model to compare year three earnings and employment outcomes between the treatment and control groups.

Findings

Earnings and wages.

  • The study found no significant differences in average year three earnings between the treatment group and the control group.

Employment.

Considerations for Interpreting the Findings

The treatment condition largely reflected the WorkAdvance model. The authors note that full model implementation took some time, suggesting that participants enrolling later in the study period may have received services more closely aligned with the model than those received by participants enrolling early in the study period. Additionally, early in the study period, the Madison Strategies Group site offered a “placement-first” track that allowed participants to seek employment without first receiving training. This approach was phased out roughly halfway through the enrollment period.

Causal Evidence Rating

The quality of causal evidence presented in this report is high because it is based on a well-implemented randomized controlled trial. This means we would be confident that any estimated effects would be attributable to the WorkAdvance program at the Madison Strategies Group site, and not to other factors. However, the study did not find statistically significant effects.

Additional Sources

Schaberg, K., & Greenberg, D.H. (2020). Long-term effects of a sectoral advancement strategy: Costs, benefits, and impacts from the WorkAdvance demonstration. New York: MDRC.

Reviewed by CLEAR

July 2022

Topic Area