Skip to main content

Building a future: Interim impact findings from the YouthBuild evaluation (Miller et al., 2016)

Absence of conflict of interest.

Citation

Miller, C., Millenky, M., Schwartz, L., Goble, L., & Stein, J. (2016). Building a future: Interim impact findings from the YouthBuild evaluation. New York, NY: MDRC.

Highlights

  • The study's objective was to examine the impact of YouthBuild on employment, earnings, and education outcomes.
  • The study was a randomized controlled trial that randomly assigned young adults to the YouthBuild program or a control group. Using data collected through a 12- and 30-month follow-up survey, the authors conducted statistical models to compare outcomes of participants in the treatment and control groups.
  • The study found that YouthBuild participants were significantly more likely than control participants to be enrolled in a vocational program or earn an education credential during the follow-up period.
  • This study receives a high evidence rating. This means we are confident that the estimated effects are attributable to YouthBuild, and not to other factors.

Intervention Examined

Youthbuild

Features of the Intervention

YouthBuild began as the East Harlem Youth Action Program in the 1970s to provide education and vocational training to young adults. In 2016, the program served over 10,000 young adults at over 250 organizations in the United States annually and provided several services to reengage disconnected youth in employment and education. These services included education designed to lead to a high school diploma or equivalent credential; vocational training for an in-demand industry like construction; services focused on building youth development (e.g., leadership training and community service); supportive services geared to help individuals in training and employment; case management, workforce preparation; life skills training; and counseling. The program typically lasts between 6-12 months and offers youth a stipend or living allowance while participating in the program. Programs also used additional screening measures including academic skills tests, program specific criteria, and Mental Toughness Orientation to determine readiness to participate in the program. All YouthBuild programs are locally operated by community-based organizations, educational institutions, or government agencies and the program model provides flexibility to adapt program components, as needed, to fit community contexts. The program serves young adults between the ages of 16 to 24 who are not currently enrolled in high school and are from one of the following groups: low-income family, migrant family, in foster care, are ex-offenders, have a disability, or have parents who are incarcerated.

Features of the Study

The study was a randomized controlled trial of 75 YouthBuild programs selected from those receiving funding from the U.S. Department of Labor or Corporation for National and Community Service in 29 states, the U.S. Virgin Islands and Washington DC. The random assignment and enrollment procedures differed across the locations, where each program determined the eligible pool of applicants based on their own standard selection processes (e.g., administering basic skills tests or conducting interviews). Young adults between the ages of 16-24 years old were recruited from August 2011 through January 2013. A total of 3,929 eligible participants were enrolled in the study. Of the eligible participants, 2,700 were randomly assigned to the treatment group and 1,229 were assigned to the control group. Those assigned to the treatment group received the YouthBuild program and those in the control group were given information about other education and employment services available in the community but were prohibited from enrolling in the YouthBuild program for two years after random assignment. The study sample was predominantly male (64 percent) and African American (63 percent), with an average age of 20 years. The majority of participants did not have a high school diploma or equivalent (91 percent) and 30 percent were parents. Data sources included a survey administered at 12- and 30-months after study enrollment and administrative records on employment, earnings, and educational attainment. The authors used statistical models with controls for demographic, education, and program characteristics to compare outcomes of participants in the treatment and control groups.

Findings

Education and skills gains

  • The study found that treatment participants were significantly more likely than control participants to have earned a GED at the 12-month follow-up (26 percent vs. 11 percent) and 30-month follow-up (31 percent vs. 18 percent).
  • The study found that treatment participants were significantly more likely than control participants to be enrolled in vocational school at the 12-month follow-up (26 percent vs. 15 percent) and 30-month follow-up (31 percent vs. 20 percent).
  • The study found that treatment participants were significantly more likely than control participants to have received a trade license or training certificate at the 12-month follow-up (3 percent vs. 1 percent) and 30-month follow-up (4 percent vs. 2 percent).

Employment

  • The study found no significant differences in current employment between the treatment and control participants at the 12- or 30-month follow-up.

Earnings and wages

  • The study found no significant differences in average weekly earnings between the treatment and control participants at the 12- or 30-month follow-up.

Considerations for Interpreting the Findings

The timing of random assignment was not consistent among sites and sites were able to choose if they conducted the random assignment before, during, or after the program orientation. The authors corrected for this in the statistical models (i.e., using weights). Study teams were also allowed to bypass random assignments if not meeting their recruitment targets and to allow certain young adults to participate. However, authors omitted these individuals from the research analyses. Therefore, study randomization remained intact.

Causal Evidence Rating

The quality of causal evidence presented in this report is high, because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to YouthBuild, and not to other factors.

Reviewed by CLEAR

August 2022

Topic Area