Absence of Conflict of Interest
This study was conducted by staff from Abt Associates, which administers CLEAR. The review of this study was conducted by ICF Incorporated, which also administers CLEAR and is trained in applying the CLEAR causal evidence guidelines.
Citation
Highlights
- The study's objective was to examine the impact of the Indiana Welfare Reform on employment, earnings, and public benefits receipt outcomes. This profile focuses on the outcomes for the single parent households in the later cohort. The authors investigated similar research questions for another contrast, the profile of which can be found here.
- The study was a randomized controlled trial that used administrative records, quarterly earnings data, and participant surveys to compare the outcomes of the treatment and control group members.
- The study found that Indiana's program significantly reduced public benefits receipt and increased employment rates over the two-year study period.
- This study receives a high evidence rating. This means we are confident that the estimated effects are attributable to Indiana’s Welfare Reform, and not to other factors.
Intervention Examined
Indiana’s Welfare Reform
Features of the Intervention
Indiana's welfare program is designed for disadvantaged single-parent families needing financial assistance. Due to welfare reform at the federal level, Indiana's welfare program underwent policy changes between 1997 and 2000 to strengthen the program. Indiana’s Family and Social Services Administration (FSSA) focused on employment and training, including unsubsidized employment placement and job search activities. Program participants were required to participate in work activities for at least 20 hours per week; this was raised to 25 hours per week in June 1997. They were also required to sign a personal responsibility agreement (PRA), ensuring that their children were immunized and that school-age children attended school. Participants could receive sanctions (a reduction in the amount of cash assistance received) for noncompliance with the work requirement or PRA. However, participants were exempt from the work requirements if caring for a child under age 3. The exemption age was lowered to age 2 in June 1997 and then to age 1 in December 1997. Temporary Assistance to Needy Families (TANF) receipt was limited two years and the amount would not increase if a child was conceived while the mother was receiving TANF benefits. FSSA also increased its earnings disregard to provide a stronger work incentive and make it easier to increase income. The fixed grant policy for the most “job ready” clients (Placement Track clients) did not change the TANF amount received with increased earnings. There was also a zero grant policy where participants would remain eligible for Medicaid and other supportive services if there was an increase in earnings.
Features of the Study
The study was a randomized controlled trial where eligible families that were approved for welfare and cash assistance were randomly assigned to the Welfare Reform group (treatment) or the Traditional Welfare group (control). Single-parent families from 12 counties in Indiana applying for welfare between March 1998 and February 1999 were eligible for the study. The study sample included 4,954 families (3,863 in the treatment group and 1,091 in the control group). The majority of participants were female (95 percent), White (53 percent) or African American (41 percent), with an average age of 27 years. The treatment group in this later cohort was subject to the full set of welfare reform policies, including Placement Track policies. The control group was subject to the Traditional welfare program, but in this later cohort, the participants were no longer required to participate in the work component of the Indiana welfare program. Additionally, after random assignment to the Traditional Welfare group, applicants were sent immediately to a specialized case worker.
The study data included administrative records from FSSA's TANF eligibility computer system, quarterly earnings records from the State Unemployment Insurance System, and a follow-up survey. The authors used statistical models to compare the outcomes of treatment and control group members two years after program entry.
Findings
Earnings and wages
- The study found no significant differences in earnings between the treatment and control groups in the eight follow-up quarters.
Employment
- The study found that Indiana's welfare reform program significantly increased employment rates for participants, with treatment participants having a higher average quarterly employment rate over the study period compared to control participants (56 percent vs. 53 percent, respectively).
- The study found that significantly more treatment participants than control participants were ever employed during the study period (85 percent vs. 83 percent).
- The study did not find a significant difference between the groups for employment and being off TANF and food stamps during the study period.
Public benefits receipt
- The study found that significantly fewer treatment participants than control participants were receiving TANF payments in the last quarter of year one (39 percent vs. 45 percent). No significant differences were found for year two.
- The study found that treatment participants received TANF for fewer months over the study period than control participants, and that treatment participants received $446 less in average TANF payments over the study period. These differences were significant.
- The study did not find a significant difference between the groups for receipt of food stamps or the average value of food stamps received.
Considerations for Interpreting the Findings
The study authors estimated multiple related impacts on outcomes related to employment, earnings, and public benefit receipt. Performing multiple statistical tests on related outcomes makes it more likely that some impacts will be found statistically significant purely by chance and not because they reflect program effectiveness. The authors did not perform statistical adjustments to account for the multiple tests, so the number of statistically significant findings in these domains is likely to be overstated. Also, the study reports a less stringent statistical significance level, considering p-values of less than 0.10 to be significant, though it is standard practice to consider statistical significance if the p-value is less than 0.05. Only results that demonstrate a p-value of less than 0.05 are considered statistically significant in this profile.
Causal Evidence Rating
The quality of causal evidence presented in this report is high because it was based on a well-implemented randomized controlled trial. This means we are confident that the estimated effects are attributable to Indiana’s Welfare Program, and not to other factors.