This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Orwin, R. G. Articles by Krupski, A. Search for Related Content Social Bookmarking                         What's this?

Welfare Reform and Addiction: A Priori Hypotheses, Post Hoc Explorations, and Assisted Sensemaking in Evaluating the Effects of Terminating Benefits for Chronic Substance Abusers

Westat, Substance Abuse Research Group, 1650 Research Blvd., Rockville, MD 20850, USA, RobertOrwin{at}westat.com

Bernadette Campbell

Kevin Campbell

Antoinette Krupski

The passage of the Contract with America Advancement Act terminated the Social Security Administration’s Disability Insurance and Supplemental Security Income benefits for persons diagnosed with drug or alcohol addiction (also known as DA&A recipients), effective January 1, 1997. From an evaluation standpoint, the law created the opportunity for a "natural" experiment, specifically, an interrupted time series quasi-experiment. Through the availability of person-level data on an entire state population, the present study combines the design tradition of interrupted time series with the analytic tradition of growth curve modeling to create an "enriched" interrupted time series with greater flexibility and explanatory power than the standard design based on aggregate data. Additional techniques from the contemporary evaluation toolkit include: use of propensity scoring for matching and covariance adjustment, multilevel modeling, alternate estimates of the counter-factual, and sensitivity analyses to empirically test the plausibility of validity threats. The study assesses the net impact of the law on labor force participation and criminal behavior among former DA&A recipients in Washington State, using person-level data on employment and arrests from 2 years before implementation to 3 years after. Hypothesis tests showed unambiguously that the law increased employment but did not increase arrests. Post hoc exploratory analyses—framed by Mark et al. [Mark, M. M., Henry, G. T., & Julnes, G. (2000). Evaluation: An integrated framework for understanding, guiding, and improving policies and programs. San Francisco: Jossey Bass] theory of evaluation as assisted sensemaking with particular attention to generative mechanisms and social betterment—suggest a more nuanced interpretation. The combination of a priori and post hoc analyses confirmed that, as a result of the law, there were fewer DA&As on public supports, more DA&As in the workforce, and no evidence of more criminals menacing the public. Analyses also confirmed that a segment of the population, already poor, was made destitute.

American Journal of Evaluation, Vol. 25, No. 4, 409-441 (2004)
DOI: 10.1177/109821400402500402


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?