Journal article
Selection effects and prevention program outcomes
Prevention science, Vol.14(6), pp.557-569
12/2013
Handle:
https://hdl.handle.net/2376/115750
PMCID: PMC3760982
PMID: 23417667
Abstract
A primary goal of the paper is to provide an example of an evaluation design and analytic method that can be used to strengthen causal inference in nonexperimental prevention research. We used this method in a nonexperimental multisite study to evaluate short-term outcomes of a preventive intervention, and we accounted for effects of two types of selection bias: self-selection into the program and differential dropout. To provide context for our analytic approach, we present an overview of the counterfactual model (also known as Rubin's causal model or the potential outcomes model) and several methods derived from that model, including propensity score matching, the Heckman two-step approach, and full information maximum likelihood based on a bivariate probit model and its trivariate generalization. We provide an example using evaluation data from a community-based family intervention and a nonexperimental control group constructed from the Washington State biennial Healthy Youth Survey (HYS) risk behavior data (HYS n = 68,846; intervention n = 1,502). We identified significant effects of participant, program, and community attributes in self-selection into the program and program completion. Identification of specific selection effects is useful for developing recruitment and retention strategies, and failure to identify selection may lead to inaccurate estimation of outcomes and their public health impact. Counterfactual models allow us to evaluate interventions in uncontrolled settings and still maintain some confidence in the internal validity of our inferences; their application holds great promise for the field of prevention science as we scale up to community dissemination of preventive interventions.
Metrics
7 Record Views
Details
- Title
- Selection effects and prevention program outcomes
- Creators
- Laura G Hill - Department of Human Development, Washington State University, PO Box 644852, Pullman, WA, 99164-4852, USA, laurahill@wsu.eduRobert RosenmanVidhura TennekoonBidisha Mandal
- Publication Details
- Prevention science, Vol.14(6), pp.557-569
- Academic Unit
- Economic Sciences, School of; Office of the Provost; Community Health
- Publisher
- United States
- Grant note
- R21 DA019758 / NIDA NIH HHS R21 DA025139 / NIDA NIH HHS R21 DA025139-01A1 / NIDA NIH HHS R21 DA19758-01 / NIDA NIH HHS
- Identifiers
- 99900547811001842
- Language
- English
- Resource Type
- Journal article