On the Feasibility of Extending Social Experiments to Wider Applications

Main Article Content

Stephen H. Bell
Laura R. Peck

Abstract

Background: When deciding how to allocate limited funds for social programs, policymakers and program managers increasingly ask for evidence of effectiveness based on studies that rely on solid methodology, providing credible scientific evidence. The basic claim for the “social experiment”—that the “coin flip” of randomization creates two statistically equivalent groups that do not diverge except through an intervention’s effects—makes resulting estimates unbiased. Despite the transparency and conceptual strength of the experimental strategy for revealing the causal connection between an intervention and the outcomes of its participants, the wisdom or feasibility of conducting social experiments is often questioned on a variety of grounds.

 

Purpose: This article defines 15 common concerns about the viability and policy reliability of social experiments, in order to assess how much these issues need constrain the use of the method in providing policy evidence.

 

Setting: NA

 

Intervention: NA

 

Research Design: The research uses the authors’ experience designing and conducting dozens of social experiments to examine the basis for and soundness of each concern.  It  provides examples from the scholarly literature and evaluations in practice of both the problems posed and responses to each issue.

 

Data Collection and Analysis: NA

 

Findings: We conclude that none of the 15 concerns precludes substantially extending the use of randomized experiments as a means of evaluating the impacts of government and foundation social policies and programs.

Downloads

Download data is not yet available.

Article Details

How to Cite
Bell, S. H., & Peck, L. R. (2016). On the Feasibility of Extending Social Experiments to Wider Applications. Journal of MultiDisciplinary Evaluation, 12(27), 93–111. https://doi.org/10.56645/jmde.v12i27.452
Section
Research Articles