Designing and analyzing randomized experiments: Application to a Japanese election survey experiment

Yusaku Horiuchi, Kosuke Imai, Naoko Taniguchi

Research output: Contribution to journalArticlepeer-review

67 Citations (Scopus)


Randomized experiments are becoming increasingly common in political science. Despite their well-known advantages over observational studies, randomized experiments are not free from complications. In particular, researchers often cannot force subjects to comply with treatment assignment and to provide the requested information. Furthermore, simple randomization of treatments remains the most commonly used method in the discipline even though more efficient procedures are available. Building on the recent statistical literature, we address these methodological issues by offering general recommendations for designing and analyzing randomized experiments to improve the validity and efficiency of causal inference. We also develop a new statistical methodology to explore causal heterogeneity. The proposed methods are applied to a survey experiment conducted during Japan's 2004 Upper House election, where randomly selected voters were encouraged to obtain policy information from political parties' websites. An R package is publicly available for implementing various methods useful for designing and analyzing randomized experiments.

Original languageEnglish
Pages (from-to)669-687
Number of pages19
JournalAmerican Journal of Political Science
Issue number3
Publication statusPublished - 2007 Jul
Externally publishedYes

ASJC Scopus subject areas

  • Sociology and Political Science
  • Political Science and International Relations


Dive into the research topics of 'Designing and analyzing randomized experiments: Application to a Japanese election survey experiment'. Together they form a unique fingerprint.

Cite this