Search

Skip to main content Accessibility help

Only show content I have access to (0)

Chapters (1)

Over 3 years (1)

From year:

To year:

Apply

Politics and International Relations (1)

Cambridge University Press (1)

1 results

15 - Subgroup Analysis: Pitfalls, Promise, and Honesty
from Part IV - Experimental Analys is and Presentation
- By Marc Ratkovic
Edited by James N. Druckman, Northwestern University, Illinois, Donald P. Green, Columbia University, New York
Book:

Advances in Experimental Political Science

Published online:

08 March 2021

Print publication:

01 April 2021, pp 271-288
- Chapter
- - Get access
    
    Check if you have access via personal or institutional login
    
    Log in Register
- Export citation
Summary

Experiments often focus on recovering an average effect of a treatment on an outcome. A subgroup analysis involves identifying subgroups of observations for which the treatment is particularly efficacious or deleterious. Since these subgroups are not preregistered but instead discovered from the data, significant inferential issues emerge. We discuss methods for conduct honest inference on subgroups, meaning generating valid p-values and confidence intervals which account for the fact that the subgroups were not specified a priori. Central to this approach is the split-sample strategy, where half the data is used to identify effects and the other half to test them. After an intuitive and formal discussion of these issues, we provide simulation evidence and two examples illustrating these concepts in practice.