Testing for arbitrary interference on experimentation platforms

成果类型:
Article
署名作者:
Pouget-Abadie, J.; Saint-Jacques, G.; Saveski, M.; Duan, W.; Ghosh, S.; Xu, Y.; Airoldi, E. M.
署名单位:
Alphabet Inc.; Google Incorporated; Massachusetts Institute of Technology (MIT); Pennsylvania Commonwealth System of Higher Education (PCSHE); Temple University
刊物名称:
BIOMETRIKA
ISSN/ISSBN:
0006-3444
DOI:
10.1093/biomet/asz047
发表日期:
2019
页码:
929940
关键词:
Causal Inference DESIGN randomization TRIAL units
摘要:
Experimentation platforms are essential to large modern technology companies, as they are used to carry out many randomized experiments daily. The classic assumption of no interference among users, under which the outcome for one user does not depend on the treatment assigned to other users, is rarely tenable on such platforms. Here, we introduce an experimental design strategy for testing whether this assumption holds. Our approach is in the spirit of the Durbin-Wu-Hausman test for endogeneity in econometrics, where multiple estimators return the same estimate if and only if the null hypothesis holds. The design that we introduce makes no assumptions on the interference model between units, nor on the network among the units, and has a sharp bound on the variance and an implied analytical bound on the Type I error rate. We discuss how to apply the proposed design strategy to large experimentation platforms, and we illustrate it in the context of an experiment on the LinkedIn platform.