Trustworthy Online Marketplace Experimentation with Budget-split Design

Estimating causal effects of treatments in randomized and nonrandomized studies

Rubin, D. B. (1974) · 1974

Earlier work this paper cites.

Statistics and causal inference

Holland, P. W. (1986) · 1986

Earlier work this paper cites.

Causal inference using potential outcomes

Rubin, D. B. (2005) · 2005

Earlier work this paper cites.

Internet advertising and the generalized second-price auction: Selling billions of dollars worth of keywords

Edelman, B., M. Ostrovsky, and M. Schwarz (2007) · 2007

Earlier work this paper cites.

Causal inference with bipartite designs

Original

Doudchenko, N., M. Zhang, E. Drynkin, E. Airoldi, V. Mirrokni, and J. Pouget-Abadie (2020) · 2010

Earlier work this paper cites.

Overlapping experiment infrastructure: More, better, faster experimentation

Tang, D., A. Agarwal, D. O’Brien, and M. Meyer (2010) · 2010

Earlier work this paper cites.

Trustworthy Online Controlled Experiments : Five Puzzling Outcomes Explained

Kohavi, R., A. Deng, B. Frasca, R. Longbotham, T. Walker, and Y. Xu (2012) · 2012

Earlier work this paper cites.

Improving the sensitivity of online controlled experiments by utilizing pre-experiment data

Deng, A., Y. Xu, R. Kohavi, and T. Walker (2013) · 2013

Earlier work this paper cites.

Ad click prediction: a view from the trenches

McMahan, H., G. Holt, D. Sculley, M. Young, D. Ebner, J. Grady, L. Nie, T. Phillips, E. Davydov, D. Golovin, S. Chikkerur, D. Liu, M. Wattenberg, A. Hrafnkelsson, T. Boulos, and J. Kubica (2013, 08) · 2013

Earlier work this paper cites.

Budget pacing for targeted online advertisements at linkedin

Agarwal, D., S. Ghosh, K. Wei, and S. You (2014) · 2014

Earlier work this paper cites.

Why marketplace experimentation is harder than it seems: The role of test-control interference

Blake, T. and D. Coey (2014) · 2014

Earlier work this paper cites.

Practical lessons from predicting clicks on ads at facebook

He, X., J. Pan, O. Jin, T. Xu, B. Liu, T. Xu, Y. Shi, A. Atallah, R. Herbrich, S. Bowers, and J. Q. n. Candela (2014) · 2014

Cited alongside, same era.

Causal inference in statistics, social, and biomedical sciences

Imbens, G. W. and D. B. Rubin (2015) · 2015

Cited alongside, same era.

These charts show how far google and facebook are ahead of twitter

Lara O’Reilly (2015) · 2015

Cited alongside, same era.

From infrastructure to culture: A/b testing challenges in large scale social networks

Xu, Y., N. Chen, A. Fernandez, O. Sinno, and A. Bhasin (2015) · 2015

Cited alongside, same era.

Randomization and the pernicious effects of limited budgets on auction experiments

Basse, G. W., H. A. Soufiani, and D. Lambert (2016a) · 2016

Cited alongside, same era.

Data-Driven Metric Development for Online Controlled Experiments

The design of a/b tests in an online marketplace

Jason (Xiao) Wang (2018) · 2018

Later among the works it cites.

Time series experiments and causal estimands: Exact randomization tests and trading

Bojinov, I. and N. Shephard (2019) · 2019

Later among the works it cites.

Amazon statistics you should know: Opportunities to make the most of america’s top online marketplace

Emily Dayton (2019) · 2019

Later among the works it cites.

Constrained bayesian optimization with noisy experiments

Letham, B., B. Karrer, G. Ottoni, and E. Bakshy (2019, 06) · 2019

Later among the works it cites.

Variance reduction in bipartite experiments through correlation clustering

Pouget-Abadie, J., K. Aydin, W. Schudy, K. Brodersen, and V. Mirrokni (2019) · 2019

Later among the works it cites.

Design and analysis of switchback experiments

Bojinov, I., D. Simchi-Levi, and J. Zhao (2020) · 2020