Fetching the paper…
Reading the bibliography…
A/B tests are typically analyzed via frequentist p-values and confidence intervals; but these inferences are wholly unreliable if users endogenously choose samples sizes by *continuously monitoring* their tests.
Wald A (1945) Sequential tests of statistical hypotheses. The Annals of Mathematical Statistics 16(2):117–186
1945
Earlier work this paper cites.
Hoeffding W (1960) Lower bounds for the expected sample size and the average risk of a sequential procedure. The Annals of Mathematical Statistics 352–368
1960
Earlier work this paper cites.
Dunn OJ (1961) Multiple comparisons among means. Journal of the American Statistical Association 56(293):52–64
1961
Earlier work this paper cites.
James W, Stein C (1961) Estimation with quadratic loss. Proceedings of the fourth Berkeley symposium on mathematical statistics and probability , volume 1, 361–379
1961
Earlier work this paper cites.
Darling D, Robbins H (1967) Confidence sequences for mean, variance, and median. Proceedings of the National Academy of Sciences of the United States of America 58(1):66
1967
Earlier work this paper cites.
Robbins H (1970) Statistical methods related to the law of the iterated logarithm. The Annals of Mathematical Statistics 1397–1409
1970
Earlier work this paper cites.
Robbins H, Siegmund D (1974) The expected sample size of some tests of power one. The Annals of Statistics 415–436
1974
Earlier work this paper cites.
Pollak M, Siegmund D (1975) Approximations to the expected sample size of certain sequential tests. The Annals of Statistics 3(6):1267–1282, URL http://dx.doi.org/10.1214/aos/1176343284
1975
Earlier work this paper cites.
Lai TL, Siegmund D (1977) A nonlinear renewal theory with applications to sequential analysis i. The Annals of Statistics 5(5):946–954, URL http://dx.doi.org/10.1214/aos/1176343950
1977
Earlier work this paper cites.
Siegmund D (1978) Estimation following sequential tests. Biometrika 65(2):341–349
1978
Earlier work this paper cites.
Lai TL, Siegmund D (1979) A nonlinear renewal theory with applications to sequential analysis ii. The Annals of Statistics 7(1):60–76, URL http://dx.doi.org/10.1214/aos/1176344555
1979
Earlier work this paper cites.
Siegmund D (1985) Sequential analysis: tests and confidence intervals (Springer)
1985
Earlier work this paper cites.
Lehmann EL, Romano JP, Casella G (1986) Testing statistical hypotheses , volume 150 (Wiley New York et al)
1986
Earlier work this paper cites.
Ghosh BK, Sen PK (1991) Handbook of sequential analysis (CRC Press)
1991
Earlier work this paper cites.
Lai TL, Wang JQ (1994) Asymptotic expansions for the distributions of stopped random walks and first passage times. The Annals of Probability 1957–1992
1992
Earlier work this paper cites.
Demets DL, Lan KG (1994) Interim analysis: the alpha spending function approach. Statistics in medicine 13(13-14):1341–1352
1994
Cited alongside, same era.
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological) 289–300
1995
Cited alongside, same era.
Benjamini Y, Yekutieli D (2001) The control of the false discovery rate in multiple testing under dependency. Annals of statistics 1165–1188
2001
Cited alongside, same era.
Lai TL (2001) Sequential analysis: Some classical problems and new challenges. Statistica Sinica 11:303–408
2001
Cited alongside, same era.
Even-Dar E, Mannor S, Mansour Y (2002) Pac bounds for multi-armed bandit and markov decision processes. International Conference on Computational Learning Theory , 255–270 (Springer)
2014
Later among the works it cites.
Fithian W, Wager S (2014) Semiparametric exponential families for heavy-tailed data. Biometrika 102(2):486–493
2014
Later among the works it cites.
Jamieson K, Malloy M, Nowak R, Bubeck S (2014) lil’ucb: An optimal exploration algorithm for multi-armed bandits. Conference on Learning Theory , 423–439
2014
Later among the works it cites.
2014
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2002
Cited alongside, same era.
Benjamini Y, Yekutieli D (2005) False discovery rate–adjusted multiple confidence intervals for selected parameters. Journal of the American Statistical Association 100(469):71–81
2005
Cited alongside, same era.
de la Peña VH, Lai TL, Shao QM (2008) Self-normalized processes: Limit theory and Statistical Applications (Springer Science & Business Media)
2008
Cited alongside, same era.
Foster DP, Stine RA (2008) α \alpha -investing: a procedure for sequential control of expected false discoveries. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 70(2):429–444
2008
Cited alongside, same era.
Bubeck S, Munos R, Stoltz G (2009) Pure exploration in multi-armed bandits problems. International conference on Algorithmic learning theory , 23–37 (Springer)
2009
Cited alongside, same era.
Miller E (2010) How not to run an A/B test URL http://www.evanmiller.org/how-not-to-run-an-ab-test.html
2010
Cited alongside, same era.
Tang D, Agarwal A, O’Brien D, Meyer M (2010) Overlapping experiment infrastructure: More, better, faster experimentation. Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining , 17–26 (ACM)
2010
Cited alongside, same era.
Abbasi-Yadkori Y, Pál D, Szepesvári C (2011) Improved algorithms for linear stochastic bandits. Advances in Neural Information Processing Systems , 2312–2320
2011
Cited alongside, same era.
2015
Closest in time.
Miller E (2015) Simple sequential a/b testing URL http://www.evanmiller.org/sequential-ab-testing.html
2015
Closest in time.
Scott SL (2015) Multi-armed bandit experiments in the online service economy. Applied Stochastic Models in Business and Industry 31(1):37–45
2015
Closest in time.
2016
Closest in time.
Zhao S, Zhou E, Sabharwal A, Ermon S (2016) Adaptive concentration inequalities for sequential decision problems. Advances in Neural Information Processing Systems , 1343–1351
2016
Closest in time.
Johari R, Koomen P, Pekelis L, Walsh D (2017) Peeking at a/b tests: Why it matters, and what to do about it. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 1517–1525, KDD ’17 (New York, NY, USA: ACM), ISBN 978-1-4503-4887-4, URL http://dx.doi.org/10.1145/3097983.3097992
2017
Closest in time.
Malek A, Katariya S, Chow Y, Ghavamzadeh M (2017) Sequential multiple hypothesis testing with type i error control. Artificial Intelligence and Statistics , 1468–1476
2017
Closest in time.
2017
Closest in time.
2018
Closest in time.
2018
Closest in time.
Lattimore T, Szepesvári C (2018) Bandit algorithms. preprint
2018
Closest in time.