2015

Optimal Non-Asymptotic Lower Bound on the Minimax Regret of Learning with Expert Advice

Orabona, Francesco, Pal, David

Understand

We prove non-asymptotic lower bounds on the expectation of the maximum of $d$ independent Gaussian variables and the expectation of the maximum of $d$ independent symmetric random walks.

  • Both lower bounds recover the optimal leading constant in the limit.
  • A simple application of the lower bound for random walks is an (asymptotically optimal) non-asymptotic lower bound on the minimax regret of online learning with expert advice.

Built on

  • A remark on Stirling’s formula

    H. Robbins · 1955

    Earlier work this paper cites.

  • Inequalities for Mill’s ratio

    A. V. Boyd · 1959

    Earlier work this paper cites.

Similar

  • On Littlewood’s estimate for the binomial distribution

    B. D. McKay · 1989

    Cited alongside, same era.

  • Prediction, learning, and games

    N. Cesa-Bianchi and G. Lugosi · 2006

    Cited alongside, same era.

Then

  • Dimension-free exponentiated gradient

    F. Orabona · 2013

    Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…