Less Regret via Online Conditioning

Two problems with backpropagation and other steepest-descent learning procedures for networks

Richard S. Sutton · 1986

Earlier work this paper cites.

Increased rates of convergence through learning rate adaptation

Robert A. Jacobs · 1988

Earlier work this paper cites.

Online convex programming and generalized infinitesimal gradient ascent

Original

Martin Zinkevich · 2003

Earlier work this paper cites.

Solving large scale linear prediction problems using stochastic gradient descent algorithms

Tong Zhang · 2004

Earlier work this paper cites.

Online passive-aggressive algorithms

Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer · 2006

Earlier work this paper cites.

Adaptive online gradient descent

Peter L. Bartlett, Elad Hazan, and Alexander Rakhlin · 2008

Earlier work this paper cites.

The tradeoffs of large scale learning

Léon Bottou and Olivier Bousquet · 2008

Cited alongside, same era.

Confidence-weighted linear classification

Mark Drezde, Koby Crammer, and Fernando Pereira · 2008

Cited alongside, same era.

Extracting certainty from uncertainty: Regret bounded by variation in costs

Elad Hazan and Satyen Kale · 2008

Cited alongside, same era.

Adaptive regularization of weight vectors

Koby Crammer, Alex Kulesza, and Mark Drezde · 2009

Cited alongside, same era.

Efficient learning algorithms for changing environments

Elad Hazan and C. Seshadhri · 2009

Cited alongside, same era.

Periodic step-size adaptation in second-order gradient descent for single-pass on-line structured learning

Chun-Nan Hsu, Han-Shen Huang, Yu-Ming Chang, and Yuh-Jye Lee · 2009

Cited alongside, same era.

Identifying suspicious URLs: an application of large-scale online learning

Justin Ma, Lawrence K. Saul, Stefan Savage, and Geoffrey M. Voelker · 2009

Later among the works it cites.

LIBSVM data sets

Chih-Chung Chang and Chih-Jen Lin · 2010

Closest in time.

Multi-domain sentiment dataset (v2.0)

Mark Dredze · 2010

Closest in time.

Adaptive subgradient methods for online learning and stochastic optimization

John Duchi, Elad Hazan, and Yoram Singer · 2010

Closest in time.

Adaptive bound optimization for online convex optimization

H. Brendan McMahan and Matthew Streeter · 2010

Closest in time.