Understanding the bias-variance tradeoff of Bregman divergences

Problem Complexity and Method Efficiency in Optimization

A.S. Nemirovski and D.B. Yudin · 1983

Earlier work this paper cites.

Neural Networks and the Bias/Variance Dilemma

Stuart Geman, Elie Bienenstock, and René Doursat · 1992

Earlier work this paper cites.

Some pac-bayesian theorems

David A. McAllester · 1998

Earlier work this paper cites.

A unified bias-variance decomposition and its applications

Pedro Domingos · 2000

Earlier work this paper cites.

Improving predictive inference under covariate shift by weighting the log-likelihood function

Hidetoshi Shimodaira · 2000

Earlier work this paper cites.

Joint and separate convexity of the bregman distance

Heinz H. Bauschke and Jonathan M. Borwein · 2001

Earlier work this paper cites.

The Elements of Statistical Learning

Trevor Hastie, Robert Tibshirani, and Jerome Friedman · 2001

Earlier work this paper cites.

Clustering with bregman divergences

Arindam Banerjee, Srujana Merugu, Inderjit S. Dhillon, and Joydeep Ghosh · 2005

Cited alongside, same era.

Bias-variance theory

Thomas G. Dietterich · 2005

Cited alongside, same era.

Prediction, learning, and games

Nicolo Cesa-Bianchi and Gábor Lugosi · 2006

Cited alongside, same era.

Learning theory estimates via integral operators and their approximations

S. Smale and D. X. Zhou · 2007

Cited alongside, same era.

Primal-dual subgradient methods for convex problems

Yurii E. Nesterov · 2009

Cited alongside, same era.

A Generalized Bias-Variance Decomposition for Bregman Divergences

David Pfau · 2013

Cited alongside, same era.

A modern take on the bias-variance tradeoff in neural networks, 2019a

A bias-variance decomposition for bayesian deep learning

James A. Brofos and Rui Shu · 2019

Later among the works it cites.

Understanding double descent requires A fine-grained bias-variance decomposition

Ben Adlam and Jeffrey Pennington · 2020

Later among the works it cites.

Double trouble in double descent : Bias and variance(s) in the lazy regime, 2020

Stéphane d’Ascoli, Maria Refinetti, Giulio Biroli, and Florent Krzakala · 2020

Later among the works it cites.

To ensemble or not ensemble: When does end-to-end training fail?

Andrew Webb, Charles Reynolds, Wenlin Chen, Henry Reeve, Dan Iliescu, Mikel Lujan, and Gavin Brown · 2020

Later among the works it cites.

Rethinking bias-variance trade-off for generalization of neural networks

Zitong Yang, Yaodong Yu, Chong You, Jacob Steinhardt, and Yi Ma · 2020

Later among the works it cites.

Unifying mirror descent and dual averaging, 2021