LossPlot: A Better Way to Visualize Loss Landscapes

Visualizing data using t-sne

L. V. D. Maaten and G. E. Hinton · 2008

Earlier work this paper cites.

Qualitatively characterizing neural network optimization problems, 2014

I. J. Goodfellow, O. Vinyals, and A. M. Saxe · 2014

Earlier work this paper cites.

A survey of dimensionality reduction techniques, 2014

C. O. S. Sorzano, J. Vargas, and A. P. Montano · 2014

Earlier work this paper cites.

Tensorflow: Large-scale machine learning on heterogeneous distributed systems, 2016

M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mane, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viegas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, and X. Zheng · 2016

Earlier work this paper cites.

Visualizing the loss landscape of neural nets, 2017

H. Li, Z. Xu, G. Taylor, C. Studer, and T. Goldstein · 2017

Cited alongside, same era.

Direct-manipulation visualization of deep networks, 2017

D. Smilkov, S. Carter, D. Sculley, F. B. Viégas, and M. Wattenberg · 2017

Cited alongside, same era.

Visualizing dataflow graphs of deep learning models in tensorflow

K. Wongsuphasawat, D. Smilkov, J. Wexler, J. Wilson, D. Mané, D. Fritz, D. Krishnan, F. B. Viégas, and M. Wattenberg · 2017

Cited alongside, same era.

Loss landscape: A.i deep learning explorations of morphology & dynamics

Cited in the paper.

https://github.com/tomgoldstein/loss-landscape#visualizing-3d-loss-surface

T. Goldstein

Cited in the paper.

Loss visualization

A. Mohan

Cited in the paper.

Essentially no barriers in neural network energy landscape

F. Draxler, K. Veschgini, M. Salmhofer, and F. A. Hamprecht · 2018

Later among the works it cites.

Loss landscape sightseeing with multi-point optimization, 2019

I. Skorokhodov and M. Burtsev · 2019

Later among the works it cites.

Umap: Uniform manifold approximation and projection for dimension reduction, 2020

L. McInnes, J. Healy, and J. Melville · 2020

Later among the works it cites.