Fetching the paper…
Reading the bibliography…
Deep learning (DL) workflows demand an ever-increasing budget of compute and energy in order to achieve outsized gains.
A method to estimate the energy consumption of deep neural networks
1920
Earlier work this paper cites.
Power-law distributions in empirical data
2009
Earlier work this paper cites.
ImageNet: A Large-Scale Hierarchical Image Database
2009
Earlier work this paper cites.
statsmodels: Econometric and statistical modeling with python
2010
Earlier work this paper cites.
Scikit-learn: Machine learning in python
2011
Earlier work this paper cites.
Quantum chemistry structures and properties of 134 kilo molecules
2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
2014
Earlier work this paper cites.
Fathom: reference workloads for modern deep learning methods
2016
Earlier work this paper cites.
Deep residual learning for image recognition
2016
Earlier work this paper cites.
Molecular graph convolutions: moving beyond fingerprints
2016
Earlier work this paper cites.
Pointer sentinel mixture models, 2016
2016
Earlier work this paper cites.
Rethinking the inception architecture for computer vision
2016
Earlier work this paper cites.
Geometric deep learning: Going beyond euclidean data
2017
Earlier work this paper cites.
Adam: A method for stochastic optimization, 2017
2017
Earlier work this paper cites.
Paleo: A performance model for deep neural networks
2017
Earlier work this paper cites.
Schnet: A continuous-filter convolutional neural network for modeling quantum interactions, 2017
2017
Earlier work this paper cites.
Neural architecture search with reinforcement learning, 2017
2017
Cited alongside, same era.
Neural tangent kernel: Convergence and generalization in neural networks
2018
Cited alongside, same era.
Predicting the computational cost of deep learning models
2018
Cited alongside, same era.
Interactive supercomputing on 40,000 cores for machine learning and data analysis
2018
Cited alongside, same era.
Horovod: fast and easy distributed deep learning in tensorflow
2018
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Directional message passing for molecular graphs, 2020
2020
Later among the works it cites.
Pytorch distributed: Experiences on accelerating data parallel training, 2020
2020
Later among the works it cites.
What does power consumption behavior of hpc jobs reveal? : Demystifying, quantifying, and predicting power consumption characteristics
2020
Later among the works it cites.
Designing network design spaces, 2020
2020
Later among the works it cites.
Survey of machine learning accelerators
2020
Later among the works it cites.
The cost of training nlp models: A concise overview, 2020
2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2019
Cited alongside, same era.
Pytorch lightning
2019
Cited alongside, same era.
Fast graph representation learning with PyTorch Geometric
2019
Cited alongside, same era.
Estimation of energy consumption in machine learning
2019
Cited alongside, same era.
A variable batch size strategy for large scale distributed dnn training
2019
Cited alongside, same era.
Analysis of large-scale multi-tenant GPU clusters for DNN training workloads
2019
Cited alongside, same era.
Quantifying the carbon emissions of machine learning
2019
Cited alongside, same era.
Energy and policy considerations for modern deep learning research
2020
Later among the works it cites.
Efficientnet: Rethinking model scaling for convolutional neural networks, 2020
2020
Later among the works it cites.
The computational limits of deep learning, 2020
2020
Later among the works it cites.
Predicting training time without training
2020
Later among the works it cites.
Revisiting resnets: Improved training and scaling strategies, 2021
2021
Later among the works it cites.
On the dangers of stochastic parrots: Can language models be too big?
2021
Later among the works it cites.
Geometric deep learning: Grids, groups, graphs, geodesics, and gauges, 2021
2021
Later among the works it cites.
Scalable geometric deep learning on molecular graphs
2021
Later among the works it cites.
Carbon emissions and large neural network training, 2021
2021
Later among the works it cites.
The mit supercloud dataset, 2021
2021
Later among the works it cites.