Fetching the paper…
Reading the bibliography…
This paper presents reverse-mode algorithmic differentiation (AD) based on source code transformation, in particular of the Static Single Assignment (SSA) form used by modern compilers.
Compiling fast partial derivatives of functions given by algorithms
Speelpenning, B · 1980
Earlier work this paper cites.
Efficiently computing static single assignment form and the control dependence graph
Cytron, R., Ferrante, J., Rosen, B. K., Wegman, M. N., and Zadeck, F. K · 1991
Earlier work this paper cites.
SSA is functional programming
Appel, A. W · 1998
Earlier work this paper cites.
Recipes for adjoint code construction
Giering, R. and Kaminski, T · 1998
Earlier work this paper cites.
Automatic differentiation of algorithms
Bartholomew-Biggs, M., Brown, S., Christianson, B., and Dixon, L · 2000
Earlier work this paper cites.
LLVM: A compilation framework for lifelong program analysis & transformation
Lattner, C. and Adve, V · 2004
Earlier work this paper cites.
Reverse-mode ad in a functional framework: Lambda the ultimate backpropagator
Pearlmutter, B. A. and Siskind, J. M · 2008
Earlier work this paper cites.
The tapenade automatic differentiation tool: principles, model, and specification
Hascoet, L. and Pascual, V · 2013
Earlier work this paper cites.
Tensorflow: a system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al · 2016
Earlier work this paper cites.
Automatic differentiation in machine learning: a survey
Baydin, A. G., Pearlmutter, B. A., Radul, A. A., and Siskind, J. M · 2017
Earlier work this paper cites.
Julia: A fresh approach to numerical computing
Bezanson, J., Edelman, A., Karpinski, S., and Shah, V. B · 2017
Cited alongside, same era.
Reversible architectures for arbitrarily deep residual neural networks
Chang, B., Meng, L., Haber, E., Ruthotto, L., Begert, D., and Holtham, E · 2017
Cited alongside, same era.
Dynet: The dynamic neural network toolkit
Neubig, G., Dyer, C., Goldberg, Y., Matthews, A., Ammar, W., Anastasopoulos, A., Ballesteros, M., Chiang, D., Clothiaux, D., Cohn, T., et al · 2017
Cited alongside, same era.
Automatic differentiation in pytorch
Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A · 2017
Cited alongside, same era.
Tangent: automatic differentiation using source code transformation in python
Wiltschko, A. B., van Merriënboer, B., and Moldovan, D · 2017
Flux: Elegant machine learning with julia
Innes, M · 2018
Closest in time.
On machine learning and programming languages
Innes, M., Karpinski, S., Shah, V., Barber, D., Stenetorp, P., Besard, T., Bradbury, J., Churavy, V., Danisch, S., Edelman, A., et al · 2018
Closest in time.
Efficient deep learning inference on edge devices
Jiang, Z., Chen, T., and Li, M · 2018
Closest in time.
PyTorch, a, year in…
PyTorch Team · 2018
Closest in time.
Cassette.jl
Revels, J · 2018
Closest in time.
Reversediff.jl
Revels, J · 2018
Closest in time.
Automatic differentiation in ml: Where we are and where we should be going
van Merriënboer, B., Breuleux, O., Bergeron, A., and Lamblin, P · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
tensorflow.org/performance/xla , 2018
XLA overview · 2018
Cited alongside, same era.
Effective extensible programming: Unleashing julia on gpus
Besard, T., Foket, C., and De Sutter, B · 2018
Cited alongside, same era.
Tvm: end-to-end compilation stack for deep learning
Chen, T., Moreau, T., Jiang, Z., Shen, H., Yan, E., Wang, L., Hu, Y., Ceze, L., Guestrin, C., and Krishnamurthy, A · 2018
Cited alongside, same era.
Intel ngraph: An intermediate representation, compiler, and executor for deep learning
Cyphers, S., Bansal, A. K., Bhiwandiwalla, A., Bobba, J., Brookhart, M., Chakraborty, A., Constable, W., Convey, C., Cook, L., Kanawi, O., Kimball, R., Knight, J., Korovaiko, N., Kumar, V., Lao, Y., Lishka, C. R., Menon, J., Myers, J., Narayana, S. A., Procter, A., and Webb, T. J · 2018
Cited alongside, same era.
Automatic full compilation of julia programs and ml models to cloud tpus, 2018
Fischer, K. and Saba, E · 2018
Cited alongside, same era.
Closest in time.
First-class automatic differentition in swift
Wei, R · 2018
Closest in time.
Swift for TensorFlow
Wei, R., Zheng, D., et al · 2018
Closest in time.