AbstractDifferentiation.jl: Backend-Agnostic Differentiable Programming in Julia

Zygote: A differentiable programming system to bridge machine learning and scientific computing

Original

M. Innes, A. Edelman, K. Fischer, C. Rackauckus, E. Saba, V. B. Shah, and W. Tebbutt · 1907

Earlier work this paper cites.

Universal differential equations for scientific machine learning

Original

C. Rackauckas, Y. Ma, J. Martensen, C. Warner, K. Zubov, R. Supekar, D. Skinner, and A. Ramadhan · 2001

Earlier work this paper cites.

Mathoptinterface: a data structure for mathematical optimization problems, 2020

Original

B. Legat, O. Dowson, J. D. Garcia, and M. Lubin · 2002

Earlier work this paper cites.

An interior point algorithm for large-scale nonlinear optimization with applications in process engineering

A. Wachter · 2002

Earlier work this paper cites.

Perturbation confusion and referential transparency: Correct functional implementation of forward-mode AD

J. M. Siskind and B. A. Pearlmutter · 2005

Earlier work this paper cites.

A guide to NumPy , volume 1

T. E. Oliphant · 2006

Earlier work this paper cites.

Julia: A fast dynamic language for technical computing

Original

J. Bezanson, S. Karpinski, V. B. Shah, and A. Edelman · 2012

Earlier work this paper cites.

Convex optimization in Julia

M. Udell, K. Mohan, D. Zeng, J. Hong, S. Diamond, and S. Boyd · 2014

Earlier work this paper cites.

TensorFlow: Large-scale machine learning on heterogeneous systems, 2015

M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viégas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, and X. Zheng · 2015

Earlier work this paper cites.

Theano: A Python framework for fast computation of mathematical expressions

Original

R. Al-Rfou, G. Alain, A. Almahairi, C. Angermueller, D. Bahdanau, N. Ballas, F. Bastien, J. Bayer, A. Belikov, A. Belopolsky, Y. Bengio, A. Bergeron, J. Bergstra, V. Bisson, J. Bleecher Snyder, N. Bouchard, N. Boulanger-Lewandowski, X. Bouthillier, A. de Brébisson, O. Breuleux, P.-L. Carrier, K. Cho, J. Chorowski, P. Christiano, T. Cooijmans, M.-A. Côté, M. Côté, A. Courville, Y. N. Dauphin, O. Delalleau, J. Demouth, G. Desjardins, S. Dieleman, L. Dinh, M. Ducoffe, V. Dumoulin, S. Ebrahimi Kahou, D. Erhan, Z. Fan, O. Firat, M. Germain, X. Glorot, I. Goodfellow, M. Graham, C. Gulcehre, P. Hamel, I. Harlouchet, J.-P. Heng, B. Hidasi, S. Honari, A. Jain, S. Jean, K. Jia, M. Korobov, V. Kulkarni, A. Lamb, P. Lamblin, E. Larsen, C. Laurent, S. Lee, S. Lefrancois, S. Lemieux, N. Léonard, Z. Lin, J. A. Livezey, C. Lorenz, J. Lowin, Q. Ma, P.-A. Manzagol, O. Mastropietro, R. T. McGibbon, R. Memisevic, B. van Merriënboer, V. Michalski, M. Mirza, A. Orlandi, C. Pal, R. Pascanu, M. Pezeshki, C. Raffel, D. Renshaw, M. Rocklin, A. Romero, M. Roth, P. Sadowski, J. Salvatier, F. Savard, J. Schlüter, J. Schulman, G. Schwartz, I. V. Serban, D. Serdyuk, S. Shabanian, E. Simon, S. Spieckermann, S. R. Subramanyam, J. Sygnowski, J. Tanguay, G. van Tulder, J. Turian, S. Urban, P. Vincent, F. Visin, H. de Vries, D. Warde-Farley, D. J. Webb, M. Willson, K. Xu, L. Xue, L. Yao, S. Zhang, and Y. Zhang · 2016

Earlier work this paper cites.

Forward-mode automatic differentiation in julia

Original

J. Revels, M. Lubin, and T. Papamarkou · 2016

Earlier work this paper cites.

Probabilistic programming in python using PyMC3

J. Salvatier, T. V. Wiecki, and C. Fonnesbeck · 2016

Cited alongside, same era.

Jump: A modeling language for mathematical optimization

I. Dunning, J. Huchette, and M. Lubin · 2017

Cited alongside, same era.

Automatic differentiation in pytorch

A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer · 2017

Cited alongside, same era.

End-to-end differentiable learning of protein structure

M. AlQuraishi · 2018

Cited alongside, same era.

Effective extensible programming: Unleashing Julia on GPUs

T. Besard, C. Foket, and B. De Sutter · 2018

Cited alongside, same era.

JAX: composable transformations of Python+NumPy programs, 2018

J. Bradbury, R. Frostig, P. Hawkins, M. J. Johnson, C. Leary, D. Maclaurin, G. Necula, A. Paszke, J. VanderPlas, S. Wanderman-Milne, and Q. Zhang · 2018

Cited alongside, same era.

ReverseDiff.jl, 2018

J. Revels · 2018

Later among the works it cites.

Spnets: Differentiable fluid dynamics for deep neural networks

C. Schenck and D. Fox · 2018

Later among the works it cites.

A benchmark of selected algorithmic differentiation tools on some problems in computer vision and machine learning

F. Srajer, Z. Kukelova, and A. Fitzgibbon · 2018

Later among the works it cites.

Perturbation confusion in forward automatic differentiation of higher-order functions

O. Manzyuk, B. A. Pearlmutter, A. A. Radul, D. R. Rush, and J. M. Siskind · 2019

Later among the works it cites.

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

M. Raissi, P. Perdikaris, and G. E. Karniadakis · 2019

Later among the works it cites.