hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices

FPGA-based accelerators of deep learning networks for learning and classification: A review

Original

A. Shawahna, et al · 1901

Earlier work this paper cites.

HAWQ: Hessian aware quantization of neural networks with mixed-precision. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV) . IEEE, 293

Original

Z. Dong, et al · 1905

Earlier work this paper cites.

NeckSense: A multi-sensor necklace for detecting eating activities in free-living conditions

Original

S. Zhang, et al · 1911

Earlier work this paper cites.

A flexible FPGA accelerator for convolutional neural networks. (2019)

Original

K. Majumder et al · 1912

Earlier work this paper cites.

Optimal brain damage. In Advances in Neural Information Processing Systems , D. S. Touretzky (Ed.), Vol. 2. Morgan-Kaufmann, 598

Y. LeCun, et al · 1990

Earlier work this paper cites.

Fast inference of boosted decision trees in FPGAs for particle physics

Original

S. Summers et al · 2002

Earlier work this paper cites.

Benchmarking TinyML Systems: Challenges and Direction. (2020)

Original

C. R. Banbury, et al · 2003

Earlier work this paper cites.

Compressing deep neural networks on FPGAs to binary and ternary precision with hls4ml

Original

J. Ngadiuba, et al · 2003

Earlier work this paper cites.

Comparing rewinding and fine-tuning in neural network pruning. In 8th International Conference on Learning Representations

Original

A. Renda, et al · 2003

Earlier work this paper cites.

Feature selection, L1 vs. L2 regularization, and rotational invariance. In 21st International Conference On Machine Learning (ICML ’04) . ACM, New York, NY, USA, 78

A. Y. Ng. 2004 · 2004

Earlier work this paper cites.

Automatic deep heterogeneous quantization of deep neural networks for ultra low-area, low-latency inference on the edge at particle colliders. (2020)

Original

C. N. Coelho, et al · 2006

Earlier work this paper cites.

Measuring the gap between FPGAs and ASICs

I. Kuon et al · 2006

Earlier work this paper cites.

Distance-weighted graph neural networks on FPGAs for real-time particle reconstruction in high energy physics

Original

Y. Iiyama et al · 2008

Earlier work this paper cites.

Rectified linear units improve restricted Boltzmann machines. In 27th International Conference on International Conference on Machine Learning (ICML’10) . Omnipress, Madison, WI, USA, 807

V. Nair et al · 2010

Earlier work this paper cites.

MNIST handwritten digit database

Y. LeCun et al · 2010

Earlier work this paper cites.

FPGAs-as-a-Service Toolkit (FaaST). In 2020 IEEE/ACM International Workshop on Heterogeneous High-performance Reconfigurable Computing

Original

D. S. Rankin, et al · 2010

Earlier work this paper cites.

Torch7: A Matlab-like environment for machine learning. In BigLearn, NIPS Workshop

R. Collobert, et al · 2011

Earlier work this paper cites.

Deep sparse rectifier neural networks. In 14th International Conference on Artificial Intelligence and Statistics , G. Gordon, et al

X. Glorot, et al · 2011

Earlier work this paper cites.

Improving the speed of neural networks on CPUs. In Deep Learning and Unsupervised Feature Learning Workshop at the 25th Conference on Neural Information Processing Systems

V. Vanhoucke, et al · 2011

Earlier work this paper cites.

Mix and Match: A novel FPGA-centric deep neural network quantization framework. In 27th IEEE International Symposium on High-Performance Computer Architecture (HPCA)

Original

S.-E. Chang, et al · 2012

Earlier work this paper cites.

1.1 Computing’s energy problem (and what we can do about it). In 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC) . IEEE, 10

M. Horowitz. 2014 · 2014

Earlier work this paper cites.

Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the 22nd ACM International Conference on Multimedia . ACM, New York, NY, USA, 675

Original

Y. Jia, et al · 2014

Earlier work this paper cites.

Compressing deep convolutional networks using vector quantization. (2014)

Original

Y. Gong, et al · 2014

Earlier work this paper cites.

A survey and evaluation of FPGA high-level synthesis tools

R. Nane, et al · 2015

Earlier work this paper cites.

TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems

Original

M. Abadi, et al · 2015

Earlier work this paper cites.

Batch normalization: Accelerating deep network training by reducing internal covariate shift. In 32nd International Conference on Machine Learning , F. Bach et al

Original

S. Ioffe et al · 2015

Earlier work this paper cites.

Deep Learning with Limited Numerical Precision. In 32nd International Conference on Machine Learning , F. Bach et al

Original

S. Gupta, et al · 2015

Earlier work this paper cites.

BinaryConnect: Training deep neural networks with binary weights during propagations. In Advances in Neural Information Processing Systems , C. Cortes, et al

Original

M. Courbariaux, et al · 2015

Cited alongside, same era.

Learning both weights and connections for efficient neural networks. In Advances in Neural Information Processing Systems , C. Cortes, et al

Original

S. Han, et al · 2015

Cited alongside, same era.

fpgaConvNet: A framework for mapping convolutional neural networks on FPGAs. In 2016 IEEE 24th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) . IEEE, 40

S. I. Venieris et al · 2016

Cited alongside, same era.

From high-level deep neural models to FPGAs. In 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) . IEEE, 1

H. Sharma, et al · 2016

Cited alongside, same era.

The importance of calorimetry for highly-boosted jet substructure

Original

E. Coleman, et al · 2018

Later among the works it cites.

Quantized neural networks: Training neural networks with low precision weights and activations

Original

I. Hubara, et al · 2018

Later among the works it cites.

Learning sparse neural networks through L 0 L_{0} regularization. In 6th International Conference on Learning Representations

Original

C. Louizos, et al · 2018

Later among the works it cites.

UNIQ: Uniform noise injection for the quantization of neural networks. (2018)

Original

C. Baskin, et al · 2018

Later among the works it cites.

7 Series DSP48E1 slice user guide

Xilinx. 2018 · 2018