GPT4AIGChip: Towards Next-Generation AI Accelerator Design Automation via Large Language Models

B. L. Miller et al. , “Genetic algorithms, tournament selection, and the effects of noise,” Complex systems , vol. 9, no. 3, pp. 193–212, 1995

1995

Earlier work this paper cites.

Y. Wang et al. , “Deepburning: Automatic generation of fpga-based learning accelerators for the neural network family,” ser. DAC ’16. New York, NY, USA: Association for Computing Machinery, 2016. [Online]. Available: https://doi.org/10.1145/2897937.2898003

2016

Earlier work this paper cites.

Y. Guan et al. , “FP-DNN: An automated framework for mapping deep neural networks onto FPGAs with RTL-HLS hybrid templates,” in 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) . IEEE, 2017, pp. 152–159

2017

Earlier work this paper cites.

J. Devlin et al. , “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805 , 2018

Original

2018

Earlier work this paper cites.

B. Khailany et al. , “A modular digital vlsi flow for high-productivity soc design,” in Proceedings of the 55th Annual Design Automation Conference , 2018, pp. 1–6

2018

Earlier work this paper cites.

A. Radford et al. , “Improving language understanding by generative pre-training,” 2018

2018

Earlier work this paper cites.

X. Zhang et al. , “DNNBuilder: an automated tool for building high-performance DNN hardware accelerators for FPGAs,” in Proceedings of the International Conference on Computer-Aided Design . ACM, 2018, p. 56

2018

Earlier work this paper cites.

A. Radford et al. , “Language models are unsupervised multitask learners,” OpenAI blog , vol. 1, no. 8, p. 9, 2019

2019

Earlier work this paper cites.

E. Real et al. , “Regularized evolution for image classifier architecture search,” in Proceedings of the aaai conference on artificial intelligence , vol. 33, no. 01, 2019, pp. 4780–4789

2019

Earlier work this paper cites.

R. Venkatesan et al. , “Magnet: A modular accelerator generator for neural networks,” in 2019 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) . IEEE, 2019, pp. 1–8

2019

Earlier work this paper cites.

Y. Zhang et al. , “Dialogpt: Large-scale generative pre-training for conversational response generation,” arXiv preprint arXiv:1911.00536 , 2019

Original

2019

Earlier work this paper cites.

T. Brown et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020

2020

Earlier work this paper cites.

L. Floridi and M. Chiriatti, “Gpt-3: Its nature, scope, limits, and consequences,” Minds and Machines , vol. 30, pp. 681–694, 2020

2020

Earlier work this paper cites.

S. Liang et al. , “Deepburning-gl: an automated framework for generating graph neural network accelerators,” in ICCAD , 2020

2020

Earlier work this paper cites.

C. Raffel et al. , “Exploring the limits of transfer learning with a unified text-to-text transformer,” The Journal of Machine Learning Research , vol. 21, no. 1, pp. 5485–5551, 2020

2020

Earlier work this paper cites.

P. Xu et al. , “AutoDNNchip: An automated dnn chip predictor and builder for both FPGAs and ASICs,” The 2020 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays , Feb 2020. [Online]. Available: http://dx.doi.org/10.1145/3373087.3375306

2020

Earlier work this paper cites.

X. Zhang et al. , “Skynet: a hardware-efficient method for object detection and tracking on embedded systems,” Proceedings of Machine Learning and Systems , vol. 2, pp. 216–229, 2020

2020

Earlier work this paper cites.

M. Chen et al. , “Evaluating large language models trained on code,” arXiv preprint arXiv:2107.03374 , 2021

Original

2021

Cited alongside, same era.

Y. Fu et al. , “Auto-nba: Efficient and effective search over the joint space of networks, bitwidths, and accelerators,” in International Conference on Machine Learning . PMLR, 2021, pp. 3505–3517

2021

Cited alongside, same era.

R. Garg et al. , “A taxonomy for classification and comparison of dataflows for gnn accelerators,” arXiv preprint arXiv:2103.07977 , 2021

Original

2021

Cited alongside, same era.

L. Jia et al. , “Tensorlib: A spatial accelerator generation framework for tensor algebra,” in 2021 58th ACM/IEEE Design Automation Conference (DAC) . IEEE, 2021, pp. 865–870

2021

Cited alongside, same era.

J. Liu et al. , “What makes good in-context examples for gpt- 3 3 ?” arXiv preprint arXiv:2101.06804 , 2021

X. Wang et al. , “Code4struct: Code generation for few-shot structured prediction from natural language,” arXiv preprint arXiv:2210.12810 , 2022

Original

2022

Later among the works it cites.

S. Zhang et al. , “Opt: Open pre-trained transformer language models,” arXiv preprint arXiv:2205.01068 , 2022

Original

2022

Later among the works it cites.

Y. Zhang et al. , “Active example selection for in-context learning,” arXiv preprint arXiv:2211.04486 , 2022

Original

2022

Later among the works it cites.

“Ds891-zynq-ultrascale-plus-overview,” https://docs.xilinx.com/v/u/en-US/ds891-zynq-ultrascale-plus-overview, (Accessed on 02/21/2023)

2023

Closest in time.

B. Ahmad et al. , “Fixing hardware security bugs with large language models,” arXiv preprint arXiv:2302.01215 , 2023