Dynamic-Width Speculative Beam Decoding for Efficient LLM Inference

The state of sparsity in deep neural networks

Original

Gale, T.; Elsen, E.; and Hooker, S. 2019 · 1902

Earlier work this paper cites.

Mask-predict: Parallel decoding of conditional masked language models

Original

Ghazvininejad, M.; Levy, O.; Liu, Y.; and Zettlemoyer, L. 2019 · 1904

Earlier work this paper cites.

Tree structured analysis on GPU power study

Chen, J.; Li, B.; Zhang, Y.; Peng, L.; and Peir, J.-k. 2011 · 2011

Earlier work this paper cites.

Distilling the knowledge in a neural network

Original

Hinton, G.; Vinyals, O.; and Dean, J. 2015 · 2015

Earlier work this paper cites.

Characterizing power and performance of gpu memory access

Allen, T.; and Ge, R. 2016 · 2016

Earlier work this paper cites.

Non-autoregressive neural machine translation

Original

Gu, J.; Bradbury, J.; Xiong, C.; Li, V. O.; and Socher, R. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, Ł.; and Polosukhin, I. 2017 · 2017

Earlier work this paper cites.

Deterministic non-autoregressive neural sequence modeling by iterative refinement

Original

Lee, J.; Mansimov, E.; and Cho, K. 2018 · 2018

Earlier work this paper cites.

Know what you don’t know: Unanswerable questions for SQuAD

Original

Rajpurkar, P.; Jia, R.; and Liang, P. 2018 · 2018

Earlier work this paper cites.

Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task

Original

Yu, T.; Zhang, R.; Yang, K.; Yasunaga, M.; Wang, D.; Li, Z.; Ma, J.; Li, I.; Yao, Q.; Roman, S.; et al. 2018 · 2018

Earlier work this paper cites.

Fast structured decoding for sequence models

Sun, Z.; Li, Z.; Wang, H.; He, D.; Lin, Z.; and Deng, Z. 2019 · 2019

Earlier work this paper cites.

Non-autoregressive machine translation with auxiliary regularization

Wang, Y.; Tian, F.; He, D.; Qin, T.; Zhai, C.; and Liu, T.-Y. 2019 · 2019

Earlier work this paper cites.

Jointly masked sequence-to-sequence model for non-autoregressive neural machine translation

Guo, J.; Xu, L.; and Chen, E. 2020 · 2020

Earlier work this paper cites.

Movement pruning: Adaptive sparsity by fine-tuning

Sanh, V.; Wolf, T.; and Rush, A. 2020 · 2020

Cited alongside, same era.

Gptq: Accurate post-training quantization for generative pre-trained transformers

Original

Frantar, E.; Ashkboos, S.; Hoefler, T.; and Alistarh, D. 2022 · 2022

Cited alongside, same era.

Opt: Open pre-trained transformer language models

Original

Zhang, S.; Roller, S.; Goyal, N.; Artetxe, M.; Chen, M.; Chen, S.; Dewan, C.; Diab, M.; Li, X.; Lin, X. V.; et al. 2022 · 2022

Cited alongside, same era.

Gpt-4 technical report

Original

Achiam, J.; Adler, S.; Agarwal, S.; Ahmad, L.; Akkaya, I.; Aleman, F. L.; Almeida, D.; Altenschmidt, J.; Altman, S.; Anadkat, S.; et al. 2023 · 2023

Cited alongside, same era.

Palm 2 technical report

Original

Spectr: Fast speculative decoding via optimal transport

Original

Sun, Z.; Suresh, A. T.; Ro, J. H.; Beirami, A.; Jain, H.; and Yu, F. 2023 · 2023

Later among the works it cites.

Llama: Open and efficient foundation language models

Original

Touvron, H.; Lavril, T.; Izacard, G.; Martinet, X.; Lachaux, M.-A.; Lacroix, T.; Rozière, B.; Goyal, N.; Hambro, E.; Azhar, F.; et al. 2023 · 2023

Later among the works it cites.

Part-time Power Measurements: nvidia-smi’s Lack of Attention

Original

Yang, Z.; Adamek, K.; and Armour, W. 2023 · 2023

Later among the works it cites.

Judging llm-as-a-judge with mt-bench and chatbot arena

Zheng, L.; Chiang, W.-L.; Sheng, Y.; Zhuang, S.; Wu, Z.; Zhuang, Y.; Lin, Z.; Li, Z.; Li, D.; Xing, E.; et al. 2023 · 2023

Later among the works it cites.

Llama 3 Model Card

AI@Meta. 2024 · 2024

Closest in time.