Accelerating Diffusion LLMs via Adaptive Parallel Decoding

Bonferroni inequalities

Janos Galambos · 1977

Earlier work this paper cites.

Products of experts

Geoffrey E Hinton · 1999

Earlier work this paper cites.

Approximation algorithms for classification problems with pairwise relationships: Metric labeling and markov random fields

Jon Kleinberg and Eva Tardos · 2002

Earlier work this paper cites.

Visualizing the pareto frontier

Alexander V Lotov and Kaisa Miettinen · 2008

Earlier work this paper cites.

Deep unsupervised learning using nonequilibrium thermodynamics

Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015

Earlier work this paper cites.

Categorical reparameterization with gumbel-softmax

Original

Eric Jang, Shixiang Gu, and Ben Poole · 2016

Earlier work this paper cites.

Semi-autoregressive neural machine translation, 2018

Chunqi Wang, Ji Zhang, and Haiqing Chen · 2018

Earlier work this paper cites.

Mask-predict: Parallel decoding of conditional masked language models

Original

Marjan Ghazvininejad, Omer Levy, Yinhan Liu, and Luke Zettlemoyer · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019

Earlier work this paper cites.

Scaling laws for neural language models

Original

Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei · 2020

Earlier work this paper cites.

Evaluating large language models trained on code

Original

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al · 2021

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman · 2021

Earlier work this paper cites.

Measuring mathematical problem solving with the math dataset

Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt · 2021

Earlier work this paper cites.

Efficiently scaling transformer inference, 2022

Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Anselm Levskaya, Jonathan Heek, Kefan Xiao, Shivani Agrawal, and Jeff Dean · 2022

Earlier work this paper cites.

Accelerating large language model decoding with speculative sampling

Original

Charlie Chen, Sebastian Borgeaud, Geoffrey Irving, Jean-Baptiste Lespiau, Laurent Sifre, and John Jumper · 2023

Earlier work this paper cites.

The case for 4-bit precision: k-bit inference scaling laws

Tim Dettmers and Luke Zettlemoyer · 2023

Cited alongside, same era.

Fast inference from transformers via speculative decoding

Yaniv Leviathan, Matan Kalman, and Yossi Matias · 2023

Cited alongside, same era.

Discrete diffusion language modeling by estimating the ratios of the data distribution

Aaron Lou, Chenlin Meng, and Stefano Ermon · 2023

Cited alongside, same era.

Gpqa: A graduate-level google-proof qa benchmark, 2023

David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman · 2023

Cited alongside, same era.

Parallel sampling via counting

Nima Anari, Ruiquan Gao, and Aviad Rubinstein · 2024

Cited alongside, same era.

Medusa: Simple llm inference acceleration framework with multiple decoding heads

Original

DynaMo: Accelerating language model inference with dynamic multi-token sampling

Shikhar Tuli, Chi-Heng Lin, Yen-Chang Hsu, Niraj Jha, Yilin Shen, and Hongxia Jin · 2024

Later among the works it cites.

Qwen2. 5 technical report

Original

An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, et al · 2024

Later among the works it cites.

A survey on efficient inference for large language models, 2024

Zixuan Zhou, Xuefei Ning, Ke Hong, Tianyu Fu, Jiaming Xu, Shiyao Li, Yuming Lou, Luning Wang, Zhihang Yuan, Xiuhong Li, Shengen Yan, Guohao Dai, Xiao-Ping Zhang, Yuhan Dong, and Yu Wang · 2024

Later among the works it cites.

Block diffusion: Interpolating between autoregressive and diffusion language models

Original

Marianne Arriola, Aaron Gokaslan, Justin T Chiu, Zhihan Yang, Zhixuan Qi, Jiaqi Han, Subham Sekhar Sahoo, and Volodymyr Kuleshov · 2025

Closest in time.

Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning