Inference Performance Optimization for Large Language Models on CPUs

Attention is all you need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I · 2017

Earlier work this paper cites.

Flashattention: Fast and memory-efficient exact attention with io-awareness

Dao, T., Fu, D., Ermon, S., Rudra, A., and Ré, C · 2022

Earlier work this paper cites.

Opt: Open pre-trained transformer language models

Original

Zhang, S., Roller, S., Goyal, N., Artetxe, M., Chen, M., Chen, S., Dewan, C., Diab, M., Li, X., Lin, X. V., et al · 2022

Earlier work this paper cites.

Qwen technical report

Original

Bai, J., Bai, S., Chu, Y., Cui, Z., Dang, K., Deng, X., Fan, Y., Ge, W., Han, Y., Huang, F., et al · 2023

Earlier work this paper cites.

Lost in the middle: How language models use long contexts

Original

Liu, N. F., Lin, K., Hewitt, J., Paranjape, A., Bevilacqua, M., Petroni, F., and Liang, P · 2023

Cited alongside, same era.

Large language models in medicine

Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., and Ting, D. S. W · 2023

Cited alongside, same era.

Llama 2: Open foundation and fine-tuned chat models

Original

Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al · 2023

Cited alongside, same era.

A brief overview of chatgpt: The history, status quo and potential future development

Wu, T., He, S., Liu, J., Sun, S., Liu, K., Han, Q.-L., and Tang, Y · 2023

Cited alongside, same era.

Baichuan 2: Open large-scale language models

Original

Yang, A., Xiao, B., Wang, B., Zhang, B., Bian, C., Yin, C., Lv, C., Pan, D., Wang, D., Yan, D., et al · 2023

Later among the works it cites.

A survey of large language models

Original

Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al · 2023

Later among the works it cites.

Intrinsics guide, 2024

Intel, R · 2024

Closest in time.