TongGu: Mastering Classical Chinese Understanding with Knowledge-Grounded Large Language Models

Language models are few-shot learners

Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Punctuation as implicit annotations for chinese word segmentation

Zhongguo Li and Maosong Sun. 2009 · 2009

Earlier work this paper cites.

CNN-BiLSTM-CRF model for term extraction in Chinese corpus

Xiaowei Han, Lizhen Xu, and Feng Qiao. 2018 · 2018

Earlier work this paper cites.

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018 · 2018

Earlier work this paper cites.

Daizhigev20

Garychowcmu. 2019 · 2019

Earlier work this paper cites.

Retrieval augmented language model pre-training

Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. 2020 · 2020

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive NLP tasks

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020 · 2020

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020

Earlier work this paper cites.

BERT-based named entity recognition in Chinese Twenty-Four Histories

Peng Yu and Xin Wang. 2020 · 2020

Earlier work this paper cites.

Time-Aware ancient Chinese text translation and inference

Ernie Chang, Yow-Ting Shiue, Hui-Syuan Yeh, and Vera Demberg. 2021 · 2021

Earlier work this paper cites.

Improving language models by retrieving from trillions of tokens

Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George Bm Van Den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, et al. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Gray, et al. 2022 · 2022

Cited alongside, same era.

OPT: Open pre-trained transformer language models

Original

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al. 2022 · 2022

Cited alongside, same era.

Baichuan 2: Open large-scale language models

Original

Baichuan. 2023 · 2023

Cited alongside, same era.

SikuGPT: A generative pre-trained model for intelligent information processing of ancient texts from the perspective of digital humanities

Original

Liu Chang, Wang Dongbo, Zhao Zhixiao, Hu Die, Wu Mengcheng, Lin Litao, Shen Si, Li Bin, Liu Jiangfeng, Zhang Hai, et al. 2023 · 2023

Cited alongside, same era.

PALM: Scaling language modeling with pathways

ShareGPT-Chinese-English-90k bilingual human-machine qa dataset

shareAI. 2023 · 2023

Later among the works it cites.

Redpajama: An open source recipe to reproduce llama training dataset

Together Computer. 2023 · 2023

Later among the works it cites.

GujiBERT and GujiGPT: Construction of intelligent information processing foundation language models for ancient texts

Original

Dongbo Wang, Chang Liu, Zhixiao Zhao, Si Shen, Liu Liu, Bin Li, Haotian Hu, Mengcheng Wu, Litao Lin, Xue Zhao, et al. 2023 · 2023

Later among the works it cites.

Bloom-7B-chunhua

Wptoux. 2023 · 2023

Later among the works it cites.

PMC-LLaMA: Further finetuning LLaMA on medical papers

Original

Chaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang, and Weidi Xie. 2023 · 2023

Later among the works it cites.