CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Scaling laws for neural language models

Original

Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. 2020 · 2001

Earlier work this paper cites.

Contrastive decoding: Open-ended text generation as optimization

Original

Xiang Lisa Li, Ari Holtzman, Daniel Fried, Percy Liang, Jason Eisner, Tatsunori Hashimoto, Luke Zettlemoyer, and Mike Lewis. 2022 · 2022

Earlier work this paper cites.

Same author or just same topic? towards content-independent style representations

Anna Wegmann, Marijn Schraagen, and Dong Nguyen. 2022 · 2022

Earlier work this paper cites.

TextFusion: Privacy-preserving pre-trained model inference via token fusion

Xin Zhou, Jinzhu Lu, Tao Gui, Ruotian Ma, Zichu Fei, Yuran Wang, Yong Ding, Yibo Cheung, Qi Zhang, and Xuanjing Huang. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al. 2023 · 2023

Earlier work this paper cites.

Sparks of artificial general intelligence: Early experiments with gpt-4

Original

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023 · 2023

Earlier work this paper cites.

A survey on evaluation of large language models

Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, et al. 2023 · 2023

Earlier work this paper cites.

A customized text sanitization mechanism with differential privacy

Sai Chen, Fengran Mo, Yanhao Wang, Cen Chen, Jian-Yun Nie, Chengyu Wang, and Jamie Cui. 2023b · 2023

Earlier work this paper cites.

Ultrafeedback: Boosting language models with high-quality feedback

Original

Ganqu Cui, Lifan Yuan, Ning Ding, Guanming Yao, Wei Zhu, Yuan Ni, Guotong Xie, Zhiyuan Liu, and Maosong Sun. 2023 · 2023

Earlier work this paper cites.

Challenges towards the next frontier in privacy

Original

Rachel Cummings, Damien Desfontaines, David Evans, Roxana Geambasu, Matthew Jagielski, Yangsibo Huang, Peter Kairouz, Gautam Kamath, Sewoong Oh, Olga Ohrimenko, et al. 2023 · 2023

Earlier work this paper cites.

Enhancing chat language models by scaling high-quality instructional conversations

Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Shengding Hu, Zhiyuan Liu, Maosong Sun, and Bowen Zhou. 2023 · 2023

Earlier work this paper cites.

On the creativity of large language models

Original

Giorgio Franceschelli and Mirco Musolesi. 2023 · 2023

Earlier work this paper cites.

Specializing smaller language models towards multi-step reasoning

Yao Fu, Hao Peng, Litu Ou, Ashish Sabharwal, and Tushar Khot. 2023 · 2023

Earlier work this paper cites.

Retrieval-augmented generation for large language models: A survey

Original

Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, and Haofen Wang. 2023 · 2023

Earlier work this paper cites.

Textbooks are all you need

Original

Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, et al. 2023 · 2023

Earlier work this paper cites.

Artificial muses: Generative artificial intelligence chatbots have risen to human-level creativity

Original

Jennifer Haase and Paul HP Hanel. 2023 · 2023

Earlier work this paper cites.

Mistral 7b

Original

Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. 2023 · 2023

Cited alongside, same era.

Swe-bench: Can language models resolve real-world github issues?

Original

Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan. 2023 · 2023

Cited alongside, same era.

Protecting user privacy in remote conversational systems: A privacy-preserving framework based on text sanitization

Original

Zhigang Kan, Linbo Qiao, Hao Yu, Liwen Peng, Yifu Gao, and Dongsheng Li. 2023 · 2023

Cited alongside, same era.

Fast inference from transformers via speculative decoding

Yaniv Leviathan, Matan Kalman, and Yossi Matias. 2023 · 2023

Cited alongside, same era.

Trustworthy llms: a survey and guideline for evaluating large language models’ alignment

System 2 attention (is something you might need too)

Original

Jason Weston and Sainbayar Sukhbaatar. 2023 · 2023

Later among the works it cites.

Privacy-preserving in-context learning for large language models

Tong Wu, Ashwinee Panda, Jiachen T Wang, and Prateek Mittal. 2023 · 2023

Later among the works it cites.

Offsite-tuning: Transfer learning without full model

Original

Guangxuan Xiao, Ji Lin, and Song Han. 2023 · 2023

Later among the works it cites.

A survey on large language model (llm) security and privacy: The good, the bad, and the ugly

Original

Yifan Yao, Jinhao Duan, Kaidi Xu, Yuanfang Cai, Eric Sun, and Yue Zhang. 2023 · 2023

Later among the works it cites.

CRaSh: Clustering, removing, and sharing enhance fine-tuning without full large language model

Kaiyan Zhang, Ning Ding, Biqing Qi, Xuekai Zhu, Xinwei Long, and Bowen Zhou. 2023c · 2023