Can LLM be a Personalized Judge?

Item-based collaborative filtering recommendation algorithms

Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001 · 2001

Earlier work this paper cites.

What is personalization? perspectives on the design and implementation of personalization in information systems

Haiyan Fan and Marshall Scott Poole. 2006 · 2006

Earlier work this paper cites.

User-model based personalized summarization

Alberto Díaz and Pablo Gervás. 2007 · 2007

Earlier work this paper cites.

Summarize what you are interested in: An optimization framework for interactive personalized summarization

Rui Yan, Jian-Yun Nie, and Xiaoming Li. 2011 · 2011

Earlier work this paper cites.

A persona-based neural conversation model

Jiwei Li, Michel Galley, Chris Brockett, Georgios Spithourakis, Jianfeng Gao, and Bill Dolan. 2016 · 2016

Earlier work this paper cites.

Computational Sociolinguistics: A Survey

Dong Nguyen, A. Seza Doğruöz, Carolyn P. Rosé, and Franciska de Jong. 2016 · 2016

Earlier work this paper cites.

Personalizing dialogue agents: I have a dog, do you have pets too?

Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason Weston. 2018 · 2018

Earlier work this paper cites.

Sentence-BERT: Sentence embeddings using Siamese BERT-networks

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

Returning the N to NLP: Towards contextually personalized classification models

Lucie Flek. 2020 · 2020

Earlier work this paper cites.

The curious case of neural text degeneration

Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020 · 2020

Earlier work this paper cites.

Minilm: Deep self-attention distillation for task-agnostic compression of pre-trained transformers

Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, and Ming Zhou. 2020 · 2020

Earlier work this paper cites.

A pre-training based personalized dialogue generation model with persona-sparse data

Yinhe Zheng, Rongsheng Zhang, Minlie Huang, and Xiaoxi Mao. 2020 · 2020

Earlier work this paper cites.

The importance of modeling social factors of language: Theory and practice

Dirk Hovy and Diyi Yang. 2021 · 2021

Earlier work this paper cites.

Towards understanding and mitigating social biases in language models

Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2021 · 2021

Earlier work this paper cites.

BoB: BERT over BERT for training persona-based dialogue models from limited personalized data

Haoyu Song, Yan Wang, Kaiyan Zhang, Wei-Nan Zhang, and Ting Liu. 2021 · 2021

Earlier work this paper cites.

Language models (mostly) know what they know

Original

Saurav Kadavath, Tom Conerly, Amanda Askell, Tom Henighan, Dawn Drain, Ethan Perez, Nicholas Schiefer, Zac Hatfield-Dodds, Nova DasSarma, Eli Tran-Johnson, et al. 2022 · 2022

Earlier work this paper cites.

Quantifying and alleviating political bias in language models

Ruibo Liu, Chenyan Jia, Jason Wei, Guangxuan Xu, and Soroush Vosoughi. 2022 · 2022

Earlier work this paper cites.

Empathic conversations: A multi-level dataset of contextualized conversations

Original

Damilola Omitaomu, Shabnam Tafreshi, Tingting Liu, Sven Buechel, Chris Callison-Burch, Johannes Eichstaedt, Lyle Ungar, and João Sedoc. 2022 · 2022

Cited alongside, same era.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Cited alongside, same era.

Generative language models exhibit social identity biases

Original

Tiancheng Hu, Yara Kyrychenko, Steve Rathje, Nigel Collier, Sander van der Linden, and Jon Roozenbeek. 2023 · 2023

Cited alongside, same era.

Personalized soups: Personalized large language model alignment via post-hoc parameter merging

Original

Joel Jang, Seungone Kim, Bill Yuchen Lin, Yizhong Wang, Jack Hessel, Luke Zettlemoyer, Hannaneh Hajishirzi, Yejin Choi, and Prithviraj Ammanabrolu. 2023 · 2023

Cited alongside, same era.

Social choice for ai alignment: Dealing with diverse human feedback

Original

Vincent Conitzer, Rachel Freedman, Jobst Heitzig, Wesley H Holliday, Bob M Jacobs, Nathan Lambert, Milan Mossé, Eric Pacuit, Stuart Russell, Hailey Schoelkopf, et al. 2024 · 2024

Closest in time.

Alpacafarm: A simulation framework for methods that learn from human feedback

Yann Dubois, Chen Xuechen Li, Rohan Taori, Tianyi Zhang, Ishaan Gulrajani, Jimmy Ba, Carlos Guestrin, Percy S Liang, and Tatsunori B Hashimoto. 2024 · 2024

Closest in time.

Aligning llm agents by learning latent preference from user edits

Original

Ge Gao, Alexey Taymanov, Eduardo Salinas, Paul Mineiro, and Dipendra Misra. 2024 · 2024

Closest in time.

Quantifying the Persona Effect in LLM Simulations

Original

Tiancheng Hu and Nigel Collier. 2024 · 2024

Closest in time.

Prometheus 2: An open source language model specialized in evaluating other language models