Rethinking Diverse Human Preference Learning through Principal Component Analysis

Rank analysis of incomplete block designs: I. the method of paired comparisons

Ralph Allan Bradley and Milton E Terry. 1952 · 1952

Earlier work this paper cites.

Rank analysis of incomplete block designs: A method of paired comparisons employing unequal repetitions on pairs

Otto Dykstra. 1960 · 1960

Earlier work this paper cites.

Response surface fitting using a generalization of the bradley-terry paired comparison model

A Springall. 1973 · 1973

Earlier work this paper cites.

Random indexing of text samples for latent semantic analysis

Pentii Kanerva, Jan Kristoferson, and Anders Holst. 2000 · 2000

Earlier work this paper cites.

Incremental learning for robust visual tracking

David A Ross, Jongwoo Lim, Ruei-Sung Lin, and Ming-Hsuan Yang. 2008 · 2008

Earlier work this paper cites.

Deep reinforcement learning from human preferences

Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017 · 2017

Earlier work this paper cites.

Deepmdp: Learning continuous latent space models for representation learning

Carles Gelada, Saurabh Kumar, Jacob Buckman, Ofir Nachum, and Marc G Bellemare. 2019 · 2019

Earlier work this paper cites.

Asymptotic theory of sparse bradley–terry model

Ruijian Han, Rougang Ye, Chunxi Tan, and Kani Chen. 2020 · 2020

Earlier work this paper cites.

Learning to summarize with human feedback

Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. 2020 · 2020

Earlier work this paper cites.

Webgpt: Browser-assisted question-answering with human feedback

Original

Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, et al. 2021 · 2021

Earlier work this paper cites.

Training a helpful and harmless assistant with reinforcement learning from human feedback

Original

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, et al. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Ultrafeedback: Boosting language models with high-quality feedback

Original

Ganqu Cui, Lifan Yuan, Ning Ding, Guanming Yao, Wei Zhu, Yuan Ni, Guotong Xie, Zhiyuan Liu, and Maosong Sun. 2023 · 2023

Earlier work this paper cites.

Exploring dimensionality reduction techniques in multilingual transformers

Álvaro Huertas-García, Alejandro Martín, Javier Huertas-Tato, and David Camacho. 2023 · 2023

Earlier work this paper cites.

Personalized soups: Personalized large language model alignment via post-hoc parameter merging

Original

Joel Jang, Seungone Kim, Bill Yuchen Lin, Yizhong Wang, Jack Hessel, Luke Zettlemoyer, Hannaneh Hajishirzi, Yejin Choi, and Prithviraj Ammanabrolu. 2023 · 2023

Earlier work this paper cites.

Llm-blender: Ensembling large language models with pairwise ranking and generative fusion

Original

Dongfu Jiang, Xiang Ren, and Bill Yuchen Lin. 2023 · 2023

Cited alongside, same era.

Epistemic neural networks

Ian Osband, Zheng Wen, Seyed Mohammad Asghari, Vikranth Dwaracherla, Morteza Ibrahimi, Xiuyuan Lu, and Benjamin Van Roy. 2023 · 2023

Cited alongside, same era.

Query-dependent prompt evaluation and optimization with offline inverse rl

Hao Sun, Alihan Hüyük, and Mihaela van der Schaar. 2023 · 2023

Cited alongside, same era.

Gemini: a family of highly capable multimodal models

Original

Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, Katie Millican, et al. 2023 · 2023

Cited alongside, same era.

Chimed-gpt: A chinese medical large language model with full training regime and better alignment to human preferences

Original

Traversing pareto optimal policies: Provably efficient multi-objective reinforcement learning

Original

Shuang Qiu, Dake Zhang, Rui Yang, Boxiang Lyu, and Tong Zhang. 2024 · 2024

Later among the works it cites.

Dmoerm: Recipes of mixture-of-experts for effective reward modeling

Original

Shanghaoran Quan. 2024 · 2024

Later among the works it cites.

Rewarded soups: towards pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards

Alexandre Rame, Guillaume Couairon, Corentin Dancette, Jean-Baptiste Gaya, Mustafa Shukor, Laure Soulier, and Matthieu Cord. 2024 · 2024

Later among the works it cites.

Rethinking bradley-terry models in preference-based reward modeling: Foundations, theory, and alternatives

Original

Hao Sun, Yunyi Shen, and Jean-Francois Ton. 2024 · 2024

Later among the works it cites.

Gemma: Open models based on gemini research and technology