Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMs

Language models are few-shot learners

Brown, T.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J. D.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; et al. 2020 · 1901

Earlier work this paper cites.

Gender bias in contextualized word embeddings

Original

Zhao, J.; Wang, T.; Yatskar, M.; Cotterell, R.; Ordonez, V.; and Chang, K.-W. 2019 · 1904

Earlier work this paper cites.

Mitigating gender bias in natural language processing: Literature review

Original

Sun, T.; Gaut, A.; Tang, S.; Huang, Y.; ElSherief, M.; Zhao, J.; Mirza, D.; Belding, E.; Chang, K.-W.; and Wang, W. Y. 2019 · 1906

Earlier work this paper cites.

Fine-tuning language models from human preferences

Original

Ziegler, D. M.; Stiennon, N.; Wu, J.; Brown, T. B.; Radford, A.; Amodei, D.; Christiano, P.; and Irving, G. 2019 · 1909

Earlier work this paper cites.

Language (technology) is power: A critical survey of" bias" in nlp

Original

Blodgett, S. L.; Barocas, S.; Daumé III, H.; and Wallach, H. 2020 · 2005

Earlier work this paper cites.

Reinforcement learning from simultaneous human and MDP reward

Knox, W. B.; and Stone, P. 2012 · 2012

Earlier work this paper cites.

Guided Policy Search

Levine, S.; and Koltun, V. 2013 · 2013

Earlier work this paper cites.

Man is to computer programmer as woman is to homemaker? debiasing word embeddings

Bolukbasi, T.; Chang, K.-W.; Zou, J. Y.; Saligrama, V.; and Kalai, A. T. 2016 · 2016

Earlier work this paper cites.

Learning to Learn from Weak Supervision by Full Supervision

Original

Dehghani, M.; Severyn, A.; Rothe, S.; and Kamps, J. 2017 · 2017

Earlier work this paper cites.

Proximal policy optimization algorithms

Original

Schulman, J.; Wolski, F.; Dhariwal, P.; Radford, A.; and Klimov, O. 2017 · 2017

Earlier work this paper cites.

Legal summarization for multi-role debate dialogue via controversy focus mining and multi-task learning

Duan, X.; Zhang, Y.; Yuan, L.; Zhou, X.; Liu, X.; Wang, T.; Wang, R.; Zhang, Q.; Sun, C.; and Wu, F. 2019 · 2019

Earlier work this paper cites.

Towards the systematic reporting of the energy and carbon footprints of machine learning

Henderson, P.; Hu, J.; Romoff, J.; Brunskill, E.; Jurafsky, D.; and Pineau, J. 2020 · 2020

Earlier work this paper cites.

Learning to summarize from human feedback

Stiennon, N.; Ouyang, L.; Wu, J.; Ziegler, D.; Lowe, R.; Voss, C.; Radford, A.; Amodei, D.; and Christiano, P. 2020 · 2020

Earlier work this paper cites.

Group multi-role assignment with conflicting roles and agents

Zhu, H. 2020 · 2020

Earlier work this paper cites.

A General Language Assistant as a Laboratory for Alignment

Amanda, A.; Bai, Y.; Chen, A.; Drain, D.; Deep, G.; Tom, H.; Jones, A.; Joseph, N.; Mann, B.; DasSarma, N.; Nelson, E.; Zac, H.-D.; Hernandez, D.; Kernion, J.; Kamal, N.; Olsson, C.; Amodei, D.; Brown, T.; Clark, J.; Sam, M.; Olah, C.; and Kaplan, J. 2021 · 2021

Earlier work this paper cites.

On the dangers of stochastic parrots: Can language models be too big?

Bender, E. M.; Gebru, T.; McMillan-Major, A.; and Shmitchell, S. 2021 · 2021

Earlier work this paper cites.

Large image datasets: A pyrrhic win for computer vision?

Birhane, A.; and Prabhu, V. U. 2021 · 2021

Earlier work this paper cites.

Constitutional ai: Harmlessness from ai feedback

Original

Bai, Y.; Kadavath, S.; Kundu, S.; Askell, A.; Kernion, J.; Jones, A.; Chen, A.; Goldie, A.; Mirhoseini, A.; McKinnon, C.; et al. 2022 · 2022

Cited alongside, same era.

Large language models can self-improve

Original

Huang, J.; Gu, S. S.; Hou, L.; Wu, Y.; Wang, X.; Yu, H.; and Han, J. 2022 · 2022

Cited alongside, same era.

Training language models to follow instructions with human feedback

Ouyang, L.; Wu, J.; Jiang, X.; Almeida, D.; Wainwright, C.; Mishkin, P.; Zhang, C.; Agarwal, S.; Slama, K.; Ray, A.; et al. 2022 · 2022

Cited alongside, same era.

Chain-of-thought prompting elicits reasoning in large language models

Wei, J.; Wang, X.; Schuurmans, D.; Bosma, M.; Xia, F.; Chi, E.; Le, Q. V.; Zhou, D.; et al. 2022 · 2022

Cited alongside, same era.

Fairness reprogramming

Zhang, G.; Zhang, Y.; Zhang, Y.; Fan, W.; Li, Q.; Liu, S.; and Chang, S. 2022 · 2022

Cited alongside, same era.

Evaluating and mitigating discrimination in language model decisions

Original

Tamkin, A.; Askell, A.; Lovitt, L.; Durmus, E.; Joseph, N.; Kravec, S.; Nguyen, K.; Kaplan, J.; and Ganguli, D. 2023 · 2023

Later among the works it cites.

Can Large Language Models Really Improve by Self-critiquing Their Own Plans?

Original

Valmeekam, K.; Marquez, M.; and Kambhampati, S. 2023 · 2023

Later among the works it cites.

The rise and potential of large language model based agents: A survey

Original

Xi, Z.; Chen, W.; Guo, X.; He, W.; Ding, Y.; Hong, B.; Zhang, M.; Wang, J.; Jin, S.; Zhou, E.; et al. 2023 · 2023

Later among the works it cites.

Exploring collaboration mechanisms for llm agents: A social psychology view

Original

Zhang, J.; Xu, X.; and Deng, S. 2023 · 2023

Later among the works it cites.