Real-World Offline Reinforcement Learning from Vision Language Model Feedback

R. A. Bradley and M. E. Terry, “Rank analysis of incomplete block designs: I. the method of paired comparisons,” Biometrika

1952

Earlier work this paper cites.

A. G. Barto, R. S. Sutton, and C. W. Anderson, “Neuronlike adaptive elements that can solve difficult learning control problems,” IEEE Transactions on Systems, Man, and Cybernetics

1983

Earlier work this paper cites.

D. A. Pomerleau, “Efficient Training of Artificial Neural Networks for Autonomous Navigation,” Neural Computation

1991

Earlier work this paper cites.

S. Russell, “Learning agents for uncertain environments (extended abstract),” in Proceedings of the Eleventh Annual Conference on Computational Learning Theory

1998

Earlier work this paper cites.

A. Y. Ng and S. J. Russell, “Algorithms for inverse reinforcement learning,” in Proceedings of the Seventeenth International Conference on Machine Learning

2000

Earlier work this paper cites.

B. D. Ziebart, A. L. Maas, J. A. Bagnell, A. K. Dey, et al

2008

Earlier work this paper cites.

J. Ho and S. Ermon, “Generative adversarial imitation learning,” Advances in neural information processing systems

2016

Earlier work this paper cites.

C. Finn, S. Levine, and P. Abbeel, “Guided cost learning: Deep inverse optimal control via policy optimization,” in International conference on machine learning

2016

Earlier work this paper cites.

C. Finn, P. Christiano, P. Abbeel, and S. Levine, “A connection between generative adversarial networks, inverse reinforcement learning, and energy-based models,” arXiv preprint arXiv:1611.03852

Original

2016

Earlier work this paper cites.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition

2016

Earlier work this paper cites.

J. Fu, K. Luo, and S. Levine, “Learning robust rewards with adversarial inverse reinforcement learning,” arXiv preprint arXiv:1710.11248

Original

2017

Earlier work this paper cites.

C. R. Qi, L. Yi, H. Su, and L. J. Guibas, “Pointnet++: Deep hierarchical feature learning on point sets in a metric space,” Advances in neural information processing systems

2017

Earlier work this paper cites.

P. Henderson, R. Islam, P. Bachman, J. Pineau, D. Precup, and D. Meger, “Deep reinforcement learning that matters,” in Proceedings of the AAAI conference on artificial intelligence

2018

Earlier work this paper cites.

The MIT Press, second ed., 2018

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction · 2018

Earlier work this paper cites.

X. B. Peng, A. Kumar, G. Zhang, and S. Levine, “Advantage-weighted regression: Simple and scalable off-policy reinforcement learning,” arXiv preprint arXiv:1910.00177

Original

2019

Earlier work this paper cites.

A. Kumar, A. Zhou, G. Tucker, and S. Levine, “Conservative q-learning for offline reinforcement learning,” Advances in Neural Information Processing Systems

2020

Cited alongside, same era.

S. Levine, A. Kumar, G. Tucker, and J. Fu, “Offline reinforcement learning: Tutorial, review, and perspectives on open problems,” arXiv preprint arXiv:2005.01643

Original

2020

Cited alongside, same era.

J. Fu, A. Kumar, O. Nachum, G. Tucker, and S. Levine, “D4rl: Datasets for deep data-driven reinforcement learning,” arXiv preprint arXiv:2004.07219

Original

2020

Cited alongside, same era.

I. Kostrikov, A. Nair, and S. Levine, “Offline reinforcement learning with implicit q-learning,” 2021

2021

Cited alongside, same era.

S. Fujimoto and S. S. Gu, “A minimalist approach to offline reinforcement learning,” Advances in neural information processing systems

M. Klissarov, P. D’Oro, S. Sodhani, R. Raileanu, P.-L. Bacon, P. Vincent, A. Zhang, and M. Henaff, “Motif: Intrinsic motivation from artificial intelligence feedback,” arXiv preprint arXiv:2310.00166

Original

2023

Later among the works it cites.

J. Rocamonde, V. Montesinos, E. Nava, E. Perez, and D. Lindner, “Vision-language models are zero-shot reward models for reinforcement learning,” arXiv preprint arXiv:2310.12921

Original

2023

Later among the works it cites.

Y. J. Ma, V. Kumar, A. Zhang, O. Bastani, and D. Jayaraman, “Liv: Language-image representations and rewards for robotic control,” in International Conference on Machine Learning

2023

Later among the works it cites.

C. Chi, S. Feng, Y. Du, Z. Xu, E. Cousineau, B. Burchfiel, and S. Song, “Diffusion policy: Visuomotor policy learning via action diffusion,” arXiv preprint arXiv:2303.04137

Original

2023

Later among the works it cites.