TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation

E. Perez, F. Strub et al. , “Film: Visual reasoning with a general conditioning layer,” in Proceedings of the AAAI conference on artificial intelligence , vol. 32, no. 1, 2018

2018

Earlier work this paper cites.

J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” Advances in neural information processing systems , vol. 33, pp. 6840–6851, 2020

2020

Earlier work this paper cites.

T. Yu, D. Quillen et al. , “Meta-world: A benchmark and evaluation for multi-task and meta reinforcement learning,” in Conference on robot learning . PMLR, 2020, pp. 1094–1100

2020

Earlier work this paper cites.

S. Toyer, R. Shah, A. Critch, and S. Russell, “The magical benchmark for robust imitation,” Advances in Neural Information Processing Systems , vol. 33, pp. 18 284–18 295, 2020

2020

Earlier work this paper cites.

D. Yarats, I. Kostrikov, and R. Fergus, “Image augmentation is all you need: Regularizing deep reinforcement learning from pixels,” in International conference on learning representations , 2020

2020

Earlier work this paper cites.

T. Chen, S. Saxena, L. Li, D. J. Fleet, and G. Hinton, “Pix2seq: A language modeling framework for object detection,” arXiv preprint arXiv:2109.10852 , 2021

Original

2021

Earlier work this paper cites.

F. Ebert, Y. Yang et al. , “Bridge data: Boosting generalization of robotic skills with cross-domain datasets,” RSS , 2022

2022

Earlier work this paper cites.

M. Ahn, A. Brohan et al. , “Do as i can, not as i say: Grounding language in robotic affordances,” arXiv preprint arXiv:2204.01691 , 2022

Original

2022

Earlier work this paper cites.

A. Brohan, N. Brown et al. , “Rt-1: Robotics transformer for real-world control at scale,” arXiv preprint arXiv:2212.06817 , 2022

Original

2022

Earlier work this paper cites.

E. Jang, A. Irpan et al. , “Bc-z: Zero-shot task generalization with robotic imitation learning,” in Conference on Robot Learning . PMLR, 2022, pp. 991–1002

2022

Earlier work this paper cites.

A. Kumar, A. Singh, F. Ebert, Y. Yang, C. Finn, and S. Levine, “Pre-training for robots: Offline rl enables learning new tasks from a handful of trials,” arXiv preprint arXiv:2210.05178 , 2022

Original

2022

Earlier work this paper cites.

E. J. Hu, yelong shen et al. , “LoRA: Low-rank adaptation of large language models,” in International Conference on Learning Representations , 2022

2022

Earlier work this paper cites.

J. Lu, C. Clark, R. Zellers, R. Mottaghi, and A. Kembhavi, “Unified-io: A unified model for vision, language, and multi-modal tasks,” in The Eleventh International Conference on Learning Representations , 2022

2022

Earlier work this paper cites.

T. Chen, S. Saxena, L. Li, T.-Y. Lin, D. J. Fleet, and G. E. Hinton, “A unified sequence interface for vision tasks,” Advances in Neural Information Processing Systems , vol. 35, pp. 31 333–31 346, 2022

2022

Earlier work this paper cites.

L. A. Doumas, G. Puebla, A. E. Martin, and J. E. Hummel, “A theory of relation learning and cross-domain generalization.” Psychological review , vol. 129, no. 5, p. 999, 2022

2022

Earlier work this paper cites.

C. Chi, S. Feng et al. , “Diffusion policy: Visuomotor policy learning via action diffusion,” RSS , 2023

2023

Earlier work this paper cites.

H. Touvron, L. Martin et al. , “Llama 2: Open foundation and fine-tuned chat models,” arXiv preprint arXiv:2307.09288 , 2023

Original

2023

Cited alongside, same era.

A. Q. Jiang, A. Sablayrolles, A. Mensch, C. Bamford, D. S. Chaplot, D. d. l. Casas, F. Bressand, G. Lengyel, G. Lample, L. Saulnier et al. , “Mistral 7b,” arXiv preprint arXiv:2310.06825 , 2023

Original

2023

Cited alongside, same era.

R. Shi, Y. Liu, Y. Ze, S. S. Du, and H. Xu, “Unleashing the power of pre-trained language models for offline reinforcement learning,” arXiv preprint arXiv:2310.20587 , 2023

Original

2023

Cited alongside, same era.

A. Brohan, N. Brown et al. , “Rt-2: Vision-language-action models transfer web knowledge to robotic control,” arXiv preprint arXiv:2307.15818 , 2023

Original

2023

Cited alongside, same era.

Y. Ze, G. Zhang et al. , “3d diffusion policy: Generalizable visuomotor policy learning via simple 3d representations,” in Proceedings of Robotics: Science and Systems (RSS) , 2024

2024

Closest in time.

M. J. Kim, K. Pertsch et al. , “Openvla: An open-source vision-language-action model,” 8th Annual Conference on Robot Learning , 2024

2024

Closest in time.

D. Zhu, J. Chen et al. , “MiniGPT-4: Enhancing vision-language understanding with advanced large language models,” in The Twelfth International Conference on Learning Representations , 2024

2024

Closest in time.

X. Chu, L. Qiao et al. , “Mobilevlm v2: Faster and stronger baseline for vision language model,” arXiv preprint arXiv:2402.03766 , 2024

Original

2024

Closest in time.

Y. Zhu, M. Zhu, N. Liu, Z. Ou, X. Mou, and J. Tang, “Llava-phi: Efficient multi-modal assistant with small language model,” arXiv preprint arXiv:2401.02330 , 2024