ERMV: Editing 4D Robotic Multi-view images to enhance embodied agents

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark et al. , “Learning transferable visual models from natural language supervision,” in International conference on machine learning . PmLR, 2021, pp. 8748–8763

2021

Earlier work this paper cites.

Z. Mandi, H. Bharadhwaj, V. Moens, S. Song, A. Rajeswaran, and V. Kumar, “Cacti: A framework for scalable multi-task multi-scene visual imitation learning,” arXiv preprint arXiv:2212.05711 , 2022

Original

2022

Earlier work this paper cites.

T. Brooks, J. Hellsten, M. Aittala, T.-C. Wang, T. Aila, J. Lehtinen, M.-Y. Liu, A. Efros, and T. Karras, “Generating long videos of dynamic scenes,” Advances in Neural Information Processing Systems , vol. 35, pp. 31 769–31 781, 2022

2022

Earlier work this paper cites.

R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, “High-resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2022, pp. 10 684–10 695

2022

Earlier work this paper cites.

J. Ho, T. Salimans, A. Gritsenko, W. Chan, M. Norouzi, and D. J. Fleet, “Video diffusion models,” Advances in Neural Information Processing Systems , vol. 35, pp. 8633–8646, 2022

2022

Earlier work this paper cites.

T. Yu, T. Xiao, J. Tompson, A. Stone, S. Wang, A. Brohan, J. Singh, C. Tan, D. M, J. Peralta, K. Hausman, B. Ichter, and F. Xia, “Scaling Robot Learning with Semantically Imagined Experience,” in Robotics: Science and Systems XIX, Daegu, Republic of Korea, July 10-14, 2023 , 2023

2023

Earlier work this paper cites.

K. Yang, E. Ma, J. Peng, Q. Guo, D. Lin, and K. Yu, “Bevcontrol: Accurately controlling street-view elements with multi-perspective consistency via bev sketch layout,” arXiv preprint arXiv:2308.01661 , 2023

Original

2023

Earlier work this paper cites.

P. Zeng, H. Zhang, L. Gao, X. Li, J. Qian, and H. T. Shen, “Visual commonsense-aware representation network for video captioning,” IEEE Transactions on Neural Networks and Learning Systems , 2023

2023

Earlier work this paper cites.

I. Kapelyukh, V. Vosylius, and E. Johns, “Dall-e-bot: Introducing web-scale diffusion models to robotics,” IEEE Robotics and Automation Letters , vol. 8, no. 7, pp. 3956–3963, 2023

2023

Earlier work this paper cites.

K. Black, M. Nakamoto, P. Atreya, H. Walke, C. Finn, A. Kumar, and S. Levine, “Zero-shot robotic manipulation with pretrained image-editing diffusion models,” arXiv preprint arXiv:2310.10639 , 2023

Original

2023

Earlier work this paper cites.

Z. Chen, S. Kiami, A. Gupta, and V. Kumar, “Genaug: Retargeting behaviors to unseen situations via generative augmentation,” arXiv preprint arXiv:2302.06671 , 2023

Original

2023

Earlier work this paper cites.

A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.-Y. Lo et al. , “Segment anything,” in Proceedings of the IEEE/CVF international conference on computer vision , 2023, pp. 4015–4026

2023

Earlier work this paper cites.

R. Liu, R. Wu, B. Van Hoorick, P. Tokmakov, S. Zakharov, and C. Vondrick, “Zero-1-to-3: Zero-shot one image to 3d object,” in Proceedings of the IEEE/CVF international conference on computer vision , 2023, pp. 9298–9309

2023

Earlier work this paper cites.

C. Chi, Z. Xu, S. Feng, E. Cousineau, Y. Du, B. Burchfiel, R. Tedrake, and S. Song, “Diffusion policy: Visuomotor policy learning via action diffusion,” The International Journal of Robotics Research , p. 02783649241273668, 2023

2023

Earlier work this paper cites.

T. Z. Zhao, V. Kumar, S. Levine, and C. Finn, “Learning fine-grained bimanual manipulation with low-cost hardware,” arXiv preprint arXiv:2304.13705 , 2023

Original

2023

Earlier work this paper cites.

S. Liu, L. Wu, B. Li, H. Tan, H. Chen, Z. Wang, K. Xu, H. Su, and J. Zhu, “Rdt-1b: a diffusion foundation model for bimanual manipulation,” arXiv preprint arXiv:2410.07864 , 2024

Original

2024

Earlier work this paper cites.

M. J. Kim, K. Pertsch, S. Karamcheti, T. Xiao, A. Balakrishna, S. Nair, R. Rafailov, E. Foster, G. Lam, P. Sanketi et al. , “Openvla: An open-source vision-language-action model,” arXiv preprint arXiv:2406.09246 , 2024

Original

2024

Earlier work this paper cites.

R. Gao, K. Chen, E. Xie, L. Hong, Z. Li, D.-Y. Yeung, and Q. Xu, “MagicDrive: Street view generation with diverse 3d geometry control,” in International Conference on Learning Representations , 2024

2024

Cited alongside, same era.

A. Swerdlow, R. Xu, and B. Zhou, “Street-view image generation from a bird’s-eye view layout,” IEEE Robotics Autom. Lett. , vol. 9, no. 4, pp. 3578–3585, 2024

2024

Cited alongside, same era.

Y. Deng, R. Wang, Y. Zhang, Y.-W. Tai, and C.-K. Tang, “Dragvideo: Interactive drag-style video editing,” in European Conference on Computer Vision . Springer, 2024, pp. 183–199

2024

Cited alongside, same era.

S. Liu, Y. Zhang, W. Li, Z. Lin, and J. Jia, “Video-p2p: Video editing with cross-attention control,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 8599–8608

2024

Cited alongside, same era.

N. Sharma, A. Tripathi, A. Chakraborty, and A. Mishra, “Sketch-guided image inpainting with partial discrete diffusion process,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 6024–6034

2024

Later among the works it cites.

X. He, F. Yang, F. Liu, and G. Lin, “Few-shot image generation via style adaptation and content preservation,” IEEE Transactions on Neural Networks and Learning Systems , 2024

2024

Later among the works it cites.

Z. Huang, H. Wen, J. Dong, Y. Wang, Y. Li, X. Chen, Y.-P. Cao, D. Liang, Y. Qiao, B. Dai et al. , “Epidiff: Enhancing multi-view synthesis via localized epipolar-constrained diffusion,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 9784–9794

2024

Later among the works it cites.

H. Lin, Y. Chen, J. Wang, W. An, M. Wang, F. Tian, Y. Liu, G. Dai, J. Wang, and Q. Wang, “Schedule your edit: A simple yet effective diffusion noise schedule for image editing,” Advances in Neural Information Processing Systems , vol. 37, pp. 115 712–115 756, 2024