Fetching the paper…
Reading the bibliography…
Affordance grounding refers to the task of finding the area of an object with which one can interact.
Hico: A benchmark for recognizing human-object interactions in images
Yu-Wei Chao, Zhan Wang, Yugeng He, Jiaxuan Wang, and Jia Deng · 2015
Earlier work this paper cites.
Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture
David Eigen and Rob Fergus · 2015
Earlier work this paper cites.
Designing deep networks for surface normal estimation
Xiaolong Wang, David Fouhey, and Abhinav Gupta · 2015
Earlier work this paper cites.
Focal loss for dense object detection
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár · 2017
Earlier work this paper cites.
Demo2vec: Reasoning object affordances from online videos
Kuan Fang, Te-Lin Wu, Daniel Yang, Silvio Savarese, and Joseph J Lim · 2018
Earlier work this paper cites.
Detecting and recognizing human-object interactions
Georgia Gkioxari, Ross Girshick, Piotr Dollar, and Kaiming He · 2018
Earlier work this paper cites.
Visual memory for robust path following
Ashish Kumar, Saurabh Gupta, David F. Fouhey, Sergey Levine, and Jitendra Malik · 2018
Earlier work this paper cites.
Learning particle dynamics for manipulating rigid bodies, deformable objects, and fluids
Yunzhu Li, Jiajun Wu, Russ Tedrake, Joshua B Tenenbaum, and Antonio Torralba · 2018
Earlier work this paper cites.
Learning single-image depth from videos using quality assessment networks
Weifeng Chen, Shengyi Qian, and Jia Deng · 2019
Earlier work this paper cites.
Mesh r-cnn
Georgia Gkioxari, Jitendra Malik, and Justin Johnson · 2019
Earlier work this paper cites.
Lvis: A dataset for large vocabulary instance segmentation
Agrim Gupta, Piotr Dollar, and Ross Girshick · 2019
Earlier work this paper cites.
PlaneRCNN: 3D plane detection and reconstruction from a single image
Chen Liu, Kihwan Kim, Jinwei Gu, Yasutaka Furukawa, and Jan Kautz · 2019
Earlier work this paper cites.
Grounded human-object interaction hotspots from video
Tushar Nagarajan, Christoph Feichtenhofer, and Kristen Grauman · 2019
Earlier work this paper cites.
Enforcing geometric constraints of virtual normal for depth prediction
Wei Yin, Yifan Liu, Chunhua Shen, and Youliang Yan · 2019
Earlier work this paper cites.
Does computer vision matter for action?
Brady Zhou, Philipp Krähenbühl, and Vladlen Koltun · 2019
Earlier work this paper cites.
End-to-end object detection with transformers
Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko · 2020
Earlier work this paper cites.
Rlbench: The robot learning benchmark & learning environment
Stephen James, Zicong Ma, David Rovick Arrojo, and Andrew J Davison · 2020
Earlier work this paper cites.
Total3dunderstanding: Joint layout, object pose and mesh reconstruction for indoor scenes from a single image
Yinyu Nie, Xiaoguang Han, Shihui Guo, Yujian Zheng, Jian Chang, and Jian Jun Zhang · 2020
Earlier work this paper cites.
Associative3d: Volumetric reconstruction from sparse views
Shengyi Qian, Linyi Jin, and David F. Fouhey · 2020
Earlier work this paper cites.
Understanding human hands in contact at internet scale
Dandan Shan, Jiaqi Geng, Michelle Shu, and David Fouhey · 2020
Earlier work this paper cites.
Emerging properties in self-supervised vision transformers
Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, and Armand Joulin · 2021
Earlier work this paper cites.
Per-pixel classification is not all you need for semantic segmentation
Bowen Cheng, Alex Schwing, and Alexander Kirillov · 2021
Earlier work this paper cites.
Virtex: Learning visual representations from textual annotations
Karan Desai and Justin Johnson · 2021
Cited alongside, same era.
Recognizing scenes from novel viewpoints
Shengyi Qian, Alexander Kirillov, Nikhila Ravi, Devendra Singh Chaplot, Justin Johnson, David F Fouhey, and Georgia Gkioxari · 2021
Cited alongside, same era.
Vision transformers for dense prediction
René Ranftl, Alexey Bochkovskiy, and Vladlen Koltun · 2021
Cited alongside, same era.
Learning to recover 3d scene shape from a single image
Wei Yin, Jianming Zhang, Oliver Wang, Simon Niklaus, Long Mai, Simon Chen, and Chunhua Shen · 2021
Cited alongside, same era.
pixelnerf: Neural radiance fields from one or few images
Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa · 2021
Cited alongside, same era.
Human-to-robot imitation in the wild
Affordpose: A large-scale dataset of hand-object interactions with affordance-driven hand pose
Juntao Jian, Xiuping Liu, Manyi Li, Ruizhen Hu, and Jian Liu · 2023
Later among the works it cites.
Segment anything
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollár, and Ross Girshick · 2023
Later among the works it cites.
Putting people in their place: Affordance-aware human insertion into scenes
Sumith Kulal, Tim Brooks, Alex Aiken, Jiajun Wu, Jimei Yang, Jingwan Lu, Alexei A Efros, and Krishna Kumar Singh · 2023
Later among the works it cites.
Lisa: Reasoning segmentation via large language model
Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, and Jiaya Jia · 2023
Later among the works it cites.
Leverage interactive affinity for affordance learning
Hongchen Luo, Wei Zhai, Jing Zhang, Yang Cao, and Dacheng Tao · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Shikhar Bahl, Abhinav Gupta, and Deepak Pathak · 2022
Cited alongside, same era.
Fwd: Real-time novel view synthesis with forward warping and depth
Ang Cao, Chris Rockwell, and Justin Johnson · 2022
Cited alongside, same era.
Evo-nerf: Evolving nerf for sequential robot grasping of transparent objects
Justin Kerr, Letian Fu, Huang Huang, Yahav Avigal, Matthew Tancik, Jeffrey Ichnowski, Angjoo Kanazawa, and Ken Goldberg · 2022
Cited alongside, same era.
Language-driven semantic segmentation
Boyi Li, Kilian Q Weinberger, Serge Belongie, Vladlen Koltun, and Rene Ranftl · 2022
Cited alongside, same era.
Image segmentation using text and image prompts
Timo Lüddecke and Alexander Ecker · 2022
Cited alongside, same era.
Simple open-vocabulary object detection
Matthias Minderer, Alexey Gritsenko, Austin Stone, Maxim Neumann, Dirk Weissenborn, Alexey Dosovitskiy, Aravindh Mahendran, Anurag Arnab, Mostafa Dehghani, Zhuoran Shen, et al · 2022
Cited alongside, same era.
Ofa: Unifying architectures, tasks, and modalities through a simple sequence-to-sequence learning framework
Peng Wang, An Yang, Rui Men, Junyang Lin, Shuai Bai, Zhikang Li, Jianxin Ma, Chang Zhou, Jingren Zhou, and Hongxia Yang · 2022
Cited alongside, same era.
Codet: Co-occurrence guided region-word alignment for open-vocabulary object detection
Chuofan Ma, Yi Jiang, Xin Wen, Zehuan Yuan, and Xiaojuan Qi · 2023
Later among the works it cites.
Multi-label affordance mapping from egocentric vision
Lorenzo Mur-Labadia, Jose J Guerrero, and Ruben Martinez-Cantin · 2023
Later among the works it cites.
Gpt-4 technical report, 2023
OpenAI · 2023
Later among the works it cites.
Kosmos-2: Grounding multimodal large language models to the world
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, and Furu Wei · 2023
Later among the works it cites.
Understanding 3d object interaction from a single image
Shengyi Qian and David F Fouhey · 2023
Later among the works it cites.
Edadet: Open-vocabulary object detection using early dense alignment
Cheng Shi and Sibei Yang · 2023
Later among the works it cites.
Perceiver-actor: A multi-task transformer for robotic manipulation
Mohit Shridhar, Lucas Manuelli, and Dieter Fox · 2023
Later among the works it cites.
Llama: Open and efficient foundation language models
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al · 2023
Later among the works it cites.
Learning foresightful dense visual affordance for deformable object manipulation
Ruihai Wu, Chuanruo Ning, and Hao Dong · 2023
Later among the works it cites.
Masqclip for open-vocabulary universal image segmentation
Xin Xu, Tianyi Xiong, Zheng Ding, and Zhuowen Tu · 2023
Later among the works it cites.
Grounding 3d object affordance from 2d interactions in images
Yuhang Yang, Wei Zhai, Hongchen Luo, Yang Cao, Jiebo Luo, and Zheng-Jun Zha · 2023
Later among the works it cites.
Affordance diffusion: Synthesizing hand-object interactions
Yufei Ye, Xueting Li, Abhinav Gupta, Shalini De Mello, Stan Birchfield, Jiaming Song, Shubham Tulsiani, and Sifei Liu · 2023
Later among the works it cites.
Homerobot: Open-vocabulary mobile manipulation
Sriram Yenamandra, Arun Ramachandran, Karmesh Yadav, Austin Wang, Mukul Khanna, Theophile Gervet, Tsung-Yen Yang, Vidhi Jain, Alexander William Clegg, John Turner, et al · 2023
Later among the works it cites.
Navgpt: Explicit reasoning in vision-and-language navigation with large language models
Gengze Zhou, Yicong Hong, and Qi Wu · 2023
Later among the works it cites.
3dmit: 3d multi-modal instruction tuning for scene understanding
Zeju Li, Chao Zhang, Xiaoyan Wang, Ruilong Ren, Yifan Xu, Ruifei Ma, and Xiangde Liu · 2024
Closest in time.
Llm-grounder: Open-vocabulary 3d visual grounding with large language model as an agent
Jianing Yang, Xuweiyi Chen, Shengyi Qian, Nikhil Madaan, Madhavan Iyengar, David F Fouhey, and Joyce Chai · 2024
Closest in time.
Groundhog: Grounding large language models to holistic segmentation
Yichi Zhang, Ziqiao Ma, Xiaofeng Gao, Suhaila Shakiah, Qiaozi Gao, and Joyce Chai · 2024
Closest in time.