Is it safe to cross? Interpretable Risk Assessment with GPT-4V for Safety-Aware Street Crossing

B. D. Lucas and T. Kanade, “An iterative image registration technique with an application to stereo vision,” in IJCAI’81: 7th international joint conference on Artificial intelligence , vol. 2, 1981, pp. 674–679

1981

Earlier work this paper cites.

D. A. Guth, E. W. Hill, and J. J. Rieser, “Tests of blind pedestrians’ use of traffic sounds for street-crossing alignment,” Journal of Visual Impairment & Blindness , vol. 83, no. 9, pp. 461–468, 1989

1989

Earlier work this paper cites.

D. H. Ashmead, D. Guth, R. S. Wall, R. G. Long, and P. E. Ponchillia, “Street crossing by sighted and blind pedestrians at a modern roundabout,” Journal of Transportation Engineering , vol. 131, no. 11, pp. 812–821, 2005

2005

Earlier work this paper cites.

A. Geiger, P. Lenz, and R. Urtasun, “Are we ready for autonomous driving? the kitti vision benchmark suite,” in 2012 IEEE conference on computer vision and pattern recognition . IEEE, 2012, pp. 3354–3361

2012

Earlier work this paper cites.

S. E. Hassan, “Are normally sighted, visually impaired, and blind pedestrians accurate and reliable at making street crossing decisions?” Investigative ophthalmology & visual science , vol. 53, no. 6, pp. 2593–2600, 2012

2012

Earlier work this paper cites.

T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick, “Microsoft coco: Common objects in context,” in Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13 . Springer, 2014, pp. 740–755

2014

Earlier work this paper cites.

M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, “The cityscapes dataset for semantic urban scene understanding,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 3213–3223

2016

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017

2017

Earlier work this paper cites.

J. Guerreiro, D. Sato, S. Asakawa, H. Dong, K. M. Kitani, and C. Asakawa, “Cabot: Designing and evaluating an autonomous navigation robot for blind people,” in Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility , 2019, pp. 68–82

2019

Earlier work this paper cites.

F. Yu, H. Chen, X. Wang, W. Xian, Y. Chen, F. Liu, V. Madhavan, and T. Darrell, “Bdd100k: A diverse driving dataset for heterogeneous multitask learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2020, pp. 2636–2645

2020

Earlier work this paper cites.

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, et al. , “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929 , 2020

Original

2020

Earlier work this paper cites.

N. Radwan, W. Burgard, and A. Valada, “Multimodal interaction-aware motion prediction for autonomous street crossing,” The International Journal of Robotics Research , vol. 39, no. 13, pp. 1567–1598, 2020

2020

Earlier work this paper cites.

A. Bochkovskiy, C.-Y. Wang, and H.-Y. M. Liao, “Yolov4: Optimal speed and accuracy of object detection,” arXiv preprint arXiv:2004.10934 , 2020

Original

2020

Earlier work this paper cites.

K. Park, Y. Oh, S. Ham, K. Joo, H. Kim, H. Kum, and I. S. Kweon, “Sideguide: a large-scale sidewalk dataset for guiding impaired people,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) . IEEE, 2020, pp. 10 022–10 029

2020

Cited alongside, same era.

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, et al. , “Learning transferable visual models from natural language supervision,” in International conference on machine learning . PMLR, 2021, pp. 8748–8763

2021

Cited alongside, same era.

R. Ichikawa, B. Zhang, and H.-o. Lim, “Voice expression system of visual environment for a guide dog robot,” in 2022 8th International Symposium on System Security, Safety, and Reliability (ISSSR) . IEEE, 2022, pp. 191–192

2022

Cited alongside, same era.

K. M. Hoogsteen, S. Szpiro, G. Kreiman, and E. Peli, “Beyond the cane: describing urban scenes to blind people for mobility tasks,” ACM Transactions on Accessible Computing (TACCESS) , vol. 15, no. 3, pp. 1–29, 2022

I. Poola and V. Božić, “Guiding ai with human intuition for solving mathematical problems in chat gpt,” Journal Homepage: http://www. ijmra. us , vol. 11, no. 07, 2023

2023

Later among the works it cites.

S. Kwon, R. Garodia, M. Lee, Z. Yang, and H. Yu, “Vision meets definitions: Unsupervised visual word sense disambiguation incorporating gloss information,” in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , A. Rogers, J. Boyd-Graber, and N. Okazaki, Eds. Toronto, Canada: Association for Computational Linguistics, July 2023, pp. 1583–1598. [Online]. Available: https://aclanthology.org/2023.acl-long.88

2023

Later among the works it cites.

H. Nori, N. King, S. M. McKinney, D. Carignan, and E. Horvitz, “Capabilities of gpt-4 on medical challenge problems,” arXiv preprint arXiv:2303.13375 , 2023

Original

2023

Later among the works it cites.