Learning Robust Anymodal Segmentor with Unimodal and Cross-modal Distillation

Q. Zhang, S. Zhao, Y. Luo, D. Zhang, N. Huang, and J. Han, “Abmdrnet: Adaptive-weighted bi-directional modality difference reduction network for rgb-t semantic segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2021

Earlier work this paper cites.

L.-Z. Chen, Z. Lin, Z. Wang, Y.-L. Yang, and M.-M. Cheng, “Spatial information guided convolution for real-time rgbd semantic segmentation,” IEEE Transactions on Image Processing

2021

Earlier work this paper cites.

E. Xie, W. Wang, Z. Yu, A. Anandkumar, J. M. Alvarez, and P. Luo, “Segformer: Simple and efficient design for semantic segmentation with transformers,” Advances in neural information processing systems

2021

Earlier work this paper cites.

Y. Wang, X. Chen, L. Cao, W. Huang, F. Sun, and Y. Wang, “Multimodal token fusion for vision transformers,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2022

Earlier work this paper cites.

X. Peng, Y. Wei, A. Deng, D. Wang, and D. Hu, “Balanced multimodal learning via on-the-fly gradient modulation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2022

Earlier work this paper cites.

Y. Huang, J. Lin, C. Zhou, H. Yang, and L. Huang, “Modality competition: What makes joint training of multi-modal network fail in deep learning? (provably),” in International Conference on Machine Learning

2022

Earlier work this paper cites.

J. Zhang, H. Liu, K. Yang, X. Hu, R. Liu, and R. Stiefelhagen, “Cmx: Cross-modal fusion for rgb-x semantic segmentation with transformers,” IEEE Transactions on intelligent transportation systems

2023

Earlier work this paper cites.

J. Li, H. Dai, H. Han, and Y. Ding, “Mseg3d: Multi-modal 3d semantic segmentation for autonomous driving,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2023

Earlier work this paper cites.

X. Zheng, J. Zhu, Y. Liu, Z. Cao, C. Fu, and L. Wang, “Both style and distortion matter: Dual-path unsupervised domain adaptation for panoramic semantic segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2023

Earlier work this paper cites.

J. Zhang, R. Liu, H. Shi, K. Yang, S. Reiß, K. Peng, H. Fu, K. Wang, and R. Stiefelhagen, “Delivering arbitrary-modal semantic segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2023

Earlier work this paper cites.

T. Broedermann, C. Sakaridis, D. Dai, and L. Van Gool, “Hrfuser: A multi-resolution sensor fusion architecture for 2d object detection,” in IEEE International Conference on Intelligent Transportation Systems

2023

Earlier work this paper cites.

S. Wei, C. Luo, and Y. Luo, “Mmanet: Margin-aware distillation and modality-aware regularization for incomplete multimodal learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2023

Earlier work this paper cites.

Y. Man, L.-Y. Gui, and Y.-X. Wang, “Bev-guided multi-modality fusion for driving perception,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2023

Earlier work this paper cites.

M. Kleinman, A. Achille, and S. Soatto, “Critical learning periods for multisensory integration in deep networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2023

Cited alongside, same era.

Y. Wang, Q. Mao, H. Zhu, J. Deng, Y. Zhang, J. Ji, H. Li, and Y. Zhang, “Multi-modal 3d object detection in autonomous driving: a survey,” International Journal of Computer Vision

2023

Cited alongside, same era.

M. K. Reza, A. Prater-Bennette, and M. S. Asif, “Robust multimodal learning with missing modalities via parameter-efficient adaptation,” arXiv preprint arXiv:2310.03986

Original

2023

Cited alongside, same era.

M. Chen, J. Yao, L. Xing, Y. Wang, Y. Zhang, and Y. Wang, “Redundancy-adaptive multimodal learning for imperfect data,” arXiv preprint arXiv:2310.14496

Original

2023

Cited alongside, same era.

R. Liu, J. Zhang, K. Peng, Y. Chen, K. Cao, J. Zheng, M. S. Sarfraz, K. Yang, and R. Stiefelhagen, “Fourier prompt tuning for modality-incomplete scene segmentation,” in IEEE Intelligent Vehicles Symposium

2024

Closest in time.

J. Zhou, X. Zheng, Y. Lyu, and L. Wang, “Eventbind: Learning a unified representation to bind them all for event-based open-world understanding,” in Proceedings of the European Conference on Computer Vision

2024

Closest in time.

X. Zheng and L. Wang, “Eventdance: Unsupervised source-free cross-modal adaptation for event-based object recognition,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2024

Closest in time.

X. Zheng, P. Zhou, A. V. Vasilakos, and L. Wang, “Semantics distortion and style matter: Towards source-free uda for panoramic segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

2024

Closest in time.