Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning

Y. A. Malkov and D. A. Yashunin, “Efficient and robust approximate nearest neighbor search using hierarchical navigable small world graphs,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , vol. 42, no. 4, pp. 824–836, 2018

2018

Earlier work this paper cites.

P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W.-t. Yih, T. Rocktäschel et al. , “Retrieval-augmented generation for knowledge-intensive nlp tasks,” Advances in Neural Information Processing Systems (NeurIPS) , vol. 33, pp. 9459–9474, 2020

2020

Earlier work this paper cites.

X. He, Y. Zhang, L. Mou, E. Xing, and P. Xie, “Pathvqa: 30000+ questions for medical visual question answering,” arXiv preprint arXiv:2003.10286 , 2020

Original

2020

Earlier work this paper cites.

J. Wang, X. Yi, R. Guo, H. Jin, P. Xu, S. Li, X. Wang, X. Guo, C. Li, X. Xu et al. , “Milvus: A Purpose-Built Vector Data Management System,” in Proceedings of the 2021 International Conference on Management of Data (SIGMOD) , pp. 2614–2627, 2021

2021

Earlier work this paper cites.

H. Liu, K. Son, J. Yang, C. Liu, J. Gao, Y. J. Lee, and C. Li, “Learning customized visual models with retrieval-augmented knowledge,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pp. 15148–15158, 2023

2023

Earlier work this paper cites.

X. Zhai, B. Mustafa, A. Kolesnikov, and L. Beyer, “Sigmoid loss for language image pre-training,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , pp. 11975–11986, 2023

2023

Earlier work this paper cites.

Y. Gao, Y. Xiong, X. Gao, K. Jia, J. Pan, Y. Bi, Y. Dai, J. Sun, H. Wang, and H. Wang, “Retrieval-augmented generation for large language models: A survey,” arXiv preprint arXiv:2312.10997 , 2023

Original

2023

Earlier work this paper cites.

W. Ikezogwo, S. Seyfioglu, F. Ghezloo, D. Geva, F. Sheikh Mohammed, P. K. Anand, R. Krishna, and L. Shapiro, “Quilt-1m: One million image-text pairs for histopathology,” Advances in Neural Information Processing Systems , vol. 36, pp. 37995–38017, 2023

2023

Earlier work this paper cites.

M. Y. Lu, B. Chen, D. F. K. Williamson, R. J. Chen, M. Zhao, A. K. Chow, K. Ikemura, A. Kim, D. Pouli, A. Patel et al. , “A multimodal generative AI copilot for human pathology,” Nature , vol. 634, no. 8033, pp. 466–473, 2024

2024

Earlier work this paper cites.

M. S. Jabal, P. Warman, J. Zhang, K. Gupta, A. Jain, M. Mazurowski, W. Wiggins, K. Magudia, and E. Calabrese, “Language Models and Retrieval Augmented Generation for Automated Structured Data Extraction from Diagnostic Reports,” arXiv preprint arXiv:2409.10576 , 2024

Original

2024

Earlier work this paper cites.

J. Wu, J. Zhu, Y. Qi, J. Chen, M. Xu, F. Menolascina, and V. Grau, “Medical graph rag: Towards safe medical large language model via graph retrieval-augmented generation,” arXiv preprint arXiv:2408.04187 , 2024

Original

2024

Earlier work this paper cites.

C. Lee, R. Roy, M. Xu, J. Raiman, M. Shoeybi, B. Catanzaro, and W. Ping, “Nv-embed: Improved techniques for training llms as generalist embedding models,” arXiv preprint arXiv:2405.17428 , 2024

Original

2024

Earlier work this paper cites.

S. Yu, C. Tang, B. Xu, J. Cui, J. Ran, Y. Yan, Z. Liu, S. Wang, X. Han, Z. Liu et al. , “Visrag: Vision-based retrieval-augmented generation on multi-modality documents,” arXiv preprint arXiv:2410.10594 , 2024

Original

2024

Earlier work this paper cites.

J. Cho, D. Mahata, O. Irsoy, Y. He, and M. Bansal, “M3docrag: Multi-modal retrieval is what you need for multi-page multi-document understanding,” arXiv preprint arXiv:2411.04952 , 2024

Original

2024

Earlier work this paper cites.

A. Joshi, S. M. Sarwar, S. Varshney, S. Nag, S. Agrawal, and J. Naik, “Reaper: Reasoning based retrieval planning for complex rag systems,” in Proceedings of the 33rd ACM International Conference on Information and Knowledge Management (CIKM) , pp. 4621–4628, 2024

2024

Cited alongside, same era.

C. Ravuru, S. S. Sakhinana, and V. Runkana, “Agentic retrieval-augmented generation for time series analysis,” arXiv preprint arXiv:2408.14484 , 2024

Original

2024

Cited alongside, same era.

J. Chen, R. Ouyang, A. Gao, S. Chen, G. H. Chen, X. Wang, R. Zhang, Z. Cai, K. Ji, G. Yu, X. Wan, and B. Wang, “HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale,” arXiv preprint arXiv:2406.19280 , 2024

Original

2024

Cited alongside, same era.

Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. Li, Y. Wu et al. , “Deepseekmath: Pushing the limits of mathematical reasoning in open language models,” arXiv preprint arXiv:2402.03300 , 2024

Original

2024

Y. Chen, Y. Shen, W. Huang, S. Zhou, Q. Lin, X. Cai, Z. Yu, B. Shi, and Y. Qiao, “Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback,” arXiv preprint arXiv:2507.20766 , 2025

Original

2025

Closest in time.

Q. Wang, R. Ding, Z. Chen, W. Wu, S. Wang, P. Xie, and F. Zhao, “Vidorag: Visual document retrieval-augmented generation via dynamic iterative reasoning agents,” arXiv preprint arXiv:2502.18017 , 2025

Original

2025

Closest in time.

B. Jin, H. Zeng, Z. Yue, J. Yoon, S. Arik, D. Wang, H. Zamani, and J. Han, “Search-r1: Training llms to reason and leverage search engines with reinforcement learning,” arXiv preprint arXiv:2503.09516 , 2025

Original

2025

Closest in time.

J. Wu, Z. Deng, W. Li, Y. Liu, B. You, B. Li, Z. Ma, and Z. Liu, “MMSearch-R1: Incentivizing LMMs to Search,” arXiv preprint arXiv:2506.20670 , 2025

Original

2025

Closest in time.