Towards Message Brokers for Generative AI: Survey, Challenges, and Opportunities · Around

Fetching the paper…

Towards Message Brokers for Generative AI: Survey, Challenges, and Opportunities · Around

Built on

D. S. Linthicum, Enterprise application integration . Addison-Wesley Professional, 2000
2000
Earlier work this paper cites.
M. Perry, C. Delporte, F. Demi, A. Ghosh, and M. Luong, MQSeries publish/subscribe applications . IBM Redbooks, 2001
2001
Earlier work this paper cites.
P. T. Eugster, P. A. Felber, R. Guerraoui, and A.-M. Kermarrec, “The many faces of publish/subscribe,” ACM computing surveys (CSUR) , vol. 35, no. 2, pp. 114–131, 2003
2003
Earlier work this paper cites.
G. Hohpe and B. Woolf, Enterprise integration patterns: Designing, building, and deploying messaging solutions . Addison-Wesley Professional, 2004
2004
Earlier work this paper cites.
S. Tarkoma, Publish/subscribe systems: design and principles . John Wiley & Sons, 2012
2012
Earlier work this paper cites.
Oracle, “Open message queue, administration guide, release 5.0,” https://javaee.github.io/glassfish/doc/4.0/mq-admin-guide.pdf , 2013
2013
Earlier work this paper cites.
O. Iakushkin and V. Grishkin, “Messaging middleware for cloud applications: Extending brokerless approach,” in 2014 2nd 2014 2nd International Conference on Emission Electronics (ICEE) . IEEE, 2014, pp. 1–4
2014
Earlier work this paper cites.
R. Wadhwa, A. Mehra, P. Singh, and M. Singh, “A pub/sub based architecture to support public healthcare data exchange,” in 2015 7th International Conference on Communication Systems and Networks (COMSNETS) , 2015, pp. 1–6
2015
Earlier work this paper cites.
V. John and X. Liu, “A survey of distributed message broker queues,” arXiv preprint arXiv:1704.00411 , 2017
Original
2017
Earlier work this paper cites.
N. Naik, “Choice of effective messaging protocols for iot systems: Mqtt, coap, amqp and http,” in 2017 IEEE international systems engineering symposium (ISSE) . IEEE, 2017, pp. 1–7
2017
Earlier work this paper cites.
A. Radford, K. Narasimhan, T. Salimans, I. Sutskever et al. , “Improving language understanding by generative pre-training,” 2018
2018
Earlier work this paper cites.
P. Micikevicius, S. Narang, J. Alben, G. Diamos, E. Elsen, D. Garcia, B. Ginsburg, M. Houston, O. Kuchaiev, G. Venkatesh, and H. Wu, “Mixed precision training,” 2018
2018
Earlier work this paper cites.
A. Polino, R. Pascanu, and D. Alistarh, “Model compression via distillation and quantization,” arXiv preprint arXiv:1802.05668 , 2018
Original
2018
Earlier work this paper cites.
F. Ozturk and A. M. Ozdemir, “Content-based publish/subscribe communication model between iot devices in smart city environment,” in 2019 7th International Istanbul Smart Grids and Cities Congress and Fair (ICSG) , 2019, pp. 189–193
2019
Earlier work this paper cites.
A. E. Redondi, A. Arcia-Moret, and P. Manzoni, “Towards a scaled iot pub/sub architecture for 5g networks: The case of multiaccess edge computing,” in 2019 IEEE 5th World Forum on Internet of Things (WF-IoT) . IEEE, 2019, pp. 436–441
2019
Earlier work this paper cites.
M. Kleppmann, “Apache samza.” 2019
2019
Earlier work this paper cites.
J. Park, S. Samarakoon, M. Bennis, and M. Debbah, “Wireless network intelligence at the edge,” Proceedings of the IEEE , vol. 107, no. 11, pp. 2204–2239, 2019
2019
Earlier work this paper cites.
L. Lovén, T. Leppänen, E. Peltonen, J. Partala, E. Harjula, P. Porambage, M. Ylianttila, and J. Riekki, “Edgeai: A vision for distributed, edge-native artificial intelligence in future 6g networks,” 6G Wireless Summit, March 24-26, 2019 Levi, Finland , 2019
2019
Earlier work this paper cites.
J. Hasenburg, F. Stanek, F. Tschorsch, and D. Bermbach, “Managing latency and excess data dissemination in fog-based publish/subscribe systems,” in 2020 IEEE international conference on fog computing (ICFC) . IEEE, 2020, pp. 9–16
2020
Earlier work this paper cites.
T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020
2020
Earlier work this paper cites.
S. Deng, H. Zhao, W. Fang, J. Yin, S. Dustdar, and A. Y. Zomaya, “Edge intelligence: The confluence of edge computing and artificial intelligence,” IEEE Internet of Things Journal , vol. 7, no. 8, pp. 7457–7469, 2020
2020
Earlier work this paper cites.
F. Pedrosa and L. Rodrigues, “Reducing the subscription latency in reliable causal publish-subscribe systems,” in Proceedings of the 36th Annual ACM Symposium on Applied Computing , 2021, pp. 203–212
2021
Earlier work this paper cites.
K. Indrasiri and S. Suhothayan, Design Patterns for Cloud Native Applications . " O’Reilly Media, Inc.", 2021
2021
Earlier work this paper cites.
S. Li, F. Xue, C. Baranwal, Y. Li, and Y. You, “Sequence parallelism: Long sequence training from system perspective,” arXiv preprint arXiv:2105.13120 , 2021
Original
2021
Earlier work this paper cites.
H. Kokkonen, L. Lovén, N. H. Motlagh, A. Kumar, J. Partala, T. Nguyen, V. C. Pujol, P. Kostakos, T. Leppänen, A. González-Gil et al. , “Autonomy and intelligence in the computing continuum: Challenges, enablers, and future directions for orchestration,” arXiv preprint arXiv:2205.01423 , 2022
Original
2022
Earlier work this paper cites.
N. H. Motlagh, L. Lovén, J. Cao, X. Liu, P. Nurmi, S. Dustdar, S. Tarkoma, and X. Su, “Edge computing: The computing infrastructure for the smart megacities of the future,” Computer , vol. 55, no. 12, pp. 54–64, 2022
2022
Earlier work this paper cites.
S. Dustdar, V. C. Pujol, and P. K. Donta, “On distributed computing continuum systems,” IEEE Transactions on Knowledge and Data Engineering , vol. 35, no. 4, pp. 4092–4105, 2022
2022
Earlier work this paper cites.
P. K. Donta, S. N. Srirama, T. Amgoth, and C. S. R. Annavarapu, “Survey on recent advances in iot application layer protocols and machine learning scope for research directions,” Digital Communications and Networks , vol. 8, no. 5, pp. 727–744, 2022
2022
Earlier work this paper cites.
F. Z. Chafi, Y. Fakhri, and F. Z. A. H. Aadi, “Introduction to internet of things’ communication protocols,” in Advanced Intelligent Systems for Sustainable Development (AI2SD’2020) Volume 2 . Springer, 2022, pp. 142–150
2022
Earlier work this paper cites.
B. Ayaz, N. Slamnik-Kriještorac, and J. Marquez-Barja, “Data management platform for smart orchestration of decentralized and heterogeneous vehicular edge networks,” in Proceedings of the 2022 ACM Conference on Information Technology for Social Good , 2022, pp. 118–124
2022
Earlier work this paper cites.
J.-B. Alayrac, J. Donahue, P. Luc, A. Miech, I. Barr, Y. Hasson, K. Lenc, A. Mensch, K. Millican, M. Reynolds et al. , “Flamingo: a visual language model for few-shot learning,” Advances in Neural Information Processing Systems , vol. 35, pp. 23 716–23 736, 2022
2022
Earlier work this paper cites.
J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou et al. , “Chain-of-thought prompting elicits reasoning in large language models,” Advances in Neural Information Processing Systems , vol. 35, pp. 24 824–24 837, 2022
2022
Earlier work this paper cites.
S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao, “React: Synergizing reasoning and acting in language models,” arXiv preprint arXiv:2210.03629 , 2022
Original
2022
Earlier work this paper cites.
Y. Jiang, S. Wang, V. Valls, B. J. Ko, W.-H. Lee, K. K. Leung, and L. Tassiulas, “Model pruning enables efficient federated learning on edge devices,” IEEE Transactions on Neural Networks and Learning Systems , 2022
2022
Earlier work this paper cites.
Y.-C. Hsu, T. Hua, S. Chang, Q. Lou, Y. Shen, and H. Jin, “Language model compression with weighted low-rank factorization,” arXiv preprint arXiv:2207.00112 , 2022
Original
2022
Earlier work this paper cites.
S. Tarkoma, R. Morabito, and J. Sauvola, “Ai-native interconnect framework for integration of large language model technologies in 6g systems,” arXiv preprint arXiv:2311.05842 , 2023
Original
2023
Earlier work this paper cites.
L. Bariah, Q. Zhao, H. Zou, Y. Tian, F. Bader, and M. Debbah, “Large language models for telecom: The next big thing?” arXiv preprint arXiv:2306.10249 , 2023
Original
2023
Earlier work this paper cites.
Y.-C. Wang, J. Xue, C. Wei, and C.-C. J. Kuo, “An overview on generative ai at scale with edge-cloud computing,” 2023
2023
Earlier work this paper cites.
D. Praveen Kumar, M. Ilir, C. P. Victor, S. Boris, and D. Schahram, “Exploring the potential of distributed computing continuum systems,” Computers , 2023
2023
Earlier work this paper cites.
L. Lovén, R. Morabito, A. Kumar, S. Pirttikangas, J. Riekki, and S. Tarkoma, “How can ai be distributed in the computing continuum? introducing the neural pub/sub paradigm,” arXiv preprint arXiv:2309.02058 , 2023
Original
2023
Earlier work this paper cites.
V. Maniezzo, M. A. Boschetti, and P. Manzoni, “Self-adaptive publish/subscribe network design,” in Metaheuristics: 14th International Conference, MIC 2022, Syracuse, Italy, July 11–14, 2022, Proceedings . Springer, 2023, pp. 478–484
2023
Earlier work this paper cites.
F. García-Peñalvo and A. Vázquez-Ingelmo, “What do we mean by genai? a systematic mapping of the evolution, trends, and techniques involved in generative ai,” 2023
2023
Earlier work this paper cites.
M. Gupta, C. Akiri, K. Aryal, E. Parker, and L. Praharaj, “From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy,” IEEE Access , vol. 11, pp. 80 218–80 245, 2023
2023
Earlier work this paper cites.
T. Gong, C. Lyu, S. Zhang, Y. Wang, M. Zheng, Q. Zhao, K. Liu, W. Zhang, P. Luo, and K. Chen, “Multimodal-gpt: A vision and language model for dialogue with humans,” arXiv preprint arXiv:2305.04790 , 2023
Original
2023
Earlier work this paper cites.
Y. Shen, K. Song, X. Tan, D. Li, W. Lu, and Y. Zhuang, “Hugginggpt: Solving ai tasks with chatgpt and its friends in huggingface,” arXiv preprint arXiv:2303.17580 , 2023
Original
2023
Earlier work this paper cites.
R. Huang, M. Li, D. Yang, J. Shi, X. Chang, Z. Ye, Y. Wu, Z. Hong, J. Huang, J. Liu et al. , “Audiogpt: Understanding and generating speech, music, sound, and talking head,” arXiv preprint arXiv:2304.12995 , 2023
Original
2023
Earlier work this paper cites.
OpenAI, “Gpt-4 technical report,” 2023
2023
Earlier work this paper cites.
C. Wu, S. Yin, W. Qi, X. Wang, Z. Tang, and N. Duan, “Visual chatgpt: Talking, drawing and editing with visual foundation models,” arXiv preprint arXiv:2303.04671 , 2023
Original
2023
Earlier work this paper cites.
Z. Xi, W. Chen, X. Guo, W. He, Y. Ding, B. Hong, M. Zhang, J. Wang, S. Jin, E. Zhou et al. , “The rise and potential of large language model based agents: A survey,” arXiv preprint arXiv:2309.07864 , 2023
Original
2023
Earlier work this paper cites.
L. Wang, C. Ma, X. Feng, Z. Zhang, H. Yang, J. Zhang, Z. Chen, J. Tang, X. Chen, Y. Lin et al. , “A survey on large language model based autonomous agents,” arXiv preprint arXiv:2308.11432 , 2023
Original
2023
Earlier work this paper cites.
N. Shinn, F. Cassano, A. Gopinath, K. R. Narasimhan, and S. Yao, “Reflexion: Language agents with verbal reinforcement learning,” in Thirty-seventh Conference on Neural Information Processing Systems , 2023
2023
Earlier work this paper cites.
D. Shah, B. Osiński, S. Levine et al. , “Lm-nav: Robotic navigation with large pre-trained models of language, vision, and action,” in Conference on Robot Learning . PMLR, 2023, pp. 492–504
2023
Earlier work this paper cites.
Y. Mu, Q. Zhang, M. Hu, W. Wang, M. Ding, J. Jin, B. Wang, J. Dai, Y. Qiao, and P. Luo, “Embodiedgpt: Vision-language pre-training via embodied chain of thought,” arXiv preprint arXiv:2305.15021 , 2023
Original
2023
Earlier work this paper cites.
C. Qian, C. Han, Y. R. Fung, Y. Qin, Z. Liu, and H. Ji, “Creator: Disentangling abstract and concrete reasonings of large language models through tool creation,” arXiv preprint arXiv:2305.14318 , 2023
Original
2023
Earlier work this paper cites.
X. Chen, M. Lin, N. Schärli, and D. Zhou, “Teaching large language models to self-debug,” arXiv preprint arXiv:2304.05128 , 2023
Original
2023
Earlier work this paper cites.
P. Dhoni, “Exploring the synergy between generative ai, data and analytics in the modern age,” Authorea Preprints , 2023
2023
Earlier work this paper cites.
T. K. Chiu, “The impact of generative ai (genai) on practices, policies and research direction in education: A case of chatgpt and midjourney,” Interactive Learning Environments , pp. 1–17, 2023
2023
Earlier work this paper cites.
M. Jin, Q. Wen, Y. Liang, C. Zhang, S. Xue, X. Wang, J. Zhang, Y. Wang, H. Chen, X. Li et al. , “Large models for time series and spatio-temporal data: A survey and outlook,” arXiv preprint arXiv:2310.10196 , 2023
Original
2023
Earlier work this paper cites.
V. Rawte, A. Sheth, and A. Das, “A survey of hallucination in large foundation models,” arXiv preprint arXiv:2309.05922 , 2023
Original
2023
Earlier work this paper cites.
M. Gupta, C. Akiri, K. Aryal, E. Parker, and L. Praharaj, “From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy,” IEEE Access , 2023
2023
Earlier work this paper cites.
J. Bang, B.-T. Lee, and P. Park, “Examination of ethical principles for llm-based recommendations in conversational ai,” in 2023 International Conference on Platform Technology and Service (PlatCon) . IEEE, 2023, pp. 109–113
2023
Earlier work this paper cites.

Similar

B. Min, H. Ross, E. Sulem, A. P. B. Veyseh, T. H. Nguyen, O. Sainz, E. Agirre, I. Heintz, and D. Roth, “Recent advances in natural language processing via large pre-trained language models: A survey,” ACM Computing Surveys , vol. 56, no. 2, pp. 1–40, 2023
2023
Cited alongside, same era.
L. Xia, Y. Sun, C. Liang, L. Zhang, M. A. Imran, and D. Niyato, “Generative ai for semantic communication: Architecture, challenges, and outlook,” arXiv preprint arXiv:2308.15483 , 2023
Original
2023
Cited alongside, same era.
P. Jiang, C.-K. Wen, X. Yi, X. Li, S. Jin, and J. Zhang, “Semantic communications using foundation models: Design approaches and open issues,” arXiv preprint arXiv:2309.13315 , 2023
Original
2023
Cited alongside, same era.
P. K. Donta, B. Sedlak, V. Casamayor Pujol, and S. Dustdar, “Governance and sustainability of distributed continuum systems: a big data approach,” Journal of Big Data , vol. 10, no. 1, pp. 1–31, 2023
2023
Cited alongside, same era.

Then

Microsoft, “Azure storage queue,” https://learn.microsoft.com/en-us/azure/storage/queues/ , last accessed: August 24, 2026
2026
Closest in time.
Iron.io, “Ironmq,” http://www.iron.io/mq , last accessed: August 24, 2026
2026
Closest in time.
R. Hat, “Fuse message broker,” https://docs.huihoo.com/fuse/getting_started.pdf , last accessed: August 24, 2026
2026
Closest in time.
A. S. Foundation, “Apache qpid,” https://people.apache.org/~jonathan/Programming-In-Apache-Qpid.html , last accessed: August 24, 2026
2026
Closest in time.
R. Technologies, “Rabbitmq,” https://blog.rabbitmq.com/posts/2020/07/disaster-recovery-and-high-availability-101/ , last accessed: August 24, 2026
2026
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…