A Taxonomy of Foundation Model based Systems through the Lens of Software Architecture

N. R. Mehta, N. Medvidovic, and S. Phadke, “Towards a taxonomy of software connectors,” in ICSE , 2000, pp. 178–187

2000

Earlier work this paper cites.

B. Kitchenham and S. Charters, “Guidelines for performing systematic literature reviews in software engineering,” Technical report, Ver. 2.3 EBSE Technical Report. EBSE, Tech. Rep., 2007

2007

Earlier work this paper cites.

I. Gorton, J. Klein, and A. Nurgaliev, “Architecture knowledge for evaluating scalable databases,” in 2015 12th Working IEEE/IFIP Conference on Software Architecture . IEEE, 2015, pp. 95–104

2015

Earlier work this paper cites.

X. Zhou, Y. Jin, H. Zhang, S. Li, and X. Huang, “A map of threats to validity of systematic literature reviews in software engineering,” in 2016 23rd Asia-Pacific Software Engineering Conference (APSEC) , 2016, pp. 153–160

2016

Earlier work this paper cites.

V. Garousi, M. Felderer, and M. V. Mäntylä, “Guidelines for including grey literature and conducting multivocal literature reviews in software engineering,” Information and Software Technology , vol. 106, pp. 101–121, 2019. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0950584918301939

2019

Earlier work this paper cites.

R. Bommasani, D. A. Hudson, E. Adeli, R. Altman, S. Arora, S. von Arx, M. S. Bernstein, J. Bohg, A. Bosselut, E. Brunskill et al. , “On the opportunities and risks of foundation models,” arXiv preprint arXiv:2108.07258 , 2021

Original

2021

Earlier work this paper cites.

S. M. Xie, A. Raghunathan, P. Liang, and T. Ma, “An explanation of in-context learning as implicit bayesian inference,” arXiv preprint arXiv:2111.02080 , 2021

Original

2021

Earlier work this paper cites.

E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “Lora: Low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685 , 2021

Original

2021

Earlier work this paper cites.

K. M. Jablonka, P. Schwaller, and B. Smit, “Is gpt-3 all you need for machine learning for chemistry?” in AI for Accelerated Materials Design NeurIPS 2022 Workshop

2022

Cited alongside, same era.

Q. Lu, L. Zhu, X. Xu, J. Whittle, D. Zowghi, and A. Jacquet, “Responsible ai pattern catalogue: a multivocal literature review,” arXiv preprint arXiv:2209.04963 , 2022

Original

2022

Cited alongside, same era.

A. Zeng, A. Wong, S. Welker, K. Choromanski, F. Tombari, A. Purohit, M. Ryoo, V. Sindhwani, J. Lee, V. Vanhoucke et al. , “Socratic models: Composing zero-shot multimodal reasoning with language,” arXiv preprint arXiv:2204.00598 , 2022

Original

2022

Cited alongside, same era.

E. A. van Dis, J. Bollen, W. Zuidema, R. van Rooij, and C. L. Bockting, “Chatgpt: five priorities for research,” Nature , vol. 614, no. 7947, pp. 224–226, 2023

2023

Cited alongside, same era.

S. M. Anwar, A. Parida, S. Atito, M. Awais, G. Nino, J. Kitler, and M. G. Linguraru, “Spcxr: Self-supervised pretraining using chest x-rays towards a domain specific foundation model,” 2023. [Online]. Available: https://europepmc.org/article/PPR/PPR661659

2023

Closest in time.

B. Lin, Z. Chen, M. Li, H. Lin, H. Xu, Y. Zhu, J. Liu, W. Cai, L. Yang, S. Zhao, C. Wu, L. Chen, X. Chang, Y. Yang, L. Xing, and X. Liang, “Towards medical artificial general intelligence via knowledge-enhanced multimodal pretraining,” 2023

2023

Closest in time.

H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar et al. , “Llama: Open and efficient foundation language models,” arXiv preprint arXiv:2302.13971 , 2023

Original

2023

Closest in time.

Y. Shen, K. Song, X. Tan, D. Li, W. Lu, and Y. Zhuang, “Hugginggpt: Solving ai tasks with chatgpt and its friends in huggingface,” arXiv preprint arXiv:2303.17580 , 2023

Original

2023