Fetching the paper…
Reading the bibliography…
We report a mixture of expert strategy to create fine-tuned large language models using a deep layer-wise token-level approach based on low-rank adaptation (LoRA).
J. Gasteiger and M. Marsili, Tetrahedron 36
1980
Earlier work this paper cites.
D. Weininger, Journal of Chemical Information and Computer Sciences 28
1988
Earlier work this paper cites.
D. Weininger, A. Weininger, and J. L. Weininger, Journal of Chemical Information and Computer Sciences 29
1989
Earlier work this paper cites.
S. F. Altschul, W. Gish, W. Miller, E. W. Myers, and D. J. Lipman, Journal of Molecular Biology 215
1990
Earlier work this paper cites.
R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, Neural Computation 3
1991
Earlier work this paper cites.
J. B. Hampshire and A. Waibel, IEEE Transactions on Pattern Analysis and Machine Intelligence 14
1992
Earlier work this paper cites.
A. K. Rappé, C. J. Casewit, K. S. Colwell, W. A. Goddard, and W. M. Skiff, Journal of the American Chemical Society 114
1992
Earlier work this paper cites.
M. I. Jordan and R. A. Jacobs, Neural Computation 6
1994
Earlier work this paper cites.
D. A. McQuarrie and J. D. Simon, Physical Chemistry: A Molecular Approach (University Science Books, 1997), ISBN 978-0935702996
1997
Earlier work this paper cites.
H. Lu, B. Isralewitz, A. Krammer, V. Vogel, and K. Schulten, Biophysical Journal 75
1998
Earlier work this paper cites.
M. Girvan and M. E. Newman, Proceedings of the National Academy of Sciences of the United States of America 99
2002
Earlier work this paper cites.
F. A. Carey and R. J. Sundberg, Advanced Organic Chemistry: Part A: Structure and Mechanisms (Springer, 2007), 5th ed., ISBN 978-0387683461
2007
Earlier work this paper cites.
M. Buehler, Atomistic modeling of materials failure (2008), ISBN 9780387764252
2008
Earlier work this paper cites.
2009
Earlier work this paper cites.
D. I. Spivak and M. J. B. Reoccurring, pp. 0–13 (2011)
2011
Earlier work this paper cites.
T. Giesa, D. Spivak, and M. Buehler, Advanced Engineering Materials 14
2012
Earlier work this paper cites.
L. Ruddigkeit, R. Van Deursen, L. C. Blum, and J. L. Reymond, Journal of Chemical Information and Modeling 52
2012
Earlier work this paper cites.
N. D. Matsakis and F. S. Klock II, in ACM SIGAda Ada Letters (ACM, 2014), vol. 34, pp. 103–104
2014
Cited alongside, same era.
R. Ramakrishnan, M. Hartmann, E. Tapavicza, and O. A. Von Lilienfeld, Journal of Chemical Physics 143
2015
Cited alongside, same era.
L. L. C. Schrödinger, The PyMOL molecular graphics system, version 1.8 (2015)
2015
Cited alongside, same era.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, Attention is All you Need (2017), URL https://papers.nips.cc/paper/7181-attention-is-all-you-need
2017
Cited alongside, same era.
A. Paszke, S. Gross, J. Bradbury, Z. Lin, Z. Devito, F. Massa, B. Steiner, T. Killeen, and E. Yang (2019)
2019
Cited alongside, same era.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
M. Nejjar, . Luca, Z. †1, F. Stiehle, and I. Weber (2023), URL https://arxiv.org/abs/2311.16733v3
2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, Lora: Low-rank adaptation of large language models (2021), 2106.09685
2021
Cited alongside, same era.
J. Jumper, R. Evans, A. Pritzel, T. Green, M. Figurnov, O. Ronneberger, K. Tunyasuvunakool, R. Bates, A. Žídek, A. Potapenko, et al., Nature 596
2021
Cited alongside, same era.
J. Su, Y. Lu, S. Pan, B. Wen, and Y. Liu, Roformer: Enhanced transformer with rotary position embedding (2021), 2104.09864
2021
Cited alongside, same era.
2021
Cited alongside, same era.
2022
Cited alongside, same era.
M. J. Buehler and K. Guo (2022), URL https://zenodo.org/record/6346661
2022
Cited alongside, same era.
M. Mirdita, K. Schütze, Y. Moriwaki, L. Heo, S. Ovchinnikov, and M. Steinegger, Nature Methods 2022 19:6 19
2022
Cited alongside, same era.
R. K. Luu and M. J. Buehler, Adv. Science. (2023), URL https://doi.org/10.1002/advs.202306724
2023
Later among the works it cites.
R. K. Luu, M. Wysokowski, and M. J. Buehler, Applied Physics Letters 122
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
Y. Hu and M. J. Buehler, APL Machine Learning 1
2023
Later among the works it cites.
W. Lu, D. L. Kaplan, and M. J. Buehler, Advanced Functional Materials p. 2311324 (2023), ISSN 1616-3028, URL https://onlinelibrary.wiley.com/doi/full/10.1002/adfm.202311324https://onlinelibrary.wiley.com/doi/abs/10.1002/adfm.202311324https://onlinelibrary.wiley.com/doi/10.1002/adfm.202311324
2023
Later among the works it cites.
B. Ni, D. L. Kaplan, and M. J. Buehler (2023), URL https://arxiv.org/abs/2310.10605v3
2023
Later among the works it cites.
W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. E. Gonzalez, H. Zhang, and I. Stoica, in Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles (2023)
2023
Later among the works it cites.
2023
Later among the works it cites.
A. N. Lee, C. J. Hunter, and N. Ruiz (2023), URL https://arxiv.org/abs/2308.07317v1
2023
Later among the works it cites.
2024
Closest in time.