Juru: Legal Brazilian Large Language Model from Reputable Sources

Kaplan, J., et al.: Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020), https://arxiv.org/abs/2001.08361

Original

2001

Earlier work this paper cites.

Sennrich, R., Haddow, B., Birch, A.: Neural machine translation of rare words with subword units. In: Erk, K., Smith, N.A. (eds.) Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). pp. 1715–1725. Association for Computational Linguistics (2016). https://doi.org/10.18653/v1/P16-1162

2016

Earlier work this paper cites.

Cataneo Silveira, I., Deratani Mauá, D.: Advances in automatically solving the ENEM. In: 2018 7th Brazilian Conference on Intelligent Systems (BRACIS). pp. 43–48 (2018). https://doi.org/10.1109/BRACIS.2018.00016

2018

Earlier work this paper cites.

Shazeer, N., Stern, M.: Adafactor: adaptive learning rates with sublinear memory cost. In: Dy, J., Krause, A. (eds.) Proceedings of the 35th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 80, pp. 4596–4604. PMLR (2018), https://proceedings.mlr.press/v80/shazeer18a.html

2018

Earlier work this paper cites.

Sayama, H.F., Araujo, A.V., Fernandes, E.R.: FaQuAD: reading comprehension dataset in the domain of Brazilian higher education. In: 2019 8th Brazilian Conference on Intelligent Systems (BRACIS). pp. 443–448 (2019). https://doi.org/10.1109/BRACIS.2019.00084

2019

Earlier work this paper cites.

Brown, T., et al.: Language models are few-shot learners. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M., Lin, H. (eds.) Advances in Neural Information Processing Systems. vol. 33, pp. 1877–1901. Curran Associates, Inc. (2020), https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf

2020

Earlier work this paper cites.

Carlini, N., et al.: Extracting training data from large language models. In: 30th USENIX Security Symposium (USENIX Security 21). pp. 2633–2650. USENIX Association (2021), https://www.usenix.org/conference/usenixsecurity21/presentation/carlini-extracting

2021

Earlier work this paper cites.

Hendrycks, D., et al.: Measuring massive multitask language understanding. In: International Conference on Learning Representations (2021), https://openreview.net/forum?id=d7KBjmI3GmQ

2021

Earlier work this paper cites.

Polo, F., et al.: LegalNLP - natural language processing methods for the Brazilian legal language. In: Anais do XVIII Encontro Nacional de Inteligência Artificial e Computacional. pp. 763–774. SBC (2021). https://doi.org/10.5753/eniac.2021.18301

2021

Earlier work this paper cites.

Rae, J.W., et al.: Scaling language models: methods, analysis & insights from training Gopher. arXiv preprint arXiv:2112.11446 (2021), https://arxiv.org/abs/2112.11446

Original

2021

Earlier work this paper cites.

Xue, L., et al.: mT5: a massively multilingual pre-trained text-to-text transformer. In: Toutanova, K., et al. (eds.) Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. pp. 483–498. Association for Computational Linguistics (2021). https://doi.org/10.18653/v1/2021.naacl-main.41

2021

Earlier work this paper cites.

Hoffmann, J., et al.: Training compute-optimal large language models. arXiv preprint arXiv:2203.15556 (2022), https://arxiv.org/abs/2203.15556

Original

2022

Earlier work this paper cites.

Wei, J., et al.: Emergent abilities of large language models. Transactions on Machine Learning Research (2022), https://openreview.net/forum?id=yzkSU5zdwD

2022

Cited alongside, same era.

Almeida, T.S., Laitz, T., Bonás, G.K., Nogueira, R.: BLUEX: a benchmark based on Brazilian leading universities entrance exams. In: Naldi, M.C., Bianchi, R.A.C. (eds.) Intelligent Systems. pp. 337–347. Springer Nature Switzerland (2023). https://doi.org/10.1007/978-3-031-45368-7_22

2023

Cited alongside, same era.

Chowdhery, A., et al.: PaLM: scaling language modeling with pathways. Journal of Machine Learning Research 24

2023

Cited alongside, same era.

Gunasekar, S., et al.: Textbooks are all you need. arXiv preprint arXiv:2306.11644 (2023), https://arxiv.org/abs/2306.11644

Original

2023

Cited alongside, same era.

Jiang, A.Q., et al.: Mistral 7B. arXiv preprint arXiv:2310.06825 (2023), https://arxiv.org/abs/2310.06825

Roberts, A., et al.: Scaling up models and data with t5x and seqio. Journal of Machine Learning Research 24

2023

Later among the works it cites.

Sakiyama, K., Montanari, R., Malaquias Junior, R., Nogueira, R., Romero, R.A.F.: Exploring text decoding methods for Portuguese legal text generation. In: Naldi, M.C., Bianchi, R.A.C. (eds.) Intelligent Systems. pp. 63–77. Springer Nature Switzerland (2023). https://doi.org/10.1007/978-3-031-45368-7_5

2023

Later among the works it cites.

Touvron, H., et al.: LLaMa 2: open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023), https://arxiv.org/abs/2307.09288

Original

2023

Later among the works it cites.

Touvron, H., et al.: LLaMa: open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023), https://arxiv.org/abs/2302.13971

Original

2023

Later among the works it cites.