Fetching the paper…
Reading the bibliography…
Large language models have demonstrated outstanding performance in various natural language processing tasks, but their security capabilities in the financial domain have not been explored, and their performance on complex tasks like financial agent remains unknown.
ROUGE: A package for automatic evaluation of summaries
Chin-Yew Lin. 2004 · 2004
Earlier work this paper cites.
CLUE: A Chinese language understanding evaluation benchmark
Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, Kai Sun, Dian Yu, Cong Yu, Yin Tian, Qianqian Dong, Weitang Liu, Bo Shi, Yiming Cui, Junyi Li, Jun Zeng, Rongzhao Wang, Weijian Xie, Yanting Li, Yina Patterson, Zuoyu Tian, Yiwen Zhang, He Zhou, Shaoweihua Liu, Zhe Zhao, Qipeng Zhao, Cong Yue, Xinrui Zhang, Zhengliang Yang, Kyle Richardson, and Zhenzhong Lan. 2020 · 2020
Earlier work this paper cites.
Truthfulqa: Measuring how models mimic human falsehoods
Stephanie Lin, Jacob Hilton, and Owain Evans. 2021 · 2021
Earlier work this paper cites.
Cblue: A chinese biomedical language understanding evaluation benchmark
Ningyu Zhang, Mosha Chen, Zhen Bi, Xiaozhuan Liang, Lei Li, Xin Shang, Kangping Yin, Chuanqi Tan, Jian Xu, Fei Huang, et al. 2021 · 2021
Earlier work this paper cites.
Convfinqa: Exploring the chain of numerical reasoning in conversational finance question answering
Zhiyu Chen, Shiyang Li, Charese Smiley, Zhiqiang Ma, Sameena Shah, and William Yang Wang. 2022 · 2022
Earlier work this paper cites.
Holistic evaluation of language models
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, et al. 2022 · 2022
Earlier work this paper cites.
When flue meets flang: Benchmarks and large pre-trained language model for financial domain
Raj Sanjay Shah, Kunal Chawla, Dheeraj Eidnani, Agam Shah, Wendi Du, Sudheer Chava, Natraj Raman, Charese Smiley, Jiaao Chen, and Diyi Yang. 2022 · 2022
Earlier work this paper cites.
Beyond the imitation game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, et al. 2022 · 2022
Earlier work this paper cites.
Chain of thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou. 2022 · 2022
Earlier work this paper cites.
Fingpt: Open-source financial large language models
AI4Finance-Foundation. 2023 · 2023
Cited alongside, same era.
Baichuan2-13b-chat
Baichuan-inc. 2023 · 2023
Cited alongside, same era.
Disc-finllm: A chinese financial large language model based on multiple experts fine-tuning
Fudan-DISC. 2023 · 2023
Cited alongside, same era.
C-eval: A multi-level multi-discipline chinese evaluation suite for foundation models
Yuzhen Huang, Yuzhuo Bai, Zhihao Zhu, Junlei Zhang, Jinghan Zhang, Tangjun Su, Junteng Liu, Chuancheng Lv, Yikai Zhang, Jiayi Lei, et al. 2023 · 2023
Cited alongside, same era.
Seceval: A comprehensive benchmark for evaluating cybersecurity knowledge of foundation models
Guancheng Li, Yifeng Li, Wang Guannan, Haoyu Yang, and Yang Yu. 2023 · 2023
Cited alongside, same era.
Agieval: A human-centric benchmark for evaluating foundation models
Wanjun Zhong, Ruixiang Cui, Yiduo Guo, Yaobo Liang, Shuai Lu, Yanlin Wang, Amin Saied, Weizhu Chen, and Nan Duan. 2023 · 2023
Closest in time.
Yi: Open foundation models by 01.ai
01.AI. 2024 · 2024
Closest in time.
Claude 3.5 sonnet
Anthropic. 2024 · 2024
Closest in time.
Large language model agent in financial trading: A survey
Han Ding, Yinheng Li, Junhao Wang, and Hang Chen. 2024 · 2024
Closest in time.
Financeiq: A chinese financial knowledge evaluation benchmark
Duxiaoman-DI. 2023 · 2024
Closest in time.
Chatglm: A family of large language models from glm-130b to glm-4 all tools
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Dakuan Lu, Jiaqing Liang, Yipei Xu, Qianyu He, Yipeng Geng, Mengkun Han, Yingsi Xin, Hengkui Wu, and Yanghua Xiao. 2023 · 2023
Cited alongside, same era.
Internlm: A multilingual language model with progressively enhanced capabilities
InternLM Team. 2023 · 2023
Cited alongside, same era.
Chatglm3-6b
THUDM. 2023 · 2023
Cited alongside, same era.
Evaluating the performance of large language models on gaokao benchmark
Xiaotian Zhang, Chunyang Li, Yi Zong, Zhengyu Ying, Liang He, and Xipeng Qiu. 2023 · 2023
Cited alongside, same era.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. 2021a
Cited in the paper.
Finqa: A dataset of numerical reasoning over financial data
Zhiyu Chen, Wenhu Chen, Charese Smiley, Sameena Shah, Iana Borova, Dylan Langdon, Reema Moussa, Matt Beane, Ting-Hao Huang, Bryan Routledge, et al. 2021b
Cited in the paper.
Xuanyuan2.0: A large chinese financial chat model with hundreds of billions parameters
Duxiaoman-DI. 2024a
Cited in the paper.
Team GLM, Aohan Zeng, Bin Xu, Bowen Wang, Chenhui Zhang, Da Yin, Diego Rojas, Guanyu Feng, Hanlin Zhao, Hanyu Lai, et al. 2024 · 2024
Closest in time.
The emerged security and privacy of llm agent: A survey with case studies
Feng He, Tianqing Zhu, Dayong Ye, Bo Liu, Wanlei Zhou, and Philip S. Yu. 2024 · 2024
Closest in time.
Cfgpt2: Chinese financial assistant with large language model
TongjiFinLab. 2024 · 2024
Closest in time.
Jie Zhu, Junhui Li, Yalong Wen, and Lifan Guo. 2024 · 2024
Closest in time.