Fetching the paper…

Reading the bibliography…

2023

Financial News Analytics Using Fine-Tuned Llama 2 GPT Model

Pavlyshenko, Bohdan M.

Original
PDF
Post on X

Understand

The paper considers the possibility to fine-tune Llama 2 GPT large language model (LLM) for the multitask analysis of financial news.

For fine-tuning, the PEFT/LoRA based approach was used.
In the study, the model was fine-tuned for the following tasks: analysing a text from financial market perspectives, highlighting main points of a text, summarizing a text and extracting named entities with appropriate sentiments.
The obtained results show that the fine-tuned Llama 2 model can perform a multitask financial news analysis with a specified structure of response, part of response can be a structured text and another part of data can have JSON format for further processing.

Financial News Analytics Using Fine-Tuned Llama 2 GPT Model · Around

Built on

TRL: Transformer Reinforcement Learning
Leandro von Werra, Younes Belkada, Lewis Tunstall, Edward Beeching, Tristan Thrush, Nathan Lambert, and Shengyi Huang · 2020
Earlier work this paper cites.
Using Bayesian regression for stacking time series predictive models
Original
Bohdan M. Pavlyshenko · 2020
Earlier work this paper cites.
Sales time series analytics using deep Q-learning
Original
Bohdan M. Pavlyshenko · 2020
Earlier work this paper cites.
Lora: Low-rank adaptation of large language models
Original
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen · 2021
Earlier work this paper cites.

Similar

Forming Predictive Features of Tweets for Decision-Making Support
Original
Bohdan M. Pavlyshenko · 2022
Cited alongside, same era.
Methods of Informational Trends Analytics and Fake News Detection on Twitter
Original
Bohdan M. Pavlyshenko · 2022
Cited alongside, same era.
PEFT: State-of-the-art Parameter-Efficient Fine-Tuning methods
Sourab Mangrulkar, Sylvain Gugger, Lysandre Debut, Younes Belkada, and Sayak Paul · 2022
Cited alongside, same era.
Analytics of Business Time Series Using Machine Learning and Bayesian Inference
Original
Bohdan M. Pavlyshenko · 2022
Cited alongside, same era.
US Financial News Articles
Kaggle.Com
Cited in the paper.

Then

FinGPT: Open-Source Financial Large Language Models
Original
Hongyang Yang, Xiao-Yang Liu, and Christina Dan Wang · 2023
Closest in time.
Llama 2: Open foundation and fine-tuned chat models
Original
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023
Closest in time.
Stackllama: A hands-on guide to train llama with rlhf, 2023
Edward Beeching, Younes Belkada, Kashif Rasul, Lewis Tunstall, Leandro von Werra, Nazneen Rajani, and Nathan Lambert · 2023
Closest in time.
Llama 2 is here - get it on hugging face
HuggingFace · 2023
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…