Leveraging LLM-based sentiment analysis for portfolio optimization with proximal policy optimization

Kemal Kirtac, Guido Germano


Abstract
Reinforcement learning (RL) offers adaptive solutions to portfolio optimization, yet standard methods such as proximal policy optimization (PPO) rely exclusively on historical price data and overlook the impact of investor sentiment. We introduce sentiment-augmented PPO (SAPPO), a reinforcement learning framework that incorporates real-time sentiment signals extracted from Refinitiv financial news. Daily sentiment scores are generated using LLaMA 3.3. SAPPO integrates these signals into the PPO advantage function via a sentiment-weighted term, enabling allocation strategies that respond to both price movements and market sentiment. Experiments on a three-asset portfolio demonstrate that SAPPO increases the Sharpe ratio from 1.55 to 1.90 and reduces drawdowns relative to PPO. The optimal configuration uses a sentiment influence parameter 𝜆 = 0.1, as validated through ablation studies and statistically significant t-tests (p < 0.001). These findings show that sentiment-aware reinforcement learning improves trading performance and offers a robust alternative to purely price-based strategies.
Anthology ID:
2025.realm-1.12
Volume:
Proceedings of the 1st Workshop for Research on Agent Language Models (REALM 2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Ehsan Kamalloo, Nicolas Gontier, Xing Han Lu, Nouha Dziri, Shikhar Murty, Alexandre Lacoste
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
160–169
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.realm-1.12/
DOI:
Bibkey:
Cite (ACL):
Kemal Kirtac and Guido Germano. 2025. Leveraging LLM-based sentiment analysis for portfolio optimization with proximal policy optimization. In Proceedings of the 1st Workshop for Research on Agent Language Models (REALM 2025), pages 160–169, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Leveraging LLM-based sentiment analysis for portfolio optimization with proximal policy optimization (Kirtac & Germano, REALM 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.realm-1.12.pdf