A Multimodal Framework for Financial Fake News Detection for Brazilian Portuguese

José Vitor Souza Cardoso Requena, João Victor Assaoka Ribeiro, Lilian Berton


Abstract
The rapid dissemination of digital information has exposed financial markets to the risks of disinformation. Although numerous methods exist to detect fake news, they predominantly focus on textual features, often neglecting the significant role of image-based content. This paper introduces a novel framework for detecting financial fake news in Brazilian Portuguese by bridging this gap. The proposed system integrates Natural Language Processing (NLP) with an image-to-text classification strategy: using a Tesseract-based OCR, the system extracts text from images and processes it using the unified pipeline used for text classification. Experiments on Fake.BR, FakeRecogna corpus and BBC News Brasil show that our approach achieves 98% accuracy using BERTimbau Fine Tuned on financial news. These findings underscore the critical importance of analyzing visual text and demonstrate the multimodal strategy is effective for disinformation detection.
Anthology ID:
2026.propor-1.23
Volume:
Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 1
Month:
April
Year:
2026
Address:
Salvador, Brazil
Editors:
Marlo Souza, Iria de-Dios-Flores, Diana Santos, Larissa Freitas, Jackson Wilke da Cruz Souza, Eugénio Ribeiro
Venue:
PROPOR
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
234–239
Language:
URL:
https://preview.aclanthology.org/ingest-dnd/2026.propor-1.23/
DOI:
Bibkey:
Cite (ACL):
José Vitor Souza Cardoso Requena, João Victor Assaoka Ribeiro, and Lilian Berton. 2026. A Multimodal Framework for Financial Fake News Detection for Brazilian Portuguese. In Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 1, pages 234–239, Salvador, Brazil. Association for Computational Linguistics.
Cite (Informal):
A Multimodal Framework for Financial Fake News Detection for Brazilian Portuguese (Requena et al., PROPOR 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-dnd/2026.propor-1.23.pdf