BioNLP at #SMM4H-HeaRD 2026 Task 3 Estimating Flu Vaccine Effectiveness: A Temporal-Aware Fine-Tuning and Similarity-Based Few-Shot Prompting Approach

Irina Patularu


Abstract
This paper presents our systems for the SMM4H 2026 shared task on flu-related tweetclassification across two subtasks: flu vaccination status and flu test outcome classification. For each subtask, we evaluate two approaches: fine-tuning BERTweet-large with atemporal-aware architecture, cross-validation ensembling, and regularization techniques, anda GPT-4o few-shot prompting system with similarity-based dynamic example retrieval,chain-of-thought reasoning and contrastive label ranking. Fine-tuning proves superior for theflu vaccination subtask (micro-F1: 87.90%), where sufficient and relatively balanced training datais available, while few-shot prompting performs better for the flu test subtask (micro-F1: 95.74%), where limited and heavily imbalanced training data renders fine-tuning less effective.
Anthology ID:
2026.smm4h-1.41
Volume:
Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks
Month:
July
Year:
2026
Address:
San Diego, United States
Editors:
Guillermo Lopez-Garcia, Graciela Gonzalez-Hernandez
Venues:
SMM4H | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
252–259
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.smm4h-1.41/
DOI:
Bibkey:
Cite (ACL):
Irina Patularu. 2026. BioNLP at #SMM4H-HeaRD 2026 Task 3 Estimating Flu Vaccine Effectiveness: A Temporal-Aware Fine-Tuning and Similarity-Based Few-Shot Prompting Approach. In Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks, pages 252–259, San Diego, United States. Association for Computational Linguistics.
Cite (Informal):
BioNLP at #SMM4H-HeaRD 2026 Task 3 Estimating Flu Vaccine Effectiveness: A Temporal-Aware Fine-Tuning and Similarity-Based Few-Shot Prompting Approach (Patularu, SMM4H 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.smm4h-1.41.pdf