Maha Tufail Agro
2025
Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Experts
Zain Muhammad Mujahid
|
Dilshod Azizov
|
Maha Tufail Agro
|
Preslav Nakov
Findings of the Association for Computational Linguistics: ACL 2025
In an age characterized by the proliferation of mis- and disinformation online, it is critical to empower readers to understand the content they are reading. Important efforts in this direction rely on manual or automatic fact-checking, which can be challenging for emerging claims with limited information. Such scenarios can be handled by assessing the reliability and the political bias of the source of the claim, i.e., characterizing entire news outlets rather than individual claims or articles. This is an important but understudied research direction. While prior work has looked into linguistic and social contexts, we do not analyze individual articles or information in social media. Instead, we propose a novel methodology that emulates the criteria that professional fact-checkers use to assess the factuality and political bias of an entire outlet. Specifically, we design a variety of prompts based on these criteria and elicit responses from large language models (LLMs), which we aggregate to make predictions. In addition to demonstrating sizable improvements over strong baselines via extensive experiments with multiple LLMs, we provide an in-depth error analysis of the effect of media popularity and region on model performance. Further, we conduct an ablation study to highlight the key components of our dataset that contribute to these improvements. To facilitate future research, we released our dataset and code.
2024
PALM: Few-Shot Prompt Learning for Audio Language Models
Asif Hanif
|
Maha Tufail Agro
|
Mohammad Areeb Qazi
|
Hanan Aldarmaki
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Audio-Language Models (ALMs) have recently achieved remarkable success in zero-shot audio recognition tasks, which match features of audio waveforms with class-specific text prompt features, inspired by advancements in Vision-Language Models (VLMs). Given the sensitivity of zero-shot performance to the choice of hand-crafted text prompts, many prompt learning techniques have been developed for VLMs. We explore the efficacy of these approaches in ALMs and propose a novel method, Prompt Learning in Audio Language Models (PALM), which optimizes the feature space of the text encoder branch. Unlike existing methods that work in the input space, our approach results in greater training efficiency. We demonstrate the effectiveness of our approach on 11 audio recognition datasets, encompassing a variety of speech-processing tasks, and compare the results with three baselines in a few-shot learning setup. Our method is either on par with or outperforms other approaches while being computationally less demanding. Our code is publicly available at https://asif-hanif.github.io/palm/.
2023
Handling Realistic Label Noise in BERT Text Classification
Maha Tufail Agro
|
Hanan Aldarmaki
Proceedings of the 6th International Conference on Natural Language and Speech Processing (ICNLSP 2023)
Search
Fix author
Co-authors
- Hanan Aldarmaki 2
- Dilshod Azizov 1
- Asif Hanif 1
- Zain Muhammad Mujahid 1
- Preslav Nakov 1
- show all...