Ping Luo
Other people with similar names: Ping Luo
Unverified author pages with similar names: Ping Luo
2026
Navigating Large-Scale Document Collections: MuDABench for Multi-Document Analytical QA
Zhanli Li | Yixuan Cao | Lvzhou Luo | Ping Luo
Findings of the Association for Computational Linguistics: ACL 2026
Zhanli Li | Yixuan Cao | Lvzhou Luo | Ping Luo
Findings of the Association for Computational Linguistics: ACL 2026
This paper introduces the task of analytical question answering over large, semi-structured document collections. We present MuDABench, a benchmark for multi-document analytical QA, where questions require extracting and synthesizing information across numerous documents to perform quantitative analysis. Unlike existing multi-document QA benchmarks that typically require information from only a few documents with limited cross-document reasoning, MuDABench demands extensive inter-document analysis and aggregation. Constructed via distant supervision by leveraging document-level metadata and annotated financial databases, MuDABench comprises over 80,000 pages and 332 analytical QA instances. We also propose an evaluation protocol that measures final answer accuracy and uses intermediate-fact coverage as an auxiliary diagnostic signal for the reasoning process. Experiments reveal that standard RAG systems, which treat all documents as a flat retrieval pool, perform poorly. To address these limitations, we propose a multi-agent workflow that orchestrates planning, extraction, and code generation modules. While this approach substantially improves both process and outcome metrics, a significant gap remains compared to human expert performance. Our analysis identifies two primary bottlenecks: single-document information extraction accuracy and insufficient domain-specific knowledge in current systems. MuDABench is available at https://github.com/Zhanli-Li/MuDABench.
Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching
Bo Lv | Jingbo Sun | Jianwei Lv | Chen Tang | Shaojie Zhang | Nayu Liu | Guoxin Yu | Zihao Li | Qichao Zhang | Dongbin Zhao | Ping Luo | Yue Yu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Bo Lv | Jingbo Sun | Jianwei Lv | Chen Tang | Shaojie Zhang | Nayu Liu | Guoxin Yu | Zihao Li | Qichao Zhang | Dongbin Zhao | Ping Luo | Yue Yu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Optimizing the trade-off among predictive performance and computational cost is a central focus in the deployment of Large Language Models (LLMs). Current routing methods primarily rely on direct mapping from queries to models based on surface-level features, making them susceptible to the memorization trap and leading to poor generalizability on out-of-distribution (OOD) data. In this paper, we propose DecoR, a novel routing framework that recasts the routing task as a matching process of sifting similar queries from historical logs, effectively mitigating the memorization trap. To enhance matching accuracy, we introduce a query capability deconstruction method that decouples linguistic surface forms from task-intrinsic requirements, directing matching toward capability dimensions to ground decisions in essential task attributes. Furthermore, we develop CodaSet, a comprehensive benchmark for assessing routing generalization, where experimental results demonstrate that DecoR maintains superior accuracy while substantially lowering inference costs across both in-distribution and OOD settings.