Single-Pass, Depth-Selective Reading for Multi-Aspect Sentiment Analysis

Yan Xia, Zhuangzhuang Pan, Amirrudin Kamsin, Chee Seng Chan


Abstract
Aspect-Term Sentiment Analysis (ATSA) in multi-aspect sentences faces a fundamental tradeoff between efficiency and expressiveness. Existing models either re-encode the sentence for each aspect or rely on static use of deep representations, leading to redundant computation and limited adaptivity. We argue that Transformer depth is a costly, queryable resource, and propose DABS, a single-pass inference framework that encodes each sentence once to construct a reusable, depth-ordered substrate. Each aspect then queries this shared representation to selectively read relevant tokens and abstraction levels, without re-encoding. This decouples shared sentence encoding from lightweight, aspect-conditioned readout. Experiments on four ATSA benchmarks show that DABS achieves competitive performance while reducing end-to-end computation by up to 60% in multi-aspect settings (M ≥ 2). Further analyses indicate that adaptive depth querying is most beneficial for linguistically complex cases such as negation and contrast. Code is publicly available at https://github.com/panzhzh/acl-dabs.
Anthology ID:
2026.acl-long.667
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14638–14656
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.667/
DOI:
Bibkey:
Cite (ACL):
Yan Xia, Zhuangzhuang Pan, Amirrudin Kamsin, and Chee Seng Chan. 2026. Single-Pass, Depth-Selective Reading for Multi-Aspect Sentiment Analysis. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14638–14656, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Single-Pass, Depth-Selective Reading for Multi-Aspect Sentiment Analysis (Xia et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.667.pdf
Checklist:
 2026.acl-long.667.checklist.pdf