FLARE: Task-Agnostic Embedding Model Evaluation via Normalizing Flows

Jingzhou Jiang, Yixuan Tang, Yi Yang, Kar Yan Tam


Abstract
Despite the widespread adoption of text embedding models, selecting the optimal model for a specific target corpus remains challenging due to the lack of task-specific labels. While task-agnostic evaluation offers a promising solution by relying on unlabeled data, existing approaches based on kernel estimators or Gaussian mixtures fail to model high-dimensional distributions effectively, resulting in unstable rankings. To address this limitation, we propose FLARE (Flow-based Label-free Assessment of Representation Embeddings), which employs normalizing flows to estimate information sufficiency in high-dimensional spaces. By learning invertible transformations, flows enable exact density estimation while mitigating the instability inherent in distance-based methods. We provide theoretical guarantees showing that our estimation error depends on the data’s intrinsic structure rather than its raw dimensionality. Experiments across 11 datasets demonstrate that FLARE achieves a strong Spearman’s ρ (up to 0.90) with supervised benchmarks, remaining robust even for high-dimensional embeddings (d ≥ 3,584).
Anthology ID:
2026.findings-acl.1957
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
39271–39294
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1957/
DOI:
Bibkey:
Cite (ACL):
Jingzhou Jiang, Yixuan Tang, Yi Yang, and Kar Yan Tam. 2026. FLARE: Task-Agnostic Embedding Model Evaluation via Normalizing Flows. In Findings of the Association for Computational Linguistics: ACL 2026, pages 39271–39294, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
FLARE: Task-Agnostic Embedding Model Evaluation via Normalizing Flows (Jiang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1957.pdf
Checklist:
 2026.findings-acl.1957.checklist.pdf