Aranyak Acharyya
2025
Statistical inference on black-box generative models in the data kernel perspective space
Hayden Helm
|
Aranyak Acharyya
|
Youngser Park
|
Brandon Duderstadt
|
Carey Priebe
Findings of the Association for Computational Linguistics: ACL 2025
Generative models are capable of producing human-expert level content across a variety of topics and domains. As the impact of generative models grows, it is necessary to develop statistical methods to understand collections of available models. These methods are particularly important in settings where the user may not have access to information related to a model’s pre-training data, weights, or other relevant model-level covariates. In this paper we extend recent results on representations of black-box generative models to model-level statistical inference tasks. We demonstrate that the model-level representations are effective for multiple inference tasks.