Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis

Shohei Zhou, Alisha Zachariah, Devin Conathan, Jeffery Kline


Anthology ID:
2022.eval4nlp-1.2
Volume:
Proceedings of the 3rd Workshop on Evaluation and Comparison of NLP Systems
Month:
November
Year:
2022
Address:
Online
Venue:
Eval4NLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11–20
Language:
URL:
https://aclanthology.org/2022.eval4nlp-1.2
DOI:
10.18653/v1/2022.eval4nlp-1.2
Bibkey:
Cite (ACL):
Shohei Zhou, Alisha Zachariah, Devin Conathan, and Jeffery Kline. 2022. Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis. In Proceedings of the 3rd Workshop on Evaluation and Comparison of NLP Systems, pages 11–20, Online. Association for Computational Linguistics.
Cite (Informal):
Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis (Zhou et al., Eval4NLP 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2022.eval4nlp-1.2.pdf