Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis
Zachary Zhou, Alisha Zachariah, Devin Conathan, Jeffery Kline
- Anthology ID:
- 2022.eval4nlp-1.2
- Volume:
- Proceedings of the 3rd Workshop on Evaluation and Comparison of NLP Systems
- Month:
- November
- Year:
- 2022
- Address:
- Online
- Editors:
- Daniel Deutsch, Can Udomcharoenchaikit, Juri Opitz, Yang Gao, Marina Fomicheva, Steffen Eger
- Venue:
- Eval4NLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 11–20
- Language:
- URL:
- https://aclanthology.org/2022.eval4nlp-1.2
- DOI:
- 10.18653/v1/2022.eval4nlp-1.2
- Cite (ACL):
- Zachary Zhou, Alisha Zachariah, Devin Conathan, and Jeffery Kline. 2022. Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis. In Proceedings of the 3rd Workshop on Evaluation and Comparison of NLP Systems, pages 11–20, Online. Association for Computational Linguistics.
- Cite (Informal):
- Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis (Zhou et al., Eval4NLP 2022)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/2022.eval4nlp-1.2.pdf