Taehyeon Kim
2025
C2: Scalable Auto-Feedback for LLM-based Chart Generation
Woosung Koh
|
Janghan Yoon
|
MinHyung Lee
|
Youngjin Song
|
Jaegwan Cho
|
Jaehyun Kang
|
Taehyeon Kim
|
Se-Young Yun
|
Youngjae Yu
|
Bongshin Lee
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
2024
Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters
Euiin Yi
|
Taehyeon Kim
|
Hongseok Jeung
|
Du-Seong Chang
|
Se-Young Yun
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) have revolutionized natural language processing and broadened their applicability across diverse commercial applications. However, the deployment of these models is constrained by high inference time in multilingual settings. To mitigate this challenge, this paper explores a training recipe of an assistant model in speculative decoding, which are leveraged to draft and-then its future tokens are verified by the target LLM. We show that language-specific draft models, optimized through a targeted pretrain-and-finetune strategy, substantially brings a speedup of inference time compared to the previous methods. We validate these models across various languages in inference time, out-of-domain speedup, and GPT-4o evaluation.
Search
Fix data
Co-authors
- Se-Young Yun 2
- Du-Seong Chang 1
- Jaegwan Cho 1
- Hongseok Jeung 1
- Jaehyun Kang 1
- show all...