Andrian Kravchenko
2026
Data-Efficient Adaptation of Multilingual LLMs to Ukrainian
Yurii Paniv | Bohdan Didenko | Mykola Haltiuk | Vladyslav Humennyy | Andrian Kravchenko | Roman Kyslyi | Viktoriia Makovska | Artem Orlovskyi | Bohdan Ruban | Maksym-Yurii Rudko | Anastasiia Senyk | Nazarii Drushchak | Dmytro Chaplynskyi | Mariana Romanyshyn
Proceedings of the Fifth Ukrainian Natural Language Processing Conference (UNLP 2026)
Yurii Paniv | Bohdan Didenko | Mykola Haltiuk | Vladyslav Humennyy | Andrian Kravchenko | Roman Kyslyi | Viktoriia Makovska | Artem Orlovskyi | Bohdan Ruban | Maksym-Yurii Rudko | Anastasiia Senyk | Nazarii Drushchak | Dmytro Chaplynskyi | Mariana Romanyshyn
Proceedings of the Fifth Ukrainian Natural Language Processing Conference (UNLP 2026)
Adapting large language models to low-resource languages presents three interconnected challenges: inefficient tokenization, scarcity of high-quality annotated data, and limited resources for instruction tuning. We present a reproducible approach that addresses each challenge using data-centric methods that primarily rely on unlabeled text corpora, parallel translation data, and a multilingual base model. Our approach combines (1) vocabulary surgery for tokenizer adaptation without full retraining, (2) cross-lingual transfer of quality classifiers via translation, enabling filtering without target-language annotations, and (3) generation of instruction data through translation, task conversion, and targeted synthesis. We validate this recipe by adapting Gemma-3-12B to Ukrainian. %, producing Lapa-12BOur pretrained model achieves top performance on Ukrainian benchmarks, while our instruction-tuned variant demonstrates strong performance on translation (33 BLEU on FLORES), summarization, and question-answering tasks, while requiring 1.5x fewer tokens than the original model for the same text. We release all models, datasets, classifiers, and code to enable replication for other languages.
2025
UAlign: LLM Alignment Benchmark for the Ukrainian Language
Andrian Kravchenko | Yurii Paniv | Nazarii Drushchak
Proceedings of the Fourth Ukrainian Natural Language Processing Workshop (UNLP 2025)
Andrian Kravchenko | Yurii Paniv | Nazarii Drushchak
Proceedings of the Fourth Ukrainian Natural Language Processing Workshop (UNLP 2025)
This paper introduces UAlign, the comprehensive benchmark for evaluating the alignment of Large Language Models (LLMs) in the Ukrainian language. The benchmark consists of two complementary components: a moral judgment dataset with 3,682 scenarios of varying ethical complexities and a dataset with 1,700 ethical situations presenting clear normative distinctions. Each element provides parallel English-Ukrainian text pairs, enabling cross-lingual comparison. Unlike existing resources predominantly developed for high-resource languages, our benchmark addresses the critical need for evaluation resources in Ukrainian. The development process involved machine translation and linguistic validation using Ukrainian language models for grammatical error correction. Our cross-lingual evaluation of six LLMs confirmed the existence of a performance gap between alignment in Ukrainian and English while simultaneously providing valuable insights regarding the overall alignment capabilities of these models. The benchmark has been made publicly available to facilitate further research initiatives and enhance commercial applications.Warning: The datasets introduced in this paper contain sensitive materials related to ethical and moral scenarios that may include offensive, harmful, illegal, or controversial content.