Adam Majczyk
2025
Less is More—Achieving SOTA at PolEval 2025 Task 2a: Gender-inclusive LLMs for Polish (Proofreading) with LoRA and Qwen3-8B
Adam Majczyk
Proceedings of the PolEval 2025 Workshop
Adam Majczyk
Proceedings of the PolEval 2025 Workshop
In this paper the winning solution of PolEval 2025 Task 2a is presented. The approach utilizes LoRA fine-tuning of the Qwen3-8B model. Multiple LoRA matrix ranks are explored. Versions with and without the system prompt in loss calculation are evaluated. New SOTA was established at F1=0.6039 beating the previously best model at F1=0.5985. After the task’s conclusion the solution was improved upon and F1=0.6283±0.0056 was achieved.