Fine-Tuning vs Prompting Techniques for Gender-Fair Rewriting of Machine Translations

Paolo Mainardi, Federico Garcea, Alberto Barrón-Cedeño


Abstract
Increasing attention is being dedicated by the NLP community to gender-fair practices, including emerging forms of non-binary language. Given the shift to the prompting paradigm for multiple tasks, direct comparisons between prompted and fine-tuned models in this context are lacking. We aim to fill this gap by comparing prompt engineering and fine-tuning techniques for gender-fair rewriting in Italian. We do so by framing a rewriting task where Italian gender-marked translations from English gender-ambiguous sentences are adapted into a gender-neutral alternative using direct non-binary language. We augment existing datasets with gender-neutral translations and conduct experiments to determine the best architecture and approach to complete such task, by fine-tuning and prompting seq2seq encoder-decoder and autoregressive decoder-only models. We show that smaller seq2seq models can reach good performance when fine-tuned, even with relatively little data; when it comes to prompts, including task demonstrations is crucial, and we find that chat-tuned models reach the best results in a few-shot setting. We achieve promising results, especially in contexts of limited data and resources.
Anthology ID:
2025.gebnlp-1.28
Volume:
Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP)
Month:
August
Year:
2025
Address:
Vienna, Austria
Editors:
Agnieszka Faleńska, Christine Basta, Marta Costa-jussà, Karolina Stańczak, Debora Nozza
Venues:
GeBNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
320–337
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.gebnlp-1.28/
DOI:
10.18653/v1/2025.gebnlp-1.28
Bibkey:
Cite (ACL):
Paolo Mainardi, Federico Garcea, and Alberto Barrón-Cedeño. 2025. Fine-Tuning vs Prompting Techniques for Gender-Fair Rewriting of Machine Translations. In Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP), pages 320–337, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Fine-Tuning vs Prompting Techniques for Gender-Fair Rewriting of Machine Translations (Mainardi et al., GeBNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.gebnlp-1.28.pdf