Prompting ChatGPT to Draw Morphological Connections for New Word Comprehension

Bianca-Madalina Zgreaban, Rishabh Suresh

Abstract
Though more powerful, Large Language Models need to be periodically retrained for updated information, consuming resources and energy. In this respect, prompt engineering can prove a possible solution to re-training. To explore this line of research, this paper uses a case study, namely, finding the best prompting strategy for asking ChatGPT to define new words based on morphological connections. To determine the best prompting strategy, each definition provided by the prompt was ranked in terms of plausibility and humanlikeness criteria. The findings of this paper show that adding contextual information, operationalised as the keywords ‘new’ and ‘morpheme’, significantly improve the performance of the model for any prompt. While no single prompt significantly outperformed all others, there were differences between performances on the two criteria for most prompts. ChatGPT also provided the most correct definitions with a persona-type prompt.
Anthology ID:
2023.ranlp-stud.11
Volume:
Proceedings of the 8th Student Research Workshop associated with the International Conference Recent Advances in Natural Language Processing
Month:
September
Year:
2023
Address:
Varna, Bulgaria
Editors:
Momchil Hardalov, Zara Kancheva, Boris Velichkov, Ivelina Nikolova-Koleva, Milena Slavcheva
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
98–107
Language:
URL:
https://aclanthology.org/2023.ranlp-stud.11
DOI:
Bibkey:
Cite (ACL):
Bianca-Madalina Zgreaban and Rishabh Suresh. 2023. Prompting ChatGPT to Draw Morphological Connections for New Word Comprehension. In Proceedings of the 8th Student Research Workshop associated with the International Conference Recent Advances in Natural Language Processing, pages 98–107, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Prompting ChatGPT to Draw Morphological Connections for New Word Comprehension (Zgreaban & Suresh, RANLP 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2023.ranlp-stud.11.pdf
Optional supplementary material:
 2023.ranlp-stud.11.OptionalSupplementaryMaterial.zip
PDF Search Optional supplementary material