Abstract
Split-and-rephrase is a challenging task that promotes the transformation of a given complex input sentence into multiple shorter sentences retaining equivalent meaning. This rewriting approach conceptualizes that shorter sentences benefit human readers and improve NLP downstream tasks attending as a preprocessing step. This work presents a complete pipeline capable of performing the split-and-rephrase method in a cross-lingual manner. We trained sequence-to-sequence neural models as from English corpora and applied them to predict the transformations in English and Brazilian Portuguese sentences jointly with BERT’s masked language modeling. Contrary to traditional approaches that seek training models with extensive vocabularies, we present a non-trivial way to construct symbolic ones generalized solely by grammatical classes (POS tags) and their respective recurrences, reducing the amount of necessary training data. This pipeline contribution showed competitive results encouraging the expansion of the method to languages other than English.- Anthology ID:
- 2021.ranlp-1.19
- Volume:
- Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021)
- Month:
- September
- Year:
- 2021
- Address:
- Held Online
- Editors:
- Ruslan Mitkov, Galia Angelova
- Venue:
- RANLP
- SIG:
- Publisher:
- INCOMA Ltd.
- Note:
- Pages:
- 155–164
- Language:
- URL:
- https://aclanthology.org/2021.ranlp-1.19
- DOI:
- Cite (ACL):
- Paulo Berlanga Neto and Evandro Eduardo Seron Ruiz. 2021. Split-and-Rephrase in a Cross-Lingual Manner: A Complete Pipeline. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), pages 155–164, Held Online. INCOMA Ltd..
- Cite (Informal):
- Split-and-Rephrase in a Cross-Lingual Manner: A Complete Pipeline (Berlanga Neto & Ruiz, RANLP 2021)
- PDF:
- https://preview.aclanthology.org/fix-dup-bibkey/2021.ranlp-1.19.pdf
- Data
- WikiSplit