Justin Qiu
2025
StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples
Ajay Patel
|
Jiacheng Zhu
|
Justin Qiu
|
Zachary Horvitz
|
Marianna Apidianaki
|
Kathleen McKeown
|
Chris Callison-Burch
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Style representations aim to embed texts with similar writing styles closely and texts with different styles far apart, regardless of content. However, the contrastive triplets often used for training these representations may vary in both style and content, leading to potential content leakage in the representations. We introduce StyleDistance, a novel approach to training stronger content-independent style embeddings. We use a large language model to create a synthetic dataset of near-exact paraphrases with controlled style variations, and produce positive and negative examples across 40 distinct style features for precise contrastive learning. We assess the quality of our synthetic data and embeddings through human and automatic evaluations. StyleDistance enhances the content-independence of style embeddings, which generalize to real-world benchmarks and outperform leading style representations in downstream applications.
Search
Fix data
Co-authors
- Marianna Apidianaki 1
- Chris Callison-Burch 1
- Zachary Horvitz 1
- Kathleen McKeown 1
- Ajay Patel 1
- show all...