Abstract
In response to the limitations of manual ad creation, significant research has been conducted in the field of automatic ad text generation (ATG). However, the lack of comprehensive benchmarks and well-defined problem sets has made comparing different methods challenging. To tackle these challenges, we standardize the task of ATG and propose a first benchmark dataset, CAMERA, carefully designed and enabling the utilization of multi-modal information and facilitating industry-wise evaluations. Our extensive experiments with a variety of nine baselines, from classical methods to state-of-the-art models including large language models (LLMs), show the current state and the remaining challenges. We also explore how existing metrics in ATG and an LLM-based evaluator align with human evaluations.- Anthology ID:
- 2024.acl-long.54
- Volume:
- Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Lun-Wei Ku, Andre Martins, Vivek Srikumar
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 955–972
- Language:
- URL:
- https://preview.aclanthology.org/add_missing_videos/2024.acl-long.54/
- DOI:
- 10.18653/v1/2024.acl-long.54
- Cite (ACL):
- Masato Mita, Soichiro Murakami, Akihiko Kato, and Peinan Zhang. 2024. Striking Gold in Advertising: Standardization and Exploration of Ad Text Generation. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 955–972, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- Striking Gold in Advertising: Standardization and Exploration of Ad Text Generation (Mita et al., ACL 2024)
- PDF:
- https://preview.aclanthology.org/add_missing_videos/2024.acl-long.54.pdf