@inproceedings{tagliabue-etal-2025-deep,
    title = "{DEEP}: an automatic bidirectional translator leveraging an {ASR} for translation of {I}talian sign language",
    author = "Tagliabue, Nicolas  and
      Colletti, Elisa  and
      Dani, Francesco Roberto  and
      Tedesco, Roberto  and
      Cenceschi, Sonia  and
      Trivilini, Alessandro",
    editor = "Mishra, Pushkar  and
      Muresan, Smaranda  and
      Yu, Tao",
    booktitle = "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingestion-acl-25/2025.acl-demo.22/",
    pages = "221--229",
    ISBN = "979-8-89176-253-4",
    abstract = "DEEP is a bidirectional translation system for the Italian Sign Language, tailored to two specific, common use cases: pharmacies and the registry office of the municipality, for which a custom corpus has been collected. Two independent pipelines permit to create a chatlike interaction style, where the deaf subject just signs in front of a camera, and sees a virtual LIS interpreter, while the hearing subject reads and writes messages into a chat UI. The LIS-to-Italian pipeline leverages, in a novel way, a customized Whisper model (a wellknown speech recognition system), by means of ``pseudo-spectrograms''. The Italian-to-LIS pipeline leverages a virtual avatar created with Viggle.ai. DEEP has been evaluated with LIS signers, obtaining very promising results."
}