@inproceedings{parsons-etal-2025-match,
    title = "Match {\textquoteleft}em: {Multi-Tiered} Alignment for Error Analysis in {ASR}",
    author = "Parsons, Phoebe  and
      Kvale, Knut  and
      Svendsen, Torbj{\o}rn  and
      Salvi, Giampiero",
    editor = "Johansson, Richard  and
      Stymne, Sara",
    booktitle = "Proceedings of the Joint 25th Nordic Conference on Computational Linguistics and 11th Baltic Conference on Human Language Technologies (NoDaLiDa/Baltic-HLT 2025)",
    month = mar,
    year = "2025",
    address = "Tallinn, Estonia",
    publisher = "University of Tartu Library",
    url = "https://preview.aclanthology.org/landing_page/2025.nodalida-1.48/",
    pages = "440--447",
    ISBN = "978-9908-53-109-0",
    abstract = "We introduce {\textquotedblleft}Match {\textquoteleft}em{\textquotedblright}: a new framework for aligning output from automatic speech recognition (ASR) with reference transcriptions. This allows a more detailed analysis of errors produced by end-to-end ASR systems compared to word error rate (WER). Match {\textquoteleft}em performs the alignment on both the word and character level; each relying on information from the other to provide the most meaningful global alignment. At the character level, we define a speech production motivated character similarity metric. At the word level, we rely on character similarities to define word similarity and, additionally, we reconcile compounding (insertion or deletion of spaces). We evaluated Match {\textquoteleft}em on transcripts of three European languages produced by wav2vec2 and Whisper. We show that Match {\textquoteleft}em results in more similar word substitution pairs and that compound reconciling can capture a broad range of spacing errors. We believe Match {\textquoteleft}em to be a valuable tool for ASR error analysis across many languages."
}