Title: Word Beam Search: A Connectionist Temporal Classification Decoding Algorithm
Language: English
Authors: Scheidl, Harald 
Fiel, Stefan 
Sablatnig, Robert  
Issue Date: 2018
Scheidl, H., Fiel, S., & Sablatnig, R. (2018). Word Beam Search: A Connectionist Temporal Classification Decoding Algorithm. In 16th International Conference on Frontiers in Handwriting Recognition (ICFHR 2018). Niagara Falls. https://doi.org/10.1109/ICFHR-2018.2018.00052
Recurrent Neural Networks (RNNs) are used for sequence recognition tasks such as Handwritten Text Recognition (HTR) or speech recognition. If trained with the Connectionist Temporal Classification (CTC) loss function, the output of such a RNN is a matrix containing character probabilities for each time-step. A CTC decoding algorithm maps these character probabilities to the final text. Token passing is such an algorithm and is able to constrain the recognized text to a sequence of dictionary words. However, the running time of token passing depends quadratically on the dictionary size and it is not able to decode arbitrary character strings like numbers. This paper proposes word beam search decoding, which is able to tackle these problems. It constrains words to those contained in a dictionary, allows arbitrary non-word character strings between words, optionally integrates a word-level language model and has a better running time than token passing. The proposed algorithm outperforms best path decoding, vanilla beam search decoding and token passing on the IAM and Bentham HTR datasets. An open-source implementation is provided.
Keywords: connectionist temporal classification; decoding; language model; recurrent neural network; speech recognition; handwritten text recognition
URI: https://resolver.obvsg.at/urn:nbn:at:at-ubtuw:3-3778
Library ID: AC15148695
Organisation: E193 - Institut für Visual Computing and Human-Centered Technology 
Publication Type: Inproceedings
Appears in Collections:Conference Paper

Files in this item:

Page view(s)

checked on Jan 27, 2022


checked on Jan 27, 2022

Google ScholarTM


Items in reposiTUm are protected by copyright, with all rights reserved, unless otherwise indicated.