Speech-Transformer: A No-Recurrence Sequence-to-Sequence Model for Speech Recognition

Recurrent sequence-to-sequence models using encoder-decoder architecture have made great progress in speech recognition task. However, they suffer from the drawback of slow training speed because the internal recurrence limits the training parallelization. In this paper, we present the Speech-Transf... View More