Accelerating NMT Batched Beam Decoding with LMBR Posteriors for Deployment

04/30/2018
by   Gonzalo Iglesias, et al.
0

We describe a batched beam decoding algorithm for NMT with LMBR n-gram posteriors, showing that LMBR techniques still yield gains on top of the best recently reported results with Transformers. We also discuss acceleration strategies for deployment, and the effect of the beam size and batching on memory and speed.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset