Surprisal-Triggered Conditional Computation with Neural Networks
Published in arXiv, 2020
Recommended citation: L. Lugosch, D. Nowrouzezahrai, B. H. Meyer, “Surprisal-Triggered Conditional Computation with Neural Networks”, arXiv, 2020. https://arxiv.org/abs/2006.01659
Introduces a new use for autoregressive models: allocating more computation to more difficult inputs.
Code: https://github.com/lorenlugosch/conditional-computation-using-surprisal