ISIT, 2017
This paper is about neural offset min-sum decoding (NOMS), a generalization of the offset min-sum algorithm used in practical channel decoders for LDPC codes.
Recommended citation: L. Lugosch and W. J. Gross, "Neural offset min-sum decoding," 2017 IEEE International Symposium on Information Theory (ISIT), Aachen, 2017, pp. 1361-1365. https://arxiv.org/abs/1701.05931
IEEE Journal of Selected Topics in Signal Processing, 2018
A collaboration between researchers at Tel-Aviv University and McGill University describing a family of neural belief propagation algorithms for channel decoding.
Recommended citation: E. Nachmani, E. Marciano, L. Lugosch, W. J. Gross, D. Burshtein and Y. Be’ery, "Deep learning methods for improved decoding of linear codes," in IEEE Journal of Selected Topics in Signal Processing, special issue on "Machine Learning for Cognition in Radio Communications and Radar", vol. 12, no. 1, pp. 119-131, Feb. 2018. https://arxiv.org/abs/1706.07043
Masters thesis, 2018
Channel coding enables reliable communication over unreliable, noisy channels: by encoding messages with redundancy, it is possible to decode the messages in such a way that errors introduced by the channel are corrected. Modern channel codes achieve very low error rates at long block lengths, but long blocks are often not acceptable for low-latency applications. While there exist short block codes with excellent error-correction performance when decoded optimally, designing practical, low-complexity decoding algorithms that can achieve close-to-optimal results for short codes is still an open problem. In this thesis, we explore an approach to decoding short block codes in which the decoder is recast as a machine learning algorithm. After providing the background concepts on errorcorrecting codes and machine learning, we review the literature on learning algorithms for error correction, with a special emphasis on the recently introduced “neural belief propagation” algorithm. We then describe a set of modifications to neural belief propagation which improve its performance and reduce its implementation complexity. We also propose a new syndrome-based output layer for neural error-correcting decoders which takes the code structure into account during training to yield decoders with lower frame error rate. Finally, we suggest some future work.
Recommended citation: L. Lugosch, “Learning algorithms for error correction”, Masters thesis, McGill University, 2018. http://lorenlugosch.github.io/Masters_Thesis.pdf
Interspeech, 2018
An acoustic model for tonal languages that uses convolutional lifters operating on the cepstrogram representation of the input speech signal and CTC to map inputs to outputs to achieve better tone recognition performance.
Recommended citation: L. Lugosch and V. S. Tomar, “Tone recognition using lifters and CTC”, Interspeech, Hyderabad, India, pp. 2305-2309, September 2018. https://arxiv.org/abs/1807.02465
Asilomar, 2018
Use a differentiable relaxation of the syndrome as the loss function for training neural network channel decoders for improved frame error rate and online unsupervised learning. (Invited paper.)
Recommended citation: L. Lugosch, W. J. Gross, "Learning from the syndrome," in Asilomar Conference on Signals, Systems, and Computers, special session on "Machine Learning for Wireless Systems", Oct. 2018. https://arxiv.org/abs/1810.10902
NeurIPS IRASL Workshop, 2018
Train your device to wake up for any phrase you want by recording the phrase three times, estimating the label sequence using a beam search, and computing the log probability of the label sequence at test time using the forward algorithm.
Recommended citation: L. Lugosch, S. Myer, and V. S. Tomar, “DONUT: CTC-based query-by-example keyword spotting”, NeurIPS Workshop on Interpretability and Robustness in Audio, Speech, and Language, Montreal, Canada, December 2018. https://arxiv.org/abs/1811.10736
Interspeech, 2019
Introduces the Fluent Speech Commands dataset and an ASR-based pre-training method for end-to-end SLU models.
Recommended citation: L. Lugosch, M. Ravanelli, P. Ignoto, V. S. Tomar, Y. Bengio, “Speech Model Pre-training for End-to-End Spoken Language Understanding”, Interspeech, September 2019. https://arxiv.org/abs/1904.03670
ICASSP, 2020
Proposes training end-to-end SLU models using synthesized speech to avoid recording real speakers.
Recommended citation: L. Lugosch, B. Meyer, D. Nowrouzezahrai, M. Ravanelli, “Using Speech Synthesis to Train End-to-End Spoken Language Understanding Models”, ICASSP 2020. https://arxiv.org/abs/1910.09463
arXiv, 2020
Introduces a new use for autoregressive models: allocating more computation to more difficult inputs.
Recommended citation: L. Lugosch, D. Nowrouzezahrai, B. H. Meyer, “Surprisal-Triggered Conditional Computation with Neural Networks”, arXiv, 2020. https://arxiv.org/abs/2006.01659
Undergraduate course, McGill University, 2015
Teaching assistant (Fall 2015, Fall 2016)
Undergraduate course, McGill University, 2015
Teaching assistant (Fall 2015)
Undergraduate course, McGill University, 2016
Teaching assistant (Winter 2016)
Undergraduate course, McGill University, 2016
Course project designer (Winter 2016)
Undergraduate course, McGill University, 2016
Teaching assistant (Fall 2016)
Undergraduate course, McGill University, 2017
Teaching assistant (Winter 2017)
Undergraduate course, McGill University, 2017
Teaching assistant (Winter 2017)
Graduate course, Université de Montréal, 2019
Teaching assistant (Fall 2019)
Graduate course, McGill University, 2020
Teaching assistant (Winter 2020)