References
The works cited in the tutorials, the implementation notes and the theory vault. The same bibliography, docs/src/refs.bib, is rendered as the vault's Bibliography note.
- Arriola, M.; Gokaslan, A.; Chiu, J. T.; Yang, Z.; Qi, Z.; Han, J.; Sahoo, S. S. and Kuleshov, V. (2025). Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models, arXiv:2503.09573.
- Austin, J.; Johnson, D. D.; Ho, J.; Tarlow, D. and van den Berg, R. (2021). Structured Denoising Diffusion Models in Discrete State-Spaces. In: Advances in Neural Information Processing Systems (NeurIPS), arXiv:2107.03006.
- Chen, B.; Marti Monso, D.; Du, Y.; Simchowitz, M.; Tedrake, R. and Sitzmann, V. (2024). Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion, arXiv:2407.01392.
- Dieleman, S.; Sartran, L.; Roshannai, A.; Savinov, N.; Ganin, Y.; Richemond, P. H.; Doucet, A.; Strudel, R.; Dyer, C.; Durkan, C.; Hawthorne, C.; Leblond, R.; Grathwohl, W. and Adler, J. (2022). Continuous Diffusion for Categorical Data, arXiv:2211.15089.
- Du, Y.; Durkan, C.; Strudel, R.; Tenenbaum, J. B.; Dieleman, S.; Fergus, R.; Sohl-Dickstein, J.; Doucet, A. and Grathwohl, W. (2023). Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC. In: International Conference on Machine Learning (ICML), arXiv:2302.11552.
- Fang, Z.; Díaz, M.; Buchanan, S. and Sulam, J. (2025). Beyond Scores: Proximal Diffusion Models, arXiv:2507.08956.
- Fedus, W.; Zoph, B. and Shazeer, N. (2021). Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity, arXiv:2101.03961.
- Gulrajani, I. and Hashimoto, T. B. (2023). Likelihood-Based Diffusion Language Models, arXiv:2305.18619.
- Hinton, G. E. (2002). Training Products of Experts by Minimizing Contrastive Divergence. Neural Computation 14, 1771–1800.
- Jacobs, R. A.; Jordan, M. I.; Nowlan, S. J. and Hinton, G. E. (1991). Adaptive Mixtures of Local Experts. Neural Computation 3, 79–87.
- Kaess, M.; Johannsson, H.; Roberts, R.; Ila, V.; Leonard, J. J. and Dellaert, F. (2012), iSAM2: Incremental Smoothing and Mapping Using the Bayes Tree. The International Journal of Robotics Research 31, 216–235.
- Li, X. L.; Thickstun, J.; Gulrajani, I.; Liang, P. and Hashimoto, T. B. (2022). Diffusion-LM Improves Controllable Text Generation. In: Advances in Neural Information Processing Systems (NeurIPS), arXiv:2205.14217.
- Liu, N.; Li, S.; Du, Y.; Torralba, A. and Tenenbaum, J. B. (2022). Compositional Visual Generation with Composable Diffusion Models. In: European Conference on Computer Vision (ECCV), arXiv:2206.01714.
- Lou, A.; Meng, C. and Ermon, S. (2024). Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution. In: International Conference on Machine Learning (ICML), arXiv:2310.16834.
- Nie, S.; Zhu, F.; You, Z.; Zhang, X.; Ou, J.; Hu, J.; Zhou, J.; Lin, Y.; Wen, J.-R. and Li, C. (2025). Large Language Diffusion Models, arXiv:2502.09992. ↩1
- Pagnoni, A.; Pasunuru, R.; Rodriguez, P.; Nguyen, J.; Muller, B.; Li, M.; Zhou, C.; Yu, L.; Weston, J.; Zettlemoyer, L.; Ghosh, G.; Lewis, M.; Holtzman, A. and Iyer, S. (2024). Byte Latent Transformer: Patches Scale Better Than Tokens, arXiv:2412.09871.
- Ruhe, D.; Heek, J.; Salimans, T. and Hoogeboom, E. (2024). Rolling Diffusion Models, arXiv:2402.09470.
- Sahoo, S. S.; Arriola, M.; Schiff, Y.; Gokaslan, A.; Marroquin, E.; Chiu, J. T.; Rush, A. and Kuleshov, V. (2024). Simple and Effective Masked Diffusion Language Models. In: Advances in Neural Information Processing Systems (NeurIPS), arXiv:2406.07524. ↩1
- Shazeer, N.; Mirhoseini, A.; Maziarz, K.; Davis, A.; Le, Q.; Hinton, G. and Dean, J. (2017). Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer, arXiv:1701.06538.
- Shi, J.; Han, K.; Wang, Z.; Doucet, A. and Titsias, M. K. (2024). Simplified and Generalized Masked Diffusion for Discrete Data, arXiv:2406.04329.
- Wu, T.; Fan, Z.; Liu, X.; Gong, Y.; Shen, Y.; Jiao, J.; Zheng, H.-T.; Li, J.; Wei, Z.; Guo, J.; Duan, N. and Chen, W. (2023). AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation, arXiv:2305.09515.
- Xue, L.; Barua, A.; Constant, N.; Al-Rfou, R.; Narang, S.; Kale, M.; Roberts, A. and Raffel, C. (2021). ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models, arXiv:2105.13626.
- Yao, S.; Zhao, J.; Yu, D.; Du, N.; Shafran, I.; Narasimhan, K. and Cao, Y. (2022). ReAct: Synergizing Reasoning and Acting in Language Models, arXiv:2210.03629.
- Yu, L.; Simig, D.; Flaherty, C.; Aghajanyan, A.; Zettlemoyer, L. and Lewis, M. (2023). MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers, arXiv:2305.07185.