LenticulumLM assembles a diffusion language model from implicit learners: relations over a few token positions each, combined by product into one model whose every query (continue, predict backwards, fill in) is root finding with the known tokens clamped. It builds on Lenticulum.jl, whose theory vault explains the implicit learners themselves. This vault records what is specific to language: the design, the implementation, and what does not work yet.

Where to start

  1. Assembling a Language Model from Implicit Learners: the plan, and the decisions ahead
  2. tokens and sequence: text as a joint space, and an -gram chain assembled from relations, exact in every query direction
  3. Open Problems in Assembling Language Models: the roadmap, step by step

Everything else