overview

Every note of the LenticulumLM vault, in reading order. How the vault is organised and what its conventions are: Start Here. The implicit learners, products and beliefs this builds on are explained in Lenticulum’s vault, and the general category theory in the CT-ML wiki; links to both are ordinary web links, links within this vault are wikilinks.

1. The idea

1b. Background

2. Implementation

  • tokens: tokens as one-hot codes, one block of coordinates per position; queries as clamps
  • sequence: windows and separators assembled into one relation; an -gram chain, exact in every query direction

3. Verdict

Orientation

  • Start Here: conventions
  • Bibliography: every cited work
  • Lenticulum’s Language Models note: products of diffusion language models, and why the graph only pays off when it has structure