Theory vault

Everything these pages leave out (the design, the implementation notes with their difficulties, and an honest record of what does not work yet) lives in the project's Obsidian vault. It is rendered as a website, the front page of this one:

Open the theory vault →

What is in it

start atfor
Assembling a Language Model from Implicit Learnersthe plan, and the decisions ahead
Open Problems in Assembling Language Modelsthe roadmap, step by step, with the evidence for each
sequence, tokensthe implementation notes beside sequence.jl and tokens.jl

The implicit learners, products, separators and beliefs these notes build on are explained in Lenticulum's theory vault, and the general category theory in the CT-ML wiki.

Reading it in Obsidian

The vault is the repository itself. Clone it, open the root folder in Obsidian, and start from vault/Start Here.md.