Theory vault
Everything these pages leave out (the design, the implementation notes with their difficulties, and an honest record of what does not work yet) lives in the project's Obsidian vault. It is rendered as a website, the front page of this one:
What is in it
| start at | for |
|---|---|
| Assembling a Language Model from Implicit Learners | the plan, and the decisions ahead |
| Open Problems in Assembling Language Models | the roadmap, step by step, with the evidence for each |
| sequence, tokens | the implementation notes beside sequence.jl and tokens.jl |
The implicit learners, products, separators and beliefs these notes build on are explained in Lenticulum's theory vault, and the general category theory in the CT-ML wiki.
Reading it in Obsidian
The vault is the repository itself. Clone it, open the root folder in Obsidian, and start from vault/Start Here.md.