Correctness of Automatic Differentiation via Diffeologies and Categorical Gluing — Mathieu Huot, Sam Staton & Matthijs Vákár (2020). arXiv:2001.02209 (v3, PDF); FoSSaCS 2020, LNCS 12077, 319–338, doi:10.1007/978-3-030-45231-5_17.
Proves forward-mode automatic differentiation correct for a higher-order language with lists and sum types: the AD macro is interpreted in diffeological spaces, where it coincides with the tangent bundle functor, and correctness follows from a logical relation built by categorical gluing.
Sources: the paper, arXiv:2001.02209v3, checked against the arXiv listing and Crossref. Index: Papers.
Key definitions and results
- Definition 1, Examples 3–5: diffeological spaces, Cartesian, product and functional diffeologies
- Theorem 1: semantic correctness of the dual-number macro (limited language)
- Definition 2, Lemma 2: the syntactic category and its universal property
- Proposition 1: the glued category is bicartesian closed with list objects
- Theorems 2–3: semantic correctness for the full language and for higher derivatives
- Theorems 4–5: neither CartSp nor smooth manifolds are cartesian closed
Concept notes
Diffeological Space, Automatic Differentiation of Expected Values, Logical Relations