paper

Correctness of Automatic Differentiation via Diffeologies and Categorical Gluing — Mathieu Huot, Sam Staton & Matthijs Vákár (2020). arXiv:2001.02209 (v3, PDF); FoSSaCS 2020, LNCS 12077, 319–338, doi:10.1007/978-3-030-45231-5_17.

Proves forward-mode automatic differentiation correct for a higher-order language with lists and sum types: the AD macro is interpreted in diffeological spaces, where it coincides with the tangent bundle functor, and correctness follows from a logical relation built by categorical gluing.

Sources: the paper, arXiv:2001.02209v3, checked against the arXiv listing and Crossref. Index: Papers.

Key definitions and results

  • Definition 1, Examples 3–5: diffeological spaces, Cartesian, product and functional diffeologies
  • Theorem 1: semantic correctness of the dual-number macro (limited language)
  • Definition 2, Lemma 2: the syntactic category and its universal property
  • Proposition 1: the glued category is bicartesian closed with list objects
  • Theorems 2–3: semantic correctness for the full language and for higher derivatives
  • Theorems 4–5: neither CartSp nor smooth manifolds are cartesian closed

Concept notes

Diffeological Space, Automatic Differentiation of Expected Values, Logical Relations