The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer(arxiv.org)
384 points by ibobev 8 days ago | 60 comments
tl;dr: A 195-page derivation-focused primer on the mathematics behind modern generative models, tracing a coherent path from PCA and probabilistic PCA through VAEs, diffusion models, normalizing flows, autoregressive models, GANs, Wasserstein GANs, and energy-based models. Rather than cataloging architectures or implementation details, it emphasizes how these model families are derived and connected, aimed at mathematically inclined researchers, students, and practitioners.
HN Discussion:
  • ↑Praises the book's readability and accessible approach starting from linear algebra basics
  • ↓Criticizes imprecise or confusing wording around coordinate changes in the text
  • ↓Points out unexplained notation in the very first formula, suggesting the book needs editing
  • •Recommends alternative books on ML math and deep learning as better or complementary resources
  • •Asks questions or requests additional resources like problem sets or attention-specific books