Testing whether a time series is a martingale using Black-Scholes simulation, permutation entropy, and Welch's PSD method.
Generative AI
Deep dives into how language and diffusion models are trained and adapted, from the forward pass to GRPO, SVD fine-tuning and diffusion SDEs.
5 articles
Latest Posts
GoFebruary 23, 2025
The math behind diffusion models: Chapman-Kolmogorov, Kramers-Moyal, Ito's lemma, and the forward/reverse SDEs.
GoFebruary 15, 2025
How GRPO turns next-token prediction into a reinforcement learning objective, derived step by step from the Transformer forward pass.
GoJanuary 22, 2025
A design sketch for combining Titan's surprise-based memory with Transformer² SVD fine-tuning, with the math worked out and no experiments run yet.
GoJanuary 18, 2025
How SakanaAI's Transformer² adapts LLM weights at inference time via SVD fine-tuning, RL, and expert weight combination, mapped from paper to code.
GoJanuary 18, 2025