https://ojus1.github.io/Notes on machine learning: transformers, learning theory, audio, and running models in places they were not built for.https://ojus1.github.io/posts/attention-from-the-softmax-up/https://ojus1.github.io/posts/attention-from-the-softmax-up/Wed, 04 Nov 2026 00:00:00 GMTScaled dot-product attention one piece at a time, with a temperature dial you can turn to watch a query make up its mind.https://ojus1.github.io/posts/a-language-model-in-this-tab/https://ojus1.github.io/posts/a-language-model-in-this-tab/Wed, 21 Oct 2026 00:00:00 GMTA small instruction-tuned model running inside the page, on your GPU through WebGPU or on your CPU, with nothing sent to a server.https://ojus1.github.io/posts/low-rank-updates-plotted/https://ojus1.github.io/posts/low-rank-updates-plotted/Thu, 08 Oct 2026 00:00:00 GMTWhat LoRA's rank actually buys you, as pixels and as curves. A sketch of a sweep, with charts you can hover, filter and smooth.https://ojus1.github.io/posts/watching-an-optimiser-move/https://ojus1.github.io/posts/watching-an-optimiser-move/Wed, 23 Sep 2026 00:00:00 GMTGradient descent with momentum on a surface you can click, and a short film of a diffusion model turning noise into a spiral.