Is this AI slop?
No. This website predates ChatGPT. All articles continue to be written by me. AI wrote the code for visualizations while porting to Pie, and also modified some text. I am reviewing and fixing it page by page.
- Interactive
- Programmable
- Open-source
Try it: change the matrix. See chapter 3 for why it works.
Latest posts (RSS)
- Gram-Schmidt vs modified Gram-Schmidt
Classical and modified Gram-Schmidt compute the same S in A = QS, in a different order.
- Indexing numpy arrays
A visual tour of numpy indexing: integers, slices, index arrays, boolean masks, new axes and 3D arrays, with the picked elements colored.
- Block scaling in MXFP4 and NVFP4
How MXFP4 and NVFP4 multiply 4-bit E2M1 values by a shared block scale, and NVFP4 by a tensor scale too, to get the stored numbers.
- Adding two floating point numbers
How two floats are added, step by step: align the exponents, add the bits, normalize, round, with a made-up 3-bit mantissa.
- Why floating point addition isn't associative
Each floating point addition rounds its exact sum, so the order of additions can change the result. The three ways a sum loses bits, shown in FP8 E5M2.
Made with by Vinay Sisodia. Logos designed by Jo Hsu.