Contents

Deep Dives [7]

Long-form essays on the mathematics underneath.

Extended pieces that follow one idea all the way down — from deep learning and probability to the structures the field is built on.

What Attention Actually Computes

Attention is a soft, differentiable dictionary lookup—dot-product scores, a softmax, and a weighted sum of values—that gives every position a global receptive field in a single layer.

Read entry

Walking Downhill: What Gradient Descent Actually Does

Gradient descent trains almost every neural network by repeatedly taking a small step opposite the direction of steepest ascent — a procedure whose successes and pathologies both follow from that single geometric idea.

Read entry

Why √n — Reading the Central Limit Theorem

The sample mean of many independent finite-variance draws becomes Gaussian, and its spread shrinks like σ/√n — a rate that follows from how variance adds, and that breaks precisely when its hypotheses do.

Read entry

Sensitive Dependence

Why fully deterministic systems—weather, pendulums, a tumbling die—can still defy long-range prediction, and how a positive Lyapunov exponent turns finite-precision measurement into vanishing knowledge of the future.

Read entry

Every Wave Is a Sum of Circles

Any reasonable periodic function is a sum of rotating vectors, and the recipe for the radii is a sequence of inner products.

Read entry

The Golden Angle: Why 137.5°

A sunflower head packs its seeds by placing each one a fixed angle of about 137.5° from the last, and that exact angle falls out of the golden ratio being the hardest number to approximate by fractions.

Read entry