How a language model writes
The weights are frozen and nothing is remembered. Pull the sliders and watch the model pick the next piece of text, over and over.
Temperature
1.00
Top-P
0.90
Tap a part of the diagram to open that step.
The whole loop
String → pieces → links to the earlier pieces → frozen layers → probabilities → cut the tail and draw one at random → the piece is appended. Then the same again from the top. Nothing else happens while a model is being used.
What's inside
- 1 Context and pieces — The window is finite. Once it fills up, generation stops — the model holds nothing outside it.
- 2 Attention over the context — The links are recomputed from scratch on every step: add one piece and the whole picture of links changes.
- 3 Frozen weights — Training changes the weights, using them does not. Two different modes of the same network.
- 4 Probabilities, temperature and Top-P — Move both sliders and watch " bananas": that is the price of a high temperature and a Top-P close to one.
- 5 The generation loop — The model does not write a sentence. It takes one step, then another, and that is all it ever does.
Explorable Explanations
- How a drug is smuggled past the blood–brain barrier The brain refuses almost every drug molecule, and it is right to. One slider follows the trick the labs are trying instead: wrap the molecule in a bubble the wall already knows how to carry.
- How a robot draws the map of a room it has never seen A lidar returns a few hundred dots per sweep and no idea where it is. One slider walks from that cloud to a floor plan with the robot standing in the right spot.
- How two people type in one line without losing a letter Two cursors, one line, nobody holding the pen in the middle. One slider takes an index-based merge apart and rebuilds it out of addresses that sit between the letters.
- Why a quantum computer stops at a lattice Shor’s algorithm eats RSA in one move. The same machine gets almost nothing on a grid of points with a little noise added. One slider shows the difference.
- Cooling a building by pointing it at space A coating that stays colder than the air around it, in full sun, drawing no power at all. One slider follows the heat from the sun to the far side of the atmosphere.
- How a robot predicts the next second A text model guesses the next word. A world model guesses the next frame — mass, speed and gravity included. One slider walks the whole loop, from the camera to the catch.
- Proving a secret without revealing it One slider walks through the stages, the other adds rounds. Watch certainty climb to almost total while the secret stays a secret.
- Getting lithium out of brine: ponds versus direct extraction Move the slider through five stages and compare two ways of taking the same metal out of the same salt water.
- How a personalised mRNA cancer vaccine works Move the slider through five stages and watch how a tumour’s own mutations become the instructions that teach the immune system to find it.
- The edge of the app Everything arriving from outside is untrusted. Break one link at a time and watch where the chain stops and what the screen shows.
- How search over your documents works Move the sliders and watch a search pipeline decide what the model is allowed to see — and what happens when it is fed the wrong passage.
- Retries and slow responses The network drops in the middle of an operation. Press the button twice and see what ends up in the database — with an idempotency key and without one.
- How a language model learns Pull one slider and watch a pile of random numbers turn into a prediction over a thousand training steps.
- Where electricity comes from Pull one slider and follow the energy from a river all the way to a pump that lifts water back up.