The world's smallest transformer.
Four words.Two sentences.Sixteen numbers.
Every one of them is here.
The words, the square and the sixteen numbers are Luis Serrano's. We only made them touchable.
Mary greeted Bob. Bob ignored Mary.
Change one. Drag a word across the square, or type over a number.
After Mary, the model expects (these follow from the numbers above)
Left to itself, starting from Mary, it says
Those two numbers are Mary's entire representation inside this model.
Left and right turned out to mean verb or person. Up and down turned out to mean unfriendly or friendly. Nobody told it that. Two sentences did.
The other eight numbers.
Each word owns an arrow. The model scores the current word against every arrow, and the arrow it lines up with best is the word most likely to come next. Those are the arrows, now drawn on the square. They are yours too.
But people have off days.
In the world it has seen, Mary always greets and Bob always ignores. Show it a world where, now and then, Mary ignores and Bob greets.
The arrows stretched. Being a person now counts double; being friendly counts once. Mary still greets most of the time. Bob greets on a good day.
The weights aren't facts about Mary and Bob. They're the shape that what it has seen left behind.
Now make it strange.
Engineers call this temperature. Low temperature is a lookup table. High temperature is a poet.
That's all of them.
That's the whole transformer.
The ones you use every day are larger.
The four words, the two dimensions and the sixteen numbers are Luis Serrano's, from his explanation of how a transformer could be this small. The numbers are his trained values, rounded. We only made a page you can touch. Thank you, Luis.
Everything on this page runs in your browser, and nothing you change leaves it.