Shub Tiwari

Toolstemperature dial

Turn The Dial, Change The Words

A language model writes by rolling weighted dice, one word at a time. Temperature reshapes the weights: low plays it safe, high takes chances, very high is nonsense. This tiny model learned from the posts on this site.

~/tools/temperature
1 · start with a few words
2 · the dials
3 · odds for the next word
    4 · what it wrotehover a word for its odds

    Temperature
    0.8
    Words written
    0
    Avg surprise (bits)
    –

    A trigram model: it only remembers the last two words. Trained on 18,675 words from the 49 posts on this site, so it sounds a little like them. Surprise is −log₂ of the odds of each picked word; real models roll the same kind of dice with far better odds.