Markov Blog Machine

Order 2 — phrases start holding together. This is usually the sweet spot for sounding almost-human.

Trained on 2 published posts from this blog — the chain is built in your browser, from scratch, every time you move the slider. Watch the dead-certain states number as you raise the order: when most states have exactly one possible continuation, the model has stopped generalizing and started memorizing. That’s overfitting, visible in a single statistic — and it’s the same failure mode a language model has, just without the billions of parameters hiding it.