The Language Model Vocabulary Gap

And why magic maybe isn't a terrible metaphor

I’ll start with some premises: by “language model”, I mean an instance of a trained language model. Language models aren’t people, language models aren’t conscious, language models don’t generally know or understand, language models don’t exhibit intelligence, ⛧language models are not guaranteed to be eldritch⛧, language models are programs (incl. fixed…