Some basics of n-gram language modeling
I dusted off some old work and notes of mine on language models, and it inspired me to write up a brief overview that’s hopefully fit for public consumption.
A model, by definition, abstracts away unimportant aspects of the system that it simulates. When building and training a language model, we … Read more