makemore
An autoregressive character-level language model for making more
makemore is a compact educational framework for training character-level language models on line-separated text datasets. Given examples such as personal names, company names, or dictionary words, it learns their statistical structure and generates new examples with similar patterns. The project intentionally keeps most functionality in one hackable Python file and requires only PyTorch. It includes implementations ranging from simple bigram models to MLPs, recurrent networks, LSTMs, GRUs,...