makemore

A small, hackable character-level language model that learns patterns from line-based text files and generates similar items, such as name ideas.

Share on XLicense: MIT

Overview

makemore is a small Python program that learns character patterns from text with one item per line and generates new items resembling the examples. It helps create more names, company names, or word-like strings from a list. Run it with an input file and output directory to train a model; training logs and the model are saved there. Model choices range from bigrams to a Transformer, and you can generate more samples from the best saved model.

Key features

  • Train on a text file with one item per line and save logs and the model to an output directory.
  • Generate new character sequences that resemble the training text.
  • Choose among bigram, MLP, RNN, LSTM, GRU, and Transformer models; CNN is in progress.
  • Use --sample-only to generate samples from the best saved model.

Best for

Learners exploring character-level language models and people who want to generate name-like or word-like examples from a text list.

Upstream
karpathy/makemore
Fork on GitHub
Guo-astro/makemore
Upstream stars
4.4k
Category
AI agents and LLM tools
Language
Python
License
MIT
Forked
2026-10-09
Sync status
In syncLast synced 2026-10-10