GitHub - vixhal-baraiya/microgpt-c: The most atomic way to train and inference a GPT in pure, dependency-free C
The most atomic way to train and inference a GPT in pure, dependency-free C.
A character-level transformer with forward pass, backprop, Adam and
sampling, in one C file with nothing beyond libc. It trains on ~32k names
in a couple of seconds and generates new ones.
Build and run
Or run it directly, on any corpus with one item per line:
./microgpt data/names.txt
Builds on macOS, Linux and Windows (MSYS2), on ARM64 with NEON and x86-64
with AVX2. The Makefile picks the flags for the host.
step 500...
Read more at github.com