A 15K transformer running at ~5 chars/s on my machine, 32 char context window. Not the best but we are somewhere.
I used Claude to create this. Trained on my machine (not scratch.)
