TurboWarp: https://turbowarp.org/1383051067 MicroGPT.sb3 is a Transformer that mimics the architecture of microgpt, a learning Transformer created by Karpathy. It trains in real time. The current weights have already been trained to some extent, so it will try to generate things that look like human names. If you want to experiment with it, you can either continue training from the current state, or press the R key to rebuild the architecture, reinitialize the weights, and start training from scratch. Note: This project requires more than 200,000 elements in autogr:heap, so after resetting it, it will no longer work properly on Scratch. Please use TurboWarp instead.
