More information about this will released later Note: you will need a fast-ish computer to run it turbowarp.org/1370217673 This is a working transformer with about 250k total parameters 8 heads, 5 blocks RoPE positional embeddings KV cache a whole bunch of other things
