aparler/c-llm
1
0
Fork 0
mirror of https://github.com/karpathy/llm.c.git synced 2026-07-27 20:25:09 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
880 commits 52 branches 0 tags 21 MiB
Commit graph

3 commits

Author SHA1 Message Date
Andrej Karpathy
938f8f78bb more defensive 2024-04-29 20:25:29 +00:00
Andrej Karpathy
b4c346ac2a don't hardcode the EOT token and store it in the Tokenizer file 2024-04-29 20:23:41 +00:00
Andrej Karpathy
699c25469a separate out our Tokenizer 2024-04-29 19:54:18 +00:00