aparler/c-llm
1
0
Fork 0
mirror of https://github.com/karpathy/llm.c.git synced 2026-07-20 23:05:08 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
1536 commits 52 branches 0 tags 21 MiB
Commit graph

1536 commits

This branch
This branch
All branches
Author SHA1 Message Date
Andrej
f1e2ace651
Merge pull request #801 from ngc92/ngc92/fix-test 
Fix gradient tests
 2025-05-10 16:24:10 -07:00
Erik Schultheis
42aa89184f adjusted error thresholds 2025-04-13 10:34:36 +02:00
Erik Schultheis
166f5e6c60 reorder checks to match actual tensor order 2025-04-13 10:01:18 +02:00
Andrej
7ecd8906af
Merge pull request #766 from msaroufim/patch-1 
cuda mode -> gpu mode
 2024-10-02 10:25:39 +09:00
Mark Saroufim
315b8d1f62
Update README.md 2024-09-24 13:08:11 -07:00
Mark Saroufim
5b2e3180fb
cuda mode -> gpu mode 
This is a documentation only change. Hoping this is OK to merge. See this tweet for more context on why we made this change https://x.com/jeremyphoward/status/1838341110344880637
 2024-09-23 17:09:45 -07:00
Andrej Karpathy
bd8c6045be change default params: use tinyshakespeare and decrease LR 2024-09-13 19:04:08 +00:00
Andrej
bd457aa19b
Merge pull request #724 from GaoYusong/master 
add llm.cpp(a port of this project featuring a tinytorch.hpp library) link to notable forks in readme
 2024-08-27 04:40:06 +09:00
Andrej
a2bdae248a
Merge pull request #733 from zhangpiu/feature/llm.cpp 
Add llm.cpp(a port of this project using Eigen library, supporting CPU/CUDA), link to notable forks in readme
 2024-08-27 04:37:33 +09:00
Andrej
ebc28b9563
Merge pull request #735 from gordicaleksa/minor_refactor3 
Minor LLaMA 3 refactor
 2024-08-27 04:24:22 +09:00
Andrej
2c9213731e
Merge pull request #744 from dengl11/pr 
fix a typo
 2024-08-16 12:49:55 -07:00
Andrej
0ddedf940d
Merge pull request #745 from karpathy/feature/managed2 
feature/managed2
 2024-08-16 12:11:11 -07:00
Andrej Karpathy
18298f3a40 i misspelled reduced 2024-08-16 18:16:46 +00:00
Andrej Karpathy
8c586f9158 reduce across GPUs nicer 2024-08-16 18:08:34 +00:00
Andrej Karpathy
e6856bc566 fallback to memory allocation of m,v,master_weights on host automatically in case of OOM. will run slower but won't OOM 2024-08-16 17:23:42 +00:00
Andrej Karpathy
2882ec6b9e fix makefile for multigpu setups 2024-08-16 17:22:30 +00:00
Erik Schultheis
f72c1f2c64 hint to host 2024-08-16 01:44:08 +03:00
Erik Schultheis
c8457572fa just try to allocate on device; fallback if that fails 2024-08-16 01:43:56 +03:00
Erik Schultheis
0d52d2a3d7 fall back to cudaMallocManaged for optimizer states if we're out of memory 2024-08-16 01:42:30 +03:00
Li Deng
ff356e4bc2 fix a typo 2024-08-14 09:22:44 -07:00
Andrej
4c84bc743c
Merge pull request #740 from karpathy/gordicaleksa-fix_dataloader2 
Gordicaleksa fix dataloader2
 2024-08-13 11:18:57 -07:00
Andrej Karpathy
755458d0e1 fix tokenizer omg 2024-08-13 17:24:15 +00:00
Andrej Karpathy
16635d41a2 attempt to fix PR 2024-08-13 02:13:14 +00:00
Andrej Karpathy
9740a652cd Merge branch 'fix_dataloader2' of https://github.com/gordicaleksa/llm.c into gordicaleksa-fix_dataloader2 2024-08-12 23:50:10 +00:00
Andrej
1787210306
Merge pull request #738 from ademeure/faster_compile 
Improve compile time (simple makefile changes)
 2024-08-12 16:45:15 -07:00
Aleksa Gordic
68624cc6ac Refactor tokenize, delegate instead 2024-08-12 20:26:21 +02:00
Aleksa Gordic
e8739c89a0 Refactor magic/version header dict 2024-08-12 20:17:53 +02:00
ademeure
fc8834409b Improve compile time via nvidia-smi instead of __nvcc_device_query (& add "--threads=0"). 2024-08-12 17:07:36 +00:00
ademeure
9b1c14bd93 Improve compile time via nvidia-smi instead of __nvcc_device_query (& add "--threads=0"). 2024-08-12 16:51:39 +00:00
Aleksa Gordic
eb1b359dae Replace fire with argparse 2024-08-10 22:45:46 +02:00
Aleksa Gordic
311c149a2a Add fire to reqs 2024-08-10 22:39:07 +02:00
Aleksa Gordic
50765638c0 Add fineweb llama 3 support 2024-08-10 22:35:46 +02:00
Aleksa Gordic
f8c1ff590f Use fire module, update readme 2024-08-10 22:29:19 +02:00
Aleksa Gordic
15b76bf0fb Add tiny shakespeare 2024-08-10 22:23:33 +02:00
Aleksa Gordic
b018b0c85c Change default dataset path to tiny stories 2024-08-10 21:50:39 +02:00
Aleksa Gordic
71419cbd61 Update header description 2024-08-10 21:47:09 +02:00
Aleksa Gordic
d3151c4ace Add llama 3 tokenization and data loader 2024-08-10 21:25:57 +02:00
Aleksa Gordic
b0bc864320 Refactor flash logic 2024-08-10 18:51:56 +02:00
Aleksa Gordic
a0c666bfbb Remove logprobs - like andrej in nano llama 3 2024-08-10 18:24:51 +02:00
Aleksa Gordic
92cc4ebf36 Add msg to asserts 2024-08-10 18:04:59 +02:00
Aleksa Gordic
a1278731a3 Minor refactor 2024-08-10 17:43:50 +02:00
Biao Zhang
25a302fde6
Update README.md 2024-08-10 17:53:12 +08:00
Biao Zhang
ed4c50dd6e
Merge branch 'master' into feature/llm.cpp 2024-08-10 17:51:49 +08:00
zhangpiu
ee0a92f915 Add llm.cpp fork 2024-08-10 17:45:21 +08:00
Andrej
6e6a528111
Merge pull request #725 from gordicaleksa/llama 
Add LLaMA 3 Python support
 2024-08-08 14:08:20 -07:00
Aleksa Gordic
d773c88e49 Remove unnecessary comment 2024-08-08 21:06:01 +02:00
Aleksa Gordic
c5c87fc4e7 Add comments, fix stop tokens 2024-08-08 20:54:17 +02:00
Aleksa Gordic
8b672ffcb9 Add data loader not implemented exception 2024-08-08 18:55:17 +02:00
Aleksa Gordic
f1c91f8ae3 Address Andrej's PR comments 2024-08-08 18:45:04 +02:00
Aleksa Gordic
89addd3e3e Remove pycache 2024-08-08 18:20:51 +02:00