Andrej Karpathy
ed37d9261b
fix bug in readme
2024-05-30 21:39:47 +00:00
Andrej Karpathy
b48224cb0c
refactor the README file because it was getting crazy
2024-05-30 21:39:06 +00:00
Andrej Karpathy
fc40ffc4aa
adjust readme to new scripts/ dir
2024-05-30 20:10:04 +00:00
Andrej Karpathy
88dd670c42
link to recent post from readme
2024-05-28 17:31:31 +00:00
Andrej Karpathy
5ec4b774f2
simple jupyter notebook example on how to parse and vis the logfiles
2024-05-26 17:40:49 +00:00
otabuzzman
5f87b13f34
Update documentation with Swift port reference
2024-05-23 21:15:01 +02:00
Andrej Karpathy
05be4f6d82
readme changes
2024-05-22 12:32:25 +00:00
Andrej Karpathy
54ccbd300c
docs on master-breaking changes around dataset file representation
2024-05-21 18:31:19 +00:00
Andrej Karpathy
f7cb77f3d9
docs on master-breaking change around how we store data .bin files
2024-05-21 18:20:51 +00:00
Andrej Karpathy
722e5b2fe5
refactor how we treat datasets, because we're about to have more of them and we don't want them to clutter up root dir etc. this is only step 1, i'm about to refactor a bunch of the dataloading, how the .bin files work and are loaded, how the DataLoader works, etc. This is all needed to support good evals and training at scale
2024-05-20 22:43:40 +00:00
Anthony Blake
3113656e3f
Add link to AMD fork
2024-05-16 13:33:34 -07:00
ntr
e64df91191
Add Llm.cs by nietras to README
2024-05-12 16:02:36 +02:00
Marco van Zwetselaar
6da5e63e2c
Fix detection of cudnn-frontend in '.' on Linux
...
Plus minor legibility fixes in the cudnn-frontend explanation.
2024-05-10 10:57:39 +03:00
Yijun Yu
8ccf2f97f8
Update README.md
2024-05-10 06:49:24 +08:00
Joe Halabi
69aa64cc80
Adds cuDNN install instructions for a smaller but sufficient package
...
- Modifies README.md to provide example apt-get cuDNN install instructions that install the cuDNN dev package. "sudo apt-get install -y cudnn" will install the default cuDNN packages, but for a minimal setup, installing the dev package will see a 50% reduction in both, download size (~850MB to 425MB now) and local storage size (~2GB to ~1GB now).
- Modifies the Makefile to point users to the README for cuDNN install instructions (through comments and the cuDNN install error message)
- Modifies attention_forward.cu comments to point users to the README for cuDNN install instructions
Signed-off-by: Vedaanta Agarwalla <vagarwalla@ipp2-1949.nvidia.com>
2024-05-08 14:53:31 -07:00
Andrej
ff2fbdc2a1
Merge pull request #332 from harryjackson/llm.java
...
Adding a java port of the project
2024-05-03 13:58:59 -07:00
Andrej
aa5dd2eeab
Update README.md
2024-05-03 12:43:08 -07:00
Harry Jackson
c13a730149
Merge branch 'master' into llm.java
2024-05-02 11:44:44 -07:00
Andrej Karpathy
69d40ebfff
add readme and search for cudd in home dir
2024-05-01 17:43:50 +00:00
Jake Hemstad
78eba5fff3
Add llm.cpp fork to README
2024-04-30 18:52:42 -05:00
harry
74d5bcd03a
Adding a java port of the project
2024-04-30 14:51:06 -07:00
Aydyn Tairov
d0b943ba04
Fix link to zig port
2024-04-29 11:18:03 +01:00
Andrej Karpathy
aedf3a5cdd
changes to readme for multigpu. i think this is ready now for v0 merge to master nice
2024-04-26 18:20:15 +00:00
Andrej Karpathy
8389fbaa0c
Merge branch 'multi_gpu_support' of https://github.com/PeterZhizhin/llm.c into PeterZhizhin-multi_gpu_support
2024-04-26 15:55:15 +00:00
Petr Zhizhin
d49e8301eb
[Multi-GPU] llm.c now runs on multiple GPUs with NCCL
2024-04-24 22:11:00 +00:00
Joshua Carpeggiani
0ee2d4a965
Add llm.go in description
2024-04-24 17:48:49 -04:00
Andrej Karpathy
e44ed15639
small updates on intent for fp32 and non-fp32 CUDA versions
2024-04-24 19:44:12 +00:00
Andrej
b2c779d40e
Merge pull request #231 from Saimirbaci/zig-port-ref
...
Added ref to the zig port
2024-04-24 10:00:08 -07:00
Andrej Karpathy
c5f1db6020
fix important typo on precision
2024-04-23 17:43:19 +00:00
Andrej Karpathy
ed6387a695
updates to readme, and introduce the test fp32 cuda file too
2024-04-23 17:41:42 +00:00
Saimir Baci
7f279cd6cb
Adding Zig port ref
2024-04-23 13:37:53 -04:00
Andrej Karpathy
451c1a4c99
update readme to point to SoU
2024-04-22 19:18:03 +00:00
James Thompson
38857ff1d0
Added llm.metal to notable forks
...
This is a fork of llm.c designed to take full advantage of Apple Silicon via the Metal framework. Just got the forward pass working and will start on the backward pass. I wrote a minimal C wrapper API over the Objective-C Metal API that was needed to set up and run compute shaders. The rest of the code is pure-C and Metal Shading Language. I'm trying to mirror the original repo as closely as possible both in code and project philosophy.
2024-04-22 09:01:21 -07:00
Tomisin Jenrola
43ffd2af8a
add Rust port to notable forks
2024-04-21 19:23:50 -02:30
Andrej Karpathy
7fa9f7b140
document one way to do experiments / sweeps as just an example
2024-04-20 19:39:12 +00:00
Andrej Karpathy
7df2d4d92b
also requirements for quick start
2024-04-20 00:59:32 +00:00
Andrej Karpathy
38fd42d3e3
also add a quick start CPU section
2024-04-20 00:41:13 +00:00
Andrej Karpathy
da4c5c79ca
very quick start section add
2024-04-20 00:35:35 +00:00
Azret Botash
c6bd590b47
typo
2024-04-19 14:17:13 -07:00
Azret Botash
6cd1354b3e
C# port ref
2024-04-19 13:59:36 -07:00
Martin Dudek
1f08134fb9
Added link to Mojo port in Notable Forks section
2024-04-20 01:44:50 +05:30
Andrej Karpathy
810b0dd90f
adjust header
2024-04-19 17:19:26 +00:00
Andrej Karpathy
f7fb3e67d5
update readme
2024-04-19 17:16:48 +00:00
Andrej Karpathy
70170006ca
adjust readme with latest speed
2024-04-18 22:50:52 +00:00
Andrej Karpathy
eef92c3fbe
make comment on comparison to PyTorch runtime with kernels as they are right now
2024-04-18 04:53:09 +00:00
Andrej Karpathy
33a4985d19
change readme again to keep it up to date
2024-04-18 04:39:59 +00:00
Andrej Karpathy
79586880b7
adjust readme now that the full training loop works in cud
2024-04-17 17:15:59 +00:00
ent0n29
66c30fb55f
-fno-finite-math-only for almost 2x speed up
2024-04-16 12:49:54 +02:00
Andrej
a44b0ce0f0
Merge pull request #142 from dagelf/master
...
Update Makefile with -march=native for 25%+ CPU speedup
2024-04-15 12:01:25 -07:00
Andrej Karpathy
480b638606
few more words on what i want the repo to be atm
2024-04-15 18:55:50 +00:00
