aparler/c-llm
1
0
Fork 0
mirror of https://github.com/karpathy/llm.c.git synced 2026-07-27 20:25:09 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions
c-llm/llmc
History
Exact
Aleksa Gordic 2cd4d3985d Add H100 PCIe
2024-06-14 09:23:55 +02:00
..
adamw.cuh stride-based adam and copy-and-cast 2024-06-13 02:01:26 +03:00
attention.cuh consolidate memory by deleting the grad activation struct, move some of the last pieces of memory to the forward pass 2024-06-14 00:54:58 +00:00
cublas_common.h made implicit includes of standard headers explicit 2024-06-04 13:22:16 +03:00
cuda_common.h Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2 2024-06-04 22:52:26 +00:00
cuda_utils.cuh stride-based adam and copy-and-cast 2024-06-13 02:01:26 +03:00
cudnn_att.cpp move all kernels into a main_stream in preparation for future parallelism 2024-06-04 22:35:12 +03:00
cudnn_att.h move all kernels into a main_stream in preparation for future parallelism 2024-06-04 22:35:12 +03:00
dataloader.h Remove file size - not used 2024-06-03 12:14:58 +02:00
encoder.cuh Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2 2024-06-04 22:52:26 +00:00
fused_classifier.cuh move all kernels into a main_stream in preparation for future parallelism 2024-06-04 22:35:12 +03:00
gelu.cuh move all kernels into a main_stream in preparation for future parallelism 2024-06-04 22:35:12 +03:00
global_norm.cuh fewer global norm kernel calls 2024-06-12 21:55:01 +03:00
layernorm.cuh moved remaining memcpy/memset in the training loop to main_stream 2024-06-05 02:06:32 +03:00
logger.h Add learning rate and grad norm logging 2024-06-07 17:34:42 +02:00
matmul.cuh Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2 2024-06-04 22:52:26 +00:00
mfu.h Add H100 PCIe 2024-06-14 09:23:55 +02:00
rand.h Add clarification on Box-Muller 2024-06-02 15:04:45 +02:00
sampler.h refactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well 2024-06-03 18:10:33 +00:00
tokenizer.h made implicit includes of standard headers explicit 2024-06-04 13:22:16 +03:00
utils.h made implicit includes of standard headers explicit 2024-06-04 13:22:16 +03:00
zero.cuh revert old printf0, minor touchups and comments, add assert 2024-06-13 23:18:22 +00:00