| .. |
|
adamw.cuh
|
stride-based adam and copy-and-cast
|
2024-06-13 02:01:26 +03:00 |
|
attention.cuh
|
consolidate memory by deleting the grad activation struct, move some of the last pieces of memory to the forward pass
|
2024-06-14 00:54:58 +00:00 |
|
cublas_common.h
|
made implicit includes of standard headers explicit
|
2024-06-04 13:22:16 +03:00 |
|
cuda_common.h
|
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
|
2024-06-04 22:52:26 +00:00 |
|
cuda_utils.cuh
|
stride-based adam and copy-and-cast
|
2024-06-13 02:01:26 +03:00 |
|
cudnn_att.cpp
|
move all kernels into a main_stream in preparation for future parallelism
|
2024-06-04 22:35:12 +03:00 |
|
cudnn_att.h
|
move all kernels into a main_stream in preparation for future parallelism
|
2024-06-04 22:35:12 +03:00 |
|
dataloader.h
|
Remove file size - not used
|
2024-06-03 12:14:58 +02:00 |
|
encoder.cuh
|
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
|
2024-06-04 22:52:26 +00:00 |
|
fused_classifier.cuh
|
move all kernels into a main_stream in preparation for future parallelism
|
2024-06-04 22:35:12 +03:00 |
|
gelu.cuh
|
move all kernels into a main_stream in preparation for future parallelism
|
2024-06-04 22:35:12 +03:00 |
|
global_norm.cuh
|
fewer global norm kernel calls
|
2024-06-12 21:55:01 +03:00 |
|
layernorm.cuh
|
moved remaining memcpy/memset in the training loop to main_stream
|
2024-06-05 02:06:32 +03:00 |
|
logger.h
|
Add learning rate and grad norm logging
|
2024-06-07 17:34:42 +02:00 |
|
matmul.cuh
|
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
|
2024-06-04 22:52:26 +00:00 |
|
mfu.h
|
add new file llmc/mfu.h for MFU calculations for different GPUs
|
2024-06-03 01:41:18 +00:00 |
|
rand.h
|
Add clarification on Box-Muller
|
2024-06-02 15:04:45 +02:00 |
|
sampler.h
|
refactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well
|
2024-06-03 18:10:33 +00:00 |
|
tokenizer.h
|
made implicit includes of standard headers explicit
|
2024-06-04 13:22:16 +03:00 |
|
utils.h
|
made implicit includes of standard headers explicit
|
2024-06-04 13:22:16 +03:00 |
|
zero.cuh
|
revert old printf0, minor touchups and comments, add assert
|
2024-06-13 23:18:22 +00:00 |
