17 commits

Author	SHA1	Message	Date
Andrej Karpathy	49b9776e50	also move the launchers	2024-06-03 21:37:18 +00:00
Andrej Karpathy	93546aed01	move encoder, kernel 1/N	2024-06-03 21:21:28 +00:00
Andrej	3392671826	Merge pull request #535 from ngc92/speed-up-compile ... moved device utilities into a separate file, and follow-up cleanup	2024-06-03 14:11:10 -07:00
Erik Schultheis	67502c7f8e	moved device utilities into a separate file, and follow-up cleanup	2024-06-03 23:58:47 +03:00
Andrej	8cc39a794b	Merge pull request #528 from gordicaleksa/refactor_evalloader ... Refactor eval loader - remove 2 unnecessary malloc calls per iteration	2024-06-03 13:54:52 -07:00
Andrej Karpathy	001ad78fe1	resolve deviceProp and cudaCheck dupes	2024-06-03 19:54:32 +00:00
Andrej Karpathy	020b15ad77	small more fixes	2024-06-03 19:32:32 +00:00
Andrej Karpathy	5d9403479c	some fixes, still not done	2024-06-03 18:50:41 +00:00
Andrej Karpathy	804d0693c8	refactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well	2024-06-03 18:10:33 +00:00
Aleksa Gordic	d9e867678e	Remove file size - not used	2024-06-03 12:14:58 +02:00
Aleksa Gordic	e86bd62374	Refactor eval loader - remove 2 unnecessary malloc calls per iteration	2024-06-03 11:43:33 +02:00
Andrej Karpathy	41dc65a0ef	attempt to move cudnn attention to the llmc directory	2024-06-03 03:23:04 +00:00
Andrej Karpathy	1ac30591f2	add new file llmc/mfu.h for MFU calculations for different GPUs	2024-06-03 01:41:18 +00:00
Aleksa Gordic	ae9c957273	Add clarification on Box-Muller	2024-06-02 15:04:45 +02:00
Andrej Karpathy	0bc24c36e6	fix bug in resumption of dataloader, have to reload shard	2024-05-31 22:19:37 +00:00
Andrej Karpathy	35aa110244	more refactor	2024-05-30 19:39:29 +00:00
Andrej Karpathy	eed242702a	experiment with adding the llmc lib directory	2024-05-27 21:10:28 +00:00