20 commits

Author	SHA1	Message	Date
Christopher	5450632237	Removed unnecesary shared memory due to blockreduce using static defined shared memory	2024-05-30 03:01:52 +00:00
Erik Schultheis	1b98637960	int -> int64_t	2024-05-24 20:11:34 +03:00
ngc92	691c1df969	fused layernorm+residual	2024-05-09 23:48:11 +02:00
ademeure	e1f89b3043	remove BF16 default from classified_fused before PR	2024-05-07 00:57:01 +01:00
ademeure	1ea7f9bf25	tiny irrelevant optimisation to final unaligned fused_classifier loop + add missing common.h changes	2024-05-07 00:54:50 +01:00
ademeure	9b55ea8cf5	More crazy optimisations to layernorm_backward, fused_classifier, and matmul_backward_bias.	2024-05-07 00:11:42 +01:00
lancer	bbfe8c989c	Minor update on the code	2024-05-05 16:59:58 -07:00
Andrej Karpathy	2202c9a51b	add kernel 4 to docs. have to improve these docs more and document them better	2024-05-02 18:09:27 +00:00
“Christopher	398cdaf4cd	Removed cooperative groups and added packed128 to fused classifier and prepare softmax blockwide	2024-05-02 02:33:51 +00:00
Andrej Karpathy	dcff5613c6	add kernel3, which is like kernel 2 but no float4	2024-04-19 01:19:20 +00:00
Andrej Karpathy	8a2cab3431	make default dloss be 1/BT	2024-04-19 00:27:28 +00:00
Andrej Karpathy	ea3e2abdcf	small fixes and more comments very cool kernels	2024-04-18 23:48:39 +00:00
Andrej Karpathy	de1e87158c	add comments to classifier_fused	2024-04-18 16:59:45 +00:00
ademeure	557fecd6e9	bugfix for bounds checking	2024-04-18 04:45:07 +01:00
ademeure	ea77a26473	mini fix	2024-04-18 03:42:34 +01:00
ademeure	3ba2cdc723	fixes + bounds checking	2024-04-18 03:41:27 +01:00
ademeure	4ee98f5135	Merge branch 'master' into optimised_fused_classifier	2024-04-17 22:58:51 +01:00
Erik Schultheis	43bf9eb66a	ensure valid test cases and incorporate fixes by @ademeure	2024-04-16 20:53:50 +03:00
ademeure	b225501b7b	optimised version of the cool new fused classifier + hopefully bugfixes?	2024-04-16 14:54:23 +01:00
Erik Schultheis	780d8bd012	initial version	2024-04-14 03:48:56 +03:00