9 commits

Author	SHA1	Message	Date
Erik Schultheis	d7a81ef26f	added a useful mixed precision utility for dev/cuda	2024-05-18 22:45:44 +03:00
ngc92	691c1df969	fused layernorm+residual	2024-05-09 23:48:11 +02:00
lancer	c81adeb6b2	move gelu_backward to backward block	2024-05-02 17:36:12 -07:00
Jane Illarionova	7746217433	update gelu backward rto allow all kernels to use both types	2024-05-01 23:36:59 +00:00
Erik Schultheis	b42db706b2	this kernel will be released later, sorry for the spoiler :)	2024-05-01 22:47:24 +03:00
Erik Schultheis	06980b6b2f	mixed precision utilities for dev/cuda	2024-05-01 22:35:55 +03:00
Andrej Karpathy	12da2c16cc	slight docs tweaks to dev/cuda	2024-04-27 14:40:57 +00:00
austinvhuang	25d703fbec	Use a make pattern rule to simplify Makefile, group kernels into forward/backward/updates/nccls, add some comments and update the README.md	2024-04-27 00:13:01 -04:00
austinvhuang	d937f93aaa	Add a local convenience Makefile for dev/cuda/, fix 2 minor warnings observed when building all targets.	2024-04-26 21:19:44 -04:00