8 commits

Author	SHA1	Message	Date
Ross Wheeler	b203820232	Including unistd.h in cudnn_att.cpp for latest MSVC compiler	2024-07-20 11:57:10 -07:00
ademeure	29a067f916	Make cuDNN deterministic for Flash Attention backward (requires frontend >=1.5)	2024-06-27 13:33:02 +00:00
Erik Schultheis	ca7caac5c5	move all kernels into a main_stream in preparation for future parallelism	2024-06-04 22:35:12 +03:00
Ross Wheeler	4bfb23948d	Make clean fix and Windows cuDNN build fix	2024-06-03 20:26:52 -07:00
Erik Schultheis	67502c7f8e	moved device utilities into a separate file, and follow-up cleanup	2024-06-03 23:58:47 +03:00
Andrej Karpathy	020b15ad77	small more fixes	2024-06-03 19:32:32 +00:00
Andrej Karpathy	5d9403479c	some fixes, still not done	2024-06-03 18:50:41 +00:00
Andrej Karpathy	41dc65a0ef	attempt to move cudnn attention to the llmc directory	2024-06-03 03:23:04 +00:00

Renamed from cudnn_att.cpp (Browse further)