Commit graph

7 commits

Author SHA1 Message Date
ademeure
29a067f916 Make cuDNN deterministic for Flash Attention backward (requires frontend >=1.5) 2024-06-27 13:33:02 +00:00
Erik Schultheis
ca7caac5c5 move all kernels into a main_stream in preparation for future parallelism 2024-06-04 22:35:12 +03:00
Ross Wheeler
4bfb23948d Make clean fix and Windows cuDNN build fix 2024-06-03 20:26:52 -07:00
Erik Schultheis
67502c7f8e moved device utilities into a separate file, and follow-up cleanup 2024-06-03 23:58:47 +03:00
Andrej Karpathy
020b15ad77 small more fixes 2024-06-03 19:32:32 +00:00
Andrej Karpathy
5d9403479c some fixes, still not done 2024-06-03 18:50:41 +00:00
Andrej Karpathy
41dc65a0ef attempt to move cudnn attention to the llmc directory 2024-06-03 03:23:04 +00:00
Renamed from cudnn_att.cpp (Browse further)