Commit graph

23 commits

Author SHA1 Message Date
lucasdelimanogueira
e6d58121f1 fix memory usage 2024-06-05 20:24:09 -03:00
lucasdelimanogueira
c42d334599 fix allreduce distributed not working after 2nd iteration 2024-06-03 15:14:42 -03:00
lucasdelimanogueira
e706b81007 fix broadcast and reduce gradients distributeddataparallel and tensor hooks 2024-06-03 11:40:05 -03:00
lucasdelimanogueira
e590f57555 implemented distributed sampler 2024-05-25 10:53:09 -03:00
lucasdelimanogueira
77cabe41a2 fix cross entropy loss cuda 2024-05-23 12:19:32 -03:00
lucasdelimanogueira
8b19ac38c9 fix send module to device 2024-05-23 10:20:08 -03:00
lucasdelimanogueira
40a6bccab4 vision tranform, readme and example training 2024-05-22 14:25:02 -03:00
lucasdelimanogueira
cebf890165 sigmoid kernel avoid overflow 2024-05-22 13:24:01 -03:00
lucasdelimanogueira
0972a0873f small fix crossentropy 2024-05-22 10:34:16 -03:00
lucasdelimanogueira
34a762b666 fix shape one hot cross entropy 2024-05-21 19:50:17 -03:00
lucasdelimanogueira
9cfb1f622d softmax autograd 2024-05-21 13:52:05 -03:00
lucasdelimanogueira
d530f79a82 cross entropy loss 2024-05-21 12:16:12 -03:00
lucasdelimanogueira
5e72fe57d3 softmax v1 need fix some erros yet 2024-05-20 20:16:41 -03:00
lucasdelimanogueira
cc483417dc max min and equal operations 2024-05-20 12:50:45 -03:00
lucasdelimanogueira
eb49d8cae3 fixed sum axis with keepdim 2024-05-17 20:12:57 -03:00
lucasdelimanogueira
7e3100f796 unit test nn module mse loss and sigmoid 2024-05-07 17:44:59 -03:00
lucasdelimanogueira
2c2569d482 operations unit tests 2024-05-07 11:52:56 -03:00
lucasdelimanogueira
1ccf9a6c8d some tests test.py 2024-05-07 01:00:08 -03:00
lucasdelimanogueira
ffe10e48c5 Fix grad update step! loss decreasing 2024-05-07 00:10:25 -03:00
lucasdelimanogueira
b034d86ec3 Fix recursion backward increasing a lot 2024-05-06 22:58:37 -03:00
lucasdelimanogueira
de6f2af637 fix upgrade grads reference to parameter 2024-05-06 20:40:06 -03:00
lucasdelimanogueira
e5819a4121 nn module v1 2024-05-06 19:47:27 -03:00
lucasdelimanogueira
1e00930c4e Fix nn.Module linear 2024-05-06 13:23:22 -03:00